Research on Brain and Mind Inspired Intelligence.

Yang Liu; Jianshe Wei

doi:10.9781/ijimai.2023.07.004

Authors

Yang Liu Henan University
Jianshe Wei Henan University

DOI:

https://doi.org/10.9781/ijimai.2023.07.004

Keywords:

Bio-Inspired Computing, Cognitive Computing, Neural Computing, Deep Learning, Multimedia

Abstract

To address the problems of scientific theory, common technology and engineering application of multimedia and multimodal information computing, this paper is focused on the theoretical model, algorithm framework, and system architecture of brain and mind inspired intelligence (BMI) based on the structure mechanism simulation of the nervous system, the function architecture emulation of the cognitive system and the complex behavior imitation of the natural system. Based on information theory, system theory, cybernetics and bionics, we define related concept and hypothesis of brain and mind inspired computing (BMC) and design a model and framework for frontier BMI theory. Research shows that BMC can effectively improve the performance of semantic processing of multimedia and cross-modal information, such as target detection, classification and recognition. Based on the brain mechanism and mind architecture, a semantic-oriented multimedia neural, cognitive computing model is designed for multimedia semantic computing. Then a hierarchical cross-modal cognitive neural computing framework is proposed for cross-modal information processing. Furthermore, a cross-modal neural, cognitive computing architecture is presented for remote sensing intelligent information extraction platform and unmanned autonomous system.

Downloads

Download data is not yet available.

References

G.-W. Ng, Brain-mind machinery: Brain-inspired computing and mind opening, 2009.

Y. Zeng, et al., “Retrospect and Outlook of Brain-Inspired Intelligence Research,” Chinese Journal of Computers, vol. 39, pp. 212-222, 2016, doi. https://doi.org/10.11897/SP.J.1016.2016.00212

D. S. Modha, et al., “Cognitive Computing,” Communications of the Acm, vol. 54, pp. 62-71, Aug 2011. doi. https://doi.org/10.1145/1978542.1978559

A. Vestrucci, et al., “Can AI Help Us to Understand Belief? Sources, Advances, Limits, and Future Directions,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, p. 24, 2021. doi. https://doi.org/10.9781/ijimai.2021.08.003

Y. Chen, et al., “Neuromorphic computing’s yesterday, today, and tomorrow – an evolutional view,” Integration, vol. 61, pp. 49-61, 2018. doi. https://doi.org/10.1016/j.vlsi.2017.11.001

E. R. Zhou, et al., “An improved memristor model for brain-inspired computing,” Chinese Physics B, vol. 26, pp. 537-543, Nov 2017. doi. https://doi.org/10.1088/1674-1056/26/11/118502

C. Mead, “Neuromorphic electronic systems,” presented at the Proceedings of the IEEE, 1990. doi. https://doi.org/10.1109/5.58356

K. Roy, et al., “Towards spike-based machine intelligence with neuromorphic computing,” Nature, vol. 575, pp. 607-617, Nov 2019. doi. https://doi.org/10.1038/s41586-019-1677-2

Y. Wu, et al., “Spatio-Temporal Backpropagation for Training High Performance Spiking Neural Networks,” Frontiers in Neuroscience, vol. 12, pp. 1-12, 2018-May-23, 2018. doi. https://doi.org/10.3389/fnins.2018.00331

Y. Sun, et al., “Quantum superposition inspired spiking neural network,” iScience, vol. 24, 2021. doi. https://doi.org/10.1016/j.isci.2021.102880

B. V. Benjamin, et al., “Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations,” Proceedings of the IEEE, vol. 102, pp. 699-716, 2014. doi. https://doi.org/10.1109/jproc.2014.2313565

S. Schmitt, et al., “Neuromorphic hardware in the loop: Training a deep spiking network on the BrainScaleS wafer-scale system,” in 2017 International Joint Conference on Neural Networks (IJCNN), 2017, pp. 2227-2234.

S. B. Furber, et al., “The SpiNNaker Project,” Proceedings of the IEEE, vol. 102, pp. 652-665, 2014. doi. https://doi.org/10.1109/jproc.2014.2304638

D. Ma, et al., “Darwin: A neuromorphic hardware co-processor based on spiking neural networks,” Journal Of Systems Architecture, vol. 77, pp. 43- 51, Jun 2017. doi. https://doi.org/10.1016/j.sysarc.2017.01.003

[15] J. Pei, et al., “Towards artificial general intelligence with hybrid Tianjic chip architecture,” Nature, vol. 572, pp. 106-111, 2019/08/01, 2019. doi. https://doi.org/10.1038/s41586-019-1424-8

M. Paul A, “Artificial brains. A million spiking-neuron integrated circuit with a scalable communication network and interface,” Science, vol. 6197, pp. 668-673, 2014. doi. https://doi.org/10.1126/science.1254642

N. P. Jouppi, et al., “Motivation for and Evaluation of the First Tensor Processing Unit,” IEEE Micro, vol. 38, pp. 10-19, May-Jun 2018. doi. https://doi.org/10.1109/MM.2018.032271057

T. Luo, et al., “DaDianNao: A Neural Network Supercomputer,” Ieee Transactions on Computers, vol. 66, pp. 73-88, Jan 2017. doi. https://doi.org/10.1109/tc.2016.2574353

B. J. Kagan, et al., “In vitro neurons learn and exhibit sentience when embodied in a simulated game-world,” Neuron, vol. 110, pp. 1-18, December 7, 2022, 2022. doi. https://doi.org/10.1016/j.neuron.2022.09.001

R. Wang, et al., “Neuromorphic Hardware Architecture Using the Neural Engineering Framework for Pattern Recognition,” IEEE Transactions on Biomedical Circuits and Systems, vol. 11, pp. 574-584, 2017. doi. https://doi.org/10.1109/tbcas.2017.2666883

M. V. DeBole, et al., “TrueNorth: Accelerating From Zero to 64 Million Neurons in 10 Years,” Computer, vol. 52, pp. 20-29, 2019. doi. https://doi.org/10.1109/MC.2019.2903009

C. Eliasmith, et al., “A large-scale model of the functioning brain,” Science, vol. 338, pp. 1202-1205, 2012. doi. https://doi.org/10.1126/science.1225266

A. Mehonic and A. J. Kenyon, “Brain-inspired computing needs a master plan,” Nature, vol. 604, pp. 255-260, 2022/04/01, 2022. doi. https://doi.org/10.1038/s41586-021-04362-w

G. Piccinini, “The First Computational Theory of Mind and Brain: A Close Look at Mcculloch and Pitts’s “Logical Calculus of Ideas Immanent in Nervous Activity”,” Synthese, vol. 141, pp. 175-215, 2004/08/01, 2004. doi. https://doi.org/10.1023/B:SYNT.0000043018.52445.3e

V. Mnih, et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, pp. 529-533, 02/26/print, 2015. doi. https://doi.org/10.1038/nature14236

D. Silver, et al., “Mastering the game of Go with deep neural networks and tree search,” Nature, vol. 529, pp. 484-489, 01/28/print, 2016. doi. https://doi.org/10.1038/nature16961

S. Sabour, et al., “Dynamic Routing Between Capsules,” presented at the neural information processing systems, 2017.

A. Creswell, et al., “Generative Adversarial Networks: An Overview,” IEEE Signal Processing Magazine, vol. 35, pp. 53-65, 2018. doi. https://doi.org/10.1109/MSP.2017.2765202

M. G. Huddar, et al., “Attention-based Multi-modal Sentiment Analysis and Emotion Detection in Conversation using RNN,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, pp. 112-121, 2021. doi. https://doi.org/10.9781/ijimai.2020.07.004

J. Bobadilla, et al., “DeepFair: Deep Learning for Improving Fairness in Recommender Systems,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, pp. 86-94, Jun 2021. doi. https://doi.org/10.9781/ijimai.2020.11.001

A. Vaswani, et al., “Attention Is All You Need,” in 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, 2017, pp. 1-15.

T. B. Brown, et al., “Language Models are Few-Shot Learners,” presented at the Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020), Virtual-only Conference, 2020. doi. https://doi.org/arXiv:2005.14165 [cs.CL].

Z. Wu, et al., “A Comprehensive Survey on Graph Neural Networks,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1-21, 2020. doi. https://doi.org/10.1109/TNNLS.2020.2978386

D. George and J. Hawkins, “Towards a Mathematical Theory of Cortical Micro-circuits,” Plos Computational Biology, vol. 5, Oct 2009. doi. https://doi.org/10.1371/journal.pcbi.1000532

N. Tzourio-Mazoyer, et al., “Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain,” Neuroimage, vol. 15, pp. 273-289, 2002. doi. https://doi.org/10.1006/nimg.2001.0978

L. Fan, et al., “The Human Brainnetome Atlas: A New Brain Atlas Based on Connectional Architecture,” Cerebral Cortex, vol. 26, pp. 3508-3526, 2016. doi. https://doi.org/10.1093/cercor/bhw157

Y. Liu, et al., “Cognitive Neural Mechanisms and Saliency Computational Model of Auditory Selective Attention,” Computer Science, vol. 40, pp. 283-287, 2013. doi. https://doi.org/10.3969/j.issn.1002-137X.2013.06.063

Y. Liu, et al., “Cognitive Neural Mechanisms and Saliency Computational Model of Visual Selective Attention,” Journal of Chinese Computer Systems, vol. 35, pp. 584-589, 2014. doi. https://doi.org/10.3969/j.issn.1000-1220.2014.03.029

X. Fu, et al., “A computational cognition model of perception, memory, and judgment,” Science China-Information Sciences, vol. 57, Mar 2014. doi. https://doi.org/10.1007/s11432-013-4911-9

P. T. Fox, et al., “Meta-analysis in human neuroimaging: computational modeling of large-scale databases,” Neuroscience, vol. 37, pp. 409-434, 2014. doi. https://doi.org/10.1146/annurev-neuro-062012-170320

E. C. Cieslik, et al., “Is there “one” DLPFC in cognitive action control? Evidence for heterogeneity from co-activation-based parcellation,” Cerebral Cortex, vol. 23, pp. 2677-2689, 2013. doi. https://doi.org/10.1093/cercor/bhs256

S. B. Eickhoff, et al., “Co-activation patterns distinguish cortical modules, their connectivity and functional differentiation,” Neuroimage, vol. 57, pp. 938-949, 2011. doi. https://doi.org/10.1016/j.neuroimage.2011.05.021

Y. Liu, et al., “CSRNCVA: A model of cross-media semantic retrieval based on neural computing of visual and auditory sensations,” Neural Network World, vol. 28, pp. 305-323, 2018. doi. https://doi.org/10.14311/NNW.2018.28.018

Y. Liu, et al., “CSMCCVA: Framework of cross-modal semantic mapping based on cognitive computing of visual and auditory sensations,” High Technology Letters, vol. 22, pp. 90-98, 2016. doi. https://doi.org/10.3772/j.issn.1006-6748.2016.01.013

J. S. Gero, “Design Prototypes: A Knowledge Representation Schema for Design,” AI Magazine, vol. 11, pp. 26-36, 1990.

Y. Zhong, “Mechanism-based artificial intelligence theory: a universal theory of artifical intelligence,” CAAI Transactions on Intelligent Systems, vol. 13, pp. 2-18, 2018. doi. https://doi.org/10.11992/tis.201711032

Y. Liu, et al., “Scene classification of high-resolution remote sensing image based on multimedia neural cognitive computing,” Systems Engineering and Electronics, vol. 37, pp. 2623-2633, 2015. doi. https://doi.org/10.3969/j.issn.1001-506X.2015.11.31

Y. Liu, et al., “Spike-Based Approximate Backpropagation Algorithm of Brain-Inspired Deep SNN for Sonar Target Classification,” Computational Intelligence and Neuroscience, vol. 2022, p. 1633946, 2022/10/20, 2022. doi. https://doi.org/10.1155/2022/1633946

Y. Liu, et al., “SAR ship detection using sea-land segmentation-based convolutional neural network,” presented at the 2017 International Workshop on Remote Sensing with Intelligent Processing, RSIP 2017, May 19, 2017 - May 21, 2017, Shanghai, China, 2017. doi. https://doi.org/10.1109/RSIP.2017.7958806

Y. Liu, et al., “Target detection in remote sensing image based on saliency computation of spiking neural network,” presented at the 38th Annual IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018, July 22, 2018 - July 27, 2018, Valencia, Spain, 2018. doi. https://doi.org/10.1109/IGARSS.2018.8517588

Y. Liu and F.-b. Zheng, “Object-oriented and multi-scale target classification and recognition based on hierarchical ensemble learning,” Computers & Electrical Engineering, vol. 62, pp. 538-554, 2017. doi. https://doi.org/10.1016/j.compeleceng.2016.12.026

Y. Liu, et al., “Hyperspectral Image Classification of Brain-Inspired Spiking Neural Network Based on Approximate Derivative Algorithm,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-16, 2022. doi. https://doi.org/10.1109/tgrs.2022.3207098

Y. Liu, et al., “Research of Neural Cognitive Computing Model for Visual and Auditory Cross-media Retrieval,” Computer Science, vol. 42, pp. 19- 25,30, 2015, 2015. doi. https://doi.org/10.11896/j.issn.1002-137X.2015.3.004

C. Pogliano, “Lucky Triune Brain Chronicles of Paul D-MacLean’s Neuro-Catchword,” Nuncius-Journal of the History of Science, vol. 32, pp. 330-375, 2017. doi. https://doi.org/10.1163/18253911-03202004

S. CU, “The triune brain in antiquity: Plato, Aristotle, Erasistratus,” Journal of the history of the neurosciences, vol. 1, pp. 1-14, 2010. doi. https://doi.org/10.1080/09647040802601605

R. Joseph, Neuropsychiatry, Neuropsychology, Clinical Neuroscience, 2000.

T. L. Griffiths, et al., Bayesian models of cognition: Cambridge University Press, 2008.

A. A. Valladares, et al., “Event related potentials changes associated with the processing of auditory valid and invalid targets as a function of previous trial validity in a Posner’s paradigm,” Neuroscience Research, vol. 115, pp. 37-43, Feb 2017. doi. https://doi.org/10.1016/j.neures.2016.09.006

G. Berry and G. Boudol, “The chemical abstract machine,” Theoretical Computer Science, vol. 96, pp. 217-248, 1992/04/06/, 1992. doi. https://doi.org/10.1016/0304-3975(92)90185-I

X. Li, et al., “A New Method to Construct the Software Vulnerability Model,” presented at the 2017 2nd IEEE International Conference on Computational Intelligence and Applications (ICCIA), Beijing, 2017. doi. https://doi.org/10.1109/CIAPP.2017.8167212