Staff member


Paul Verschure

Group Leader / ICREA Research Professor
Synthetic, Perceptive, Emotive and Cognitive Systems (SPECS)
pverschure@ibecbarcelona.eu
+34 93 401 19 89
Staff member publications

Moulin-Frier, C., Fischer, T., Petit, M., Pointeau, G., Puigbo, J., Pattacini, U., Low, S. C., Camilleri, D., Nguyen, P., Hoffmann, M., Chang, H. J., Zambelli, M., Mealier, A., Damianou, A., Metta, G., Prescott, T. J., Demiris, Y., Dominey, P. F., Verschure, P. F. M. J., (2018). DAC-h3: A proactive robot cognitive architecture to acquire and express knowledge about the world and the self IEEE Transactions on Cognitive and Developmental Systems Early Access

This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both the human and the robot. The framework, based on a biologically-grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users.

Keywords: Autobiographical Memory., Biology, Cognition, Cognitive Robotics, Computer architecture, Distributed Adaptive Control, Grounding, Human-Robot Interaction, Humanoid robots, Robot sensing systems, Symbol Grounding


Blancas-Muñoz, M., Vouloutsi, Vasiliki, Zucca, R., Mura, Anna, Verschure, P., (2018). Hints vs distractions in intelligent tutoring systems: Looking for the proper type of help ARXIV Computer Science, (Human-Computer Interaction), 1-4

The kind of help a student receives during a task has been shown to play a significant role in their learning process. We designed an interaction scenario with a robotic tutor, in real-life settings based on an inquiry-based learning task. We aim to explore how learners' performance is affected by the various strategies of a robotic tutor. We explored two kinds of(presumable) help: hints (which were specific to the level or general to the task) or distractions (information not relevant to the task: either a joke or a curious fact). Our results suggest providing hints to the learner and distracting them with curious facts as more effective than distracting them with humour.

Keywords: Computer Science, Human-Computer Interaction


Fischer, Tobias, Puigbò, Jordi-Ysard, Camilleri, Daniel, Nguyen, Phuong D. H., Moulin-Frier, Clément, Lallée, Stéphane, Metta, Giorgio, Prescott, Tony J., Demiris, Yiannis, Verschure, P., (2018). iCub-HRI: A software framework for complex human-robot interaction scenarios on the iCub humanoid robot Frontiers in Robotics and AI 5, (22), Article 22

Generating complex, human-like behaviour in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, touch detection), object manipulation (basic and complex motor actions) and social interaction (speech synthesis, joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human-robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behaviour and expression of a verbal narrative of the robot's experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarising themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community.

Keywords: Robotics, iCub Humanoid, YARP, Software architecture, C++, Python, Java, Human-robot interaction


Puigbò, J. Y., Maffei, G., Herreros, I., Ceresa, M., González Ballester, M. A., Verschure, P. F. M. J., (2018). Cholinergic behavior state-dependent mechanisms of neocortical gain control: A neurocomputational study Molecular Neurobiology 55, (1), 249-257

The embodied mammalian brain evolved to adapt to an only partially known and knowable world. The adaptive labeling of the world is critically dependent on the neocortex which in turn is modulated by a range of subcortical systems such as the thalamus, ventral striatum, and the amygdala. A particular case in point is the learning paradigm of classical conditioning where acquired representations of states of the world such as sounds and visual features are associated with predefined discrete behavioral responses such as eye blinks and freezing. Learning progresses in a very specific order, where the animal first identifies the features of the task that are predictive of a motivational state and then forms the association of the current sensory state with a particular action and shapes this action to the specific contingency. This adaptive feature selection has both attentional and memory components, i.e., a behaviorally relevant state must be detected while its representation must be stabilized to allow its interfacing to output systems. Here, we present a computational model of the neocortical systems that underlie this feature detection process and its state-dependent modulation mediated by the amygdala and its downstream target the nucleus basalis of Meynert. In particular, we analyze the role of different populations of inhibitory interneurons in the regulation of cortical activity and their state-dependent gating of sensory signals. In our model, we show that the neuromodulator acetylcholine (ACh), which is in turn under control of the amygdala, plays a distinct role in the dynamics of each population and their associated gating function serving the detection of novel sensory features not captured in the state of the network, facilitating the adjustment of cortical sensory representations and regulating the switching between modes of attention and learning.

Keywords: Acetylcholine, Inhibitory network, Neocortical circuits, Neuromodulation


Arsiwalla, Xerxes D., Verschure, Paul, (2018). Measuring the complexity of consciousness Frontiers in Neuroscience 12, (424), Article 424

The grand quest for a scientific understanding of consciousness has given rise to many new theoretical and empirical paradigms for investigating the phenomenology of consciousness as well as clinical disorders associated to it. A major challenge in this field is to formalize computational measures that can reliably quantify global brain states from data. In particular, information-theoretic complexity measures such as integrated information have been proposed as measures of conscious awareness. This suggests a new framework to quantitatively classify states of consciousness. However, it has proven increasingly difficult to apply these complexity measures to realistic brain networks. In part, this is due to high computational costs incurred when implementing these measures on realistically large network dimensions. Nonetheless, complexity measures for quantifying states of consciousness are important for assisting clinical diagnosis and therapy. This article is meant to serve as a lookup table of measures of consciousness, with particular emphasis on clinical applicability. We consider both, principle-based complexity measures as well as empirical measures tested on patients. We address challenges facing these measures with regard to realistic brain networks, and where necessary, suggest possible resolutions. We address challenges facing these measures with regard to realistic brain networks, and where necessary, suggest possible resolutions.

Keywords: Consciousness in the Clinic, Computational neuroscience, Complexity measures, Clinical Neuroscience, Measures of consciousness


Pacheco, D., Verschure, P. F. M. J., (2018). Long-term spatial clustering in free recall Memory Article in press

We explored the influence of space on the organisation of items in long-term memory. In two experiments, we asked our participants to explore a virtual environment and memorise discrete items presented at specific locations. Memory for those items was later on tested in immediate (T1) and 24 hours delayed (T2) free recall tests, in which subjects were asked to recall as many items as possible in any order. In experiment 2, we further examined the contribution of active and passive navigation in recollection dynamics. Results across experiments revealed a significant tendency for participants to consecutively recall items that were encountered in proximate locations during learning. Moreover, the degree of spatial organisation and the total number of items recalled were positively correlated in the immediate and the delayed tests. Results from experiment 2 indicated that the spatial clustering of items was independent of navigation types. Our results highlight the long-term stability of spatial clustering effects and their correlation with recall performance, complementing previous results collected in immediate or briefly delayed tests.

Keywords: Free recall, Spatial clustering, Spatial memory, Spatial navigation, Virtual reality


Arsiwalla, Xerxes, Signorelli, Camilo M., Puigbo, Jordi-Ysard, Freire, Ismael, Verschure, P., (2018). Are brains computers, emulators or simulators? Biomimetic and Biohybrid Systems 7th International Conference, Living Machines 2018 (Lecture Notes in Computer Science) , Springer International Publishing (Paris, France) 10928, 11-15

There has been intense debate on the question of whether the brain is a computer. If so, that challenge is to show that all cognitive processes can be described by algorithms running on a universal Turing machine. By extension that implies consciousness is a computational process. Both Penrose and Searle have vehemently argued against this view, proposing that consciousness is a fundamentally non-computational process. Even proponents of the brain as a computer metaphor such a Dennett agree that the organizational architecture of the brain is unlike any computing system ever conceived, possibly alluding to non-classical computational processes. The latter class of processes veer away from any program that can be encoded by Church’s lambda calculus. In fact, such a program would have to be based on non-classical logic (either semi-classical or quantum). But quantum logic or machines that might implement them typically are not meant for solving the same type of problems that a classical computer solves (nor are they necessarily faster for any given problem). We will argue that machines implementing non-classical logic might be better suited for simulation rather than computation (a la Turing). It is thus reasonable to pit simulation as an alternative to computation and ask whether the brain, rather than computing, is simulating a model of the world in order to make predictions and guide behavior. If so, this suggests a hardware supporting dynamics more akin to a quantum many-body field theory.


Freire, Ismael, Puigbo, J., Arsiwalla, Xerxes, Verschure, Paul, (2018). Modeling the opponent’s action using control-based reinforcement learning Biomimetic and Biohybrid Systems 7th International Conference, Living Machines 2018 (Lecture Notes in Computer Science) , Springer International Publishing (Paris, France) 10928, 179-186

In this paper, we propose an alternative to model-free reinforcement learning approaches that recently have demonstrated Theory-of-Mind like behaviors. We propose a game theoretic approach to the problem in which pure RL has demonstrated to perform below the standards of human-human interaction. In this context, we propose alternative learning architectures that complement basic RL models with the ability to predict the other’s actions. This architecture is tested in different scenarios where agents equipped with similar or varying capabilities compete in a social game. Our different interaction scenarios suggest that our model-based approaches are especially effective when competing against models of equivalent complexity, in contrast to our previous results with more basic predictive architectures. We conclude that the evolution of mechanisms that allow for the control of other agents provide different kinds of advantages that can become significant when interacting with different kinds of agents. We argue that no single proposed addition to the learning architecture is sufficient to optimize performance in these scenarios, but a combination of the different mechanisms suggested is required to achieve near-optimal performance in any case.


Verschure, P., (2018). The architecture of mind and brain Living machines: A handbook of research in biomimetics and biohybrid systems (ed. Prescott, T. J., Lepora, Nathan, Verschure, P.), Oxford Scholarship (Oxford, UK) , 338-345

The components of a Living Machine must be integrated into a functioning whole, which requires a detailed understanding of the architecture of living machines. This chapter starts with a conceptual and historical analysis which from Plato brings us to nineteenth-century neuroscience and early concepts of the layered structure of nervous systems. These concepts were further captured in the cognitive behaviorism of Tolman and came to full fruition in the cognitive revolution of the second half of the twentieth century. Verschure subsequently describes the most relevant proposals of cognitive architectures followed by an overview of the few proposals stemming from modern neuroscience on the architecture of the brain. Subsequently, we will look at contemporary contenders that mediate between cognitive and brain architecture. An important challenge to any model of cognitive architectures is how to benchmark it. Verschure proposes the Unified Theories of Embodied Minds (UTEM) benchmark which advances from Newell’s classic Unified Theories of Cognition benchmark.

Keywords: Architecture, Mind, Brain, Organization, System, Virtualization, Abstraction layers


Verschure, P., (2018). A chronology of Distributed Adaptive Control Living machines: A handbook of research in biomimetics and biohybrid systems (ed. Prescott, T. J., Lepora, Nathan, Verschure, P.), Oxford Scholarship (Oxford, UK) , 346-360

This chapter presents the Distributed Adaptive Control (DAC) theory of the mind and brain of living machines. DAC provides an explanatory framework for biological brains and an integration framework for synthetic ones. DAC builds on several themes presented in the handbook: it integrates different perspectives on mind and brain, exemplifies the synthetic method in understanding living machines, answers well-defined constraints faced by living machines, and provides a route for the convergent validation of anatomy, physiology, and behavior in our explanation of biological living machines. DAC addresses the fundamental question of how a living machine can obtain, retain, and express valid knowledge of its world. We look at the core components of DAC, specific benchmarks derived from the engagement with the physical and the social world (the H4W and the H5W problems) in foraging and human–robot interaction tasks. Lastly we address how DAC targets the UTEM benchmark and the relation with contemporary developments in AI.

Keywords: Distributed Adaptive Control, Problem of priors, Symbol grounding problem, Convergent validation, Foraging, brain, Architecture, system


Vouloutsi, Vasiliki, Verschure, P., (2018). Emotions and self-regulation Living machines: A handbook of research in biomimetics and biohybrid systems (ed. Prescott, T. J., Lepora, Nathan, Verschure, P.), Oxford Scholarship (Oxford, UK) , 327-337

This chapter takes the view that emotions of living machines can be seen from the perspective of self-regulation and appraisal. We will first look at the pragmatic needs to endow machines with emotions and subsequently describe some of the historical background of the science of emotions and its different interpretations and links to affective neuroscience. Subsequently, we argue that emotions can be cast in terms of self-regulation where they provide for a descriptor of the state of the homeostatic processes that maintain the relationship between the agent and its internal and external environment. We augment the notion of homeostasis with that of allostasis which signifies a change from stability through a fixed equilibrium to stability through continuous change. The chapter shows how this view can be used to create complex living machines where emotions are anchored in the need fulfillment of the agent, in this case considering both utilitarian and epistemic needs.

Keywords: Emotion, Motivation, Needs, Appraisal, Self-regulation, Homeostasis, Allostasis, Human–robot interaction, James–Lange theory


This chapter discusses basic concepts from control theory and machine learning to facilitate a formal understanding of animal learning and motor control. It first distinguishes between feedback and feed-forward control strategies, and later introduces the classification of machine learning applications into supervised, unsupervised, and reinforcement learning problems. Next, it links these concepts with their counterparts in the domain of the psychology of animal learning, highlighting the analogies between supervised learning and classical conditioning, reinforcement learning and operant conditioning, and between unsupervised and perceptual learning. Additionally, it interprets innate and acquired actions from the standpoint of feedback vs anticipatory and adaptive control. Finally, it argues how this framework of translating knowledge between formal and biological disciplines can serve us to not only structure and advance our understanding of brain function but also enrich engineering solutions at the level of robot learning and control with insights coming from biology.

Keywords: Feedback control, Feed-forward control, Supervised learning, Unsupervised learning, Reinforcement, Learning, Classical conditioning, Operant conditioning, Reflex, Anticipatory reflex


Lepora, Nathan, Verschure, P., Prescott, T. J., (2018). A roadmap for Living Machines research Living machines: A handbook of research in biomimetics and biohybrid systems (ed. Prescott, T. J., Lepora, Nathan, Verschure, P.), Oxford Scholarship (Oxford, UK) , 26-50

This roadmap identifies current trends in biomimetic and biohybrid systems together with their implications for future research and innovation. Important questions include the scale at which these systems are defined, the types of biological systems addressed, the kind of principles sought, the differences between biologically based and biologically inspired approaches, the role in the understanding of living systems, relevant application domains, common benchmarks, the relation to other fields, and developments on the horizon. We interviewed and collated answers from experts who have been involved a series of events organized by the Convergent Science Network. These answers were then collated into themes of research. Overall, we see a field rapidly expanding in influence and impact. As such, this report will provide information to researchers and scientific policy makers on contemporary biomimetics and its future, together with pointers to further reading on relevant topics within this handbook.

Keywords: Biomimetics, Biohybrid, Bio-inspiration, Biologically inspired, Roadmap, Living machines, policy


Vouloutsi, Vasiliki, Halloy, José, Mura, Anna, Mangan, Michael, Lepora, Nathan, Prescott, T. J., Verschure, P., (2018). Biomimetic and Biohybrid Systems 7th International Conference, Living Machines 2018, Paris, France, July 17–20, 2018, Proceedings , Springer International Publishing (Lausanne, Switzerland) 10928, 1-551

This book constitutes the proceedings of the 7th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2018, held in Paris, France, in July 2018. The 40 full and 18 short papers presented in this volume were carefully reviewed and selected from 60 submissions. The theme of the conference targeted at the intersection of research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

Keywords: Artificial neural network, Bio-actuators, Bio-robotics, Biohybrid systems, Biomimetics, Bipedal robots, Earthoworm-like robots, Robotics, Decision-making, Tactile sensing, Soft robots, Locomotion, Insects, Sensors, Actuators, Robots, Artificial intelligence, Neural networks, Motion planning, Learning algorithms


Prescott, T. J., Lepora, Nathan, Verschure, P., (2018). Living machines: A handbook of research in biomimetics and biohybrid systems Oxford Scholarship , 1-623

Biomimetics is the development of novel technologies through the distillation of ideas from the study of biological systems. Biohybrids are formed through the combination of at least one biological component—an existing living system—and at least one artificial, newly engineered component. These two fields are united under the theme of Living Machines—the idea that we can construct artifacts that not only mimic life but also build on the same fundamental principles. The research described in this volume seeks to understand and emulate life’s ability to self-organize, metabolize, grow, and reproduce; to match the functions of living tissues and organs such as muscles, skin, eyes, ears, and neural circuits; to replicate cognitive and physical capacities such as perception, attention, locomotion, grasp, emotion, and consciousness; and to assemble all of these elements into integrated systems that can hold a technological mirror to life or that have the capacity to merge with it. We conclude with contributions from philosophers, ethicists, and futurists on the potential impacts of this remarkable research on society and on how we see ourselves.

Keywords: Novel technologies, Biomimetics, Biohybrids, Living systems, Living machines, Biological principles, Technology ethics, Societal impacts


Maffei, Giovanni, Herreros, Ivan, Sanchez-Fibla, Marti, Friston, Karl J., Verschure, Paul F. M. J., (2017). The perceptual shaping of anticipatory actions Proceedings of the Royal Society B 284, (1869)

Humans display anticipatory motor responses to minimize the adverse effects of predictable perturbations. A widely accepted explanation for this behavior relies on the notion of an inverse model that, learning from motor errors, anticipates corrective responses. Here, we propose and validate the alternative hypothesis that anticipatory control can be realized through a cascade of purely sensory predictions that drive the motor system, reflecting the causal sequence of the perceptual events preceding the error. We compare both hypotheses in a simulated anticipatory postural adjustment task. We observe that adaptation in the sensory domain, but not in the motor one, supports the robust and generalizable anticipatory control characteristic of biological systems. Our proposal unites the neurobiology of the cerebellum with the theory of active inference and provides a concrete implementation of its core tenets with great relevance both to our understanding of biological control systems and, possibly, to their emulation in complex artefacts.

Keywords: Active inference, Cerebellum, Computational model, Motor control, Perceptual learning


Pacheco, D., Sánchez-Fibla, M., Duff, A., Verschure, P. F. M. J., (2017). A spatial-context effect in recognition memory Frontiers in Behavioral Neuroscience 11, Article 143

We designed a novel experiment to investigate the modulation of human recognition memory by environmental context. Human participants were asked to navigate through a four-arm Virtual Reality (VR) maze in order to find and memorize discrete items presented at specific locations in the environment. They were later on tested on their ability to recognize items as previously presented or new. By manipulating the spatial position of half of the studied items during the testing phase of our experiment, we could assess differences in performance related to the congruency of environmental information at encoding and retrieval. Our results revealed that spatial context had a significant effect on the quality of memory. In particular, we found that recognition performance was significantly better in trials in which contextual information was congruent as opposed to those in which it was different. Our results are in line with previous studies that have reported spatial-context effects in recognition memory, further characterizing their magnitude under ecologically valid experimental conditions.

Keywords: Context effects, Recognition memory, Spatial behavior, Spatial memory and navigation, Virtual reality


Hindriks, Rikkert, Schmiedt, Joscha, Arsiwalla, Xerxes D., Peter, Alina, Verschure, Paul F. M. J., Fries, Pascal, Schmid, Michael C., Deco, Gustavo, (2017). Linear distributed source modeling of local field potentials recorded with intra-cortical electrode arrays PLoS ONE 12, (12), e0187490

Planar intra-cortical electrode (Utah) arrays provide a unique window into the spatial organization of cortical activity. Reconstruction of the current source density (CSD) underlying such recordings, however, requires “inverting” Poisson’s equation. For inter-laminar recordings, this is commonly done by the CSD method, which consists in taking the second-order spatial derivative of the recorded local field potentials (LFPs). Although the CSD method has been tremendously successful in mapping the current generators underlying inter-laminar LFPs, its application to planar recordings is more challenging. While for inter-laminar recordings the CSD method seems reasonably robust against violations of its assumptions, is it unclear as to what extent this holds for planar recordings. One of the objectives of this study is to characterize the conditions under which the CSD method can be successfully applied to Utah array data. Using forward modeling, we find that for spatially coherent CSDs, the CSD method yields inaccurate reconstructions due to volume-conducted contamination from currents in deeper cortical layers. An alternative approach is to “invert” a constructed forward model. The advantage of this approach is that any a priori knowledge about the geometrical and electrical properties of the tissue can be taken into account. Although several inverse methods have been proposed for LFP data, the applicability of existing electroencephalographic (EEG) and magnetoencephalographic (MEG) inverse methods to LFP data is largely unexplored. Another objective of our study therefore, is to assess the applicability of the most commonly used EEG/MEG inverse methods to Utah array data. Our main conclusion is that these inverse methods provide more accurate CSD reconstructions than the CSD method. We illustrate the inverse methods using event-related potentials recorded from primary visual cortex of a macaque monkey during a motion discrimination task.


Santos-Pata, D., Zucca, R., Low, S. C., Verschure, P. F. M. J., (2017). Size matters: How scaling affects the interaction between grid and border cells Frontiers in Computational Neuroscience 11, Article 65

Many hippocampal cell types are characterized by a progressive increase in scale along the dorsal-to-ventral axis, such as in the cases of head-direction, grid and place cells. Also located in the medial entorhinal cortex (MEC), border cells would be expected to benefit from such scale modulations. However, this phenomenon has not been experimentally observed. Grid cells in the MEC of mammals integrate velocity related signals to map the environment with characteristic hexagonal tessellation patterns. Due to the noisy nature of these input signals, path integration processes tend to accumulate errors as animals explore the environment, leading to a loss of grid-like activity. It has been suggested that border-to-grid cells' associations minimize the accumulated grid cells' error when rodents explore enclosures. Thus, the border-grid interaction for error minimization is a suitable scenario to study the effects of border cell scaling within the context of spatial representation. In this study, we computationally address the question of (i) border cells' scale from the perspective of their role in maintaining the regularity of grid cells' firing fields, as well as (ii) what are the underlying mechanisms of grid-border associations relative to the scales of both grid and border cells. Our results suggest that for optimal contribution to grid cells' error minimization, border cells should express smaller firing fields relative to those of the associated grid cells, which is consistent with the hypothesis of border cells functioning as spatial anchoring signals.

Keywords: Border cells, Error minimization, Grid cells, Navigation, Path integration


Moulin-Frier, C., Puigbò, J.-Y., Arsiwalla, Xerxes D., Martì Sanchez-Fibla, M., Verschure, Paul F. M. J., (2017). Embodied artificial intelligence through distributed adaptive control: An integrated framework 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-Epirob 2017) , IEEE (Lisbon, Portugal) , 1-8

In this paper, we argue that the future of Artificial Intelligence research resides in two keywords: integration and embodiment. We support this claim by analyzing the recent advances of the field. Regarding integration, we note that the most impactful recent contributions have been made possible through the integration of recent Machine Learning methods (based in particular on Deep Learning and Recurrent Neural Networks) with more traditional ones (e.g. Monte-Carlo tree search, goal babbling exploration or addressable memory systems). Regarding embodiment, we note that the traditional benchmark tasks (e.g. visual classification or board games) are becoming obsolete as state-of-the-art learning algorithms approach or even surpass human performance in most of them, having recently encouraged the development of first-person 3D game platforms embedding realistic physics. Building upon this analysis, we first propose an embodied cognitive architecture integrating heterogenous sub-fields of Artificial Intelligence into a unified framework. We demonstrate the utility of our approach by showing how major contributions of the field can be expressed within the proposed framework. We then claim that benchmarking environments need to reproduce ecologically-valid conditions for bootstrapping the acquisition of increasingly complex cognitive skills through the concept of a cognitive arms race between embodied agents.

Keywords: Cognitive Architectures, Embodied Artificial Intelligence, Evolutionary Arms Race, Unified Theories of Cognition


Puigbò, Jordi-Ysard, Gonzalez-Ballester, Miguel Ángel, Verschure, Paul , (2017). Behavior-state dependent modulation of perception based on a model of conditioning Biomimetic and Biohybrid Systems 6th International Conference, Living Machines 2017 (Lecture Notes in Computer Science) , Springer International Publishing (Standfor, USA) 10384, 387-393

The embodied mammalian brain evolved to adapt to an only partially known and knowable world. The adaptive labeling of the world is critically dependent on the neocortex which in turn is modulated by a range of subcortical systems such as the thalamus, ventral striatum and the amygdala. A particular case in point is the learning paradigm of classical conditioning where acquired representations of states of the world such as sounds and visual features are associated with predefined discrete behavioral responses such as eye blinks and freezing. Learning progresses in a very specific order, where the animal first identifies the features of the task that are predictive of a motivational state and then forms the association of the current sensory state with a particular action and shapes this action to the specific contingency. This adaptive feature selection has both attentional and memory components, i.e. a behaviorally relevant state must be detected while its representation must be stabilized to allow its interfacing to output systems. Here we present a computational model of the neocortical systems that underlie this feature detection process and its state dependent modulation mediated by the amygdala and its downstream target, the nucleus basalis of Meynert. Specifically, we analyze how amygdala driven cholinergic modulation these mechanisms through computational modeling and present a framework for rapid learning of behaviorally relevant perceptual representations.


Marco, S., Gutiérrez-Gálvez, A., Lansner, A., Martinez, D., Rospars, J. P., Beccherelli, R., Perera, A., Pearce, T. C., Verschure, P. F. M. J., Persaud, K., (2014). A biomimetic approach to machine olfaction, featuring a very large-scale chemical sensor array and embedded neuro-bio-inspired computation Microsystem Technologies 20, (4-5), 729-742

Biological olfaction outperforms chemical instrumentation in specificity, response time, detection limit, coding capacity, time stability, robustness, size, power consumption, and portability. This biological function provides outstanding performance due, in a large extent, to the unique architecture of the olfactory pathway, which combines a high degree of redundancy and efficient combinatorial coding, with unmatched chemical information processing mechanisms. The last decade has seen important advances in the understanding of the computational primitives underlying the functioning of the olfactory system. The EU-funded Project NEUROCHEM (Bio-ICT-FET- 216916) developed novel computing paradigms and biologically motivated artefacts for chemical sensing, taking its inspiration from the biological olfactory pathway. To demonstrate this approach, a biomimetic demonstrator has been built that features a very large-scale sensor array (65,536 elements) using conducting polymer technology which mimics the olfactory receptor neuron layer. It implements derived computational neuroscience algorithms in an embedded system that interfaces the chemical sensors and processes their signals in real-time. This embedded system integrates abstracted computational models of the main anatomic building blocks in the olfactory pathway: the olfactory bulb, and olfactory cortex in vertebrates (respectively, antennal lobe and mushroom bodies in the insect). For implementation in the embedded processor, an abstraction phase has been carried out in which their processing capabilities are captured by algorithmic solutions implemented in software. Finally, the algorithmic models are tested in mixed chemical plumes with an odour robot having navigation capabilities.


Ziyatdinov, Andrey, Calvo, Jose Maria Blanco, Lechon, Miguel, Bermudez i Badia, Sergi, Verschure, Paul F. M. J., Marco, Santiago, Perera, Alexandre, (2011). Odour mapping under strong backgrounds with a metal oxide sensor array Olfaction and Electronic Nose: Proceedings of the 14th International Symposium on Olfaction and Electronic Nose AIP Conference Proceedings (ed. Perena Gouma, SUNY Stony Brook), AIP (New York City, USA) 1362, (1), 232-233

This work describes the data from navigation experiments with the mobile robot, equipped with the sensor array of three MOX gas sensors. Performed four series of measurements aim to explore the capabilities of sensor array to build the odour map with one or two odour sources in the wind tunnel space. It was demonstrated that the method based on Independent Component Analysis (ICA) is able to discriminate two odour sources, that in future can be used in the surge-and-cast robot navigation algorithm.

Keywords: Mobile robots, Data acquisition, MIS devices, Chemioception