Publications

by Keyword: neural network


By year:[ 2020 | 2019 | 2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 ]

Marban, A., Srinivasan, V., Samek, W., Fernández, J., Casals, A., (2019). A recurrent convolutional neural network approach for sensorless force estimation in robotic surgery Biomedical Signal Processing and Control 50, 134-150

Providing force feedback as relevant information in current Robot-Assisted Minimally Invasive Surgery systems constitutes a technological challenge due to the constraints imposed by the surgical environment. In this context, force estimation techniques represent a potential solution, enabling to sense the interaction forces between the surgical instruments and soft-tissues. Specifically, if visual feedback is available for observing soft-tissues’ deformation, this feedback can be used to estimate the forces applied to these tissues. To this end, a force estimation model, based on Convolutional Neural Networks and Long-Short Term Memory networks, is proposed in this work. This model is designed to process both, the spatiotemporal information present in video sequences and the temporal structure of tool data (the surgical tool-tip trajectory and its grasping status). A series of analyses are carried out to reveal the advantages of the proposal and the challenges that remain for real applications. This research work focuses on two surgical task scenarios, referred to as pushing and pulling tissue. For these two scenarios, different input data modalities and their effect on the force estimation quality are investigated. These input data modalities are tool data, video sequences and a combination of both. The results suggest that the force estimation quality is better when both, the tool data and video sequences, are processed by the neural network model. Moreover, this study reveals the need for a loss function, designed to promote the modeling of smooth and sharp details found in force signals. Finally, the results show that the modeling of forces due to pulling tasks is more challenging than for the simplest pushing actions.

Keywords: Convolutional neural networks, Force estimation, LSTM networks, Robotic surgery


Martinez-Hernandez, Uriel, Vouloutsi, Vasiliki, Mura, Anna, Mangan, Michael, Asada, Minoru, Prescott, T. J., Verschure, P., (2019). Biomimetic and Biohybrid Systems 8th International Conference, Living Machines 2019, Nara, Japan, July 9–12, 2019, Proceedings , Springer, Cham (Lausanne, Switzerland) 11556, 1-384

This book constitutes the proceedings of the 8th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2019, held in Nara, Japan, in July 2019. The 26 full and 16 short papers presented in this volume were carefully reviewed and selected from 45 submissions. They deal with research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

Keywords: Artificial intelligence, Biomimetics, Computer architecture, Human robot interaction, Human-Computer Interaction (HCI), Humanoid robot, Image processing, Learning algorithms, Mobile robots, Multipurpose robots, Neural networks, Quadruped robots, Reinforcement learning, Robot learning, Robotics, Robots, Sensor, Sensors, Swarm robotics, User interfaces


Taghadomi-Saberi, S., Garcia, S. M., Masoumi, A. A., Sadeghi, M., Marco, S., (2018). Classification of bitter orange essential oils according to fruit ripening stage by untargeted chemical profiling and machine learning Sensors 18, (6), 1922

The quality and composition of bitter orange essential oils (EOs) strongly depend on the ripening stage of the citrus fruit. The concentration of volatile compounds and consequently its organoleptic perception varies. While this can be detected by trained humans, we propose an objective approach for assessing the bitter orange from the volatile composition of their EO. The method is based on the combined use of headspace gas chromatography–mass spectrometry (HS-GC-MS) and artificial neural networks (ANN) for predictive modeling. Data obtained from the analysis of HS-GC-MS were preprocessed to select relevant peaks in the total ion chromatogram as input features for ANN. Results showed that key volatile compounds have enough predictive power to accurately classify the EO, according to their ripening stage for different applications. A sensitivity analysis detected the key compounds to identify the ripening stage. This study provides a novel strategy for the quality control of bitter orange EO without subjective methods.

Keywords: Bitter orange essential oil, Headspace gas chromatography–mass spectrometry, Artificial neural network, Foodomics, Chemometrics, Feature selection


Puigbò, J. Y., Arsiwalla, X. D., Verschure, P., (2018). Challenges of machine learning for living machines Biomimetic and Biohybrid Systems 7th International Conference, Living Machines 2018 (Lecture Notes in Computer Science) , Springer International Publishing (Paris, France) 10928, 382-386

Machine Learning algorithms (and in particular Reinforcement Learning (RL)) have proved very successful in recent years. These have managed to achieve super-human performance in many different tasks, from video-games to board-games and complex cognitive tasks such as path-planning or Theory of Mind (ToM) on artificial agents. Nonetheless, this super-human performance is also super-artificial. Despite some metrics are better than what a human can achieve (i.e. cumulative reward), in less common metrics (i.e. time to learning asymptote) the performance is significantly worse. Moreover, the means by which those are achieved fail to extend our understanding of the human or mammal brain. Moreover, most approaches used are based on black-box optimization, making any comparison beyond performance (e.g. at the architectural level) difficult. In this position paper, we review the origins of reinforcement learning and propose its extension with models of learning derived from fear and avoidance behaviors. We argue that avoidance-based mechanisms are required when training on embodied, situated systems to ensure fast and safe convergence and potentially overcome some of the current limitations of the RL paradigm.

Keywords: Avoidance, Neural networks, Reinforcement learning


Vouloutsi, Vasiliki, Halloy, José, Mura, Anna, Mangan, Michael, Lepora, Nathan, Prescott, T. J., Verschure, P., (2018). Biomimetic and Biohybrid Systems 7th International Conference, Living Machines 2018, Paris, France, July 17–20, 2018, Proceedings , Springer International Publishing (Lausanne, Switzerland) 10928, 1-551

This book constitutes the proceedings of the 7th International Conference on Biomimetic and Biohybrid Systems, Living Machines 2018, held in Paris, France, in July 2018. The 40 full and 18 short papers presented in this volume were carefully reviewed and selected from 60 submissions. The theme of the conference targeted at the intersection of research on novel life-like technologies inspired by the scientific investigation of biological systems, biomimetics, and research that seeks to interface biological and artificial systems to create biohybrid systems.

Keywords: Artificial neural network, Bio-actuators, Bio-robotics, Biohybrid systems, Biomimetics, Bipedal robots, Earthoworm-like robots, Robotics, Decision-making, Tactile sensing, Soft robots, Locomotion, Insects, Sensors, Actuators, Robots, Artificial intelligence, Neural networks, Motion planning, Learning algorithms


Aviles, A. I., Marban, A., Sobrevilla, P., Fernandez, Josep, Casals, A., (2014). A recurrent neural network approach for 3D vision-based force estimation IPTA 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA) , IEEE (Paris, France) , 1-6

Robotic-assisted minimally invasive surgery has demonstrated its benefits in comparison with traditional procedures. However, one of the major drawbacks of current robotic system approaches is the lack of force feedback. Apart from space restrictions, the main problems of using force sensors are their high cost and the biocompatibility. In this work a proposal based on Vision Based Force Measurement is presented, in which the deformation mapping of the tissue is obtained using the `2−Regularized Optimization class, and the force is estimated via a recurrent neural network that has as inputs the kinematic variables and the deformation mapping. Moreover, the capability of RNN for predicting time series is used in order to deal with tool occlusions. The highlights of this proposal, according to the results, are: knowledge of material properties are not necessary, there is no need of adding extra sensors and a good trade-off between accuracy and efficiency has been achieved.

Keywords: Force estimation, Regularized optimization, Deformable tracking, Recurrent neural network


Gonzalez, H., Acevedo, H., Arizmendi, C., Giraldo, B. F., (2013). Methodology for determine the moment of disconnection of patients of the mechanical ventilation using discrete wavelet transform Complex Medical Engineering (CME) 2013 ICME International Conference , IEEE (Beijing, China) , 483-486

The process of weaning from mechanical ventilation is one of the challenges in intensive care units. 66 patients under extubation process (T-tube test) were studied: 33 patients with successful trials and 33 patients who failed to maintain spontaneous breathing and were reconnected. Each patient was characterized using 7 time series from respiratory signals, and for each serie was evaluated the discrete wavelet transform. It trains a neural network for discriminating between patients from the two groups.

Keywords: discrete wavelet transforms, neural nets, patient treatment, pneumodynamics, time series, ventilation, T-tube test, discrete wavelet transform, extubation process, intensive care units, mechanical ventilation, moment of disconnection, neural network, patients, respiratory signals, spontaneous breathing, time series, weaning, Mechanical Ventilation, Neural Networks, Time series from respiratory signals, Wavelet Transform


Correa, L. S., Laciar, E., Mut, V., Giraldo, B. F., Torres, A., (2010). Multi-parameter analysis of ECG and Respiratory Flow signals to identify success of patients on weaning trials Engineering in Medicine and Biology Society (EMBC) 32nd Annual International Conference of the IEEE , IEEE (Buenos Aires, Argentina) -----, 6070-6073

Statistical analysis, power spectral density, and Lempel Ziv complexity, are used in a multi-parameter approach to analyze four temporal series obtained from the Electrocardiographic and Respiratory Flow signals of 126 patients on weaning trials. In which, 88 patients belong to successful group (SG), and 38 patients belong to failure group (FG), i.e. failed to maintain spontaneous breathing during trial. It was found that mean values of cardiac inter-beat and breath durations give higher values for SG than for FG; Kurtosis coefficient of the spectrum of the rapid shallow breathing index is higher for FG; also Lempel Ziv complexity mean values associated with the respiratory flow signal are bigger for FG. Patients were then classified with a pattern recognition neural network, obtaining 80% of correct classifications (81.6% for FG and 79.5% for SG).

Keywords: Electrocardiography, Medical signal processing, Neural nets, Pattern recognition, Pneumodynamics, Signal classification, Statistical analysis, ECG, Kurtosis coefficient, Lempel Ziv complexity, Breath durations, Cardiac interbeat durations, Electrocardiography, Multiparameter analysis, Pattern recognition neural network, Power spectral density, Respiratory flow signals, Signal classification, Spontaneous breathing, Statistical analysis, Weaning trials