scholarly journals Real-Time Brain Machine Interaction via Social Robot Gesture Control

Author(s):  
Reza Abiri ◽  
Soheil Borhani ◽  
Xiaopeng Zhao ◽  
Yang Jiang

Brain-Machine Interaction (BMI) system motivates interesting and promising results in forward/feedback control consistent with human intention. It holds great promise for advancements in patient care and applications to neurorehabilitation. Here, we propose a novel neurofeedback-based BCI robotic platform using a personalized social robot in order to assist patients having cognitive deficits through bilateral rehabilitation and mental training. For initial testing of the platform, electroencephalography (EEG) brainwaves of a human user were collected in real time during tasks of imaginary movements. First, the brainwaves associated with imagined body kinematics parameters were decoded to control a cursor on a computer screen in training protocol. Then, the experienced subject was able to interact with a social robot via our real-time BMI robotic platform. Corresponding to subject’s imagery performance, he/she received specific gesture movements and eye color changes as neural-based feedback from the robot. This hands-free neurofeedback interaction not only can be used for mind control of a social robot’s movements, but also sets the stage for application to enhancing and recovering mental abilities such as attention via training in humans by providing real-time neurofeedback from a social robot.

Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3358
Author(s):  
Donato Calabria ◽  
Maria Maddalena Calabretta ◽  
Martina Zangheri ◽  
Elisa Marchegiani ◽  
Ilaria Trozzi ◽  
...  

Paper-based lateral-flow immunoassays (LFIAs) have achieved considerable commercial success and their impact in diagnostics is continuously growing. LFIA results are often obtained by visualizing by the naked eye color changes in given areas, providing a qualitative information about the presence/absence of the target analyte in the sample. However, this platform has the potential to provide ultrasensitive quantitative analysis for several applications. Indeed, LFIA is based on well-established immunological techniques, which have known in the last year great advances due to the combination of highly sensitive tracers, innovative signal amplification strategies and last-generation instrumental detectors. All these available progresses can be applied also to the LFIA platform by adapting them to a portable and miniaturized format. This possibility opens countless strategies for definitively turning the LFIA technique into an ultrasensitive quantitative method. Among the different proposals for achieving this goal, the use of enzyme-based immunoassay is very well known and widespread for routine analysis and it can represent a valid approach for improving LFIA performances. Several examples have been recently reported in literature exploiting enzymes properties and features for obtaining significative advances in this field. In this review, we aim to provide a critical overview of the recent progresses in highly sensitive LFIA detection technologies, involving the exploitation of enzyme-based amplification strategies. The features and applications of the technologies, along with future developments and challenges, are also discussed.


2021 ◽  
Vol 7 (9) ◽  
pp. eabe5914 ◽  
Author(s):  
Qianqian Wang ◽  
Kai Fung Chan ◽  
Kathrin Schweizer ◽  
Xingzhou Du ◽  
Dongdong Jin ◽  
...  

Swarming micro/nanorobots offer great promise in performing targeted delivery inside diverse hard-to-reach environments. However, swarm navigation in dynamic environments challenges delivery capability and real-time swarm localization. Here, we report a strategy to navigate a nanoparticle microswarm in real time under ultrasound Doppler imaging guidance for active endovascular delivery. A magnetic microswarm was formed and navigated near the boundary of vessels, where the reduced drag of blood flow and strong interactions between nanoparticles enable upstream and downstream navigation in flowing blood (mean velocity up to 40.8 mm/s). The microswarm-induced three-dimensional blood flow enables Doppler imaging from multiple viewing configurations and real-time tracking in different environments (i.e., stagnant, flowing blood, and pulsatile flow). We also demonstrate the ultrasound Doppler–guided swarm formation and navigation in the porcine coronary artery ex vivo. Our strategy presents a promising connection between swarm control and real-time imaging of microrobotic swarms for localized delivery in dynamic environments.


Author(s):  
Pierluigi Carcagnì ◽  
Dario Cazzato ◽  
Marco Del Coco ◽  
Pier Luigi Mazzeo ◽  
Marco Leo ◽  
...  

AbstractIn thiswork, a real-time system able to automatically recognize soft-biometric traits is introduced and used to improve the capability of a humanoid robot to interact with humans. In particular the proposed system is able to estimate gender and age of humans in images acquired from the embedded camera of the robot. This knowledge allows the robot to properly react with customized behaviors related to the gender/age of the interacting individuals. The system is able to handle multiple persons in the same acquired image, recognizing the age and gender of each person in the robot’s field of view. These features make the robot particularly suitable to be used in socially assistive applications.


2013 ◽  
Vol 119 (2) ◽  
pp. 277-287 ◽  
Author(s):  
Majid Dowlati ◽  
Seyed Saeid Mohtasebi ◽  
Mahmoud Omid ◽  
Seyed Hadi Razavi ◽  
Mansour Jamzad ◽  
...  

Author(s):  
John Alejandro Castro Vargas ◽  
Alberto Garcia Garcia ◽  
Sergiu Oprea ◽  
Sergio Orts Escolano ◽  
Jose Garcia Rodriguez

Object grasping in domestic environments using social robots has an enormous potential to help dependent people with a certain degree of disability. In this chapter, the authors make use of the well-known Pepper social robot to carry out such task. They provide an integrated solution using ROS to recognize and grasp simple objects. That system was deployed on an accelerator platform (Jetson TX1) to be able to perform object recognition in real time using RGB-D sensors attached to the robot. By using the system, the authors prove that the Pepper robot shows a great potential for such domestic assistance tasks.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Kesavan Devarayan ◽  
Kopperundevi Sivakami Nagaraju ◽  
Padmavathi Pandiyan

Purpose The present study aims to describe the development of halochromic thin film sensors using mixed indicator dyes for monitoring the spoilage of packed seer fish. Design/methodology/approach Thin film was prepared using renewable polysaccharide incorporated with mixed indicator dyes. The thin film was characterized using ultraviolet visible and Fourier transform-infrared spectroscopy. The characteristics of the thin film were studied by analyzing the CIELAB and Red Green Blue values and biodegradability. The thin films were evaluated for real-time monitoring of the spoilage of packed seer fish. Findings The thin film sensors were found to exhibit excellent halochromism. The color changes were visible and distinguishable. The sensors responded efficiently for real-time monitoring of spoilage of fish by showing unique color changes. Originality/value This study provides promising mixed indicator that exhibits different colors in the alkaline pH. Also the present study reveals a potential combination of materials for preparation of halochromic sensors that can be used for monitoring the spoilage of packed seer fish in real time.


Sign in / Sign up

Export Citation Format

Share Document