scholarly journals Intuitive Cognition-Based Method for Generating Speech Using Hand Gestures

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5291
Author(s):  
Eldad Holdengreber ◽  
Roi Yozevitch ◽  
Vitali Khavkin

Muteness at its various levels is a common disability. Most of the technological solutions to the problem creates vocal speech through the transition from mute languages to vocal acoustic sounds. We present a new approach for creating speech: a technology that does not require prior knowledge of sign language. This technology is based on the most basic level of speech according to the phonetic division into vowels and consonants. The speech itself is expected to be expressed through sensing of the hand movements, as the movements are divided into three rotations: yaw, pitch, and roll. The proposed algorithm converts these rotations through programming to vowels and consonants. For the hand movement sensing, we used a depth camera and standard speakers in order to produce the sounds. The combination of the programmed depth camera and the speakers, together with the cognitive activity of the brain, is integrated into a unique speech interface. Using this interface, the user can develop speech through an intuitive cognitive process in accordance with the ongoing brain activity, similar to the natural use of the vocal cords. Based on the performance of the presented speech interface prototype, it is substantiated that the proposed device could be a solution for those suffering from speech disabilities.

Author(s):  
Shihui Han

Chapter 7 reviews empirical findings that allow consideration of biological and environmental influences on human behavior from an evolutionary perspective (e.g., gene-culture coevolution) and from a perspective of individual development (e.g., gene-culture interaction). It also reviews imaging genetic studies that link genes with brain functional organization. It introduces a cultural neuroscience paradigm for investigating genetic influences on the coupling of brain activity and culture by presenting two studies that examined how serotonin transporter functional polymorphism and oxytocin receptor gene moderate the association between interdependence and brain activities involved in self-reflection and empathy. These studies illustrate a new approach to understanding the manner with which culture interacts with gene to shape human brain activity.


2019 ◽  
Vol 11 (1) ◽  
pp. 19-29
Author(s):  
Akhil Kumar Singh

For many decades, cognition has been viewed as a computational process in the brain. For cognition, the brain, body and the interaction with the environment are important. Conventional views are inclined towards the existence of discrete and internal representations realised by highly specific mechanisms in the brain. The Embodied approach challenges this view and accepts the evolution of cognitive abilities.  There is a shift in focus from the belief that the brain is solely responsible for cognition to the thought that the body is somehow deeply integrated into cognition. However, it does not deny the central position of the brain in the process of cognition but opens the doors for other factors for integration. At the basic level, there are three ways in which an agent’s body can be utilised for the cognitive process. An agent’s body may help to generate, operate and distribute the cognitive processes. As a result, this approach tries to diminish the monopoly of the brain by taking into account the importance of the body and the environment for cognition.


2021 ◽  
Vol 9 ◽  
Author(s):  
Christoph Guger ◽  
Marc Sebastián-Romagosa ◽  
Woosang Cho ◽  
Tim Von Oertzen ◽  
Kyousuke Kamada ◽  
...  

Many people who have had a stroke have trouble moving, even after therapy with the best experts and methods. New ways to make stroke therapy more effective could help people recover more effectively. Some research groups have developed brain-computer interface (BCI) systems that can measure when a stroke patient imagines hand movement by recording brain waves. We developed a BCI that used each patient’s brain activity to control a muscle stimulator and a monitor during therapy. The patients got rewarding feedback during therapy when they imagined a movement correctly. We tested 51 patients, some of whom had a stroke many years ago. Forty nine patients improved after the therapy, based on the results of standardized tests. Therefore, BCI-based therapy could help some stroke patients. We think there will be further advances in the next several years that will lead to more effective therapies using BCIs.


2015 ◽  
Vol IX (2) ◽  
pp. 101-114
Author(s):  
John Crutchfield

As teachers, we have every reason to take seriously the findings of neuroscience. Learning is after all a brain activity, and those who teach would do well to consider how the brain actually learns. “Neuroscientific research,” writes Michaela Sambanis, “offers powerful insights into the brain mechanisms that underly learning processes. These findings can give a better understanding of how learning happens, how the brain as organ of learning copes with stimuli, how it stores information, how it forms networks, and how competences are developed. In a nutshell, neuroscience can make substantial contributions when it comes to answering the multifaceted question of what helps and what hinders learning” (Sambanis 2016). One of the more powerful neuroscientific findings, though at the same time perhaps one of the least surprising, has to do with the role of emotions in learning: the brain learns more efficiently when cognitive activity is accompanied by “positive” or pleasant emotions (Spitzer 2003). In fact, there is reason to suppose that this is the natural state of affairs, i.e. that learning is in itself pleasurable, and that Nature arranged things for us this way because, with neither sharp teeth and claws nor very much in the way of fur, ...


2001 ◽  
Vol 120 (5) ◽  
pp. A713-A713
Author(s):  
M POWER ◽  
C FRASER ◽  
S HAMDY ◽  
P TYRELL ◽  
J ROTHWELL ◽  
...  
Keyword(s):  

2010 ◽  
Vol 24 (2) ◽  
pp. 131-135 ◽  
Author(s):  
Włodzimierz Klonowski ◽  
Pawel Stepien ◽  
Robert Stepien

Over 20 years ago, Watt and Hameroff (1987 ) suggested that consciousness may be described as a manifestation of deterministic chaos in the brain/mind. To analyze EEG-signal complexity, we used Higuchi’s fractal dimension in time domain and symbolic analysis methods. Our results of analysis of EEG-signals under anesthesia, during physiological sleep, and during epileptic seizures lead to a conclusion similar to that of Watt and Hameroff: Brain activity, measured by complexity of the EEG-signal, diminishes (becomes less chaotic) when consciousness is being “switched off”. So, consciousness may be described as a manifestation of deterministic chaos in the brain/mind.


1999 ◽  
Vol 13 (2) ◽  
pp. 117-125 ◽  
Author(s):  
Laurence Casini ◽  
Françoise Macar ◽  
Marie-Hélène Giard

Abstract The experiment reported here was aimed at determining whether the level of brain activity can be related to performance in trained subjects. Two tasks were compared: a temporal and a linguistic task. An array of four letters appeared on a screen. In the temporal task, subjects had to decide whether the letters remained on the screen for a short or a long duration as learned in a practice phase. In the linguistic task, they had to determine whether the four letters could form a word or not (anagram task). These tasks allowed us to compare the level of brain activity obtained in correct and incorrect responses. The current density measures recorded over prefrontal areas showed a relationship between the performance and the level of activity in the temporal task only. The level of activity obtained with correct responses was lower than that obtained with incorrect responses. This suggests that a good temporal performance could be the result of an efficacious, but economic, information-processing mechanism in the brain. In addition, the absence of this relation in the anagram task results in the question of whether this relation is specific to the processing of sensory information only.


Author(s):  
V. A. Maksimenko ◽  
A. A. Harchenko ◽  
A. Lüttjohann

Introduction: Now the great interest in studying the brain activity based on detection of oscillatory patterns on the recorded data of electrical neuronal activity (electroencephalograms) is associated with the possibility of developing brain-computer interfaces. Braincomputer interfaces are based on the real-time detection of characteristic patterns on electroencephalograms and their transformation  into commands for controlling external devices. One of the important areas of the brain-computer interfaces application is the control of the pathological activity of the brain. This is in demand for epilepsy patients, who do not respond to drug treatment.Purpose: A technique for detecting the characteristic patterns of neural activity preceding the occurrence of epileptic seizures.Results:Using multi-channel electroencephalograms, we consider the dynamics of thalamo-cortical brain network, preceded the occurrence of an epileptic seizure. We have developed technique which allows to predict the occurrence of an epileptic seizure. The technique has been implemented in a brain-computer interface, which has been tested in-vivo on the animal model of absence epilepsy.Practical relevance:The results of our study demonstrate the possibility of epileptic seizures prediction based on multichannel electroencephalograms. The obtained results can be used in the development of neurointerfaces for the prediction and prevention of seizures of various types of epilepsy in humans. 


2019 ◽  
Vol 21 (1) ◽  
pp. 21-25 ◽  

Emerging results support the concept that Alzheimer disease (AD) and age-related dementia are affected by the ability of the immune system to contain the brain's pathology. Accordingly, well-controlled boosting, rather than suppression of systemic immunity, has been suggested as a new approach to modify disease pathology without directly targeting any of the brain's disease hallmarks. Here, we provide a short review of the mechanisms orchestrating the cross-talk between the brain and the immune system. We then discuss how immune checkpoint blockade directed against the PD-1/PD-L1 pathways could be developed as an immunotherapeutic approach to combat this disease using a regimen that will address the needs to combat AD.


Sign in / Sign up

Export Citation Format

Share Document