scholarly journals HOLISTIC SELF-REPROGRAMMING OF NEURAL NETWORKS: BETWEEN SELF-ORGANIZATION AND SELF-OBSERVATION

2014 ◽  
pp. 54-67
Author(s):  
Jean-Jacques Mariage

Neural networks (NNs) are inspired – at least metaphorically –from biological solutions nature selected by evolution. On one hand, learning algorithms' efficacy has been widely demonstrated experimentally, even if the mathematical proof of their convergence is not always very easy to establish (SOM). On the other hand, biological mechanisms like brain wiring or embryology remain partly understood and how life or the bases of consciousness are related to the underlying biological substrate remains a total mystery. The same goes for memory. We don’t really know how information is stored in and recovered from biological neural structures. We therein paradoxically use complex systems, the hard core of which we still don't always fully understand, both regarding the models we build, as well as their former roots in the leaving world. In this theoretical paper, we resort to a few biological encoding schemata that bring insights into neural structures' growth, plasticity and reorganization, and we suggest reconsidering the metaphor in an adaptive developmental view.

1996 ◽  
Vol 07 (04) ◽  
pp. 451-459 ◽  
Author(s):  
I. TSUDA

A new type of self-organized dynamics is presented, in relation with chaos in neural networks. One is chaotic itinerancy and the other is chaos-driven contraction dynamics. The former is addressed as a universal behavior in high-dimensional dynamical systems. In particular, it can be viewed as one possible form of memory dynamics in brain. The latter gives rise to singular-continuous nowhere-differentiable attractors. These dynamics can be related to each other in the context of dimensionality and of chaotic information processings. Possible roles of these complex dynamics in brain are also discussed.


2021 ◽  
Author(s):  
Romik Ghosh ◽  
Dana Mastrovito ◽  
Stefan Mihalas

The human brain readily learns tasks in sequence without forgetting previous ones. Artificial neural networks (ANNs), on the other hand, need to be modified to achieve similar performance. While effective, many algorithms that accomplish this are based on weight importance methods that do not correspond to biological mechanisms. Here we introduce a simple, biologically plausible method for enabling effective continual learning in ANNs. We show that it is possible to learn a weight-dependent plasticity function that prevents catastrophic forgetting over multiple tasks. We highlight the effectiveness of our method by evaluating it on a set of MNIST classification tasks. We further find that the use of our method promotes synaptic multi-modality, similar to that seen in biology.


2018 ◽  
Vol 9 (1) ◽  
pp. 31-42
Author(s):  
Rysa Sahrial

Poverty is one continuing social issue which is hard to solve. Dealing with this problem, Islam has already had the alternative solution that is tithe (Zakat). Zakat is implemented to decrease economy imbalanced appeared in the society. While in fact, not all the Moslem pay Zakat. There are five factors as the reason why Moslem didn’t do that. First, some Muzakki wants to deliver his zakat directly.Seconde, not all Muzakki know how much Zakat must be paid. The other factors are Limited information about Mustahik home, limited time that Muzakki have to deliver his Zakat directly and the easiness to report Mustahik data. Dealing with those factors, it is required to have an information system which can make Muzakki meets Mustahik. In this research, information system application used Extreme Programming (XP) development method. XP method is required to program a system which will be made by accomodating the users’ needs and expectations.


2021 ◽  
Vol 40 (1) ◽  
pp. 551-563
Author(s):  
Liqiong Lu ◽  
Dong Wu ◽  
Ziwei Tang ◽  
Yaohua Yi ◽  
Faliang Huang

This paper focuses on script identification in natural scene images. Traditional CNNs (Convolution Neural Networks) cannot solve this problem perfectly for two reasons: one is the arbitrary aspect ratios of scene images which bring much difficulty to traditional CNNs with a fixed size image as the input. And the other is that some scripts with minor differences are easily confused because they share a subset of characters with the same shapes. We propose a novel approach combing Score CNN, Attention CNN and patches. Attention CNN is utilized to determine whether a patch is a discriminative patch and calculate the contribution weight of the discriminative patch to script identification of the whole image. Score CNN uses a discriminative patch as input and predict the score of each script type. Firstly patches with the same size are extracted from the scene images. Secondly these patches are used as inputs to Score CNN and Attention CNN to train two patch-level classifiers. Finally, the results of multiple discriminative patches extracted from the same image via the above two classifiers are fused to obtain the script type of this image. Using patches with the same size as inputs to CNN can avoid the problems caused by arbitrary aspect ratios of scene images. The trained classifiers can mine discriminative patches to accurately identify some confusing scripts. The experimental results show the good performance of our approach on four public datasets.


Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 211
Author(s):  
Garland Culbreth ◽  
Mauro Bologna ◽  
Bruce J. West ◽  
Paolo Grigolini

We study two forms of anomalous diffusion, one equivalent to replacing the ordinary time derivative of the standard diffusion equation with the Caputo fractional derivative, and the other equivalent to replacing the time independent diffusion coefficient of the standard diffusion equation with a monotonic time dependence. We discuss the joint use of these prescriptions, with a phenomenological method and a theoretical projection method, leading to two apparently different diffusion equations. We prove that the two diffusion equations are equivalent and design a time series that corresponds to the anomalous diffusion equation proposed. We discuss these results in the framework of the growing interest in fractional derivatives and the emergence of cognition in nature. We conclude that the Caputo fractional derivative is a signature of the connection between cognition and self-organization, a form of cognition emergence different from the other source of anomalous diffusion, which is closely related to quantum coherence. We propose a criterion to detect the action of self-organization even in the presence of significant quantum coherence. We argue that statistical analysis of data using diffusion entropy should help the analysis of physiological processes hosting both forms of deviation from ordinary scaling.


2021 ◽  
Vol 32 (8) ◽  
pp. 312-316
Author(s):  
Paul Silverston

The pandemic has led to an increase in the use of pulse oximetry to assess and manage patients with COVID-19 disease. Paul Silverston explains the principles of pulse oximetry and the factors that can affect the reliability and accuracy of readings Pulse oximetry is performed to detect and quantify the degree of hypoxia in patients with respiratory symptoms and illnesses, including patients with COVID-19 disease. Pulse oximeters are non-invasive, simple to use and inexpensive, but it is important to know how to interpret the readings in the context of the patient's symptoms and the other clinical findings. In COVID-19 disease, very small differences in the oxygen saturation reading result in significant differences in the way that the patient is managed, so it is important to be aware of the factors that can affect these readings. It is also important to appreciate that a low reading in a patient with suspected or confirmed COVID-19 disease may be the result of another disease process.


Author(s):  
Valerii Dmitrienko ◽  
Sergey Leonov ◽  
Mykola Mezentsev

The idea of ​​Belknap's four-valued logic is that modern computers should function normally not only with the true values ​​of the input information, but also under the conditions of inconsistency and incompleteness of true failures. Belknap's logic introduces four true values: T (true - true), F (false - false), N (none - nobody, nothing, none), B (both - the two, not only the one but also the other).  For ease of work with these true values, the following designations are introduced: (1, 0, n, b). Belknap's logic can be used to obtain estimates of proximity measures for discrete objects, for which the functions Jaccard and Needhem, Russel and Rao, Sokal and Michener, Hamming, etc. are used. In this case, it becomes possible to assess the proximity, recognition and classification of objects in conditions of uncertainty when the true values ​​are taken from the set (1, 0, n, b). Based on the architecture of the Hamming neural network, neural networks have been developed that allow calculating the distances between objects described using true values ​​(1, 0, n, b). Keywords: four-valued Belknap logic, Belknap computer, proximity assessment, recognition and classification, proximity function, neural network.


2005 ◽  
Vol 187 (3) ◽  
pp. 203-205 ◽  
Author(s):  
Mark Weiser ◽  
Jim van Os ◽  
Michael Davidson

SummaryMany manifestations of mental illness, risk factors, course and even response to treatment are shared by several diagnostic groups. For example, cognitive and social impairments are present to some degree in most DSM and ICD diagnostic groups. The idea that diagnostic boundaries of mental illness, including schizophrenia, have to be redefined is reinforced by recent findings indicating that on the one hand multiple genetic factors, each exerting a small effect, come together to manifest as schizophrenia, and on the other hand, depending on interaction with the environment, the same genetic variations can present as diverse clinical phenotypes. Rather than attempting to find a unitary biological explanation for a DSM construct of schizophrenia, it would be reasonable to deconstruct it into the most basic manifestations, some of which are common with other DSM constructs, such as cognitive or social impairment, and then investigate the biological substrate of these manifestations.


In attempting to present some observations on the kind of information on the Earth’s resources which may be obtained from spacecraft and space satellites, I think I should explain that I speak as a geographer with research interests in the field of biogeography/geobotany where I have been concerned with the use of vegetation in mineral exploration work and in the assessment of land potential for agricultural and other uses. In the course of this work I have come to appreciate major problems of regional or even continental dimensions and have become aware of the great potential offered by suitably equipped Earth resources satellites for providing information which would assist their solution. At the same time I have come to recognize the great contribution which Earth resources satellites can make in the fields of agriculture, forestry and conservation, topographical and geological mapping, hydrology, oceanography, land use and urban planning, to mention but a few. As a setting for my subsequent remarks I would like to state what I believe to be the relative positions of the U. S. A. and the U. S. S. R. on the one hand and this country and certain West European countries on the other with regard to the acquisition of information from Earth resources satellites. America and Russia have led the world in space research. They have the resources, the facilities and the technical know-how for placing spacecraft and satellites in orbit. For the effective development of Earth resources satellites, however, ground control information is essential. Here this country, together with member and former member countries of the Commonwealth possesses a body of people scattered through universities, government departments and organizations, commerce and industry whose firsthand knowledge of remote terrain in many parts of the world is unrivalled. This knowledge harnessed into an Earth resources satellites programme could enable this country to make a leading contribution to the development of the less developed parts of the world and at the same time materially assist the economy of this country.


Slovene ◽  
2017 ◽  
Vol 6 (1) ◽  
pp. 95-117 ◽  
Author(s):  
Barbara Sonnenhauser

For the linguistic expression of the concept of knowledge, the Slavic languages use verbs deriving from the Indo-European roots *ĝnō and *ṷei̭d. They differ in terms of the availability of both types of verbs in the contemporary standard languages and in terms of their semantic range. As will be shown in this paper, these differences are interesting not only from a language-specific lexicological point of view, but also in the context of the intersection of lexicon and grammar. Covering the domain of ‘knowing how,’ the *ĝnō-based verb in Slovene (znati) has been extending into the domain of possibility and, on this basis, developing into a modal verb. While this development is not surprising from a typological point of view, it is remarkable from a Slavic perspective, since this particular grammaticalisation path towards possibility is otherwise unknown to Slavic. This peculiar feature of Slovene, which most probably relates to its long-lasting and intensive contact with German, is illustrated in the present paper by comparing Slovene to Russian on the basis of three main questions: 1) the semantic range of vedeti / vedatʹ and znati / znatʹ, 2) the lexicalisation of ‘know how,’ and 3) the relation between knowledge, ability, and possibility. The focus is on contemporary Slovene and Russian, leaving a detailed diachronic investigation and the further embedding into a larger Slavic and areal perspective for future analyses.


Sign in / Sign up

Export Citation Format

Share Document