ENTROPY MINIMIZATION: A DESIGN PRINCIPLE FOR SENSORY PERCEPTION?

1992 ◽  
Vol 03 (supp01) ◽  
pp. 81-90 ◽  
Author(s):  
Joseph J. Atick
Keyword(s):  
Information Theory ◽  
Knowledge Acquisition ◽  
Data Reduction ◽  
Design Principle ◽  
Variational Principles ◽  
Sensory Perception ◽  
Sensory Systems ◽  
Sensory Pathways ◽  
Reduction Problem ◽  
Predictive Design

We speculate on how computational strategies suggested by Information theory could be useful for knowledge acquisition in sensory systems. The focus of our exploration is the idea that perception is a data reduction problem and as such sensory transformations should be predictable from the data reduction problem and as such sensory transformations should be predictable terms of variational principles involving the minimization of two types of entropy. The analysis suggests a scheme in which the two can be combined to produce a predictive design principle for sensory pathways.

scholarly journals A digitization theory of the Weber–Fechner law

2021 ◽  
Author(s):  
Haengjin Choe
Keyword(s):  
Information Theory ◽  
Neural Coding ◽  
Sensory Perception ◽  
Physical Stimulus ◽  
New Era ◽  
Microscopic Scale ◽  
Amount Of Information ◽  
Subjective Sensation

AbstractSince the publication of Shannon’s article about information theory, there have been many attempts to apply information theory to the field of neuroscience. Meanwhile, the Weber–Fechner law of psychophysics states that the magnitude of a subjective sensation of a person increases in proportion to the logarithm of the intensity of the external physical-stimulus. It is not surprising that we assign the amount of information to the response in the Weber–Fechner law. But no one has succeeded in applying information theory directly to that law: the direct links between information theory and that response in the Weber–Fechner law have not yet been found. The proposed theory unveils a link between information theory and that response, and differs subtly from the field such as neural coding that involves complicated calculations and models. Because our theory targets the Weber–Fechner law which is a macroscopic phenomenon, this theory does not involve complicated calculations. Our theory is expected to mark a new era in the fields of sensory perception research. Our theory must be studied in parallel with the fields of microscopic scale such as neural coding. This article ultimately aim to provide the fundamental concepts and their applications so that a new field of research on stimuli and responses can be created.

A novel data reduction method based on information theory and the Eclectic Genetic Algorithm

2017 ◽  
Vol 21 (4) ◽  
pp. 803-826
Author(s):  
Edwin Aldana-Bobadilla ◽  
Ivan Lopez-Arevalo ◽  
Alejandro Molina-Villegas
Keyword(s):  
Genetic Algorithm ◽  
Information Theory ◽  
Data Reduction ◽  
Reduction Method ◽  
Data Reduction Method

ENTROPIES OF FUZZY INDISCERNIBILITY RELATION AND ITS OPERATIONS

2004 ◽  
Vol 12 (05) ◽  
pp. 575-589 ◽  
Author(s):  
QINGHUA HU ◽  
DAREN YU
Keyword(s):  
Information Theory ◽  
Mutual Information ◽  
Relative Entropy ◽  
Rough Set ◽  
Data Reduction ◽  
Conditional Entropy ◽  
Point Of View ◽  
Joint Entropy ◽  
Fuzzy Rough Set ◽  
Numeric Data

Yager's entropy was proposed to compute the information of fuzzy indiscernibility relation. In this paper we present a novel interpretation of Yager's entropy in discernibility power of a relation point of view. Then some basic definitions in Shannon's information theory are generalized based on Yager's entropy. We introduce joint entropy, conditional entropy, mutual information and relative entropy to compute the information changes for fuzzy indiscerniblity relation operations. Conditional entropy and relative conditional entropy are proposed to measure the information increment, which is interpreted as the significance of an attribute in fuzzy rough set model. As an application, we redefine independency of an attribute set, reduct, relative reduct in fuzzy rough set model based on Yager's entropy. Some experimental results show the proposed approach is suitable for fuzzy and numeric data reduction.

LTE performance data reduction for knowledge acquisition

2014 ◽  
Author(s):  
Emil J. Khatib ◽  
Raquel Barco ◽  
Inmaculada Serrano ◽  
Pablo Munoz
Keyword(s):  
Knowledge Acquisition ◽  
Data Reduction ◽  
Performance Data

scholarly journals Non-visual crypsis: a review of the empirical evidence for camouflage to senses other than vision

2008 ◽  
Vol 364 (1516) ◽  
pp. 549-557 ◽  
Author(s):  
Graeme D Ruxton
Keyword(s):  
Predation Risk ◽  
Empirical Evidence ◽  
Sensory System ◽  
Sensory Perception ◽  
Sensory Systems ◽  
Conclusive Evidence ◽  
Chemical Camouflage ◽  
Background Matching

I review the evidence that organisms have adaptations that confer difficulty of detection by predators and parasites that seek their targets primarily using sensory systems other than vision. In other words, I will answer the question of whether crypsis is a concept that can usefully be applied to non-visual sensory perception. Probably because vision is such an important sensory system in humans, research in this field is sparse. Thus, at present we have very few examples of chemical camouflage, and even these contain some ambiguity in deciding whether they are best seen as examples of background matching or mimicry. There are many examples of organisms that are adaptively silent at times or in locations when or where predation risk is higher or in response to detection of a predator. By contrast, evidence that the form (rather than use) of vocalizations and other sound-based signals has been influenced by issues of reducing detectability to unintended receivers is suggestive rather than conclusive. There is again suggestive but not completely conclusive evidence for crypsis against electro-sensing predators. Lastly, mechanoreception is highly understudied in this regard, but there are scattered reports that strongly suggest that some species can be thought of as being adapted to be cryptic in this modality. Hence, I conclude that crypsis is a concept that can usefully be applied to senses other than vision, and that this is a field very much worthy of more investigation.

scholarly journals Application of agent-based simulated annealing and tabu search procedures to solving the data reduction problem

2011 ◽  
Vol 21 (1) ◽  
pp. 57-68 ◽  
Author(s):  
Ireneusz Czarnowski ◽  
Piotr Jędrzejowicz
Keyword(s):  
Simulated Annealing ◽  
Tabu Search ◽  
Learning Process ◽  
Data Reduction ◽  
Large Data ◽  
Process Data ◽  
Training Set ◽  
Agent Based ◽  
Reduction Problem ◽  
Learning Data

Application of agent-based simulated annealing and tabu search procedures to solving the data reduction problemThe problem considered concerns data reduction for machine learning. Data reduction aims at deciding which features and instances from the training set should be retained for further use during the learning process. Data reduction results in increased capabilities and generalization properties of the learning model and a shorter time of the learning process. It can also help in scaling up to large data sources. The paper proposes an agent-based data reduction approach with the learning process executed by a team of agents (A-Team). Several A-Team architectures with agents executing the simulated annealing and tabu search procedures are proposed and investigated. The paper includes a detailed description of the proposed approach and discusses the results of a validating experiment.

Variational Principles in Mathematical Physics, Geometry, and Economics

2009 ◽  
Author(s):  
Alexandru Kristaly ◽  
Vicentiu D. Radulescu ◽  
Csaba Varga
Keyword(s):  
Variational Principles ◽  
Mathematical Physics
Sign in / Sign up

Export Citation Format

Share Document