scholarly journals Compositional Inductive Biases in Function Learning

2016 ◽  
Author(s):  
Eric Schulz ◽  
Joshua B. Tenenbaum ◽  
David Duvenaud ◽  
Maarten Speekenbrink ◽  
Samuel J. Gershman

AbstractHow do people recognize and learn about complex functional structure? Taking inspiration from other areas of cognitive science, we propose that this is achieved by harnessing compositionality: complex structure is decomposed into simpler building blocks. We formalize this idea within the framework of Bayesian regression using a grammar over Gaussian process kernels, and compare this approach with other structure learning approaches. Participants consistently chose compositional (over non-compositional) extrapolations and interpolations of functions. Experiments designed to elicit priors over functional patterns revealed an inductive bias for compositional structure. Compositional functions were perceived as subjectively more predictable than non-compositional functions, and exhibited other signatures of predictability, such as enhanced memorability and reduced numerosity. Taken together, these results support the view that the human intuitive theory of functions is inherently compositional.

2007 ◽  
Vol 342 (2) ◽  
pp. 170-181 ◽  
Author(s):  
Hauke Hilz ◽  
Laura E. de Jong ◽  
Mirjam A. Kabel ◽  
René Verhoef ◽  
Henk A. Schols ◽  
...  

2020 ◽  
Vol 24 (23) ◽  
pp. 17771-17785
Author(s):  
Antonio Candelieri ◽  
Riccardo Perego ◽  
Ilaria Giordani ◽  
Andrea Ponti ◽  
Francesco Archetti

AbstractModelling human function learning has been the subject of intense research in cognitive sciences. The topic is relevant in black-box optimization where information about the objective and/or constraints is not available and must be learned through function evaluations. In this paper, we focus on the relation between the behaviour of humans searching for the maximum and the probabilistic model used in Bayesian optimization. As surrogate models of the unknown function, both Gaussian processes and random forest have been considered: the Bayesian learning paradigm is central in the development of active learning approaches balancing exploration/exploitation in uncertain conditions towards effective generalization in large decision spaces. In this paper, we analyse experimentally how Bayesian optimization compares to humans searching for the maximum of an unknown 2D function. A set of controlled experiments with 60 subjects, using both surrogate models, confirm that Bayesian optimization provides a general model to represent individual patterns of active learning in humans.


2019 ◽  
Vol 10 ◽  
pp. 1217-1227 ◽  
Author(s):  
Giulia Tuci ◽  
Andree Iemhoff ◽  
Housseinou Ba ◽  
Lapo Luconi ◽  
Andrea Rossin ◽  
...  

The rational design and synthesis of covalent triazine frameworks (CTFs) from defined dicyano-aryl building blocks or their binary mixtures is of fundamental importance for a judicious tuning of the chemico-physical and morphological properties of this class of porous organic polymers. In fact, their gas adsorption capacity and their performance in a variety of catalytic transformations can be modulated through an appropriate selection of the building blocks. In this contribution, a set of five CTFs (CTF1–5) have been prepared under classical ionothermal conditions from single dicyano-aryl or heteroaryl systems. The as-prepared samples are highly micro-mesoporous and thermally stable materials featuring high specific surface area (up to 1860 m2·g−1) and N content (up to 29.1 wt %). All these features make them highly attractive samples for carbon capture and sequestration (CCS) applications. Indeed, selected polymers from this series rank among the CTFs with the highest CO2 uptake at ambient pressure reported so far in the literature (up to 5.23 and 3.83 mmol·g−1 at 273 and 298 K, respectively). Moreover, following our recent achievements in the field of steam- and oxygen-free dehydrogenation catalysis using CTFs as metal-free catalysts, the new samples with highest N contents have been scrutinized in the process to provide additional insights to their complex structure–activity relationship.


2011 ◽  
Vol 287-290 ◽  
pp. 2640-2643
Author(s):  
Guo Dong Gao ◽  
Wen Xiao Zhang ◽  
Gong Zhi Yu ◽  
Jiang Hua Sui

The structure, characteristics and principles of BP neural network model are described in this paper. First, three impact factors of the dissolved oxygen are selected as the sample input of network, and then the parameters of BP neural network are selected, such as network structure, learning algorithm, output layer transfer function, learning rate and so on. Finally, the BP neural network model is established and trained, in order to approach compensate the effects of improves non-linearity. The simulation results show that BP neural network is practical and dependable in the field of dissolved oxygen modeling and has nice applied prospect.


Molecules ◽  
2020 ◽  
Vol 25 (16) ◽  
pp. 3616
Author(s):  
Leonardo Bruno Assis Oliveira ◽  
Tertius L. Fonseca ◽  
Benedito J. C. Cabral

Theoretical results for the magnetic shielding of protonated and unprotonated nitrogens of eumelanin building blocks including monomers, dimers, and tetramers in gas phase and water are presented. The magnetic property in water was determined by carrying out Monte Carlo statistical mechanics sampling combined with quantum mechanics calculations based on the gauge-including atomic orbitals approach. The results show that the environment polarization can have a marked effect on nitrogen magnetic shieldings, especially for the unprotonated nitrogens. Large contrasts of the oligomerization effect on magnetic shielding show a clear distinction between eumelanin building blocks in solution, which could be detected in nuclear magnetic resonance experiments. Calculations for a π-stacked structure defined by the dimer of a tetrameric building block indicate that unprotonated N atoms are significantly deshielded upon π stacking, whereas protonated N atoms are slightly shielded. The results stress the interest of NMR experiments for a better understanding of the eumelanin complex structure.


2021 ◽  
Author(s):  
Safaa Eldin H. Etaiw ◽  
Safaa N. Abdou Nabih Abdou

Abstract A new 3D-host-guest supramolecular coordination polymer (SCP); ∞3[(Cu3(CN)3)2.(DAHP)], 1 [1,7-diaminoheptane=.(DAHP)] had been synthesized by self-assembly at ambient conditions. X-ray single crystal diffraction of SCP 1 indicated the formation of two-fold [Cu3(CN)3]2 units containing tetrahedral copper(I) atoms which are arranged in unique way to create 3D-network. The neutral [Cu3(CN)3]2 building blocks create unique complex structure containing the minicycle [Cu2(μ3-CN)2] motif with wide cavities enable to capsulate the long chain DAHP as guest molecule. The topology of 1 had been studied by elemental analysis, IR-spectra and thermogravimetric analyses. The topology of 1 had been compared with the prototype SCP containing different aliphatic diamines which indicated the effect of structural variability and flexibility of aliphatic diamines on the network structure of these SCP. The catalytic and photo-catalytic activity of 1 was studied for mineralization of methylene blue (MB) utilizing H2O2 as an oxidant.


10.29007/8fmw ◽  
2020 ◽  
Author(s):  
Nicholas Leiby ◽  
Ayaan Hossain ◽  
Howard M Salis

Promoters drive gene expression and help regulate cellular responses to the environment. In recent research, machine learning models have been developed to predict a bacterial promoter’s transcriptional initiation rate, although these models utilize expert-labeled sequence elements across a defined set of DNA building blocks. The generalizability of these methods is therefore limited by the necessary labeling of the specific components studied. As a result, current models have not been used to predict the transcriptional initiation rates of promoters with generalized nucleotide sequences. If generalizable models existed, they could greatly facilitate the design of synthetic genetic circuits with well-controlled transcription rates in bacteria.To address these limitations, we used a convolutional neural network (CNN) to predict a promoter’s transcriptional initiation rate directly from its DNA nucleotide sequence. We first evaluated the model on a published promoter component dataset. Trained using only the sequence as input, our model fits held-out test data with R2​ ​= 0.90, comparable to published models that fit expert-labeled sequence elements.We produced a new promoter strength dataset including non-repetitive promoters with high sequence variation and not limited to combinations of discrete expert-labeled components. Our CNN trained on this more varied dataset fits held-out promoter strength with R2​ ​= 0.61. Previously-published models are intractable on a dataset like this with highly diverse inputs. The CNN outperforms classical approach baselines like LASSO on a bag of words for promoter sequence elements (R2​ ​= 0.42).We applied recent machine learning approaches to quantify the contribution of individual nucleotides to the CNN's promoter strength prediction. Learning directly from DNA sequence, our model identified the consensus -35 and -10 hexamer regions as well as the discriminator element as keycontributorstoσ7​0​promoterstrength.Italsoreplicatedafindingthataperfectconsensus sequence match does not yield the strongest promoter.The model's ability to independently learn biologically-relevant information directly from sequence, while performing similarly to or better than classical methods, makes it appealing for further prediction optimization and research into generalizability. This approach may be useful for synthetic promoter design, as well as for sequence feature identification.


PLoS ONE ◽  
2021 ◽  
Vol 16 (2) ◽  
pp. e0246092
Author(s):  
Shady E. Ahmed ◽  
Omer San ◽  
Kursat Kara ◽  
Rami Younis ◽  
Adil Rasheed

Hybrid physics-machine learning models are increasingly being used in simulations of transport processes. Many complex multiphysics systems relevant to scientific and engineering applications include multiple spatiotemporal scales and comprise a multifidelity problem sharing an interface between various formulations or heterogeneous computational entities. To this end, we present a robust hybrid analysis and modeling approach combining a physics-based full order model (FOM) and a data-driven reduced order model (ROM) to form the building blocks of an integrated approach among mixed fidelity descriptions toward predictive digital twin technologies. At the interface, we introduce a long short-term memory network to bridge these high and low-fidelity models in various forms of interfacial error correction or prolongation. The proposed interface learning approaches are tested as a new way to address ROM-FOM coupling problems solving nonlinear advection-diffusion flow situations with a bifidelity setup that captures the essence of a broad class of transport processes.


2014 ◽  
Vol 86 (5) ◽  
pp. 843-857 ◽  
Author(s):  
Rafael Luque

AbstractBiomass is a renewable and abundant feedstock that is poised to become a future alternative to petroleum as the understanding and technology surrounding catalytic biomass conversion and biorefineries progresses. A relevant research avenue explored in recent years deals with biomass deconstruction into simpler compounds (platform chemicals) by overcoming its recalcitrant and complex structure and subsequently converting these building blocks into value-added chemicals, fuels and materials in a similar way to that of current refineries. This contribution is aimed at providing a short overview of biomass processing chemistry by illustrating some relevant examples of catalytic strategies for biorefineries.


Author(s):  
Yi Sun ◽  
Alfredo Cuesta-Infante ◽  
Kalyan Veeramachaneni

A vine copula model is a flexible high-dimensional dependence model which uses only bivariate building blocks. However, the number of possible configurations of a vine copula grows exponentially as the number of variables increases, making model selection a major challenge in development. In this work, we formulate a vine structure learning problem with both vector and reinforcement learning representation. We use neural network to find the embeddings for the best possible vine model and generate a structure. Throughout experiments on synthetic and real-world datasets, we show that our proposed approach fits the data better in terms of loglikelihood. Moreover, we demonstrate that the model is able to generate high-quality samples in a variety of applications, making it a good candidate for synthetic data generation.


Sign in / Sign up

Export Citation Format

Share Document