The evolutionary sound synthesis method

Author(s):  
Jônatas Manzolli ◽  
Adolfo Maia ◽  
Jose Fornari ◽  
Furio Damiani
1986 ◽  
Vol 79 (4) ◽  
pp. 1201-1201
Author(s):  
Sydney A. Alonso ◽  
Cameron W. Jones

2018 ◽  
Author(s):  
Chris Kiefer

Conceptors are a recent development in the field of reservoir computing; they can be used to influence the dynamics of recurrent neural networks (RNNs), enabling generation of arbitrary patterns based on training data. Conceptors allow interpolation and extrapolation between patterns, and also provide a system of boolean logic for combining patterns together. Generation and manipulation of arbitrary patterns using conceptors has significant potential as a sound synthesis method for applications in computer music and procedural audio but has yet to be explored. Two novel methods of sound synthesis based on conceptors are introduced. Conceptular Synthesis is based on granular synthesis; sets of conceptors are trained to recall varying patterns from a single RNN, then a runtime mechanism switches between them, generating short patterns which are recombined into a longer sound. Conceptillators are trainable, pitch-controlled oscillators for harmonically rich waveforms, commonly used in a variety of sound synthesis applications. Both systems can exploit conceptor pattern morphing, boolean logic and manipulation of RNN dynamics, enabling new creative sonic possibilities. Experiments reveal how RNN runtime parameters can be used for pitch-independent timestretching and for precise frequency control of cyclic waveforms. They show how these techniques can create highly malleable sound synthesis models, trainable using short sound samples. Limitations are revealed with regards to reproduction quality, and pragmatic limitations are also shown, where exponential rises in computation and memory requirements preclude the use of these models for training with longer sound samples. The techniques presented here represent an initial exploration of the sound synthesis potential of conceptors; future possibilities and research questions are outlined, including possibilities in generative sound.


2014 ◽  
Vol 63 (22) ◽  
pp. 224303
Author(s):  
Zhang Bing-Rui ◽  
Chen Ke-An ◽  
Ding Shao-Hu

2019 ◽  
Vol 5 ◽  
pp. e205 ◽  
Author(s):  
Chris Kiefer

Conceptors are a recent development in the field of reservoir computing; they can be used to influence the dynamics of recurrent neural networks (RNNs), enabling generation of arbitrary patterns based on training data. Conceptors allow interpolation and extrapolation between patterns, and also provide a system of boolean logic for combining patterns together. Generation and manipulation of arbitrary patterns using conceptors has significant potential as a sound synthesis method for applications in computer music but has yet to be explored. Conceptors are untested with the generation of multi-timbre audio patterns, and little testing has been done on scalability to longer patterns required for audio. A novel method of sound synthesis based on conceptors is introduced. Conceptular Synthesis is based on granular synthesis; sets of conceptors are trained to recall varying patterns from a single RNN, then a runtime mechanism switches between them, generating short patterns which are recombined into a longer sound. The quality of sound resynthesis using this technique is experimentally evaluated. Conceptor models are shown to resynthesise audio with a comparable quality to a close equivalent technique using echo state networks with stored patterns and output feedback. Conceptor models are also shown to excel in their malleability and potential for creative sound manipulation, in comparison to echo state network models which tend to fail when the same manipulations are applied. Examples are given demonstrating creative sonic possibilities, by exploiting conceptor pattern morphing, boolean conceptor logic and manipulation of RNN dynamics. Limitations of conceptor models are revealed with regards to reproduction quality, and pragmatic limitations are also shown, where rises in computation and memory requirements preclude the use of these models for training with longer sound samples. The techniques presented here represent an initial exploration of the sound synthesis potential of conceptors, demonstrating possible creative applications in sound design; future possibilities and research questions are outlined.


2013 ◽  
Vol 40 (5) ◽  
pp. 1477-1483 ◽  
Author(s):  
M. Dolores Redel-Macías ◽  
Francisco Fernández-Navarro ◽  
Pedro A. Gutiérrez ◽  
A. José Cubero-Atienza ◽  
César Hervás-Martínez

Author(s):  
Cornelius Poepel

An overview on problems and methods to map performers’ actions to a synthesized sound is presented. Approaches incorporating the audio signal are described and a synthesis method called “Audio Signal Driven Sound Synthesis” is introduced. It uses the raw audio signal of a traditional instrument to drive a synthesis algorithm. The system tries to support musicians with satisfying instrument-specific playability. In contrast to common methods that try to increase openness for the player’s input, openness of the system is achieved here by leaving essential playing parameters non-formalized as far as possible. Three implementations of the method and one application are described. An empirical study and experiences with users testing the system implemented for a bowed string instrument are presented. This implementation represents a specific case of a broader range of approaches to the treatment of user input, which have applications in a wide variety of contexts involving human-computer interaction.


2018 ◽  
Author(s):  
Chris Kiefer

Conceptors are a recent development in the field of reservoir computing; they can be used to influence the dynamics of recurrent neural networks (RNNs), enabling generation of arbitrary patterns based on training data. Conceptors allow interpolation and extrapolation between patterns, and also provide a system of boolean logic for combining patterns together. Generation and manipulation of arbitrary patterns using conceptors has significant potential as a sound synthesis method for applications in computer music and procedural audio but has yet to be explored. Two novel methods of sound synthesis based on conceptors are introduced. Conceptular Synthesis is based on granular synthesis; sets of conceptors are trained to recall varying patterns from a single RNN, then a runtime mechanism switches between them, generating short patterns which are recombined into a longer sound. Conceptillators are trainable, pitch-controlled oscillators for harmonically rich waveforms, commonly used in a variety of sound synthesis applications. Both systems can exploit conceptor pattern morphing, boolean logic and manipulation of RNN dynamics, enabling new creative sonic possibilities. Experiments reveal how RNN runtime parameters can be used for pitch-independent timestretching and for precise frequency control of cyclic waveforms. They show how these techniques can create highly malleable sound synthesis models, trainable using short sound samples. Limitations are revealed with regards to reproduction quality, and pragmatic limitations are also shown, where exponential rises in computation and memory requirements preclude the use of these models for training with longer sound samples. The techniques presented here represent an initial exploration of the sound synthesis potential of conceptors; future possibilities and research questions are outlined, including possibilities in generative sound.


MRS Advances ◽  
2020 ◽  
Vol 5 (57-58) ◽  
pp. 2961-2972
Author(s):  
P.C. Meléndez-González ◽  
E. Garza-Duran ◽  
J.C. Martínez-Loyola ◽  
P. Quintana-Owen ◽  
I.L. Alonso-Lemus ◽  
...  

In this work, low-Pt content nanocatalysts (≈ 5 wt. %) supported on Hollow Carbon Spheres (HCS) were synthesized by two routes: i) colloidal conventional polyol, and ii) surfactant-free Bromide Anion Exchange (BAE). The nanocatalysts were labelled as Pt/HCS-P and Pt/HCS-B for polyol and BAE, respectively. The physicochemical characterization of the nanocatalysts showed that by following both methods, a good control of chemical composition was achieved, obtaining in addition well dispersed nanoparticles of less than 3 nm TEM average particle size (d) on the HCS. Pt/HCS-B contained more Pt0 species than Pt/HCS-P, an effect of the synthesis method. In addition, the structure of the HCS remains more ordered after BAE synthesis, compared to polyol. Regarding the catalytic activity for the Oxygen Reduction Reaction (ORR) in 0.5 M KOH, Pt/HCS-P and Pt/HCS-B showed a similar performance in terms of current density (j) at 0.9 V vs. RHE than the benchmark commercial 20 wt. % Pt/C. However, Pt/HCS-P and Pt/HCS-B demonstrated a 6 and 5-fold increase in mass catalytic activity compared to Pt/C, respectively. A positive effect of the high specific surface area of the HCS and its interactions with metal nanoparticles and electrolyte, which promoted the mass transfer, increased the performance of Pt/HCS-P and Pt/HCS-B. The high catalytic activity showed by Pt/HCS-B and Pt/HCS-P for the ORR, even with a low-Pt content, make them promising cathode nanocatalysts for Anion Exchange Membrane Fuel Cells (AEMFC).


Sign in / Sign up

Export Citation Format

Share Document