scholarly journals Sonifyd: A Graphical Approach for Sound Synthesis and Synesthetic Visual Expression

Author(s):  
Woohun Joo

This paper describes Sonifyd, a sonification driven multimedia and audiovisual environment based on color-sound conversion for real-time manipulation. Sonifyd scans graphics horizontally or vertically from a scan line, generates sound and determines timbre according to its own additive synthesis based color-to-sound mapping. Color and sound relationships are fixed as default, but they can be organic for more tonal flexibility. Within this ecosystem, flexible timbre changes will be discovered by Sonifyd. The scan line is invisible, but Sonifyd provides another display that represents the scanning process in the form of dynamic imagery representation. The primary goal of this project is to be a functioning tool for a new kind of visual music, graphic sonification research and to further provide a synesthetic metaphor for audiences/users in the context of an art installation and audiovisual performance. The later section is a discussion about limitations that I have encountered: using an additive synthesis and frequency modulation technique with the line scanning method. In addition, it discusses potential possibilities for the future direction of development in relation to graphic expression and sound design context.

2021 ◽  
pp. 414-448
Author(s):  
Victor Lazzarini

The principles of sound design within a computational context are demonstrated through a series of examples and techniques. These include additive synthesis, which is the focus of the earlier part of the chapter, and is followed by source-modifier methods, which are complementary to it. The more advanced approaches of granular synthesis and streaming spectral processing complement the discussion, which is fully illustrated with code examples and spectrogram figures. The chapter concludes with an overview of design approaches.


2013 ◽  
Vol 711 ◽  
pp. 513-517 ◽  
Author(s):  
Chia Ching Wang ◽  
Po Chi Hu ◽  
Chung Li Tsai ◽  
Sung Long Chen

A dental scanning system was developed using multiple light strips of DPSSL (Diode-Pumped Solid-State Laser) sources with a video capturing module of one CMOS camera. The laser line scanning method is less sensitive to the surface conditions of the materials for measurement compared with the structured light scanning method, and a multi-lines scanning design is used to improve the scanning efficiency. The study uses DPSSL lines to scan over the teeth models either by sequence or by sections, which determines the actual time spent. For an object within 100x100mm projective area, the scanning time is about 10 minutes with ±0.05 mm accuracy on a gypsum teeth model using sequential scanning. The results show high accuracy and efficiency scanning teeth models with multi-lines projecting module integrated within, and is possible for further improvement in the growing digital-dental industry.


2021 ◽  
pp. 0271678X2110372
Author(s):  
Luisa Raimondo ◽  
Tomas Knapen ◽  
ĺcaro A.F Oliveira ◽  
Xin Yu ◽  
Serge O Dumoulin ◽  
...  

Functional magnetic resonance imaging (fMRI) is a widely used tool in neuroscience to detect neurally evoked responses, e.g. the blood oxygenation level-dependent (BOLD) signal. Typically, BOLD fMRI has millimeter spatial resolution and temporal resolution of one to few seconds. To study the sub-millimeter structures and activity of the cortical gray matter, the field needs an fMRI method with high spatial and temporal resolution. Line-scanning fMRI achieves very high spatial resolution and high sampling rate, at the cost of a sacrifice in volume coverage. Here, we present a human line-scanning implementation on a 7T MRI system. First, we investigate the quality of the saturation pulses that suppress MR signal outside the line. Second, we established the best coil combination for reconstruction. Finally, we applied the line-scanning method in the occipital lobe during a visual stimulation task, showing BOLD responses along cortical depth, every 250 µm with a 200 ms repetition time (TR). We found a good correspondence of t-statistics values with 2D gradient-echo echo planar imaging (GE-EPI) BOLD fMRI data with the same temporal resolution and voxel volume (R = 0.6 ± 0.2). In summary, we demonstrate the feasibility of line-scanning in humans and this opens line-scanning fMRI for applications in cognitive and clinical neuroscience.


10.29007/515s ◽  
2019 ◽  
Author(s):  
Mariana Bahia

This paper explores the intersection between high-end technology for immersive media and conceptual sound installations using low-quality audios. It discusses the concept of fidelity in sound reproduction and traces how this concept relates to the subject of identity and self through the recorded voice. I analyse art projects that use low-quality audio to address issues of self and how these projects can help presenting an alternative understanding of experimental sound design for spatial audio. Finally, I explore the issue through my own artistic research called This Alienness and Me, where I investigate the feeling of “not belonging” through personal voice recordings made with a cellphone. In my project the audios were juxtaposed using Wave Field Synthesis to create an immersive environment.


2020 ◽  
Vol 27 (36) ◽  
pp. 6188-6207
Author(s):  
Nan Wang ◽  
Honghao Cao ◽  
Lin Wang ◽  
Feng Ren ◽  
Qi Zeng ◽  
...  

Background: Spectroscopic imaging based on the spontaneous Raman scattering effects can provide unique fingerprint information in relation to the vibration bands of molecules. Due to its advantages of high chemical specificity, non-invasive detection capability, low sensitivity to water, and no special sample pretreatment, Raman Spectroscopic Imaging (RSI) has become an invaluable tool in the field of biomedicine and medicinal chemistry. Methods: There are three methods to implement RSI, including point scanning, line scanning and wide-field RSI. Point-scanning can achieve two-and three-dimensional imaging of target samples. High spectral resolution, full spectral range and confocal features render this technique highly attractive. However, point scanning based RSI is a time-consuming process that can take several hours to map a small area. Line scanning RSI is an extension of point scanning method, with an imaging speed being 300-600 times faster. In the wide-field RSI, the laser illuminates the entire region of interest directly and all the images then collected for analysis. In general, it enables more accurate chemical imaging at faster speeds. Results: This review focuses on the recent advances in RSI, with particular emphasis on the latest developments on instrumentation and the related applications in biomedicine and medicinal chemistry. Finally, we prospect the development trend of RSI as well as its potential to translation from bench to bedside. Conclusion: RSI is a powerful technique that provides unique chemical information, with a great potential in the fields of biomedicine and medicinal chemistry.


2006 ◽  
Vol 12 (S02) ◽  
pp. 1650-1651
Author(s):  
E Lee ◽  
F Adar ◽  
A Whitley

Extended abstract of a paper presented at Microscopy and Microanalysis 2006 in Chicago, Illinois, USA, July 30 – August 3, 2005


Sign in / Sign up

Export Citation Format

Share Document