scholarly journals Traces of Modal Synergy: Studying Interactive Musical Sonification of Images in General-audience Use

Author(s):  
Niklas Rönnberg ◽  
Jonas Löwgren

Photone is an interactive installation combining color images with musical sonification. The musical expression is generated based on the syntactic (as opposed to semantic) features of an image as it is explored by the user’s pointing device, intending to catalyze a holistic user experience we refer to as modal synergy where visual and auditory modalities multiply rather than add. We collected and analyzed two months’ worth of data from visitors’ interactions with Photone in a public exhibition at a science center. Our results show that a small proportion of visitors engaged in sustained interaction with Photone, as indicated by session times. Among the most deeply engaged visitors, a majority of the interaction was devoted to visually salient objects, i.e., semantic features of the images. However, the data also contains instances of interactive behavior that are best explained by exploration of the syntactic features of an image, and thus may suggest the emergence of modal synergy.

Author(s):  
Ivona Kučerová

AbstractPerson features play a role in narrow-syntax processes. However, a person feature is often characterized as [±participant], a characterization that suggests pragmatic or semantic features. Relatedly, person has been the subject of an ongoing debate in the literature: one family of approaches argues that 3rd person is an elsewhere case, while another argues that it is a valued interpretable feature. This article provides a programatic argument that this disagreement has a principled basis. I argue that the representation of the features we identify as person changes between narrow syntax and the syntax-semantics interface. The tests and empirical descriptions are incongruent because they target different modules of the grammar and in turn different grammatical objects. The article thus contributes to our understanding of the division of labour among the modules, with a special focus on the autonomous status of narrow syntax.


Author(s):  
Irina Muhachyova ◽  

The paper discusses semantic and syntactic features of four Russian verbs denoting liquidation of external physical condition – the verbs razbintovat' ('take off a bandage'), razvernut' ('unwrap'), razvyuchit' ('unburden'), razgruzit' ('unload'). These verbs belong to the rather large class of verbs denoting liquidation of the result of an action. The aim of the paper is to find out whether the verbs under consideration are the prototypical members of the class. The author analyses both the semantics of these verbs as presented in the academic Dictionary of the Russian Language, using Russian National Corpus as a source of contexts, and their semantic features, describing a set of valency slots of each verb and the ways these slots can be filled. In order to catch the specific features of the verbs the author compares them with their antonyms denoting achievement of the result of an action. The study showed that having similar semantics the verbs razbintovat', razvernut', razvyuchit', razgruzit' denote situations in which a person makes certain manipulations with one object in order to eliminate its contact with another object. Three of the above-mentioned verbs also have the same syntactic properties. Razbintovat', razvernut', razgruzit' have three semantic valencies, which can be expressed syntactically. These verbs have two diathesis: one of them expresses subject and the first object, the second one – subject and the other object. As opposed to them the verb razvyuchit' has only one diathesis and one of its valencies is inexpressible. Nevertheless, the verbs razbintovat', razvernut', razvyuchit', razgruzit' are the prototypical members of the class of verbs, which denote liquidation of the result of an action.


2021 ◽  
Vol 11 (4) ◽  
pp. 1480
Author(s):  
Haiyang Zhang ◽  
Guanqun Zhang ◽  
Ricardo Ma

Current state-of-the-art joint entity and relation extraction framework is based on span-level entity classification and relation identification between pairs of entity mentions. However, while maintaining an efficient exhaustive search on spans, the importance of syntactic features is not taken into consideration. It will lead to a problem that the prediction of a relation between two entities is related based on corresponding entity types, but in fact they are not related in the sentence. In addition, although previous works have proven that extract local context is beneficial for the task, it still lacks in-depth learning of contextual features in local context. In this paper, we propose to incorporate syntax knowledge into multi-head self-attention by employing part of heads to focus on syntactic parents of each token from pruned dependency trees, and we use it to model the global context to fuse syntactic and semantic features. In addition, in order to get richer contextual features from the local context, we apply local focus mechanism on entity pairs and corresponding context. Based on applying the two strategies, we perform joint entity and relation extraction on span-level. Experimental results show that our model achieves significant improvements on both Conll04 and SciERC dataset compared to strong competitors.


2003 ◽  
Vol 27 (3) ◽  
pp. 635-655 ◽  
Author(s):  
Holger Diessel

This paper examines two types of expressions that seem to exist in all languages, demonstratives and interrogatives. Based on a representative sample of 100 languages it is shown that demonstratives and interrogatives have some striking features in common. They cross-cut the boundaries of several word classes and encode the same semantic features: person, thing, place, direction, manner, time, and amount. It is the central hypothesis of this study that the crosslinguistic parallelism between demonstratives and interrogatives is motivated by their pragmatic functions: both initiate a search for information that is guided by their semantic and syntactic features. Further, it is argued that demonstratives and interrogatives have a special status in language. Although both types of expressions are commonly considered grammatical markers, they do not serve an ordinary grammatical function. Grammatical markers organize the information flow in the ongoing discourse, whereas basic demonstratives and interrogatives are immediately concerned with the speaker-hearer interaction.


1981 ◽  
Vol 17 (1) ◽  
pp. 55-76 ◽  
Author(s):  
G. G. Corbett

The aim of this paper is to justify the use of syntactic features, to show how they relate to semantic features and how they operate in syntax and morphology. 1 Particular stress is laid on the elimination of redundant features. First we shall review the literature, to show why syntactic features should require justification. Then, as an illustration, we shall investigate the feature of animacy in Russian in all components of the grammar in which it has a rôle.


Author(s):  
A. M. Watrach

During a study of the development of infectious laryngotracheitis (LT) virus in tissue culture cells, unusual tubular formations were found in the cytoplasm of a small proportion of the affected cells. It is the purpose of this report to describe the morphologic characteristics of the tubules and to discuss their possible association with the development of virus.The source and maintenance of the strain of LT virus have been described. Prior to this study, the virus was passed several times in chicken embryo kidney (CEK) tissue culture cells.


Author(s):  
John R. Porter

New ceramic fibers, currently in various stages of commercial development, have been consolidated in intermetallic matrices such as γ-TiAl and FeAl. Fiber types include SiC, TiB2 and polycrystalline and single crystal Al2O3. This work required the development of techniques to characterize the thermochemical stability of these fibers in different matrices.SEM/EDS elemental mapping was used for this work. To obtain qualitative compositional/spatial information, the best realistically achievable counting statistics were required. We established that 128 × 128 maps, acquired with a 20 KeV accelerating voltage, 3 sec. live time per pixel (total mapping time, 18 h) and with beam current adjusted to give 30% dead time, provided adequate image quality at a magnification of 800X. The maps were acquired, with backgrounds subtracted, using a Noran TN 5500 EDS system. The images and maps were transferred to a Macintosh and converted into TIFF files using either TIFF Maker, or TNtolMAGE, a Microsoft QuickBASIC program developed at the Science Center. From TIFF files, images and maps were opened in either NIH Image or Adobe Photoshop for processing and analysis and printed from Microsoft Powerpoint on a Kodak XL7700 dye transfer image printer.


Sign in / Sign up

Export Citation Format

Share Document