scholarly journals Physics 101: Learning Physical Object Properties from Unlabeled Videos

Author(s):  
Jiajun Wu ◽  
Joseph Lim ◽  
Hongyi Zhang ◽  
Joshua Tenenbaum ◽  
William Freeman
2021 ◽  
Vol 14 ◽  
Author(s):  
Guido Maiello ◽  
Marcel Schepko ◽  
Lina K. Klein ◽  
Vivian C. Paulun ◽  
Roland W. Fleming

How humans visually select where to grasp objects is determined by the physical object properties (e.g., size, shape, weight), the degrees of freedom of the arm and hand, as well as the task to be performed. We recently demonstrated that human grasps are near-optimal with respect to a weighted combination of different cost functions that make grasps uncomfortable, unstable, or impossible, e.g., due to unnatural grasp apertures or large torques. Here, we ask whether humans can consciously access these rules. We test if humans can explicitly judge grasp quality derived from rules regarding grasp size, orientation, torque, and visibility. More specifically, we test if grasp quality can be inferred (i) by using visual cues and motor imagery alone, (ii) from watching grasps executed by others, and (iii) through performing grasps, i.e., receiving visual, proprioceptive and haptic feedback. Stimuli were novel objects made of 10 cubes of brass and wood (side length 2.5 cm) in various configurations. On each object, one near-optimal and one sub-optimal grasp were selected based on one cost function (e.g., torque), while the other constraints (grasp size, orientation, and visibility) were kept approximately constant or counterbalanced. Participants were visually cued to the location of the selected grasps on each object and verbally reported which of the two grasps was best. Across three experiments, participants were required to either (i) passively view the static objects and imagine executing the two competing grasps, (ii) passively view videos of other participants grasping the objects, or (iii) actively grasp the objects themselves. Our results show that, for a majority of tested objects, participants could already judge grasp optimality from simply viewing the objects and imagining to grasp them, but were significantly better in the video and grasping session. These findings suggest that humans can determine grasp quality even without performing the grasp—perhaps through motor imagery—and can further refine their understanding of how to correctly grasp an object through sensorimotor feedback but also by passively viewing others grasp objects.


2017 ◽  
Vol 24 (5) ◽  
pp. 524-529 ◽  
Author(s):  
François Osiurak ◽  
Marine Granjon ◽  
Isabelle Bonnevie ◽  
Joël Brogniart ◽  
Laura Mechtouff ◽  
...  

AbstractObjectives: Recent evidence indicates that some left brain-damaged (LBD) patients have difficulties to use familiar tools because of the inability to reason about physical object properties. A fundamental issue is to understand the residual capacity of those LBD patients in tool selection. Methods: Three LBD patients with tool use disorders, three right brain-damaged (RBD) patients, and six matched healthy controls performed a novel tool selection task, consisting in extracting a target out from a box by selecting the relevant tool among eight, four, or two tools. Three criteria were manipulated to make relevant and irrelevant tools (size, rigidity, shape). Results: LBD patients selected a greater number of irrelevant tools and had more difficulties to solve the task compared to RBD patients and controls. All participants committed more errors for selecting relevant tools based on rigidity and shape than size. In some LBD patients, the difficulties persisted even in the 2-Choice condition. Conclusions: Our findings confirm that tool use disorders result from impaired technical reasoning, leading patients to meet difficulties in selecting tools based on their physical properties. We also go further by showing that these difficulties can decrease as the choice is reduced, at least for some properties, opening new avenues for rehabilitation programs. (JINS, 2018, 24, 524–529)


2020 ◽  
Author(s):  
Guido Maiello ◽  
Marcel Schepko ◽  
Lina K. Klein ◽  
Vivian C. Paulun ◽  
Roland W. Fleming

AbstractHow humans visually select where to grasp objects is determined by the physical object properties (e.g., size, shape, weight), the degrees of freedom of the arm and hand, as well as the task to be performed. We recently demonstrated that human grasps are near-optimal with respect to a weighted combination of different cost functions that make grasps uncomfortable, unstable or impossible e.g., due to unnatural grasp apertures or large torques. Here, we ask whether humans can consciously access these rules. We test if humans can explicitly judge grasp quality derived from rules regarding grasp size, orientation, torque, and visibility. More specifically, we test if grasp quality can be inferred (i) by using motor imagery alone, (ii) from watching grasps executed by others, and (iii) through performing grasps, i.e. receiving visual, proprioceptive and haptic feedback. Stimuli were novel objects made of 10 cubes of brass and wood (side length 2.5 cm) in various configurations. On each object, one near-optimal and one sub-optimal grasp were selected based on one cost function (e.g. torque), while the other constraints (grasp size, orientation, and visibility) were kept approximately constant or counterbalanced. Participants were visually cued to the location of the selected grasps on each object and verbally reported which of the two grasps was best. Across three experiments, participants could either (i) passively view the static objects, (ii) passively view videos of other participants grasping the objects, or (iii) actively grasp the objects themselves. Our results show that participants could already judge grasp optimality from simply viewing the objects, but were significantly better in the video and grasping session. These findings suggest that humans can determine grasp quality even without performing the grasp—perhaps through motor imagery—and can further refine their understanding of how to correctly grasp an object through sensorimotor feedback but also by passively viewing others grasp objects.


Author(s):  
Richard Healey

Novel quantum concepts acquire content not by representing new beables but through material-inferential relations between claims about them and other claims. Acceptance of quantum theory modifies other concepts in accordance with a pragmatist inferentialist account of how claims acquire content. Quantum theory itself introduces no new beables, but accepting it affects the content of claims about classical magnitudes and other beables unknown to classical physics: the content of a magnitude claim about a physical object is a function of its physical context in a way that eludes standard pragmatics but may be modeled by decoherence. Leggett’s proposed test of macro-realism illustrates this mutation of conceptual content. Quantum fields are not beables but assumables of a quantum theory we use to make claims about particles and non-quantum fields whose denotational content may also be certified by models of decoherence.


Author(s):  
Andrew Steane

This brief chapter presents a spiritual exercise, which is to contemplate an ordinary physical object in a way that does not involve assessing it but involves merely being in its presence and allowing it to impinge~on~one.


Author(s):  
Arivazhagan Pugalendhi ◽  
Rajesh Ranganathan

Additive Manufacturing (AM) capabilities in terms of product customization, manufacture of complex shape, minimal time, and low volume production those are very well suited for medical implants and biological models. AM technology permits the fabrication of physical object based on the 3D CAD model through layer by layer manufacturing method. AM use Magnetic Resonance Image (MRI), Computed Tomography (CT), and 3D scanning images and these data are converted into surface tessellation language (STL) file for fabrication. The applications of AM in ophthalmology includes diagnosis and treatment planning, customized prosthesis, implants, surgical practice/simulation, pre-operative surgical planning, fabrication of assistive tools, surgical tools, and instruments. In this article, development of AM technology in ophthalmology and its potential applications is reviewed. The aim of this study is nurturing an awareness of the engineers and ophthalmologists to enhance the ophthalmic devices and instruments. Here some of the 3D printed case examples of functional prototype and concept prototypes are carried out to understand the capabilities of this technology. This research paper explores the possibility of AM technology that can be successfully executed in the ophthalmology field for developing innovative products. This novel technique is used toward improving the quality of treatment and surgical skills by customization and pre-operative treatment planning which are more promising factors.


Linguistics ◽  
2020 ◽  
Vol 58 (6) ◽  
pp. 1737-1773
Author(s):  
Kyumin Kim

AbstractThe goal of this paper is to address the syntax of certain oblique nominals in Blackfoot (Algonquian) that are introduced by a set of verbal prefixes called linkers. In the literature, an oblique nominal introduced by a verbal affix always shows certain properties of objects, e.g., agreement. This type of affix is analyzed as forming a complex verb with the main verb via head movement, and the oblique nominal is treated as an object of the complex verb. However, this paper demonstrates that oblique nominals introduced by linkers in Blackfoot do not show certain object properties even though the linker looks like it forms a complex verb. Building on the lack of object properties, linker phrases are proposed to be adjuncts. As proposed for adjuncts generally (e.g., Stephanov, Arthur. 2001. Late adjunction and minimalist phrase structure. Syntax 4(2). 94–125), this paper proposes a late merge analysis for linker phrases. Within an Agree-based model (Chomsky, Noam. 2000. Minimalist inquiries: The framework. In Roger Martin, David Michaels & Juan Uriagereka (eds.), Step by step: Essays on minimalist syntax in honor of Howard Lasnik, 89–155. Cambridge, MA: The MIT Press, 2001. Derivation by phase. In Michael Kenstowicz (ed.), Ken Hale: A life in language, 1–52. Cambridge: The MIT Press) where the derivation proceeds by phases (Chomsky 2008), a linker phrase, as an adjunct, lacks the relevant features to participate in the derivation via Agree, and thus it merges late at the end of a given phasal derivation such as vP. When spell out applies, the linker linearizes with a [V-v] complex in the base position, i.e., vP, giving its surface appearance as a verbal affix. Under this view, a linker does not lead to formation of a complex verb as it does not undergo head movement to the verb, unlike applicative affixes, consistent with the absence of object properties.


Sign in / Sign up

Export Citation Format

Share Document