Computational Creativity Via Assisted Variational Synthesis of Mechanisms Using Deep Generative Models

2019 ◽  
Vol 141 (12) ◽  
Author(s):  
Shrinath Deshpande ◽  
Anurag Purwar

Abstract Computational methods for kinematic synthesis of mechanisms for motion generation problems require input in the form of precision positions. Given the highly nonlinear nature of the problem, solutions to these methods are overly sensitive to the input—a small perturbation to even a single position of a given motion can change the topology and dimensions of the synthesized mechanisms drastically. Thus, the synthesis becomes a blind iterative process of maneuvering precision positions in the hope of finding good solutions. In this paper, we present a deep-learning-based framework which manages the uncertain user input and provides the user with a higher level control of the design process. The framework also imputes the input with missing information required by the computational algorithms. The approach starts by learning the probability distribution of possible linkage parameters with a deep generative modeling technique, called variational auto encoder (VAE). This facilitates capturing salient features of the user input and relating them with possible linkage parameters. Then, input samples resembling the inferred salient features are generated and fed to the computational methods of kinematic synthesis. The framework postprocesses the solutions and presents the concepts to the user along with a handle to visualize the variants of each concept. We define this approach as variational synthesis of mechanisms. In addition, we also present an alternate end-to-end deep neural network architecture for variational synthesis of linkages. This end-to-end architecture is a conditional-VAE, which approximates the conditional distribution of linkage parameters with respect to a coupler trajectory distribution. The outcome is a probability distribution of kinematic linkages for an unknown coupler path or motion. This framework functions as a bridge between the current state of the art theoretical and computational kinematic methods and machine learning to enable designers to create practical mechanism design solutions.

Author(s):  
Shrinath Deshpande ◽  
Anurag Purwar

Abstract Computational methods for kinematic synthesis of mechanisms for motion generation problems require input in the form of precision positions. Given the highly non-linear nature of the problem, solutions to these methods are overly sensitive to the input — a small perturbation to even a single position of a given motion can change the topology and dimensions of the synthesized mechanisms drastically. Thus, the synthesis becomes a blind iterative process of maneuvering precision positions in the hope of finding good solutions. In this paper, we present a deep-learning based framework which manages the uncertain user input and provides the user with a higher level control of the design process. The framework also imputes the input with missing information required by the computational algorithms. The approach starts by learning the probability distribution of possible linkage parameters with a deep generative modeling technique, called Variational Auto Encoder (VAE). This facilitates capturing salient features of the user input and relating them with possible linkage parameters. Then, input samples resembling the inferred salient features are generated and fed to the computational methods of kinematic synthesis. The framework post-processes the solutions and presents the concepts to the user along with a handle to visualize the variants of each concept. We define this approach as Variational Synthesis of Mechanisms. In addition, we also present an alternate End-to-End deep neural network architecture for Variational Synthesis of linkages. This End-to-End architecture is a Conditional-VAE (C-VAE), which approximates the conditional distribution of linkage parameters with respect to coupler trajectory distribution. The outcome is a probability distribution of kinematic linkages for an unknown coupler path or motion. This framework functions as a bridge between the current state of the art theoretical and computational kinematic methods and machine learning to enable designers to create practical mechanism design solutions.


Author(s):  
Ping Zhao ◽  
Yong Wang ◽  
Lihong Zhu ◽  
Xiangyun Li

To evaluate the kinematic performance of designed mechanisms, a statistical-variance-based metric is proposed in this article to measure the “distance” between two discrete motion sequences: the reference motion and the given task motion. It seeks to establish a metric that is independent of the choice of the fixed frame or moving frame. Quaternions are adopted to represent the rotational part of a spatial pose, and the variance of the set of relative displacements is computed to reflect the difference between two sequences. With this variance-based metric formulation, we show that the comparison results of two spatial discrete motions are not affected by the choice of frames. Both theoretical demonstration and computational example are presented to support this conclusion. In addition, since the deviation error between the task motion and the synthesized motion measured with this metric is independent of the location of frames, those corresponding parameters could be excluded from the optimization algorithm formulated with our frame-independent metric in kinematic synthesis of mechanisms, and the complexity of the algorithm are hereby reduced. An application of a four-bar linkage synthesis problem is presented to illustrate the advantage of the proposed metric.


Author(s):  
Badreddine Aboulissane ◽  
Dikra El Haiek ◽  
Larbi El Bakkali

The objective of kinematic synthesis is to determine the mechanism dimensions such as link lengths, positions or joint coordinates, in order to approximate its output parameters such as link positions, trajectory points, and displacement angles. Kinematic synthesis is classified into three categories: function generation, path generation, and motion generation. This paper is dedicated only to path generation. As the number of trajectory points increases, analytical methods are limited to obtain precisely mechanism solutions. In that case, numerical methods are more efficient to solve such problems. Our study proposes an improved heuristic algorithm applied to four-bar mechanism path-generation. The objective of this work is to find optimum dimensions of the mechanism and minimize the error between the generated trajectory and the desired one, taking into consideration constraints such as: Grashof condition, transmission angle, and design variables constraints. Finally, our results are compared with those found by other evolutionary algorithms in the literature.


2021 ◽  
Author(s):  
Chia-Jung Chang ◽  
Wei Guo ◽  
Jie Zhang ◽  
Jon Newman ◽  
Shao-Hua Sun ◽  
...  

AbstractIn vivo calcium imaging using head-mounted miniature microscopes enables tracking activity from neural populations over weeks in freely behaving animals. Previous studies focus on inferring behavior from a population of neurons, yet it is challenging to extract neuronal signals given out-of-focus fluorescence in endoscopic data. Existing analysis pipelines include regions of interest (ROIs) identification, which might lose relevant information from false negatives or introduce unintended bias from false positives. Moreover, these methods often require prior knowledge for parameter tuning and are time-consuming for implementation. Here, we develop an end-to-end decoder to predict the behavioral variables directly from the raw microendoscopic images. Our framework requires little user input and outperforms existing decoders that need ROI extraction. We show that neuropil/background residuals carry additional behaviorally relevant information. Video analysis further reveals an optimal decoding window and dynamics between residuals and cells. Critically, saliency maps reveal the emergence of video-decomposition across our decoder, and identify distinct clusters representing different behavioral aspects. Together, we present a framework that is efficient for decoding behavior from microendoscopic imaging, and may help discover functional clustering for a variety of imaging studies.


2021 ◽  
Vol 8 (1) ◽  
pp. 3-31
Author(s):  
Yuan Xue ◽  
Yuan-Chen Guo ◽  
Han Zhang ◽  
Tao Xu ◽  
Song-Hai Zhang ◽  
...  

AbstractIn many applications of computer graphics, art, and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph, or layout, and have a computer system automatically generate photo-realistic images according to that input. While classically, works that allow such automatic image content generation have followed a framework of image retrieval and composition, recent advances in deep generative models such as generative adversarial networks (GANs), variational autoencoders (VAEs), and flow-based methods have enabled more powerful and versatile image generation approaches. This paper reviews recent works for image synthesis given intuitive user input, covering advances in input versatility, image generation methodology, benchmark datasets, and evaluation metrics. This motivates new perspectives on input representation and interactivity, cross fertilization between major image generation paradigms, and evaluation and comparison of generation methods.


2015 ◽  
Vol 7 (3) ◽  
Author(s):  
Qiong Shen ◽  
Wen-Tzong Lee ◽  
Kevin Russell

This work is an incremental extension of adjustable planar four-bar kinematic synthesis theory to consider not only synthesis, but also the elimination of the defects inherent in synthesis. A nonlinear equation system for moving pivot-adjustable planar four-bar motion generation that includes constraints for order defect, branch defect and circuit defect elimination is presented in this work. In the objective function of the equation system, the error between the prescribed and achieved precision positions is minimized. The equation system includes inequality constraints to eliminate order defects and branch defects. The equation system also includes a complete planar four-bar displacement model to eliminate circuit defects.


Sign in / Sign up

Export Citation Format

Share Document