Determining Optimal Model Complexity in an Iterative Design Process

Author(s):  
David G. Bell ◽  
Dean L. Taylor

Abstract In design, trade-offs are made between quality, cost and schedule. As the versatility of design tools has increased, so has the difficulty of making these trade-offs. This is especially true when choosing appropriate complexities for analytical and computational models. A fact known to designers and analysts is that more complex models yield more accurate results, but take longer to create and analyze. This paper shows that in an iterative design process there exists an optimal model complexity for each iteration, and alternatively, one optimal for the process as a whole. Quantitative methods for determining these complexities are developed, and three strategies for controlling the design modelling process are contrasted. Dependent on the stopping criteria, the best strategy will either minimize resource expenditure subject to quality requirements, or conversely, will maximize quality subject to resource constraints. These concepts are formalized with a view towards the design theory and methodology research community providing a first step in quantifying model trade-offs. An illustrative shape-optimal design example is shown wherein cost savings up to 84% were achieved. These savings were seen using several standard optimization algorithms. A customized optimization algorithm that incorporates this work should produce even better results.

2021 ◽  
Vol 13 (8) ◽  
pp. 4584
Author(s):  
Sou-Sen Leu ◽  
Theresia Daisy Nattali Suparman ◽  
Cathy Chang-Wei Hung

The classical dependency structure matrix (DSM) can effectively deal with iterative schedules that are highly coupled and interdependent, such as the design process and the concurrent process. Classical DSM generally follows the assumption that the least iteration occurs to achieve the shortest completion time. Nevertheless, the assumption may not hold because tasks ought to be re-visited several times if the design qualities do not meet the requirements. This research proposed a novel iterative scheduling model that combines the classical DSM concept with quality equations. The quality equations were used to determine the number of tasks that ought to be re-visited for fulfilling quality requirements during the iterative design process. Moreover, resources for concurrent activities are generally limited in the real world. Resource allocation should be incorporated in scheduling to avoid the waste and shortage of resources on a design project. This research proposed a new iterative scheduling model based on the classical DSM to optimize the iterative activities’ structure in terms of minimizing completion time with the consideration of design quality under resource constraints. A practical design schedule was introduced to demonstrate the applicability of the proposed DSM algorithm.


2013 ◽  
Vol 1 (1) ◽  
pp. 158-178
Author(s):  
Urcun John Tanik

Cyberphysical system design automation utilizing knowledge based engineering techniques with globally networked knowledge bases can tremendously improve the design process for emerging systems. Our goal is to develop a comprehensive architectural framework to improve the design process for cyberphysical systems (CPS) and implement a case study with Axiomatic Design Solutions Inc. to develop next generation toolsets utilizing knowledge-based engineering (KBE) systems adapted to multiple domains in the field of CPS design automation. The Cyberphysical System Design Automation Framework (CPSDAF) will be based on advances in CPS design theory based on current research and knowledge collected from global sources automatically via Semantic Web Services. A case study utilizing STEM students is discussed.


2021 ◽  
Vol 12 (01) ◽  
pp. 164-169
Author(s):  
Laurie Lovett Novak ◽  
Jonathan Wanderer ◽  
David A. Owens ◽  
Daniel Fabbri ◽  
Julian Z. Genkins ◽  
...  

Abstract Background The data visualization literature asserts that the details of the optimal data display must be tailored to the specific task, the background of the user, and the characteristics of the data. The general organizing principle of a concept-oriented display is known to be useful for many tasks and data types. Objectives In this project, we used general principles of data visualization and a co-design process to produce a clinical display tailored to a specific cognitive task, chosen from the anesthesia domain, but with clear generalizability to other clinical tasks. To support the work of the anesthesia-in-charge (AIC) our task was, for a given day, to depict the acuity level and complexity of each patient in the collection of those that will be operated on the following day. The AIC uses this information to optimally allocate anesthesia staff and providers across operating rooms. Methods We used a co-design process to collaborate with participants who work in the AIC role. We conducted two in-depth interviews with AICs and engaged them in subsequent input on iterative design solutions. Results Through a co-design process, we found (1) the need to carefully match the level of detail in the display to the level required by the clinical task, (2) the impedance caused by irrelevant information on the screen such as icons relevant only to other tasks, and (3) the desire for a specific but optional trajectory of increasingly detailed textual summaries. Conclusion This study reports a real-world clinical informatics development project that engaged users as co-designers. Our process led to the user-preferred design of a single binary flag to identify the subset of patients needing further investigation, and then a trajectory of increasingly detailed, text-based abstractions for each patient that can be displayed when more information is needed.


Author(s):  
Camila Freitas Salgueiredo ◽  
Armand Hatchuel

AbstractIs biologically inspired design only an analogical transfer from biology to engineering? Actually, nature does not always bring “hands-on” solutions that can be analogically applied in classic engineering. Then, what are the different operations that are involved in the bioinspiration process and what are the conditions allowing this process to produce a bioinspired design? In this paper, we model the whole design process in which bioinspiration is only one element. To build this model, we use a general design theory, concept–knowledge theory, because it allows one to capture analogy as well as all other knowledge changes that lead to the design of a bioinspired solution. We ground this model on well-described examples of biologically inspired designs available in the scientific literature. These examples include Flectofin®, a hingeless flapping mechanism conceived for façade shading, and WhalePower technology, the introduction of bumps on the leading edge of airfoils to improve aerodynamic properties. Our modeling disentangles the analogical aspects of the biologically inspired design process, and highlights the expansions occurring in both knowledge bases, scientific (nonbiological) and biological, as well as the impact of these expansions in the generation of new concepts (concept partitioning). This model also shows that bioinspired design requires a special form of collaboration between engineers and biologists. Contrasting with the classic one-way transfer between biology and engineering that is assumed in the literature, the concept–knowledge framework shows that these collaborations must be “mutually inspirational” because both biological and engineering knowledge expansions are needed to reach a novel solution.


Author(s):  
Andrew P. Sabelhaus ◽  
Hao Ji ◽  
Patrick Hylton ◽  
Yakshu Madaan ◽  
ChanWoo Yang ◽  
...  

The Underactuated Lightweight Tensegrity Robotic Assistive Spine (ULTRA Spine) project is an ongoing effort to create a compliant, cable-driven, 3-degree-of-freedom, underactuated tensegrity core for quadruped robots. This work presents simulations and preliminary mechanism designs of that robot. Design goals and the iterative design process for an ULTRA Spine prototype are discussed. Inverse kinematics simulations are used to develop engineering characteristics for the robot, and forward kinematics simulations are used to verify these parameters. Then, multiple novel mechanism designs are presented that address challenges for this structure, in the context of design for prototyping and assembly. These include the spine robot’s multiple-gear-ratio actuators, spine link structure, spine link assembly locks, and the multiple-spring cable compliance system.


Author(s):  
Abheek Chatterjee ◽  
Richard Malak ◽  
Astrid Layton

Abstract The objective of this study is to investigate the value of an ecologically inspired architectural metric called the Degree of System Order in the System of Systems (SoS) architecting process. Two highly desirable SoS attributes are the ability to withstand and recover from disruptions (resilience) and affordability. In practice, more resilient SoS architectures are less affordable and it is essential to balance the trade-offs between the two attributes. Ecological research analyzing long-surviving ecosystems (nature's resilient SoS) using the Degree of System Order metric has found a unique balance of efficient and redundant interactions in their architecture. This balance implies that highly efficient ecosystems tend to be inflexible and vulnerable to perturbations while highly redundant ecosystems fail to utilize resources effectively for survival. Motivated by this unique architectural property of ecosystems, this study investigates the response to disruptions vs. affordability trade-space of a large number of feasible SoS architectures. Results indicate that the most favorable SoS architectures in this trade-space share a specific range of values of Degree of System Order. This suggests that Degree of System Order can be a key metric in engineered SoS development. Evaluating the Degree of System Order does not require detailed simulations and can, therefore, guide the early stage SoS design process towards more optimal SoS architectures.


Author(s):  
Margaret Wong ◽  
Akudasuo Ezenyilimba ◽  
Alexandra Wolff ◽  
Tyrell Anderson ◽  
Erin Chiou ◽  
...  

Urban Search and Rescue (USAR) missions often involve a need to complete tasks in hazardous environments. In such situations, human-robot teams (HRT) may be essential tools for future USAR missions. Transparency and explanation are two information exchange processes where transparency is real-time information exchange and explanation is not. For effective HRTs, certain levels of transparency and explanation must be met, but how can these modes of team communication be operationalized? During the COVID-19 pandemic, our approach to answering this question involved an iterative design process that factored in our research objectives as inputs and pilot studies with remote participants. Our final research testbed design resulted in converting an in-person task environment to a completely remote study and task environment. Changes to the study environment included: utilizing user-friendly video conferencing tools such as Zoom and a custom-built application for research administration tasks and improved modes of HRT communication that helped us avoid confounding our performance measures.


2021 ◽  
Author(s):  
Jeonghwan Hwang ◽  
Taeheon Lee ◽  
Honggu Lee ◽  
Seonjeong Byun

BACKGROUND Despite the unprecedented performances of deep learning algorithms in clinical domains, full reviews of algorithmic predictions by human experts remain mandatory. Under these circumstances, artificial intelligence (AI) models are primarily designed as clinical decision support systems (CDSSs). However, from the perspective of clinical practitioners, the lack of clinical interpretability and user-centered interfaces block the adoption of these AI systems in practice. OBJECTIVE The aim of this study was to develop an AI-based CDSS for assisting polysomnographic technicians in reviewing AI-predicted sleep staging results. This study proposed and evaluated a CDSS that provides clinically sound explanations for AI predictions in a user-centered fashion. METHODS User needs for the system were identified during interviews with polysomnographic technicians. User observation sessions were conducted to understand the workflow of the practitioners during sleep scoring. Iterative design process was performed to ensure easy integration of the tool into clinical workflows. Then, we evaluated the system with polysomnographic technicians. We measured the improvements in sleep staging accuracies after adopting our tool and assessed qualitatively how the participants perceived and used the tool. RESULTS The user study revealed that technicians desire explanations relevant to key electroencephalogram (EEG) patterns for sleep staging when assessing the correctness of the AI predictions. Here, technicians could evaluate whether AI models properly locate and use those patterns during prediction. Based on this, information in AI models that is closely related to sleep EEG patterns was formulated and visualized during the iterative design process. Furthermore, we developed a different visualization strategy for each pattern based on the way the technicians interpreted the EEG recordings with these patterns during their workflows. Generally, the tool evaluation results from the nine polysomnographic technicians were positive. Quantitatively, technicians achieved better classification performances after reviewing the AI-generated predictions with the proposed system; classification accuracies measured with Macro-F1 scores improved from 60.20 to 62.71. Qualitatively, participants reported that the provided information from the tool effectively supported them, and they were able to develop notable adoption strategies for the tool. CONCLUSIONS Our findings indicate that formulating clinical explanations for automated predictions using the information in the AI with a user-centered design process is an effective strategy for developing a CDSS for sleep staging.


Author(s):  
Mats Nordlund ◽  
Taesik Lee ◽  
Sang-Gook Kim

In 1977, Nam P Suh proposed a different approach to design research. Suh’s approach was different in that it introduced the notions of domains and layers in a 2-D design thinking and stipulated a set of axioms that describes what is a good design. Following Suh’s 2-D reasoning structure in a zigzagging manner and applying these axioms through the design process should enable the designer to arrive at a good design. In this paper, we present our own experiences in applying Suh’s theories to software design, product design, organizational design, process design, and more in both academic and industrial settings. We also share our experience from teaching the Axiomatic Design theory to students at universities and engineers in industry, and draw conclusions on how best to teach and use this approach, and what results one can expect. The merits of the design axioms are discussed based on the practical experiences that the authors have had in their application. The process developed around the axioms to derive maximum value (solution neutral environment, design domains, what-how relationship, zig-zag process, decomposition, and design matrices) is also discussed and some updates are proposed.


2019 ◽  
Vol 8 (4) ◽  
pp. 195
Author(s):  
Fathi Bashier

This article presents the initial findings of the design research carried out during the last semester by the master of architecture students at Wollega University, Ethiopia. The research goal is the creation of new knowledge to improve the design process. The dissatisfaction with the outcomes of the conventional design approach has led to rising concern and growing awareness of the need to evaluate design outcomes and to learn from the failure. That inadequate understanding of design problems leads frequently to design failure suggests that the evaluation of design outcomes can be made by assessing the way architects develop understanding of design problems, and how they use that understanding for developing knowledge base of the design process. The assumption is that architects’ understanding of design problems can be assessed by examining the way data is used for developing the knowledge base of the design process. The students surveyed the architects’ views in order to produce knowledge, which can be used to develop methods for discovering how inadequate data contributes to miss-informed design decisions; and methods for assessing the architects’ understanding of design problems. In this article the survey findings are analyzed and documented; and, the way the insight drawn from the inquiry can be used in future research for developing design theory, is discussed.Keywords: design outcomes, failure, evaluation, questionnaire, analyze


Sign in / Sign up

Export Citation Format

Share Document