Implementing Creativity Evaluation Tools Into the Concept Selection Process in Engineering Education

Author(s):  
Elizabeth M. Starkey ◽  
Christopher A. Gosnell ◽  
Scarlett R. Miller

In design research, creativity assessment methods have been studied to obtain quantitative measurements of design novelty and feasibility for use in the concept selection process. However, little research exists that studies the application and implementation of these tools by engineering students on grade-dependent class projects. In this study, teams of undergraduate engineering design students evaluated their own early product sketches using informal team discussions, a creativity scale and our Tool for Assessing Semantic Creativity (TASC) adjective selection method. The resulting evaluations were compared and contrasted with evaluations obtained from the widely adopted Shah Vargas-Hernandez and Smith (SVS) method and expert ratings. These findings demonstrate that our TASC adjective selection method of evaluating design creativity is tapping into similar constructs of creativity as informal team discussions and expert evaluations. They also indicate that the SVS method does not appear to be evaluating creativity as perceived by engineering design students or experts. The results of this study can be used to understand how students make decisions during the concept selection process and how tools can be developed or implemented in the classroom setting to aid in this process.

Author(s):  
Christine A. Toh ◽  
Scarlett R. Miller

While creativity is often seen as an indispensable quality of engineering design, individuals often select conventional or previously successful options during the concept selection process due to the inherent risk associated with creative concepts. Surprisingly, prior research has shown that this preference for conventional design alternatives is often done in an unconscious manner and is attributed to people’s inadvertent bias against creativity. While we know that designers may prematurely filter out creative ideas, little is actually known about what factors attribute to the promotion or filtering of these creative concepts during concept selection. The current paper describes an empirical study conducted with 19 first-year engineering students aimed at investigating the impact of individual risk aversion and ambiguity aversion on the selection and filtering of creative ideas during the concept selection process. The results from this study indicate that individual risk attitudes are related to both creative ability and creative concept selection. However, an individual’s ability to generate creative ideas was found to be unrelated to their preference for creative ideas during concept selection. These results add to our understanding of creativity during concept selection and provide guidelines for enhancing the design process to encourage design creativity.


Author(s):  
Christine A. Toh ◽  
Arti H. Patel ◽  
Andrew A. Strohmetz ◽  
Scarlett R. Miller

Concept selection is considered one of the most crucial components of the engineering design process because the direction of the final design is largely determined at this stage. One of the most widely utilized techniques for filtering designs during this process involves informal review meetings where team members identify the designs that most closely satisfy the design goals. While this is often seen as an efficient process, factors such as ownership bias, or an unintentional preference for an individuals’ own ideas, and team member personality attributes may impact an individual’s decision-making process. However, few studies have explored the impact of these factors on concept selection. Therefore, an empirical study was conducted with 37 engineering students in order to investigate the effect of these attributes on the selection or filtering of design concepts in engineering education. The results from this study show that personality impacts the proportion of ideas selected, and that male students tend to select more of their own ideas (ownership bias) than their female counterparts who more often select their team member’s concepts. These results add to our understanding of the factors that impact the team concept selection process and provide empirical evidence of the occurrence of ownership bias in engineering design education.


2016 ◽  
Vol 138 (10) ◽  
Author(s):  
Christine A. Toh ◽  
Andrew A. Strohmetz ◽  
Scarlett R. Miller

Concept selection is a critical stage of the engineering design process because of its potential to influence the direction of the final design. While formalized selection methods have been developed to increase its effectiveness and reduce human decision-making biases, research that understands these biases in more detail can provide a foundation for improving the selection process. One important bias that occurs during this process is ownership bias or an unintentional preference for an individual's own ideas over the ideas of others. However, few studies have explored ownership bias in a design setting and the influence of other factors such as the gender of the designer or the “goodness” of an idea. In order to understand the impact of these factors in engineering design education, a study was conducted with 110 engineering students. The results from this study show that male students tend to show ownership bias during concept selection by selecting more of their own ideas while female students tend to show the opposite bias, the Halo Effect, by selecting more of their team members' concepts. In addition, participants exhibited ownership bias for ideas that were considered good or high quality, but the opposite bias for ideas that were not considered good or high quality. These results add to our understanding of the factors that impact team concept selection and provide empirical evidence of the occurrence of ownership bias and the effects of gender and idea goodness in engineering design education.


2021 ◽  
pp. 1-18
Author(s):  
Natalie M. Sisson ◽  
Emily Impett ◽  
L.H. Shu

Abstract Urgent societal problems, including climate change, require innovation and can benefit from interdisciplinary solutions. A small body of research has demonstrated the potential of positive emotions (e.g., gratitude, awe) to promote creativity and prosocial behavior, which may help address these problems. This study integrates, for the first time, psychology research on a positive and prosocial emotion (i.e., gratitude) with engineering-design creativity research. In a pre-registered study design, engineering students and working engineers (pilot N = 49; full study N = 329) completed gratitude, positive-emotion control, or neutral-control inductions. Design creativity was assessed through rater scores of responses to an Alternate Uses Task (AUT) and a Wind-Turbine-Blade Repurposing Task (WRT). No significant differences among AUT scores emerged across conditions in either sample. While only the pilot-study manipulation of gratitude was successful, WRT results warrant further studies on the effect of gratitude on engineering-design creativity. The reported work may also inform other strategies to incorporate prosocial emotion to help engineers arrive at more original and effective concepts to tackle environmental sustainability, and in the future, other problems facing society.


2021 ◽  
Author(s):  
Natalie M. Sisson ◽  
Emily A. Impett ◽  
L. H. Shu

Abstract Urgent societal problems, including climate change, require innovation, and can benefit from interdisciplinary solutions. A small body of research has demonstrated the potential of positive emotions (e.g., gratitude, awe) to promote creativity and prosocial behavior, which may help address these problems. This study integrates, for the first time, psychology research on a positive and prosocial emotion (i.e., gratitude) with engineering-design creativity research. In a pre-registered study design, engineering students and working engineers (pilot N = 49; full study N = 329) completed gratitude, positive-emotion control, or neutral-control inductions. Design creativity was assessed through rater scores of responses to an Alternate Uses Task (AUT) and a Wind-Turbine-Blade Repurposing Task (WRT). No significant differences among AUT scores emerged across conditions in either sample. While only the pilot-study manipulation of gratitude was successful, WRT results warrant further studies on the effect of gratitude on engineering-design creativity. The reported work may also inform other strategies to incorporate prosocial emotion to help engineers arrive at more original and effective concepts to tackle environmental sustainability, and in the future, other problems facing society.


Author(s):  
Scott A.C. Flemming ◽  
Clifton R. Johnston

In previous work [1] it was argued that turning attention from the act of problem solving to the act of problem defining has several benefits for engineering students and practitioners alike. Such benefits include developing and refining student’s empathy and critical thinking skills inside the engineering discipline. The practical question then becomes how to teach and practice the process of defining the problem well. The following paper is a literature review of the current state of problem definition within engineering design research and how problem diagnosis can be taught and practiced by engineers. Two significant insights emerge from this review: (1) traditional engineering design literature does not suggest processes for defining problems; and (2) the authors consider "Contextual Inquiry" the most promising tool for problem diagnosis from an Industrial Engineering perspective.


Author(s):  
Farrah Fayyaz

There is a growing trend in engineering education to increase the societal awareness among theengineering graduates, so that the engineering solutions proposed by the engineers are more sustainable. To achieve this, one of the efforts in Concordia University is to ask capstone students to discuss and implement (wherever possible) ethical, legal, social, environmental, and entrepreneurial aspects of their capstone design. Students are given two lectures during the capstone year which provides them with prompts to identify and think beyond their personal biases and perceptions of the society. At the end of the term, each capstone team is asked to define engineering failure. The aim for this is for graduating students to have a well thought of idea of the engineering design failure before they enter the workplace. This article explains the two phases (lectures) of the capstone lectures related to the ethical, legal, societal, environmental, and entrepreneurial aspects of an engineering design. Additionally, the article aims to analyze the definitions of engineering failure submitted by the engineering students at the end of the capstone year to identify keywords and terms that the graduating engineering students attribute to success and failure of an engineering design. The objective of the paper is to open the discussion among engineering educators for incorporating ideas in their courses that can improve engineering students’ understanding of a sustainable design and assess the success of these strategies.


Author(s):  
Scarlett R. Miller ◽  
Samuel T. Hunter ◽  
Elizabeth Starkey ◽  
Sharath Ramachandran ◽  
Faez Ahmed ◽  
...  

Abstract Design researchers have long sought to understand the mechanisms that support creative idea development. However, one of the key challenges faced by the design community is how to effectively measure the nebulous construct of creativity. The social science and engineering communities have adopted two vastly different approaches to solving this problem, both of which have been deployed throughout engineering design research. The goal of this paper was to compare and contrast these two approaches using design ratings of nearly 1000 engineering design ideas paired with a qualitative study with expert raters. The results of this study identify that while these two methods provide similar ratings of idea quality, there was a statistically significant negative relationship between these methods for ratings of idea novelty. Qualitative analysis of recordings from expert raters’ think aloud concept mapping points to potential sources of disagreement. In addition, the results show that while quasi-expert and expert raters provided similar ratings of design novelty, there was not significant agreement between these groups for ratings of design quality. The results of this study provide guidance for the deployment of idea ratings in engineering design research and evidence for the development and potential modification of engineering design creativity metrics.


2017 ◽  
Vol 139 (7) ◽  
Author(s):  
Ferris M. Pfeiffer ◽  
Rachel E. Bauer ◽  
Steve Borgelt ◽  
Suzanne Burgoyne ◽  
Sheila Grant ◽  
...  

The creative process is fun, complex, and sometimes frustrating, but it is critical to the future of our nation and progress in science, technology, engineering, mathematics (STEM), as well as other fields. Thus, we set out to see if implementing methods of active learning typical to the theater department could impact the creativity of senior capstone design students in the bioengineering (BE) department. Senior bioengineering capstone design students were allowed to self-select into groups. Prior to the beginning of coursework, all students completed a validated survey measuring engineering design self-efficacy. The control and experimental groups both received standard instruction, but in addition the experimental group received 1 h per week of creativity training developed by a theater professor. Following the semester, the students again completed the self-efficacy survey. The surveys were examined to identify differences in the initial and final self-efficacy in the experimental and control groups over the course of the semester. An analysis of variance was used to compare the experimental and control groups with p < 0.05 considered significant. Students in the experimental group reported more than a twofold (4.8 (C) versus 10.9 (E)) increase of confidence. Additionally, students in the experimental group were more motivated and less anxious when engaging in engineering design following the semester of creativity instruction. The results of this pilot study indicate that there is a significant potential to improve engineering students' creative self-efficacy through the implementation of a “curriculum of creativity” which is developed using theater methods.


2021 ◽  
Vol 1 ◽  
pp. 2157-2166
Author(s):  
John Clay ◽  
Xingang Li ◽  
Molla Hafizur Rahman ◽  
Darya Zabelina ◽  
Charles Xie ◽  
...  

AbstractThere are three approaches to studying designers – through their cognitive profile, design behaviors, and design artifacts (e.g., quality). However, past work has rarely considered all three data domains together. Here we introduce and describe a framework for a comprehensive approach to engineering design, and discuss how the insights may benefit engineering design research and education. To demonstrate the proposed framework, we conducted an empirical study with a solar energy system design problem. Forty-six engineering students engaged in a week-long computer-aided design challenge that assessed their design behavior and artifacts, and completed a set of psychological tests to measure cognitive competencies. Using a machine learning approach consisting of k-means, hierarchical, and spectral clustering, designers were grouped by similarities on the psychological tests. Significant differences were revealed between designer groups in their sequential design behavior, suggesting that a designer's cognitive profile is related to how they engage in the design process.


Sign in / Sign up

Export Citation Format

Share Document