Comparison and Extension of Novelty Metrics for Problem-Solving Tasks

Author(s):  
Tyler A. Johnson ◽  
Avery Cheeley ◽  
Benjamin W. Caldwell ◽  
Matthew G. Green

Shah’s metrics for measuring ideation effectiveness have been used extensively by the engineering design community to quantify the value of designed concepts. Shah measures novelty as the infrequency of an idea relative to a set of ideas. Vargas-Hernandez extended this novelty metric using partial genealogy trees to consider the frequency of ideas that share the same working principle. These genealogy trees capture differences between individual ideas organized by the following levels of abstraction: physical principle, working principle, and embodiment. Shah’s and Vargas-Hernandez’s metrics both require that all ideas be described at the lowest level (embodiment). This approach excludes ideas that are described at higher levels of abstraction. This paper proposes a new novelty metric that extends Vargas Hernandez’s metrics by including the higher levels of the genealogy trees, allowing abstract ideas to be properly evaluated. This paper compares the newly proposed novelty metric to Shah’s and Vargas Hernandez’s metrics using data from a previous study. The study required participants to perform problem-solving tasks in which they submitted a textual list of ideas for how to solve general day-to-day problems. The proposed novelty metric addresses limitations of the previous metrics when applied to the abstract ideas in the data set and meets established metric requirements. The proposed metric also broadens Shah’s metric in a similar manner as Vargas Hernandez but extends it to capture the entire genealogy tree rather than a subset of the tree.

Author(s):  
Elizabeth M. Starkey ◽  
Mohammad Alsager Alzayed ◽  
Samuel T. Hunter ◽  
Scarlett R. Miller

Product dissection is a popular educational tool in engineering design due to its ability to help students understand the components and sub-components of a product, provide inspiration for new design ideas, and aid in product redesign. While prior research has investigated how dissecting a product before idea generation impacts the creative output of the ideation session, these studies failed to look at the types of ideas generated before dissection or how the type of product dissected impacts this. In addition, few studies have looked at how creative self-efficacy (CSE), or one’s belief in their creative ability, is influenced by these intervention activities. Thus, the current study was developed to respond to these research voids through an exploratory study with engineering design students. The results of the study suggest that virtual dissection helps students generate a larger variety of ideas after the activity at the physical principle, working principle, and embodiment levels, and that the complexity of the dissected product impacts variation at the embodiment level. In addition, CSE was not affected by the dissection activity. These results strongly support the utilization and implementation of dissection practices in engineering education as a means for aiding students in the expansion of the solution space in the early stages of design. They also bring attention to the need to explore the exact cause-effect relationship between innovation interventions and student confidence gains in their creative abilities.


1999 ◽  
Vol 16 (4) ◽  
pp. 219-225 ◽  
Author(s):  
Don Tustin

AbstractFunctional analysis is used to identify potential reinforcers by generating hypotheses about possible functions of a behaviour. Current methods of functional analysis emphasise observations of events, especially consequences, that occur in the immediate environment of the behaviour. While these methods are well suited for assessing behaviour that is reinforced frequently, they are less appropriate for assessing behaviour that is reinforced only intermittently. A new method for conducting functional analysis is presented that is designed to assess intermittently reinforced behaviour. The new method is illustrated using data that were gathered from an extension of a standard problem-solving format. Data are interpreted using the principle of revealed preference that arose from behavioural economics. The revealed preference method is illustrated using information provided by a client with a dependent personality disorder.


2015 ◽  
Vol 23 (2) ◽  
pp. 115-134 ◽  
Author(s):  
Thomas L. Hogan ◽  
Neil R. Meredith ◽  
Xuhao (Harry) Pan

Purpose – The purpose of this study is to replicate Avery and Berger’s (1991) analysis using data from 2001 through 2011. Although risk-based capital (RBC) regulation is a key component of US banking regulation, empirical evidence of the effectiveness of these regulations has been mixed. Among the first studies of RBC regulation, Avery and Berger (1991) provide evidence from data on US banks that new RBC regulations outperformed old capital regulations from 1982 through 1989. Design/methodology/approach – Using data from the Federal Reserve’s Call Reports, the authors compare banks’ capital ratios and RBC ratios to five measures of bank performance: income, standard deviation of income, non-performing loans, loan charge-offs and probability of failure. Findings – Consistent with Avery and Berger (1991), the authors find banks’ risk-weighted assets to be significant predictors of their future performance and that RBC ratios outperform regular capital ratios as predictors of risk. Originality/value – The study improves on Avery and Berger (1991) by using an updated data set from 2001 through 2011. The authors also discuss some potential limitations of this method of analysis.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ruchi Mittal ◽  
Wasim Ahmed ◽  
Amit Mittal ◽  
Ishan Aggarwal

Purpose Using data from Twitter, the purpose of this paper is to assess the coping behaviour and reactions of social media users in response to the initial days of the COVID-19-related lockdown in different parts of the world. Design/methodology/approach This study follows the quasi-inductive approach which allows the development of pre-categories from other theories before the sampling and coding processes begin, for use in those processes. Data was extracted using relevant keywords from Twitter, and a sample was drawn from the Twitter data set to ensure the data is more manageable from a qualitative research standpoint and that meaningful interpretations can be drawn from the data analysis results. The data analysis is discussed in two parts: extraction and classification of data from Twitter using automated sentiment analysis; and qualitative data analysis of a smaller Twitter data sample. Findings This study found that during the lockdown the majority of users on Twitter shared positive opinions towards the lockdown. The results also found that people are keeping themselves engaged and entertained. Governments around the world have also gained support from Twitter users. This is despite the hardships being faced by citizens. The authors also found a number of users expressing negative sentiments. The results also found that several users on Twitter were fence-sitters and their opinions and emotions could swing either way depending on how the pandemic progresses and what action is taken by governments around the world. Research limitations/implications The authors add to the body of literature that has examined Twitter discussions around H1N1 using in-depth qualitative methods and conspiracy theories around COVID-19. In the long run, the government can help citizens develop routines that help the community adapt to a new dangerous environment – this has very effectively been shown in the context of wildfires in the context of disaster management. In the context of this research, the dominance of the positive themes within tweets is promising for policymakers and governments around the world. However, sentiments may wish to be monitored going forward as large-spikes in negative sentiment may highlight lockdown-fatigue. Social implications The psychology of humans during a pandemic can have a profound impact on how COVID-19 shapes up, and this shall also include how people behave with other people and with the larger environment. Lockdowns are the opposite of what societies strive to achieve, i.e. socializing. Originality/value This study is based on original Twitter data collected during the initial days of the COVID-19-induced lockdown. The topic of “lockdowns” and the “COVID-19” pandemic have not been studied together thus far. This study is highly topical.


2021 ◽  
pp. bjophthalmol-2020-318188
Author(s):  
Shotaro Asano ◽  
Hiroshi Murata ◽  
Yuri Fujino ◽  
Takehiro Yamashita ◽  
Atsuya Miki ◽  
...  

Background/AimTo investigate the clinical validity of the Guided Progression Analysis definition (GPAD) and cluster-based definition (CBD) with the Humphrey Field Analyzer 10-2 test in diagnosing glaucomatous visual field (VF) progression, and to introduce a novel definition with optimised specificity by combining the ‘any-location’ and ‘cluster-based’ approaches (hybrid definition).Methods64 400 stable glaucomatous VFs were simulated from 664 pairs of 10-2 tests (10 sets × 10 VF series × 664 eyes; data set 1). Using these simulated VFs, the specificity to detect progression and the effects of changing the parameters (number of test locations or consecutive VF tests, and percentile cut-off values) were investigated. The hybrid definition was designed as the combination where the specificity was closest to 95.0%. Subsequently, another 5000 actual glaucomatous 10-2 tests from 500 eyes (10 VFs each) were collected (data set 2), and their accuracy (sensitivity, specificity and false positive rate) and the time needed to detect VF progression were evaluated.ResultsThe specificity values calculated using data set 1 with GPAD and CBD were 99.6% and 99.8%. Using data set 2, the hybrid definition had a higher sensitivity than GPAD and CBD, without detriment to the specificity or false positive rate. The hybrid definition also detected progression significantly earlier than GPAD and CBD (at 3.1 years vs 4.2 years and 4.1 years, respectively).ConclusionsGPAD and CBD had specificities of 99.6% and 99.8%, respectively. A novel hybrid definition (with a specificity of 95.5%) had higher sensitivity and enabled earlier detection of progression.


2018 ◽  
Vol 615 ◽  
pp. A145 ◽  
Author(s):  
M. Mol Lous ◽  
E. Weenk ◽  
M. A. Kenworthy ◽  
K. Zwintz ◽  
R. Kuschnig

Context. Transiting exoplanets provide an opportunity for the characterization of their atmospheres, and finding the brightest star in the sky with a transiting planet enables high signal-to-noise ratio observations. The Kepler satellite has detected over 365 multiple transiting exoplanet systems, a large fraction of which have nearly coplanar orbits. If one planet is seen to transit the star, then it is likely that other planets in the system will transit the star too. The bright (V = 3.86) star β Pictoris is a nearby young star with a debris disk and gas giant exoplanet, β Pictoris b, in a multi-decade orbit around it. Both the planet’s orbit and disk are almost edge-on to our line of sight. Aims. We carry out a search for any transiting planets in the β Pictoris system with orbits of less than 30 days that are coplanar with the planet β Pictoris b. Methods. We search for a planetary transit using data from the BRITE-Constellation nanosatellite BRITE-Heweliusz, analyzing the photometry using the Box-Fitting Least Squares Algorithm (BLS). The sensitivity of the method is verified by injection of artificial planetary transit signals using the Bad-Ass Transit Model cAlculatioN (BATMAN) code. Results. No planet was found in the BRITE-Constellation data set. We rule out planets larger than 0.6 RJ for periods of less than 5 days, larger than 0.75 RJ for periods of less than 10 days, and larger than 1.05 RJ for periods of less than 20 days.


2015 ◽  
Vol 21 (7) ◽  
pp. 422-429 ◽  
Author(s):  
Lukas J. Hefty

Applying mathematics during engineering design challenges can help children develop critical thinking, problem solving, and communication skills.


Sign in / Sign up

Export Citation Format

Share Document