scholarly journals Improving Workgroup Assessment with WebAVALIA: The Concept, Framework and First Results

10.28945/4627 ◽  
2020 ◽  
Vol 19 ◽  
pp. 157-184
Author(s):  
Rosalina Babo ◽  
Jarkko T Suhonen ◽  
Markku Tukiainen

Aim/Purpose: The purpose of this study is to develop an efficient methodology that can assist the evaluators in assessing a variable number of individuals that are working in groups and guarantee that the assessment is dependent on the group members’ performance and contribution to the work developed. Background: Collaborative work has been gaining more popularity in academic settings. However, group assessment needs to be performed according to each individual’s performance. The problem rests on the need to distinguish each member of the group in order to provide fair and unbiased assessments. Methodology: Design Science Research methodology supported the design of a framework able to provide the evaluator with the means to distinguish individuals in a workgroup and deliver fair results. Hevner’s DSR guidelines were fulfilled in order to describe WebAVALIA. To evaluate the framework, a quantitative study was performed and the first results are presented. Contribution: This paper provides a methodological solution regarding a fair evaluation of collaborative work through a tool that allows its users to perform their own assessment and peer assessment. These are made accordingly to the user’s perspectives on the performance of each group member throughout the work development. Findings: The first analysis of the results indicates that the developed method provides fairness in the assessment of group members, delivering a distinction amongst individuals. Therefore, each group member obtains a mark that corresponds to their specific contribution to the workgroup. Recommendations for Practitioners: For those who intend to apply this workgroup assessment method, it is relevant to raise student awareness about the methodology that is going to be used. That is, all the functionalities and steps in WebAVALIA have to be thoroughly explained before beginning of the project. Then, the evaluators have to decide about the students’ intermediate voting, namely if the evaluator chooses or not to publish student results throughout the project’s development. If there is the decision to display these intermediate results, the evaluator must try to encourage collaboration among workgroup members, instead of competition. Recommendation for Researchers: This study explores the design and development of an e-assessment tool – WebAVALIA. In order to assess its feasibility, its use in other institutions or contexts is recommended. The gathering of user opinions is suggested as well. It would then be interesting to compare the findings of this study with the results from other experimentations Impact on Society: Sometimes, people develop a rejection of collaborative work because they feel exploited due to the biased evaluation results. However, the group members assessment distinction, according to each one’s performance, may give each individual a sense of fairness and reward, leading to an openness/willingness towards collaborative work. Future Research: As future work, there are plans to implement the method in other group assessment contexts – such as sports and business environments, other higher education institutions, technical training students – in other cultures and countries. From this myriad of contexts, satisfaction results would be compared. Other future plans are to further explore the mathematical formulations and the respective WebAVALIA supporting algorithms.

Author(s):  
Norman Schaffer ◽  
Martin Engert ◽  
Girts Leontjevs ◽  
Helmut Krcmar

Software tools hold great promise to support the modeling, analyzing, and innovation of business models. Current tools only focus on the design of business models and do not incorporate the complexity of existing interdependencies between business model components. These tools merely allow simulating inherent dynamics within the models or different strategic decision scenarios. In this research, we use design science research to develop a prototype that is capable of modeling and simulating dynamic business models. We use system dynamics as a simulation approach and containers to allow deployment as web applications. This paper represents the first of three design cycles, realizing six out of 59 requirements that are collected from the literature on software tools for business models. We contribute toward the design of novel artifacts for business model innovation as well as their evaluation. Future research can use these results to build tools that consider and address the complexity of business models. Lastly, we present several options for extending the proposed tool in the future.


10.28945/3984 ◽  
2018 ◽  

Aim/Purpose: [This Proceedings paper was revised and published in the 2018 issue of the journal Issues in Informing Science and Information Technology, Volume 15] The proposed Personal Knowledge Management (PKM) for Empowerment (PKM4E) Framework expands on the notions of the Ignorance Map and Matrix for further supporting the educational concept of a PKM system-in-progress. Background: The accelerating information abundance is depleting the very attention our cognitive capabilities are able to master, one key cause of individual and collective opportunity divides. Support is urgently needed to benefit Knowledge Workers independent of space (developed/developing countries), time (study or career phase), discipline (natural or social science), or role (student, professional, leader). Methodology: The Design Science Research (DSR) project introducing the novel PKM System (PKMS) aims to support a scenario of a ‘Decentralizing KM Revolution’ giving more power and autonomy to individuals and self-organized groups. Contribution: The portrayal of potential better solutions cannot be accommodated by one-dimensional linear text alone but necessitates the utilization of visuals, charts, and blueprints for the concept as well as the use of colors, icons, and catchy acronyms to successfully inform a diverse portfolio of audiences and potential beneficiaries. Findings: see Recommendation for Researchers Recommendations for Practitioners: The PKM4E learning cycles and workflows apply ‘cumulative synthesis’, a concept which convincingly couples the activities of researchers and entrepreneurs, and assists users to advance their capability endowments via applied learning. Recommendation for Researchers: In substituting document-centric with meme-based knowledge bases, the PKMS approach merges distinctive voluntarily shared knowledge objects/assets of diverse disciplines into a single unified digital knowledge repository and provides the means for advancing current metrics and reputation systems. Impact on Society: The PKMS features provide the means to tackle the widening opportunity divides by affording knowledge workers with continuous life-long support from trainee, student, novice, or mentee towards professional, expert, mentor, or leader. Future Research: After completing the test phase of the PKMS prototype, its transformation into a viable PKM system and cloud-based server based on a rapid development platform and a noSQL-database is estimated to take 12 months.


Author(s):  
Michael Voskoglou

A Fuzzy Number (FN) is a special kind of FS on the set R of real numbers. The four classical arithmetic operations can be defined on FNs, which play an important role in fuzzy mathematics analogous to the role played by the ordinary numbers in crisp mathematics (Kaufmann & Gupta, 1991). The simplest form of FNs is the Triangular FNs (TFNs), while the Trapezoidal FNs (TpFNs) are straightforward generalizations of the TFNs. In the present work a combination of the COG defuzzification technique and of the TFNs (or TpFNs) is used as an assessment tool. Examples of assessing student problem-solving abilities and basket-ball player skills are also presented illustrating in practice the results obtained. This new fuzzy assessment method is validated by comparing its outcomes in the above examples with the corresponding outcomes of two commonly used assessment methods of the traditional logic, the calculation of the mean values and of the Grade Point Average (GPA) index. Finally, the perspectives of future research on the subject are discussed.


Author(s):  
Kazuhiro Muramatsu ◽  
Sonam Wangmo

Design education is important at technical universities and colleges. In general, real product design requires collaborative work. In this chapter, the authors discuss collaborative design education. An A360 cloud platform on Autodesk's 3D computer-aided design “AutoCAD” is adopted to illustrate a collaborative design activity implemented in the Engineering Graphics class offered at the College of Science and Technology, Royal University of Bhutan. By using A360 cloud, students can share a 3D model with group members. Based on feedback received, students can modify the initial model, share it, print, and discuss the modified object with members. This collaborative work allows students to create enhanced 3D design objects while engaged in discussions and interactions. The authors also discuss some difficulties encountered during the collaborative process and offer recommendations and future research ideas.


Author(s):  
Michael Voskoglou

A fuzzy number (FN) is a special kind of FS on the set R of real numbers. The four classical arithmetic operations can be defined on FNs, which play an important role in fuzzy mathematics analogous to the role played by the ordinary numbers in crisp mathematics. The simplest form of FNs is the triangular FNs (TFNs), while the trapezoidal FNs (TpFNs) are straightforward generalizations of the TFNs. In the chapter, a combination of the COG defuzzification technique and of the TFNs (or TpFNs) is used as an assessment tool. Examples of assessing student problem-solving abilities and basketball player skills are also presented illustrating in practice the results obtained. This new fuzzy assessment method is validated by comparing its outcomes in the above examples with the corresponding outcomes of two commonly used assessment methods of the traditional logic, the calculation of the mean values, and of the grade point average (GPA) index. Finally, the perspectives of future research on the subject are discussed.


10.2196/13585 ◽  
2019 ◽  
Vol 21 (10) ◽  
pp. e13585 ◽  
Author(s):  
Jan Heinrich Beinke ◽  
Christian Fitte ◽  
Frank Teuteberg

Background Data security issues still constitute the main reason for the sluggish dissemination of electronic health records (EHRs). Given that blockchain technology offers the possibility to verify transactions through a decentralized network, it may serve as a solution to secure health-related data. Therefore, we have identified stakeholder-specific requirements and propose a blockchain-based architecture for EHRs, while referring to the already existing scientific discussions on the potential of blockchain for use in EHRs. Objective This study aimed to introduce blockchain technology for EHRs, based on identifying stakeholders and systematically eliciting their requirements, and to discuss the key benefits (KBs) and key challenges (KCs) of blockchain technology in the context of EHRs. Methods The blockchain-based architecture was developed in the framework of the design science research paradigm. The requirements were identified using a structured literature review and interviews with nine health care experts. Subsequently, the proposed architecture was evaluated using 4 workshops with 15 participants. Results We identified three major EHR stakeholder groups and 34 respective requirements. On this basis, we developed a five-layer architecture. The subsequent evaluation of the artifact was followed by the discussion of 12 KBs and 12 KCs of a blockchain-based architecture for EHRs. To address the KCs, we derived five recommendations for action for science and practice. Conclusions Our findings indicate that blockchain technology offers considerable potential to advance EHRs. Improvements to currently available EHR solutions are expected, for instance, in the areas of data security, traceability, and automation by smart contracts. Future research could examine the patient’s acceptance of blockchain-based EHRs and cost-benefit analyses.


2019 ◽  
Author(s):  
Jan Heinrich Beinke ◽  
Christian Fitte ◽  
Frank Teuteberg

BACKGROUND Data security issues still constitute the main reason for the sluggish dissemination of electronic health records (EHRs). Given that blockchain technology offers the possibility to verify transactions through a decentralized network, it may serve as a solution to secure health-related data. Therefore, we have identified stakeholder-specific requirements and propose a blockchain-based architecture for EHRs, while referring to the already existing scientific discussions on the potential of blockchain for use in EHRs. OBJECTIVE This study aimed to introduce blockchain technology for EHRs, based on identifying stakeholders and systematically eliciting their requirements, and to discuss the key benefits (KBs) and key challenges (KCs) of blockchain technology in the context of EHRs. METHODS The blockchain-based architecture was developed in the framework of the design science research paradigm. The requirements were identified using a structured literature review and interviews with nine health care experts. Subsequently, the proposed architecture was evaluated using 4 workshops with 15 participants. RESULTS We identified three major EHR stakeholder groups and 34 respective requirements. On this basis, we developed a five-layer architecture. The subsequent evaluation of the artifact was followed by the discussion of 12 KBs and 12 KCs of a blockchain-based architecture for EHRs. To address the KCs, we derived five recommendations for action for science and practice. CONCLUSIONS Our findings indicate that blockchain technology offers considerable potential to advance EHRs. Improvements to currently available EHR solutions are expected, for instance, in the areas of data security, traceability, and automation by smart contracts. Future research could examine the patient’s acceptance of blockchain-based EHRs and cost-benefit analyses.


10.28945/2143 ◽  
2015 ◽  
Author(s):  
Andreas Drechsler

This paper identifies areas in the design science research (DSR) subfield of the information systems (IS) discipline where a more detailed consideration of practitioner audiences of socio-technical design artifacts could improve current IS DSR research practice and proposes an initial conceptualization of these audiences. The consequences of not considering artifact audiences are identified through a critical appraisal of the current informing science lenses in the IS DSR literature. There are specific shortcomings in four areas: 1) treating practice stakeholders as a too homogeneous group, 2) not explicitly distinguishing between social and technical parts of socio-technical artifacts, 3) neglecting implications of the artifact abstraction level, and 4) a lack of explicit consideration of a dynamic or evolutionary fitness perspective of socio-technical artifacts. The findings not only pave the way for future research to further improve the conceptualization of artifact audiences, in order to improve the informing power – and thus, impact on practice and research relevance – of IS DSR projects; they can also help to bridge the theory-practice gap in other disciplines (e.g. computer science, engineering, or policy-oriented sociology) that seek to produce social and/or technical artifacts of practical relevance. A revised version of this paper was published in Informing Science: the International Journal of an Emerging Transdiscipline, Volume 18, 2015


Author(s):  
Jose O De Sordi ◽  
Marcia Azevedo ◽  
Manuel Meireles ◽  
Luis Hernan Contreras Pinochet ◽  
Carlos Francisco Bitencourt Jorge

Aim/Purpose: To discuss the Design Science Research approach by comparing some of its canons with observed practices in projects in which it is applied, in order to understand and structure it better. Background: Recent criticisms of the application of the Design Science Research (DSR) approach have pointed out the need to make it more approachable and less confusing to overcome deficiencies such as the unrealistic evaluation. Methodology: We identified and analyzed 92 articles that presented artifacts developed from DSR projects and another 60 articles with preceding or subsequent actions associated with these 92 projects. We applied the content analysis technique to these 152 articles, enabling the preparation of network diagrams and an analysis of the longitudinal evolution of these projects in terms of activities performed and the types of artifacts involved. Contribution: The content analysis of these 152 articles enabled the preparation of network diagrams and an analysis of the longitudinal evolution of these projects in terms of the activities and types of artifacts involved. Evidence was found of a precedence hierarchy among different types of artifacts, as well as nine new opportunities for entry points for the continuity of DSR studies. Only 14% of the DSR artifacts underwent an evaluation by typical end users, characterizing a tenth type of entry point. Regarding the evaluation process, four aspects were identified, which demonstrated that 86% of DSR artifact evaluations are unrealistic. Findings: We identified and defined a set of attributes that allows a better characterization and structuring of the artifact evaluation process. Analyzing the field data, we inferred a precedence hierarchy for different artifacts types, as well as nine new opportunities for entry points for the continuity of DSR studies. Recommendation for Researchers: The four attributes identified for analyzing evaluation processes serve as guidelines for practitioners and researchers to achieve a realistic evaluation of artifacts. Future Research: The nine new entry points identified serve as an inspiration for researchers to give continuity to DSR projects.


10.28945/4083 ◽  
2018 ◽  
Vol 13 ◽  
pp. 137-163 ◽  
Author(s):  
João Aguiar ◽  
Ruben Pereira ◽  
José Braga Vasconcelos ◽  
Isaias Bianchi

Aim/Purpose: This research aims to develop an information technology (IT) maturity model for incident management (IM) process that merges the most known IT frameworks’ practices. Our proposal intends to help organizations overcome the current limitations of multiframework implementation by informing organizations about frameworks’ overlap before their implementation. Background: By previously identifying frameworks’ overlaps it will assist organizations during the multi-framework implementation in order to save resources (human and/or financial). Methodology: The research methodology used is design science research (DSR). Plus, the authors applied semi-structured interviews in seven different organizations to demonstrate and evaluate the proposal. Contribution: This research adds a new and innovative artefact to the body of knowledge. Findings: The proposed maturity model is seen by the practitioners as complete and useful. Plus, this research also reinforces the frameworks’ overlap issue and concludes that some organizations are unaware of their actual IM maturity level; some organizations are unaware that they have implemented practices of other frameworks besides the one that was officially adopted. Recommendations for Practitioners: Practitioners may use this maturity model to assess their IM maturity level before multi-framework implementation. Moreover, practitioners are also incentivized to communicate further requirements to academics regarding multi-framework assessment maturity models. Recommendation for Researchers: Researchers may explore and develop multi-frameworks maturity models for the remaining processes of the main IT frameworks. Impact on Society: This research findings and outcomes are a step forward in the development of a unique overlapless maturity model covering the most known IT frameworks in the market thus helping organizations dealing with the increasing frameworks’ complexity and overlap. Future Research: Overlapless maturity models for the remaining IT framework processes should be explored.


Sign in / Sign up

Export Citation Format

Share Document