scholarly journals QUA³CK - A Machine Learning Development Process

2020 ◽  
Author(s):  
Simon Claus Stock ◽  
Jürgen Becker ◽  
Daniel Grimm ◽  
Tim Hotfilter ◽  
Gabriela Molinar ◽  
...  
Keyword(s):  
Machine Learning ◽  
Development Process ◽  
Learning Development

scholarly journals Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology

2021 ◽  
Vol 3 (2) ◽  
pp. 392-413
Author(s):  
Stefan Studer ◽  
Thanh Binh Bui ◽  
Christian Drescher ◽  
Alexander Hanuschkin ◽  
Ludwig Winkler ◽  
...  
Keyword(s):  
Machine Learning ◽  
Quality Assurance ◽  
Process Model ◽  
Practical Experience ◽  
Special Focus ◽  
Close Monitoring ◽  
Machine Learning Applications ◽  
Project Organizations ◽  
Considerable Impact ◽  
Learning Development

Machine learning is an established and frequently used technique in industry and academia, but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners face manifold challenges and risks when developing machine learning applications and have a need for guidance to meet business expectations. This paper therefore proposes a process model for the development of machine learning applications, covering six phases from defining the scope to maintaining the deployed machine learning application. Business and data understanding are executed simultaneously in the first phase, as both have considerable impact on the feasibility of the project. The next phases are comprised of data preparation, modeling, evaluation, and deployment. Special focus is applied to the last phase, as a model running in changing real-time environments requires close monitoring and maintenance to reduce the risk of performance degradation over time. With each task of the process, this work proposes quality assurance methodology that is suitable to address challenges in machine learning development that are identified in the form of risks. The methodology is drawn from practical experience and scientific literature, and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support, but fails to address machine learning specific tasks. The presented work proposes an industry- and application-neutral process model tailored for machine learning applications with a focus on technical tasks for quality assurance.

Paper2Wire – A Case Study of User-Centred Development of Machine Learning Tools for UX Designers

i-com ◽  
2021 ◽  
Vol 20 (1) ◽  
pp. 19-32
Author(s):  
Daniel Buschek ◽  
Charlotte Anlauff ◽  
Florian Lachner
Keyword(s):  
Machine Learning ◽  
Development Process ◽  
User Study ◽  
Concept Development ◽  
Lessons Learned ◽  
Design Tool ◽  
Learning Tools ◽  
Interface Elements ◽  
Industry Partner

Abstract This paper reflects on a case study of a user-centred concept development process for a Machine Learning (ML) based design tool, conducted at an industry partner. The resulting concept uses ML to match graphical user interface elements in sketches on paper to their digital counterparts to create consistent wireframes. A user study (N=20) with a working prototype shows that this concept is preferred by designers, compared to the previous manual procedure. Reflecting on our process and findings we discuss lessons learned for developing ML tools that respect practitioners’ needs and practices.

Goal-Oriented Machine Learning-Based Component Development Process

2021 ◽  
Author(s):  
Jati H. Husen ◽  
Hnin Thandar Tun ◽  
Nobukazu Yoshioka ◽  
Hironori Washizaki ◽  
Yoshiaki Fukazawa
Keyword(s):  
Machine Learning ◽  
Development Process ◽  
Component Development

scholarly journals A Survey of Domain Knowledge Elicitation in Applied Machine Learning

2021 ◽  
Vol 5 (12) ◽  
pp. 73
Author(s):  
Daniel Kerrigan ◽  
Jessica Hullman ◽  
Enrico Bertini
Keyword(s):  
Machine Learning ◽  
Domain Knowledge ◽  
Development Process ◽  
Model Development ◽  
Knowledge Elicitation ◽  
Future Directions ◽  
Domain Experts ◽  
Applied Machine Learning ◽  
Elicitation Process ◽  
Model Development Process

Eliciting knowledge from domain experts can play an important role throughout the machine learning process, from correctly specifying the task to evaluating model results. However, knowledge elicitation is also fraught with challenges. In this work, we consider why and how machine learning researchers elicit knowledge from experts in the model development process. We develop a taxonomy to characterize elicitation approaches according to the elicitation goal, elicitation target, elicitation process, and use of elicited knowledge. We analyze the elicitation trends observed in 28 papers with this taxonomy and identify opportunities for adding rigor to these elicitation approaches. We suggest future directions for research in elicitation for machine learning by highlighting avenues for further exploration and drawing on what we can learn from elicitation research in other fields.

scholarly journals Unsupervised by any other name: Hidden layers of knowledge production in artificial intelligence on social media

2019 ◽  
Vol 6 (1) ◽  
pp. 205395171881956 ◽  
Author(s):  
Anja Bechmann ◽  
Geoffrey C Bowker
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Knowledge Production ◽  
Classification Theory ◽  
Human Knowledge ◽  
Learning Models ◽  
Work Process ◽  
Learning Development ◽  
High Degree ◽  
Machine Learning Models

Artificial Intelligence (AI) in the form of different machine learning models is applied to Big Data as a way to turn data into valuable knowledge. The rhetoric is that ensuing predictions work well—with a high degree of autonomy and automation. We argue that we need to analyze the process of applying machine learning in depth and highlight at what point human knowledge production takes place in seemingly autonomous work. This article reintroduces classification theory as an important framework for understanding such seemingly invisible knowledge production in the machine learning development and design processes. We suggest a framework for studying such classification closely tied to different steps in the work process and exemplify the framework on two experiments with machine learning applied to Facebook data from one of our labs. By doing so we demonstrate ways in which classification and potential discrimination take place in even seemingly unsupervised and autonomous models. Moving away from concepts of non-supervision and autonomy enable us to understand the underlying classificatory dispositifs in the work process and that this form of analysis constitutes a first step towards governance of artificial intelligence.

Review and Applications of Machine Learning and Artificial Intelligence in Engineering

2020 ◽  
pp. 1-12
Author(s):  
Melda Yucel ◽  
Gebrail Bekdaş ◽  
Sinan Melih Nigdeli
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Machine Learning ◽  
Artificial Neural Network ◽  
Development Process ◽  
Current Trend ◽  
Engineering Applications ◽  
The Past ◽  
Applications Of Machine Learning ◽  
Basic Features

This chapter presents a summary review of development of Artificial Intelligence (AI). Definitions of AI are given with basic features. The development process of AI and machine learning is presented. The developments of applications from the past to today are mentioned and use of AI in different categories is given. Prediction applications using artificial neural network are given for engineering applications. Usage of AI methods to predict optimum results is the current trend and it will be more important in the future.

scholarly journals From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices

2019 ◽  
Vol 26 (4) ◽  
pp. 2141-2168 ◽  
Author(s):  
Jessica Morley ◽  
Luciano Floridi ◽  
Libby Kinsey ◽  
Anat Elhalal
Keyword(s):  
Machine Learning ◽  
New York ◽  
Future Research ◽  
Ethical Implications ◽  
Ethical Debate ◽  
Ai Ethics ◽  
Development Pipeline ◽  
Closing The Gap ◽  
Learning Development ◽  
The 1960S

AbstractThe debate about the ethical implications of Artificial Intelligence dates from the 1960s (Samuel in Science, 132(3429):741–742, 1960. 10.1126/science.132.3429.741; Wiener in Cybernetics: or control and communication in the animal and the machine, MIT Press, New York, 1961). However, in recent years symbolic AI has been complemented and sometimes replaced by (Deep) Neural Networks and Machine Learning (ML) techniques. This has vastly increased its potential utility and impact on society, with the consequence that the ethical debate has gone mainstream. Such a debate has primarily focused on principles—the ‘what’ of AI ethics (beneficence, non-maleficence, autonomy, justice and explicability)—rather than on practices, the ‘how.’ Awareness of the potential issues is increasing at a fast rate, but the AI community’s ability to take action to mitigate the associated risks is still at its infancy. Our intention in presenting this research is to contribute to closing the gap between principles and practices by constructing a typology that may help practically-minded developers apply ethics at each stage of the Machine Learning development pipeline, and to signal to researchers where further work is needed. The focus is exclusively on Machine Learning, but it is hoped that the results of this research may be easily applicable to other branches of AI. The article outlines the research method for creating this typology, the initial findings, and provides a summary of future research needs.

scholarly journals Federated Learning: A Distributed Shared Machine Learning Method

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-20
Author(s):  
Kai Hu ◽  
Yaogen Li ◽  
Min Xia ◽  
Jiasheng Wu ◽  
Meixia Lu ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Development Process ◽  
Machine Learning Algorithms ◽  
Process Definition ◽  
Future Developments ◽  
Private Data ◽  
Multiple Clients ◽  
Distributed Machine Learning

Federated learning (FL) is a distributed machine learning (ML) framework. In FL, multiple clients collaborate to solve traditional distributed ML problems under the coordination of the central server without sharing their local private data with others. This paper mainly sorts out FLs based on machine learning and deep learning. First of all, this paper introduces the development process, definition, architecture, and classification of FL and explains the concept of FL by comparing it with traditional distributed learning. Then, it describes typical problems of FL that need to be solved. On the basis of classical FL algorithms, several federated machine learning algorithms are briefly introduced, with emphasis on deep learning and classification and comparisons of those algorithms are carried out. Finally, this paper discusses possible future developments of FL based on deep learning.

Sign in / Sign up

Export Citation Format

Share Document