Usability testing of web sites designed for communities of practice: tests of the IEEE Professional Communication Society (PCS) web site combining specialized heuristic evaluation and task-based user testing

Author(s):  
Derek Har ◽  
Daniel Portwood
Author(s):  
Enlie Wang ◽  
Barrett Caldwell

In this study, two different usability-testing methods (Heuristic Evaluation and User Testing) were selected to test the usability of a pre-release version of software searching for Science, Mathematics and Engineering education materials. Our major goal is to compare Heuristic Evaluation and User Testing in terms of efficiency, effectiveness and cost/benefit analysis. We found that Heuristic Evaluation was more efficient than User Testing in finding usability problems (41 vs. 10), while User Testing was more effective than Heuristic Evaluation in finding major problems (70% vs.12%). in general, Heuristic Evaluation appears to be more economic in finding a wide range of usability problems by incurring a low cost in comparison to User Testing. However, User Testing can provide more insightful data from real users such as user's performance and satisfaction.


Respati ◽  
2017 ◽  
Vol 12 (3) ◽  
Author(s):  
Mulia Sulistiyono

INTISASIUsability sebagai ukuran kualitas pengalaman pengguna seringkali dikatakan sebagai suatu nilai penerimaan (acceptance) seseorang terhadap suatu produk ketika berinteraksi dengan sebuah antarmuka. Termasuk situs web, aplikasi perangkat lunak, teknologi bergerak, maupun peralatan-peralatan lain yang dioperasikan oleh pengguna. Kata usability mengacu pada sebuah metode yang digunakan untuk meningkatkan kemudahan penggunaan selama proses desain. Sistem Informasi Pelaporan Kerusakan Laboratorium (SIPKL) berfungsi memberikan segala bentuk informasi kerusakan yang terjadi didalam laboratorium. SIPKL merupakan sistem yang baru digunakan mulai semester genap tahun 2014, banyak sekali tanggapan dari para penggunanya yang terdiri dari : asisten praktikum, dosen praktikum, student staff/teknisi lab, serta laboran sehingga perlu ada evaluasi secara detail untuk mengetahui seberapa mudah website SIPKL digunakan salah satunya dengan analisa usability. Banyak metode yang dapat digunakan untuk mengidentifikasi masalah usability terutama dari sisi interface web. Dalam penelitian ini untuk mengukur aspek usability pada SIPKL dengan metode User Testing by Expert dan Heuristic Evaluation. Semua Atribut yang diteliti dengan evaluasi heuristic menunjukkan bahwa kendali dan kebebasan pengguna (Terdapat tombol bantu saat error, nilai : 1,70)  Fitur Bantuan dan Dokumentasi (terdapat menu help, nilai : 1,50), serta  Fleksibilitas dan Efisiensi (tata letak menu yang familiar, nilai : 2,10) memiliki masalah usability dengan tingkat kepuasan yang rendah dibanding atribut yang lain. sedangkan hasil user testing by expert memberikan rekomendasi pengembangan fungsional konten, stimulus bagi pengguna agar lebih mudah menggunakan website SIPKL..Kata kunci: Usability, Website Interface, Sistem Informasi, Usability Testing, Evaluasi Heuristik ABSTRACTUsability as a measure of the quality of the user experience is often said to be a person's acceptance of a product when interacting with an interface. Includes websites, software applications, mobile technologies, and other equipment operated by the user. The usability word refers to a method used to improve ease of use during the design process. . Sistem Informasi Pelaporan Kerusakan Laboratorium (SIPKL) serves to provide all forms of damage information that occurs in the laboratory. SIPKL is a newly used system from the first semester of 2014, a lot of responses from its users consisting of: lab assistant, practicum lecturer, student staff / lab technician, and laboran so there needs to be detailed evaluation to find out how easy SIPKL website used wrong only with usability analysis. Many methods can be used to identify usability problems especially from the web interface side. In this study to measure aspects of usability on SIPKL with User Testing by Expert method and Heuristic Evaluation. All Attributes studied with a heuristic evaluation show that control and freedom of the user (There are auxiliary buttons when error, value: 1.70) Help and Documentation Feature (there is a help menu, value: 1.50), and Flexibility and Efficiency (menu layout which is familiar, value: 2.10) has usability problems with a lower satisfaction level than other attributes., whereas the result of user testing by expert gives recommendations for the development of functional content, the stimulus for the user to make it easier to use the SIPKL website.Keywords :Usability, Website Interface, Information System, Usability Testing, Heuristik Evaluation 


Author(s):  
Robert S. Owen

This article advocates mouse tracking as an emerging method to include in corporate enterprise portal usability assessment. Issues of Web site usability testing are discussed, with mouse tracking as one method that should be given consideration in assessing enterprise portals. Usability testing is part of the process of assessing how well a machine or application does its job. Efficiency is in turn one component of usability, but is perhaps one of the most important components with regard to Web sites that are designed to serve as corporate enterprise portals. An enterprise portal is an organization’s Website that functions to deliver internal employees or external partners or customers to organizational information, applications, or services.


1992 ◽  
Vol 36 (4) ◽  
pp. 409-413 ◽  
Author(s):  
Robert W. Bailey ◽  
Robert W. Allan ◽  
P. Raiello

The importance of user testing, heuristic evaluation and iterative design in the development of computer software programs was examined. In the first study, twenty-five subjects with limited computer experience, were randomly divided into five groups of five subjects each. All groups were asked to perform a telephone bill inquiry task using two character-based screens. After having one group perform, one change per screen was made before beginning the testing of the next group. The system was improved three times. A final experimental group completed the same task using an “ideal” system designed and presented by Molich and Nielsen (1990). Rather than the 29 changes originally suggested by Molich and Nielsen, our results showed that only one change to each of the original screens was necessary to achieve the same performance and preference levels as those demonstrated by their “ideal” system. The same task was repeated using a graphical user interface. A heuristic evaluation suggested up to 43 potential changes, whereas the usability test demonstrated that only two changes optimized performance. These findings demonstrate one of the major weaknesses of heuristic evaluations, and the importance of usability testing in the design and development of human interfaces.


2003 ◽  
Vol 1 (1) ◽  
pp. 70-86
Author(s):  
Christine Rzepka

One of the top reasons given for use of the internet is the ability to search for health information. However, much of the planning for web-based health information often fails to consider accessibility issues. If health care organizations and community agencies’ web sites have the latest, most wellresearched information on the health topics of the day, it is useless to those who cannot access it because of invisible technological barriers. Many flashy, high-tech sites were designed only to appeal to the needs of the mainstream population, with no consideration given to how people with disabilities must adapt their use of the web in order to access information. This article addresses issues of access specific to web site development, and will explore barriers to accessibility frequently experienced by web users with disabilities, requirements for ADA compliance, and how people with disabilities use the web. Web site accessibility guidelines, as well as simple evaluation tools, will be discussed. A thorough review of the article will enable even the least tech-savvy of health educators to enhance their skills in planning and evaluating web sites to promote access for people with disabilities.


Author(s):  
Petar Halachev ◽  
Aleksandra Todeva ◽  
Gergana Georgieva ◽  
Marina Jekova

he report explores and analyzes the application of the most popular programming languages from different organizations: GitHub; Stackoverflow; the TIOBE's Community index. The main client technologies: HTML; CSS; JavaScript; Typescript are presented and analysed. Features are characterized and the advantages and the disadvantages of the server technologies are described: Java; PHP; Python; Ruby. The application areas for web site development technologies have been defined. The creation of a quality web site is a complex and complicated process, but by observing some guidelines and recommendations in the work process can help to select the tools and the technologies in its design and development.


2017 ◽  
Vol 8 (2) ◽  
pp. 563 ◽  
Author(s):  
Usman Ependi

Heuristic evaluation merupakan salah satu bentuk usability testing perangkat lunak yang dinilai oleh pengguna (evaluator). Dalam melakukan heuristic evaluation instrumen penilaian terdiri dari sepuluh (10) pernyataan dengan lima pilihan jawaban dalam skala severity ratings. Dalam penelitian ini heuristic evaluation terhadap aplikasi Depo Auto 2000 Tanjung Api-Api Palembang yang dilakukan oleh 4 evaluator.  Hasil dari heuristic evaluation dikelompokkan kedalam  masing-masing instrumen yaitu visibility of system status dengan nilai 0,75, match between system and the real world dengan nilai 0,25, user control and freedom dengan nilai 0,25, consistency and standards dengan nilai 0,75, error prevention dengan nilai 1, recognition rather than recall dengan nilai 1,25, flexibility and efficiency of use dengan nilai 0,25, Aesthetic and minimalist design dengan nilai 0,25, help users recognize, diagnose, and recover from errors dengan nilai 1 dan Help and documentation dengan nilai 0. Dari hasil heuristic evaluation yang dilakukan menunjukkan bahwa evaluator memberikan nilai 0 dan 1 aplikasi Depo Atuo 2000 Tanjung Api-Api Palembang. Hasil penilaian tersebut menunjukkan bahwa aplikasi yang buat tidak ada masalah usability dan hanya memiliki cosmetic problem sehingga aplikasi Depo Auto 2000 Tanjung Api Api Palembang  dapat dinyatakan layak untuk didistribusikan kepada pengguna akhir (end user). 


Sign in / Sign up

Export Citation Format

Share Document