scholarly journals Methodological Diversity in the Evaluation of Cultural Heritage Digital Libraries and Archives: Approaches, Frameworks, and Methods

Author(s):  
Ali Shiri ◽  
Emily Villanueva

Digital library evaluation has become increasingly important in information science, yet there has been minimal evaluative work focusing on digital cultural heritage. This article reports on a comprehensive review of methodologies, frameworks and techniques used in the evaluation of cultural heritage digital libraries and archives. Empirical studies are examined using Saracevic’s digital library evaluation framework to identify models, frameworks, and methodologies in the literature and to categorize these past evaluative approaches. Through the classification of evaluative types and trends, we aim to develop a set of guidelines and recommendations for the future evaluation of cultural heritage digital libraries and archives. L'évaluation des bibliothèques numériques est devenue de plus en plus importante en sciences de l'information, mais très peu de travaux d'évaluation ont été axés sur le patrmoine culturel numérique jusqu'à présent. Cet article rend compte d'une revue complet des méthodologies, cadres de références et des techniques utilisés dans l'évaluation des bibliothèques et archives numériques du patrimoine culturel. Les études empiriques sont examinées à l'aide du cadre d'évaluation des bibliothèques numériques de Saracevic pour identifier les modèles, cadres et méthodologie dans la littérature et pour catégoriser ces anciennes approches évaluatives. À travers la classification des types d'évaluation et des tendances, nous visons à développer un ensemble de lignes directrices et de recommandation pour l'évaluation future des bibliothèques et archivers numériques du patrimoine culturel.

2015 ◽  
Vol 116 (3/4) ◽  
pp. 122-135 ◽  
Author(s):  
Dan Albertson

Purpose – The purpose of this study is to synthesize prior user-centered research to develop and present a generalized framework for evaluating visual, i.e. both image and video digital libraries. The primary objectives include comprehensively examining the current state of visual digital library research to: develop a generalized framework applicable for designing user-centered evaluations of visual digital libraries; identify influential experimental factors warranting assessment evaluation as part of specific contexts; and provide examples of applied methods that have been used in research, demonstrating notable findings. Design/methodology/approach – The framework presented in the present study depicts a set of user-centered methodological considerations and examples, synthesized from a review of prior research that provides significant understanding of users and uses of visual information. Findings – Primary components for digital library evaluation, pertaining to user, interaction, system and domain and topic, and their implications for interactive research are presented. Methods, examples and discussion are presented for each primary evaluation component of the framework. Practical implications – Previously applied evaluations and their significance are described and presented as part of the developed framework, providing the importance of each component for practical application in future research and development of interactive visual digital libraries. Originality/value – Visual digital libraries warrant individual assessment, apart from other types of digital collections, as they offer users more ways to retrieve and interact with collection items. The present study complements prior digital library evaluation research by demonstrating the need for a separate framework due to variations influenced by visual information and reporting on evaluations from different perspectives.


ABI-Technik ◽  
2018 ◽  
Vol 38 (1) ◽  
pp. 37-45 ◽  
Author(s):  
Juliane Stiller ◽  
Vivien Petras

AbstractIn this paper we analyse evaluation studies of the Europeana digital library from its launch in 2009 until today. Using Saracevic’s digital library evaluation framework, the studies are categorised by their constructs, contexts, criteria, and methodologies. Concentrating on studies that evaluate Europeana services or single components, we show gaps in the evaluation of certain Europeana aspects. Finally, we derive strategies for building an evaluation archive that serves as memory and supports comparisons.


Author(s):  
Kijpokin Kasemsap

This chapter gives an overview of digital library topics: digital libraries and information architecture; digital libraries and electronic learning (e-learning); digital libraries and the Semantic Web; digital library evaluation; digital libraries and service quality; and the significance of digital libraries in the digital age. The Internet and the World Wide Web provide the impetus and technological environment for the development and operation of digital libraries in the digital age. Digital libraries comprise digital collections, services, and infrastructure to educationally support the lifelong learning, research, and conservation of the recorded knowledge. Whereas traditional libraries are limited by storage space, digital libraries have the potential to effectively store much more information and documents, because digital information requires very little physical space to contain them. Encouraging digital libraries has the potential to improve academic library performance and gain educational goals in the digital age.


Author(s):  
Hideyasu Sasaki

The principal concern of this article is to provide researchers and practitioners in information science and technology with legal references on the concepts, issues, trends, and frameworks of intellectual property protection regarding multimedia digital library in engineering manner. Digital library is the global information infrastructure in the networked society (Borgman, 2003). A digital library, as an information system, consists of digital contents in databases and retrieval mechanisms. The right protection of digital library is a critical issue in the digital library community that demands frameworks for recouping their investment in database design and system implementation. Intellectual property law gives incentive to advance appropriate investment in database design and implementation with two types of intellectual property protection: copyright and patent (Jakes & Yoches, 1989; Junghans & Levy, 2006). Multimedia digital contents take a variety of forms including text, images, photos, and video streams, which often commingle in multimedia digital libraries. Nevertheless, present legal studies are not satisfactory as the source of technical interpretation of the intellectual properties regarding multimedia digital libraries. The intellectual property protection of the multimedia digital libraries demands clear and concise frameworks.


2014 ◽  
Vol 70 (6) ◽  
pp. 970-996 ◽  
Author(s):  
Paula Goodale ◽  
Paul David Clough ◽  
Samuel Fernando ◽  
Nigel Ford ◽  
Mark Stevenson

Purpose – The purpose of this paper is to investigate the effects of cognitive style on navigating a large digital library of cultural heritage information; specifically, the paper focus on the wholist/analytic dimension as experienced in the field of educational informatics. The hypothesis is that wholist and analytic users have characteristically different approaches when they explore, search and interact with digital libraries, which may have implications for system design. Design/methodology/approach – A detailed interactive IR evaluation of a large cultural heritage digital library was undertaken, along with the Riding CSA test. Participants carried out a range of information tasks, and the authors analysed their task performance, interactions and attitudes. Findings – The hypothesis on the differences in performance and behaviour between wholist and analytic users is supported. However, the authors also find that user attitudes towards the system are opposite to expectations and that users give positive feedback for functionality that supports activities in which they are cognitively weaker. Research limitations/implications – There is scope for testing results in a larger scale study, and/or with different systems. In particular, the findings on user attitudes warrant further investigation. Practical implications – Findings on user attitudes suggest that systems which support areas of weakness in users’ cognitive abilities are valued, indicating an opportunity to offer diverse functionality to support different cognitive weaknesses. Originality/value – A model is proposed suggesting a converse relationship between behaviour and attitudes; to support individual users displaying search/navigation behaviour mapped onto the strengths of their cognitive style, but placing greater value on interface features that support aspects in which they are weaker.


2021 ◽  
Vol 5 (5) ◽  
pp. 731-746
Author(s):  
Dewa Gede Hendra Divayana ◽  
I Putu Wisna Ariawan ◽  
I Made Ardana ◽  
P. Wayan Arta Suyasa

One source of learning in universities is a digital library. In the era of industry 4.0, most universities have implemented digital libraries in supporting the learning process. However, the reality shows that digital library management is still ineffective. Therefore, the implementation of digital libraries needs to be evaluated for determining the digital library effectiveness used as learning resources in supporting the learning process in universities. Many evaluation tools are used to evaluate the effectiveness of digital libraries but have not provided accurate recommendation results to support decision-making. This research presents an innovation in the form of an evaluation tool that can be used to evaluate the digital library effectiveness in universities. That evaluation tool is called the Alkin-WP-based digital library evaluation software. This software is a desktop platform that contains aspects of measuring the digital library effectiveness by referring to the components of the Alkin evaluation model and the WP (Weighted Product) method. This research aimed to show the effectiveness level of the utilization of Alkin-WP-based digital library evaluation software. This research method was R & D (Research & Development) which refers to the ten development stages of the Borg and Gall model. In this research, development was focused only on a few stages, included: usage trials, final product revision, dissemination, and implementation. The subjects involved in assessing the implementation/utilization of the Alkin-WP-based digital library evaluation software were 35 people, in the usage trials were six people, in product revision were three people, and at the stage of dissemination were 15 people. The tools used to collect data were questionnaires and interview guidelines. The data analysis technique used was descriptive quantitative. The effectiveness level of utilizing the Alkin-WP-based digital library evaluation software was 88.34%. It showed that the evaluation software had effective. The impact of this research results on the scientific field of educational evaluation is being able to show the existence of a new evaluation tool based on educational evaluation and artificial intelligence. That evaluation tool can easier for library heads to make policies for revamping digital library services based on accurate recommendations. Doi: 10.28991/esj-2021-01308 Full Text: PDF


2017 ◽  
Vol 2 (3) ◽  
pp. 49-67 ◽  
Author(s):  
Xiao Hu ◽  
Eric M. Y. Ho ◽  
Chen Qiao

Abstract Purpose This study is a user evaluation on the usability of the Mogao Cave Panorama Digital Library (DL), aiming to measure its effectiveness from the users’ perspective and to propose suggestions for improvement. Design/methodology/approach Usability tests were conducted based on a framework of evaluation criteria and a set of information seeking tasks designed for the Dunhuang cultural heritage, and interviews were conducted for soliciting in-depth opinions from participants. Findings The results of the usability tests indicate that the DL was more efficient in supporting simple information seeking tasks than those of higher-complexity levels. Statistical tests reveal that there were correlations among dimensions of usability criteria and user effectiveness measures. Moreover, interview discourses exposed specific usability issues of the DL. Research limitations This research is based on a relatively small sample size, resulting in a limited representativeness of user diversity. A larger sample size is needed for a systematic cross group comparison. Practical implications This study evaluated the usability of the Mogao Cave Panorama DL and proposed suggestions for its improvement for better experience. The results also provide a reference to other cultural heritage DLs with panorama functions. Originality/value This study is one of the first evaluating cultural heritage DLs from the perspective of user experience. It provides methodological references for relevant studies: the evaluation framework, the designed information seeking tasks, and the interview questions can be adopted or adapted in evaluating other visually centric DLs of cultural heritage.


Author(s):  
Surbhi Saini

This chapter introduces the basics of the digital library, including needs, benefits, and requirements, and briefly describes the digitization process. The role of library and information science professionals has now become a debatable one due to the advent of digital libraries and the Internet. The cloud computing and virtualization in digital culture is also discussed here. In this regard, the chapter covers cloud computing, including the characteristics, types, and how it works. The application of cloud computing in libraries is described with an example of the cloud in the academic library in Orissa. The advantages and disadvantages of cloud computing in libraries or in organizations are also covered here. The future prospects of the digital library using cloud computing technology is like an innovative application in libraries.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Chukwuma Clement Okeji ◽  
Okeoghene Mayowa-Adebara

Purpose The purpose of this study is to evaluate the library school’s curriculum in Nigeria with the aim of comparing it with international and national library and information science (LIS) guidelines regarding provision of “digital libraries” course. Design/methodology/approach This study covered 31 universities offering LIS approved by the National Universities Commission (NUC). The main instrument for data collection for the study was analysis of departmental documents containing the LIS curriculum. Second, some library and information science educators from universities that were yet to integrate the course digital libraries in their LIS curriculum were interviewed. Findings This study revealed that majority of the library schools offer the course “digital libraries” or related areas as core course in their curricula. However, only few library schools have computer laboratories for students to enhance digital library skills. Some LIS educators in the library schools identified challenges such as lack of qualified information and communication technology (ICT) staff to handle the course coupled with lack of computer laboratories equipped with modern computers with stable internet facilities in the LIS departments in Nigeria. Practical implications The findings from this study may inform curriculum revision and updating efforts to make it more relevant by incorporating a stand-alone course on “digital libraries” and provision of computer laboratories in the LIS departments to produce future ICT/digital librarians. Originality/value If university administrators, decision-making body in the departments and LIS educators understand the factors that are currently standing in the way of integrating a course on digital libraries, then those barriers can be removed or lowered. If the enabling factors are appreciated, then actions can be taken to stimulate the implementation of the Librarians’ Registration Council of Nigeria (LRCN)/NUC recommendations in all library schools in Nigerian universities.


2020 ◽  
pp. 096100062093550
Author(s):  
Iris Xie ◽  
Soohyung Joo ◽  
Krystyna K Matusiak

Evaluation criteria and appropriate measures are critical to the success of digital library evaluation. The key problem is a lack of specific measures, especially from a heuristic perspective, corresponding to diverse dimensions and criteria. This study explored a variety of measures for digital library evaluation focusing on their appropriateness. It also compared the similarities and differences in perceptions of the appropriateness of digital library evaluation measures of two groups. Sixty-one participants were recruited representing scholars and academic digital librarians. The participants were instructed to fill in an in-depth survey consisting of 174 measures associated with 10 evaluation dimensions and 82 criteria. The findings of this study highlight the most appropriate measures in each dimension and show significant agreement in identifying appropriate measures by digital library scholars and librarians. Differences in the rating of the measures were found between the two groups in the dimensions of “interface design,” “system and technology,” “effects on users,” “administration,” “user engagement,” and “context.” The significance of this study lies not only in the integration of the perspectives on measures from both researchers and practitioners, but also in providing an inclusive list of measures to guide practitioners to effectively evaluate digital libraries in academic settings.


Sign in / Sign up

Export Citation Format

Share Document