Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Author(s):  
Rosalie Ruegg ◽  
Gretchen B. Jordan
2017 ◽  
Vol 11 (2) ◽  
pp. 125-143 ◽  
Author(s):  
Choo-Hui Park ◽  
Jin-Kyo Shin

PurposeThe purpose of this paper is to analyze the determinants of the performance of regional industrial technology development programs among the regional strategic industrial development program that the central government and Daegu metropolitan city jointly promoted between 2004 and 2012. Specifically, in this research, the authors are trying to identify the effects of R&D capabilities and technical development tasks on technological and managerial performance. Design/methodology/approachThe dependent variables of this study are technical and economic performance. Technical performance, product and process innovation, economic performance, sales and export increases were measured using five-point Likert scales. The authors added the contribution of sales through technology development to economic performance. The independent variable is the company’s R&D capability, measured by the number of R&D staff compared to the average total number of employees from 2004 to 2012. The characteristics of the technology development tasks were measured by technical characteristics, market characteristics and collaborative research types. The technological characteristics were measured by seven factors, including technological change, technical difficulty, potential in commercialization, competition between domestic and foreign competitors, difficulty in introducing overseas technology and the technological gap. Market characteristics were largely divided into complexity, dynamics and competitiveness. The types of collaborative research were divided into whether or not there were collaborative research with the participation of large corporations. The control variables are firm size (number of employees) and firm age. Regression analysis was used to analyze the determinants of performance, and a difference analysis was conducted to determine the effect of collaborative research on performance. FindingsThe main determinants of the regional industrial technology development program performance are the characteristics of the technology development task rather than the internal R&D capability; moreover, the technical characteristics, complexity of the developed product market and participation of large corporations had significant effects on R&D capability. The R&D capacity of firms in internal R&D capacity had a significant effect only on the improvement of technology development ability. Therefore, R&D capacity, which is the main determinant of technology innovation, did not have a significant effect on the performance of short-term technology development tasks. Technological change, technological difficulty, competition between domestic and foreign competitors and the technological gap had positive effects on performance, excluding sales contributions. In addition, the complexity of the developed product market such as the diversification of demand, competitive product and sales distribution channels had positive influences on the performance of technology development programs, unlike dynamics and competitiveness. In this study, the authors cannot confirm the effect of collaborative research on the performance of the technology development programs, but they confirmed that collaborative research involving large corporations had a positive influence on performance. Research limitations/implicationsThe results of the analysis of the determinants of regional industrial technology development programs suggest some implications in the future evaluation of these regional industrial technology development programs. It is necessary to review the application qualification and merit, advance review of the business plans and confirmation, an examination of the research results and performance of the applicants and a review of the technology and market situation of the project. For this, the authors suggest that the written review from the relevant technical experts be submitted to the evaluation committees. Also, when establishing regional industrial development programs, they should be evaluated thoroughly, including detailed information and contents about the technical and market characteristics of the local industry. Originality/valueThis research is one of the first to investigate the achievements of R&D support programs among regional industrial development programs in Korea. The results of this study can substantially contribute to the development and implementation of the R&D support policies of the central and local governments. Furthermore, the findings suggest guidelines for improving the performance of R&D support programs in the future. A theoretical model for enhancing the efficiency of government R&D support programs may be established, and an empirical analysis may be conducted to provide practical and academic implications for further research.


Author(s):  
F. C. Rust ◽  
R. M. Vos

The technology development process for the public sector in the transportation industry in South Africa became fragmented as a result of a short-term view with a lack of strategic focus. The subsequent perceived poor performance of the technology development program and inadequate implementation of results motivated the development of a new model for technology development—utilizing a holistic, systems approach at the strategic level with supporting techniques and basic information. The conceptual development of the new technology development model implemented in South Africa is discussed and the use of some of the concepts in the planning and execution of technology development programs for the Southern African Bitumen Association (Sabita) and the South African Department of Transport (SADoT) are illustrated. It is concluded that technology transfer and implementation would be much more effective if it were conducted as part of the technology development system.


2013 ◽  
Vol 31 (31_suppl) ◽  
pp. 252-252 ◽  
Author(s):  
Arif Kamal ◽  
Kristen McNiff ◽  
Ann A. Prestrud ◽  
Dale Lupu ◽  
Molly Gavigan ◽  
...  

252 Background: Despite a strong evidence base and increasing calls for integration, oncologists find it difficult to deliver primary palliative care concurrent with standard oncology care. Solutions that promote practical integration of palliative care in oncology are needed. In an AHRQ-funded pilot, ASCO and the American Academy of Hospice and Palliative Medicine are developing the Virtual Learning Collaborative (VLC) to develop and test a scalable model for quality improvement and dissemination of best practices in palliative care within the oncology setting. Methods: The VLC will be a web-based learning and collaboration system built upon existing ASCO technology resources. We will select at least 25 oncology practices to participate in regular, facilitated learning sessions, collaborative discussions, and sharing of best practices. The VLC will equip each practice with the knowledge, tools, and coaching to select, test, and adopt a quality improvement intervention relevant to their own palliative care needs. Development of the VLC is ongoing; oncology practices begin participation in Spring 2014. Results: We will assess the VLC using protocol-driven evaluation methods common to technology development, quality improvement, implementation science, and educational initiatives. VLC usability, feasibility, and acceptability will be assessed through surveys of participating practices and focus groups. Longitudinal changes in conformance to palliative care metrics will be assessed using ASCO’s Quality Oncology Practice Initiative (QOPI) system. We will use mixed qualitative and quantitative evaluation methods to assess ongoing changes in clinician knowledge and self-efficacy in applying palliative care principles. Conclusions: We aim to develop and test a novel method for facilitating quality improvement and palliative care learning in oncology. Through this pilot, we will refine the VLC for implementation in the greater oncology community. Ultimately, this effort supports other ASCO and AAHPM quality improvement initiatives focused on clinician education and dissemination of best practices.


Author(s):  
Ihor S. Diakunchak ◽  
Ronald L. Bannister ◽  
David J. Huber ◽  
D. Frank Roan

This paper describes the technologies that are being developed or extended beyond the current state-of-the-art to achieve Advanced Turbine Systems (ATS) Program goals. The Westinghouse ATS plant is an advanced closed-loop enoled combined cycle, based on an advanced gas turbine engine incorporating novel design concepts and enhancements of existing technologies. The ATS engine is a fuel-flexible design operating nn natural gas with provisions fnr future conversion to coal or biomass fuels. It is based nn proven concepts employed in 501F and 501G engines. To achieve the required performance and reliability the engine will include closed-loop steam cooling, advanced materials and coatings, and enhanced component performance. To minimize NOx emissions, an ultra-low NOx combustion system will be incorporated. To ensure technical success, development programs are being conducted on the following: closed-loop steam cooling, advanced materials and coatings, component aerodynamic performance, flow visualization, optical diagnostics, combustion generated noise, and catalytic combustion.


Author(s):  
R. A. Sprague

For at least the next decade, as in the recent past, the materials and process area will assume a major role in the advancement of the propulsion gas turbine industry. The selection of promising material and process technologies, with highest payoff at lowest technical and financial risk, is a major challenge. Technology development programs undertaken in the laboratory are selected, based on design needs, compatibility with payoffs in specific and generic applications, and facilities requirements. Advanced materials and process technology efforts for exploitation include directional superalloys for turbine airfoils, clean superalloy blisk/disk materials, gas path seals for clearance control, thermal barrier coatings for airfoils and hybrid structures, composite materials, and rapidly solidified plasma deposited structures. These developments will contribute significantly to the major thrusts of performance improvement, weight reduction, reliability and life extension, and reduced initial ownership cost.


2000 ◽  
Vol 2 (2) ◽  
pp. 93-113 ◽  
Author(s):  
Greg Linden ◽  
David C. Mowery ◽  
Rosemarie Ham Ziedonis

Since the late 1980s, the Cooperative Research and Development Agreement (CRADA) has been a prominent vehicle used to support collaboration between US federal laboratories and private firms. This paper examines the structure and goals of one of the most ambitious CRADAs conducted to date, the EUV CRADA, which involves three Department of Energy laboratories and leading US firms in the semiconductor industry and is aimed at the development of next-generation lithographic technologies. This large project is an important case study in ‘post-Cold-War’ technology policy and government-industry collaboration. Although the EUV project represents significant improvements in the design and management of CRADAs, it also illustrates the inherent difficulties of balancing political and economic goals in complex technology development programs.


Sign in / Sign up

Export Citation Format

Share Document