Evaluating the impact of a service-oriented framework for healthcare interoperability.

Science.gov (United States)

Daskalakis, Stylianos; Mantas, John

2008-01-01

This paper describes the evaluation of a service-oriented prototype implementation. The prototype development aims to exploit the use of service-oriented concepts for achieving healthcare interoperability while it also attempts to move towards a virtual patient record paradigm. The proposed evaluation strategy investigates the adaptation of the DeLone and McLean model of information systems success with respect to service-oriented implementations. Specific service-oriented and virtual patient record characteristics were empirically encapsulated in the DeLone and McLean model and respective evaluation measures were produced. The proposed theoretical framework was utilized for conducting an empirical study amongst sixty two participants in order to observe their perceptions with respect to the hypothetical adoption of the prototype framework. The data gathered was analyzed using partial least squares. The generated results highlighted the importance of information quality whereas system quality did not prove to be a strong significant predictor in the overall model.

Towards a Framework for the Evaluation Design of Enterprise Social Software

DEFF Research Database (Denmark)

Herzog, Christian; Richter, Alexander; Steinhüser, Melanie

2015-01-01

a design theory that highlights the various design options and ensures completeness and consistency. Based on a comprehensive literature analysis, as well as an interview study with 31 ESS experts from 29 companies, we suggest a conceptual framework intended as decision support for the ESS evaluation...... design for different stakeholders. Beyond providing an orientation the framework also reveals six evaluation classes that represent typical application instantiations and can be understood as principles of implementation. A first validation in five organizations confirms that the framework can lead......While the use of Enterprise Social Software (ESS) increases, reports from science and practice show that evaluating its impact remains a major challenge. Various interests and points of view make each ESS evaluation an individual matter and lead to diverse requirements. In this paper, we propose...

The global climate Policy Evaluation Framework

International Nuclear Information System (INIS)

Cohan, D.; Stafford, R.K.; Scheraga, J.D.; Herrod, S.

1994-01-01

The Policy Evaluation Framework (PEF) is a decision analysis tool that enables decision makers to continuously formulate policies that take into account the existing uncertainties, and to refine policies as new scientific information is developed. PEF integrates deterministic parametric models of physical, biological, and economic systems with a flexible decision tree system. The deterministic models represent greenhouse gas emissions, atmospheric accumulation of these gases, global and regional climate changes, ecosystem impacts, economic impacts, and mitigation and adaptation options, The decision tree system captures the key scientific and economic uncertainties, and reflects the wide range of possible outcomes of alternative policy actions. The framework contains considerable flexibility to allow a wide range of scientific and economic assumptions or scenarios to be represented and explored. A key feature of PEF is its capability to address both mitigation policies and investments in anticipatory adaptation to protect ecological and economic systems, as well as interactions among such options. PEF's time structure allows issues related to the timing and flexibility of alternatives to be evaluated, while the decision tree structure facilitates examining questions involving the value of information, contingent actions, and probabilistic representations. This paper is intended to introduce PEF to the global climate policy community. The paper provides an overview of the structure, modules, and capabilities of PEF, and discusses selected results from an initial set of illustrative applications

Development of a practical modeling framework for estimating the impact of wind technology on bird populations

Energy Technology Data Exchange (ETDEWEB)

Morrison, M.L. [California State Univ., Sacramento, CA (United States); Pollock, K.H. [North Carolina State Univ., Raleigh, NC (United States)

1997-11-01

One of the most pressing environmental concerns related to wind project development is the potential for avian fatalities caused by the turbines. The goal of this project is to develop a useful, practical modeling framework for evaluating potential wind power plant impacts that can be generalized to most bird species. This modeling framework could be used to get a preliminary understanding of the likelihood of significant impacts to birds, in a cost-effective way. The authors accomplish this by (1) reviewing the major factors that can influence the persistence of a wild population; (2) briefly reviewing various models that can aid in estimating population status and trend, including methods of evaluating model structure and performance; (3) reviewing survivorship and population projections; and (4) developing a framework for using models to evaluate the potential impacts of wind development on birds.

Development of a practical modeling framework for estimating the impact of wind technology on bird populations

International Nuclear Information System (INIS)

Morrison, M.L.; Pollock, K.H.

1997-11-01

One of the most pressing environmental concerns related to wind project development is the potential for avian fatalities caused by the turbines. The goal of this project is to develop a useful, practical modeling framework for evaluating potential wind power plant impacts that can be generalized to most bird species. This modeling framework could be used to get a preliminary understanding of the likelihood of significant impacts to birds, in a cost-effective way. The authors accomplish this by (1) reviewing the major factors that can influence the persistence of a wild population; (2) briefly reviewing various models that can aid in estimating population status and trend, including methods of evaluating model structure and performance; (3) reviewing survivorship and population projections; and (4) developing a framework for using models to evaluate the potential impacts of wind development on birds

Reframing Evaluation: Defining an Indigenous Evaluation Framework

Science.gov (United States)

LaFrance, Joan; Nichols, Richard

2008-01-01

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…

A Framework for the Assessment of Research and Its Impacts

Directory of Open Access Journals (Sweden)

Cinzia Daraio

2017-12-01

Full Text Available This paper proposes a holistic framework for the development of models for the assessment of research activities and their impacts. It distinguishes three dimensions, including in an original way, data as a main dimension, together with theory and methodology. Each dimension of the framework is further characterized by three main building blocks: education, research, and innovation (theory; efficiency, effectiveness, and impact (methodology; and availability, interoperability, and “unit-free” property (data. The different dimensions and their nine constituent building blocks are attributes of an overarching concept, denoted as “quality.” Three additional quality attributes are identified as implementation factors (tailorability, transparency, and openness and three “enabling” conditions (convergence, mixed methods, and knowledge infrastructures complete the framework. A framework is required to develop models of metrics. Models of metrics are necessary to assess the meaning, validity, and robustness of metrics. The proposed framework can be a useful reference for the development of the ethics of research evaluation. It can act as a common denominator for different analytical levels and relevant aspects and is able to embrace many different and heterogeneous streams of literature. Directions for future research are provided.

An Evaluation Framework for Lossy Compression of Genome Sequencing Quality Values

OpenAIRE

Alberti, Claudio; Daniels, Noah; Hernaez, Mikel; Voges, Jan; Goldfeder, Rachel L.; Hernandez-Lopez, Ana A.; Mattavelli, Marco; Berger, Bonnie

2016-01-01

This paper provides the specification and an initial validation of an evaluation framework for the comparison of lossy compressors of genome sequencing quality values. The goal is to define reference data, test sets, tools and metrics that shall be used to evaluate the impact of lossy compression of quality values on human genome variant calling. The functionality of the framework is validated referring to two state-of-the-art genomic compressors. This work has been spurred by the current act...

Evaluation Framework for Telemedicine Using the Logical Framework Approach and a Fishbone Diagram.

Science.gov (United States)

Chang, Hyejung

2015-10-01

Technological advances using telemedicine and telehealth are growing in healthcare fields, but the evaluation framework for them is inconsistent and limited. This paper suggests a comprehensive evaluation framework for telemedicine system implementation and will support related stakeholders' decision-making by promoting general understanding, and resolving arguments and controversies. This study focused on developing a comprehensive evaluation framework by summarizing themes across the range of evaluation techniques and organized foundational evaluation frameworks generally applicable through studies and cases of diverse telemedicine. Evaluation factors related to aspects of information technology; the evaluation of satisfaction of service providers and consumers, cost, quality, and information security are organized using the fishbone diagram. It was not easy to develop a monitoring and evaluation framework for telemedicine since evaluation frameworks for telemedicine are very complex with many potential inputs, activities, outputs, outcomes, and stakeholders. A conceptual framework was developed that incorporates the key dimensions that need to be considered in the evaluation of telehealth implementation for a formal structured approach to the evaluation of a service. The suggested framework consists of six major dimensions and the subsequent branches for each dimension. To implement telemedicine and telehealth services, stakeholders should make decisions based on sufficient evidence in quality and safety measured by the comprehensive evaluation framework. Further work would be valuable in applying more comprehensive evaluations to verify and improve the comprehensive framework across a variety of contexts with more factors and participant group dimensions.

Evaluating Academic Journals without Impact Factors for Collection Management Decisions.

Science.gov (United States)

Dilevko, Juris; Atkinson, Esther

2002-01-01

Discussion of evaluating academic journals for collection management decisions focuses on a methodological framework for evaluating journals not ranked by impact factors in Journal Citation Reports. Compares nonranked journals with ranked journals and then applies this framework to a case study in the field of medical science. (LRW)

An Evaluation Model for a Multidisciplinary Chronic Pelvic Pain Clinic: Application of the RE-AIM Framework.

Science.gov (United States)

Chen, Innie; Money, Deborah; Yong, Paul; Williams, Christina; Allaire, Catherine

2015-09-01

Chronic pelvic pain (CPP) is a prevalent, debilitating, and costly condition. Although national guidelines and empiric evidence support the use of a multidisciplinary model of care for such patients, such clinics are uncommon in Canada. The BC Women's Centre for Pelvic Pain and Endometriosis was created to respond to this need, and there is interest in this model of care's impact on the burden of disease in British Columbia. We sought to create an approach to its evaluation using the RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) evaluation framework to assess the impact of the care model and to guide clinical decision-making and policy. The RE-AIM evaluation framework was applied to consider the different dimensions of impact of the BC Centre. The proposed measures, data sources, and data management strategies for this mixed-methods approach were identified. The five dimensions of impact were considered at individual and organizational levels, and corresponding indicators were proposed to enable integration into existing data infrastructure to facilitate collection and early program evaluation. The RE-AIM framework can be applied to the evaluation of a multidisciplinary chronic pelvic pain clinic. This will allow better assessment of the impact of innovative models of care for women with chronic pelvic pain.

Economic framework for information system evaluation

International Nuclear Information System (INIS)

King, D.W.; Roderer, N.K.

1979-01-01

In the evaluation of complex information systems, it is useful to work within a generalized economic framework. This framework is based on consideration of four evaluation levels, including those associated with the overall system, system functions, products and services, and activities. Measures of cost and output can be defined at each level, with output measures related to volume of activity, performance, effectiveness, and benefit. The description of this framework includes definitions of the terminology used. Examples of the application of the framework to specific information system evaluations are also given. 4 figures

Wind Technology: A Framework for the Evaluation of Innovations¿ Impacts on the Diffusion Potential

NARCIS (Netherlands)

Dinica, V.

2010-01-01

This paper proposes a framework based on which innovations in wind power technologies can be evaluated from the standpoint of their contribution to diffusion expansion. The framework helps build up a missing link between the technical literature on innovations and policy-oriented contributions

Biodiversity impact assessment (BIA+) - methodological framework for screening biodiversity.

Science.gov (United States)

Winter, Lisa; Pflugmacher, Stephan; Berger, Markus; Finkbeiner, Matthias

2018-03-01

For the past 20 years, the life cycle assessment (LCA) community has sought to integrate impacts on biodiversity into the LCA framework. However, existing impact assessment methods still fail to do so comprehensively because they quantify only a few impacts related to specific species and regions. This paper proposes a methodological framework that will allow LCA practitioners to assess currently missing impacts on biodiversity on a global scale. Building on existing models that seek to quantify the impacts of human activities on biodiversity, the herein proposed methodological framework consists of 2 components: a habitat factor for 14 major habitat types and the impact on the biodiversity status in those major habitat types. The habitat factor is calculated by means of indicators that characterize each habitat. The biodiversity status depends on parameters from impact categories. The impact functions, relating these different parameters to a given response in the biodiversity status, rely on expert judgments. To ensure the applicability for LCA practitioners, the components of the framework can be regionalized on a country scale for which LCA inventory data is more readily available. The weighting factors for the 14 major habitat types range from 0.63 to 1.82. By means of area weighting of the major habitat types in a country, country-specific weighting factors are calculated. In order to demonstrate the main part of the framework, examples of impact functions are given for the categories "freshwater eutrophication" and "freshwater ecotoxicity" in 1 major habitat type. The results confirm suitability of the methodological framework. The major advantages are the framework's user-friendliness, given that data can be used from LCA databases directly, and the complete inclusion of all levels of biodiversity (genetic, species, and ecosystem). It is applicable for the whole world and a wide range of impact categories. Integr Environ Assess Manag 2018;14:282-297. �

A Sustainable Evaluation Framework and Its Application

Science.gov (United States)

Powell, Robert B.; Stern, Marc J.; Ardoin, Nicole

2006-01-01

This article presents a framework for developing internally sustainable evaluation systems for environmental education organizations, although the framework can be applied to other types of organizations. The authors developed a sustainable evaluation framework (SEF) with the intent of creating an evaluation system that could be self-administered…

A comprehensive health service evaluation and monitoring framework.

Science.gov (United States)

Reeve, Carole; Humphreys, John; Wakerman, John

2015-12-01

To develop a framework for evaluating and monitoring a primary health care service, integrating hospital and community services. A targeted literature review of primary health service evaluation frameworks was performed to inform the development of the framework specifically for remote communities. Key principles underlying primary health care evaluation were determined and sentinel indicators developed to operationalise the evaluation framework. This framework was then validated with key stakeholders. The framework includes Donabedian's three seminal domains of structure, process and outcomes to determine health service performance. These in turn are dependent on sustainability, quality of patient care and the determinants of health to provide a comprehensive health service evaluation framework. The principles underpinning primary health service evaluation were pertinent to health services in remote contexts. Sentinel indicators were developed to fit the demographic characteristics and health needs of the population. Consultation with key stakeholders confirmed that the evaluation framework was applicable. Data collected routinely by health services can be used to operationalise the proposed health service evaluation framework. Use of an evaluation framework which links policy and health service performance to health outcomes will assist health services to improve performance as part of a continuous quality improvement cycle. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

The problem of windfarm location: A social multi-criteria evaluation framework

International Nuclear Information System (INIS)

Gamboa, Gonzalo; Munda, Giuseppe

2007-01-01

Although wind energy has the green image, the location of windfarms is always a source of local conflicts. Opposition may depend on the extensive land use of windfarms, their possible impacts on tourism or their visual impact, as well as NIMBY (Never In My Back-Yard) behavior. On the other hand, some social actors are normally in favor of wind parks because they perceive them as a possibility of development or simply a source of income. In these situations, the management of the energy policy process involves many layers and kinds of decisions, and requires the construction of a dialogue process among many social actors, individual and collective, formal and informal, local and non-local. This implies that the political and social framework must find a place in evaluation exercises. This is the objective of social multi-criteria evaluation (SMCE). In this article, SMCE is proposed as a general framework for dealing with the problem of wind park location. The major strength of SMCE is the possibility of integrating both socio-economic and technical dimensions inside a coherent framework. A real-world case study is used as an illustrative example

A paradigm shift toward a consistent modeling framework to assess climate impacts

Science.gov (United States)

Monier, E.; Paltsev, S.; Sokolov, A. P.; Fant, C.; Chen, H.; Gao, X.; Schlosser, C. A.; Scott, J. R.; Dutkiewicz, S.; Ejaz, Q.; Couzo, E. A.; Prinn, R. G.; Haigh, M.

2017-12-01

Estimates of physical and economic impacts of future climate change are subject to substantial challenges. To enrich the currently popular approaches of assessing climate impacts by evaluating a damage function or by multi-model comparisons based on the Representative Concentration Pathways (RCPs), we focus here on integrating impacts into a self-consistent coupled human and Earth system modeling framework that includes modules that represent multiple physical impacts. In a sample application we show that this framework is capable of investigating the physical impacts of climate change and socio-economic stressors. The projected climate impacts vary dramatically across the globe in a set of scenarios with global mean warming ranging between 2.4°C and 3.6°C above pre-industrial by 2100. Unabated emissions lead to substantial sea level rise, acidification that impacts the base of the oceanic food chain, air pollution that exceeds health standards by tenfold, water stress that impacts an additional 1 to 2 billion people globally and agricultural productivity that decreases substantially in many parts of the world. We compare the outcomes from these forward-looking scenarios against the common goal described by the target-driven scenario of 2°C, which results in much smaller impacts. It is challenging for large internationally coordinated exercises to respond quickly to new policy targets. We propose that a paradigm shift toward a self-consistent modeling framework to assess climate impacts is needed to produce information relevant to evolving global climate policy and mitigation strategies in a timely way.

An Evaluation Framework for Lossy Compression of Genome Sequencing Quality Values.

Science.gov (United States)

Alberti, Claudio; Daniels, Noah; Hernaez, Mikel; Voges, Jan; Goldfeder, Rachel L; Hernandez-Lopez, Ana A; Mattavelli, Marco; Berger, Bonnie

2016-01-01

This paper provides the specification and an initial validation of an evaluation framework for the comparison of lossy compressors of genome sequencing quality values. The goal is to define reference data, test sets, tools and metrics that shall be used to evaluate the impact of lossy compression of quality values on human genome variant calling. The functionality of the framework is validated referring to two state-of-the-art genomic compressors. This work has been spurred by the current activity within the ISO/IEC SC29/WG11 technical committee (a.k.a. MPEG), which is investigating the possibility of starting a standardization activity for genomic information representation.

A common evaluation framework for the African Health Initiative

Science.gov (United States)

2013-01-01

Background The African Health Initiative includes highly diverse partnerships in five countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia), each of which is working to improve population health by strengthening health systems and to evaluate the results. One aim of the Initiative is to generate cross-site learning that can inform implementation in the five partnerships during the project period and identify lessons that may be generalizable to other countries in the region. Collaborators in the Initiative developed a common evaluation framework as a basis for this cross-site learning. Methods This paper describes the components of the framework; this includes the conceptual model, core metrics to be measured in all sites, and standard guidelines for reporting on the implementation of partnership activities and contextual factors that may affect implementation, or the results it produces. We also describe the systems that have been put in place for data management, data quality assessments, and cross-site analysis of results. Results and conclusions The conceptual model for the Initiative highlights points in the causal chain between health system strengthening activities and health impact where evidence produced by the partnerships can contribute to learning. This model represents an important advance over its predecessors by including contextual factors and implementation strength as potential determinants, and explicitly including equity as a component of both outcomes and impact. Specific measurement challenges include the prospective documentation of program implementation and contextual factors. Methodological issues addressed in the development of the framework include the aggregation of data collected using different methods and the challenge of evaluating a complex set of interventions being improved over time based on continuous monitoring and intermediate results. PMID:23819778

A framework provided an outline toward the proper evaluation of potential screening strategies.

Science.gov (United States)

Adriaensen, Wim J; Matheï, Cathy; Buntinx, Frank J; Arbyn, Marc

2013-06-01

Screening tests are often introduced into clinical practice without proper evaluation, despite the increasing awareness that screening is a double-edged sword that can lead to either net benefits or harms. Our objective was to develop a comprehensive framework for the evaluation of new screening strategies. Elaborating on the existing concepts proposed by experts, a stepwise framework is proposed to evaluate whether a potential screening test can be introduced as a screening strategy into clinical practice. The principle of screening strategy evaluation is illustrated for cervical cancer, which is a template for screening because of the existence of an easily detectable and treatable precursor lesion. The evaluation procedure consists of six consecutive steps. In steps 1-4, the technical accuracy, place of the test in the screening pathway, diagnostic accuracy, and longitudinal sensitivity and specificity of the screening test are assessed. In steps 5 and 6, the impact of the screening strategy on the patient and population levels, respectively, is evaluated. The framework incorporates a harm and benefit trade-off and cost-effectiveness analysis. Our framework provides an outline toward the proper evaluation of potential screening strategies before considering implementation. Copyright © 2013 Elsevier Inc. All rights reserved.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Scholarometer: a social framework for analyzing impact across disciplines.

Directory of Open Access Journals (Sweden)

Jasleen Kaur

Full Text Available The use of quantitative metrics to gauge the impact of scholarly publications, authors, and disciplines is predicated on the availability of reliable usage and annotation data. Citation and download counts are widely available from digital libraries. However, current annotation systems rely on proprietary labels, refer to journals but not articles or authors, and are manually curated. To address these limitations, we propose a social framework based on crowdsourced annotations of scholars, designed to keep up with the rapidly evolving disciplinary and interdisciplinary landscape. We describe a system called Scholarometer, which provides a service to scholars by computing citation-based impact measures. This creates an incentive for users to provide disciplinary annotations of authors, which in turn can be used to compute disciplinary metrics. We first present the system architecture and several heuristics to deal with noisy bibliographic and annotation data. We report on data sharing and interactive visualization services enabled by Scholarometer. Usage statistics, illustrating the data collected and shared through the framework, suggest that the proposed crowdsourcing approach can be successful. Secondly, we illustrate how the disciplinary bibliometric indicators elicited by Scholarometer allow us to implement for the first time a universal impact measure proposed in the literature. Our evaluation suggests that this metric provides an effective means for comparing scholarly impact across disciplinary boundaries.

Scholarometer: a social framework for analyzing impact across disciplines.

Science.gov (United States)

Kaur, Jasleen; Hoang, Diep Thi; Sun, Xiaoling; Possamai, Lino; Jafariasbagh, Mohsen; Patil, Snehal; Menczer, Filippo

2012-01-01

The use of quantitative metrics to gauge the impact of scholarly publications, authors, and disciplines is predicated on the availability of reliable usage and annotation data. Citation and download counts are widely available from digital libraries. However, current annotation systems rely on proprietary labels, refer to journals but not articles or authors, and are manually curated. To address these limitations, we propose a social framework based on crowdsourced annotations of scholars, designed to keep up with the rapidly evolving disciplinary and interdisciplinary landscape. We describe a system called Scholarometer, which provides a service to scholars by computing citation-based impact measures. This creates an incentive for users to provide disciplinary annotations of authors, which in turn can be used to compute disciplinary metrics. We first present the system architecture and several heuristics to deal with noisy bibliographic and annotation data. We report on data sharing and interactive visualization services enabled by Scholarometer. Usage statistics, illustrating the data collected and shared through the framework, suggest that the proposed crowdsourcing approach can be successful. Secondly, we illustrate how the disciplinary bibliometric indicators elicited by Scholarometer allow us to implement for the first time a universal impact measure proposed in the literature. Our evaluation suggests that this metric provides an effective means for comparing scholarly impact across disciplinary boundaries.

Evaluation Framework for Search Instruments

International Nuclear Information System (INIS)

Warren, Glen A.; Smith, Leon E.; Cooper, Matt W.; Kaye, William R.

2005-01-01

A framework for quantitatively evaluating current and proposed gamma-ray search instrument designs has been developed. The framework is designed to generate a large library of ''virtual neighborhoods'' that can be used to test and evaluate nearly any gamma-ray sensor type. Calculating nuisance-source emissions and combining various sources to create a large number of random virtual scenes places a significant computational burden on the development of the framework. To reduce this burden, a number of radiation transport simplifications have been made which maintain the essential physics ingredients for the quantitative assessment of search instruments while significantly reducing computational times. The various components of the framework, from the simulation and benchmarking of nuisance source emissions to the computational engine for generating the gigabytes of simulated search scenes, are discussed

EVALUATION OF CONCEPTUAL FRAMEWORKS IN ASTRONOMY

Directory of Open Access Journals (Sweden)

David Pundak

2016-02-01

Full Text Available Even though astronomy is the oldest science, it is still an open question how to evaluate students’ understanding in astronomy. In spite of the fact that some methods and evaluation tools have been developed for that purpose, the sources of students' difficulties in astronomy are still unclear. This paper presents an investigation of the changes in conceptual frameworks in astronomy among 50 engineering students as a result of learning a general course in astronomy. A special tool called Conceptual Frameworks in Astronomy (CFA, which was initially used in 1989, was adopted to gather data for the present research. In its new version, the tool includes 23 questions and five to six optional answers to each question. Each of the answers characterizes one of the four conceptual frameworks: pre-scientific, geocentric, heliocentric and sidereal. These four conceptual frameworks act as a taxonomical system that enables us to evaluate astronomical understanding. The paper describes the background of the CFA, its development, and discusses its validity and reliability. Using the CFA we were able to: (1 identify the students’ conceptual frameworks at the beginning of the course and at its end, (2 to evaluate the students’ paradigmatic change following the course. It was found that the measure of the students’ improvement (gain index was g = 0.37. Approximately 45% of the students in the course improved their conceptual frameworks in astronomy and 26% deepened their understanding of the heliocentric or sidereal conceptual frameworks. The CFA can also be applied as an evaluation tool in all schools and institutions that teach astronomy.

Assessing Impact Submissions for REF 2014: An Evaluation

Science.gov (United States)

Manville, Catriona; Guthrie, Susan; Henham, Marie-Louise; Garrod, Bryn; Sousa, Sonia; Kirtley, Anne; Castle-Clarke, Sophie; Ling, Tom

2015-01-01

The Research Excellence Framework (REF) is a new system for assessing the quality of research in UK higher education institutions (HEIs). For the first time, part of the assessment included the wider impact of research. RAND Europe was commissioned to evaluate the assessment process of the impact element of REF submissions, and to explore the…

A framework for evaluating the impact of obesity prevention strategies on socioeconomic inequalities in weight.

Science.gov (United States)

Backholer, Kathryn; Beauchamp, Alison; Ball, Kylie; Turrell, Gavin; Martin, Jane; Woods, Julie; Peeters, Anna

2014-10-01

We developed a theoretical framework to organize obesity prevention interventions by their likely impact on the socioeconomic gradient of weight. The degree to which an intervention involves individual agency versus structural change influences socioeconomic inequalities in weight. Agentic interventions, such as standalone social marketing, increase socioeconomic inequalities. Structural interventions, such as food procurement policies and restrictions on unhealthy foods in schools, show equal or greater benefit for lower socioeconomic groups. Many obesity prevention interventions belong to the agento-structural types of interventions, and account for the environment in which health behaviors occur, but they require a level of individual agency for behavioral change, including workplace design to encourage exercise and fiscal regulation of unhealthy foods or beverages. Obesity prevention interventions differ in their effectiveness across socioeconomic groups. Limiting further increases in socioeconomic inequalities in obesity requires implementation of structural interventions. Further empirical evaluation, especially of agento-structural type interventions, remains crucial.

Development and application of an integrated evaluation framework for preventive safety applications

NARCIS (Netherlands)

Scholliers, J.; Joshi, S.; Gemou, M.; Hendriks, F.; Ljung Aust, M.; Luoma, J.; Netto, M.; Engstrom, J.; Leanderson Olsson, S.; Kutzner, R.; Tango, F.; Amditis, A.J.; Blosseville, J.M.; Bekiaris, E.

2011-01-01

Preventive safety functions help drivers avoid or mitigate accidents. No quantitative methods have been available to evaluate the safety impact of these systems. This paper describes a framework for the assessment of preventive and active safety functions, which integrates procedures for technical

A Framework for Assessing the Social and Economic Impact of Sustainable Investments

Directory of Open Access Journals (Sweden)

Räikkönen Minna

2016-09-01

Full Text Available Investments towards sustainable development are vital for the future and they must be carefully planned to deliver immediate and long-term benefits. Hence, the ability to communicate the forms of impact of sustainable investments to local societies, people, investors and other stakeholders can provide a competitive advantage. However, the assessments are often under pressure to demonstrate short-term effects rather than emphasise the long-term impact. In addition, indirect and intangible forms of impacts should not be measured solely in economic terms. This paper proposes an assessment framework to support the integrated economic and social impact assessment of sustainable investments aimed at improving physical and socio-economic wellbeing. The framework is demonstrated in two case studies: new construction and renovation investments in affordable housing and social impact investment in sustainable development. The investments in the case studies are evaluated, selected and prioritized not only in terms of money but also with regard to sustainability, social acceptability and their overall impact on society, as a whole. The results indicate that a systematic integrated assessment of monetary and non-monetary factors can be successfully combined with the sustainable development decisions.

An Evaluation Use Framework and Empirical Assessment

Science.gov (United States)

Peck, Laura R.; Gorzalski, Lindsey M.

2009-01-01

Background: Research on evaluation use focuses on putting evaluation recommendations into practice. Prior theoretical research proposes varied frameworks for understanding the use (or lack) of program evaluation results. Purpose: Our purpose is to create and test a single, integrated framework for understanding evaluation use. This article relies…

An Evaluation Framework for Sustaining the Impact of Educational Development

Science.gov (United States)

Hashimoto, Kazuaki; Pillay, Hitendra; Hudson, Peter

2010-01-01

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

The social impacts of dams: A new framework for scholarly analysis

International Nuclear Information System (INIS)

Kirchherr, Julian; Charles, Katrina J.

2016-01-01

No commonly used framework exists in the scholarly study of the social impacts of dams. This hinders comparisons of analyses and thus the accumulation of knowledge. The aim of this paper is to unify scholarly understanding of dams' social impacts via the analysis and aggregation of the various frameworks currently used in the scholarly literature. For this purpose, we have systematically analyzed and aggregated 27 frameworks employed by academics analyzing dams' social impacts (found in a set of 217 articles). A key finding of the analysis is that currently used frameworks are often not specific to dams and thus omit key impacts associated with them. The result of our analysis and aggregation is a new framework for scholarly analysis (which we call ‘matrix framework’) specifically on dams' social impacts, with space, time and value as its key dimensions as well as infrastructure, community and livelihood as its key components. Building on the scholarly understanding of this topic enables us to conceptualize the inherently complex and multidimensional issues of dams' social impacts in a holistic manner. If commonly employed in academia (and possibly in practice), this framework would enable more transparent assessment and comparison of projects.

The Impact of National Qualifications Frameworks: By Which Yardstick Do We Measure Dreams?

Science.gov (United States)

Pilcher, Nick; Fernie, Scott; Smith, Karen

2017-01-01

National Qualifications Frameworks (NQFs) are a global phenomenon. This is evidenced by their scale, coverage and intrinsic link with education policy across Europe and beyond. Research into their impact has encompassed a number of perspectives; theoretical, practical and evaluative. Yet, despite the existence of critical literature related to the…

A portfolio evaluation framework for air transportation improvement projects

Science.gov (United States)

Baik, Hyeoncheol

This thesis explores the application of portfolio theory to the Air Transportation System (ATS) improvement. The ATS relies on complexly related resources and different stakeholder groups. Moreover, demand for air travel is significantly increasing relative to capacity of air transportation. In this environment, improving the ATS is challenging. Many projects, which are defined as technologies or initiatives, for improvement have been proposed and some have been demonstrated in practice. However, there is no clear understanding of how well these projects work in different conditions nor of how they interact with each other or with existing systems. These limitations make it difficult to develop good project combinations, or portfolios that maximize improvement. To help address this gap, a framework for identifying good portfolios is proposed. The framework can be applied to individual projects or portfolios of projects. Projects or portfolios are evaluated using four different groups of factors (effectiveness, time-to-implement, scope of applicability, and stakeholder impacts). Portfolios are also evaluated in terms of interaction-determining factors (prerequisites, co-requisites, limiting factors, and amplifying factors) because, while a given project might work well in isolation, interdependencies between projects or with existing systems could result in lower overall performance in combination. Ways to communicate a portfolio to decision makers are also introduced. The framework is unique because (1) it allows using a variety of available data, and (2) it covers diverse benefit metrics. For demonstrating the framework, an application to ground delay management projects serves as a case study. The portfolio evaluation approach introduced in this thesis can aid decision makers and researchers at universities and aviation agencies such as Federal Aviation Administration (FAA), National Aeronautics and Space Administration (NASA), and Department of Defense (DoD), in

The social impacts of dams: A new framework for scholarly analysis

Energy Technology Data Exchange (ETDEWEB)

Kirchherr, Julian, E-mail: julian.kirchherr@sant.ox.ac.uk; Charles, Katrina J., E-mail: katrina.charles@ouce.ox.ac.uk

2016-09-15

No commonly used framework exists in the scholarly study of the social impacts of dams. This hinders comparisons of analyses and thus the accumulation of knowledge. The aim of this paper is to unify scholarly understanding of dams' social impacts via the analysis and aggregation of the various frameworks currently used in the scholarly literature. For this purpose, we have systematically analyzed and aggregated 27 frameworks employed by academics analyzing dams' social impacts (found in a set of 217 articles). A key finding of the analysis is that currently used frameworks are often not specific to dams and thus omit key impacts associated with them. The result of our analysis and aggregation is a new framework for scholarly analysis (which we call ‘matrix framework’) specifically on dams' social impacts, with space, time and value as its key dimensions as well as infrastructure, community and livelihood as its key components. Building on the scholarly understanding of this topic enables us to conceptualize the inherently complex and multidimensional issues of dams' social impacts in a holistic manner. If commonly employed in academia (and possibly in practice), this framework would enable more transparent assessment and comparison of projects.

Building clinical networks: a developmental evaluation framework.

Science.gov (United States)

Carswell, Peter; Manning, Benjamin; Long, Janet; Braithwaite, Jeffrey

2014-05-01

Clinical networks have been designed as a cross-organisational mechanism to plan and deliver health services. With recent concerns about the effectiveness of these structures, it is timely to consider an evidence-informed approach for how they can be developed and evaluated. To document an evaluation framework for clinical networks by drawing on the network evaluation literature and a 5-year study of clinical networks. We searched literature in three domains: network evaluation, factors that aid or inhibit network development, and on robust methods to measure network characteristics. This material was used to build a framework required for effective developmental evaluation. The framework's architecture identifies three stages of clinical network development; partner selection, network design and network management. Within each stage is evidence about factors that act as facilitators and barriers to network growth. These factors can be used to measure progress via appropriate methods and tools. The framework can provide for network growth and support informed decisions about progress. For the first time in one place a framework incorporating rigorous methods and tools can identify factors known to affect the development of clinical networks. The target user group is internal stakeholders who need to conduct developmental evaluation to inform key decisions along their network's developmental pathway.

Diversity training for the community aged care workers: A conceptual framework for evaluation.

Science.gov (United States)

Appannah, Arti; Meyer, Claudia; Ogrin, Rajna; McMillan, Sally; Barrett, Elizabeth; Browning, Colette

2017-08-01

Older Australians are an increasingly diverse population, with variable characteristics such as culture, sexual orientation, socioeconomic status, and physical capabilities potentially influencing their participation in healthcare. In response, community aged care workers may need to increase skills and uptake of knowledge into practice regarding diversity through appropriate training interventions. Diversity training (DT) programs have traditionally existed in the realm of business, with little research attention devoted to scientifically evaluating the outcomes of training directed at community aged care workers. A DT workshop has been developed for community aged care workers, and this paper focuses on the construction of a formative evaluative framework for the workshop. Key evaluation concepts and measures relating to DT have been identified in the literature and integrated into the framework, focusing on five categories: Training needs analysis; Reactions; Learning outcomes, Behavioural outcomes and Results The use of a mixed methods approach in the framework provides an additional strength, by evaluating long-term behavioural change and improvements in service delivery. As little is known about the effectiveness of DT programs for community aged care workers, the proposed framework will provide an empirical and consistent method of evaluation, to assess their impact on enhancing older people's experience of healthcare. Copyright © 2017 Elsevier Ltd. All rights reserved.

The WellingTONNE Challenge Toolkit: Using the RE-AIM Framework to Evaluate a Community Resource Promoting Healthy Lifestyle Behaviours

Science.gov (United States)

Caperchione, Cristina; Coulson, Fiona

2010-01-01

Objective: The RE-AIM framework has been recognized as a tool to evaluate the adoption, delivery, and sustainability of an intervention, and estimate its potential public health impact. In this study four dimensions of the RE-AIM framework (adoption, implementation, effectiveness, and maintenance) were used to evaluate the WellingTONNE Challenge…

Cross-cultural medical education: conceptual approaches and frameworks for evaluation.

Science.gov (United States)

Betancourt, Joseph R

2003-06-01

Given that understanding the sociocultural dimensions underlying a patient's health values, beliefs, and behaviors is critical to a successful clinical encounter, cross-cultural curricula have been incorporated into undergraduate medical education. The goal of these curricula is to prepare students to care for patients from diverse social and cultural backgrounds, and to recognize and appropriately address racial, cultural, and gender biases in health care delivery. Despite progress in the field of cross-cultural medical education, several challenges exist. Foremost among these is the need to develop strategies to evaluate the impact of these curricular interventions. This article provides conceptual approaches for cross-cultural medical education, and describes a framework for student evaluation that focuses on strategies to assess attitudes, knowledge, and skills, and the impact of curricular interventions on health outcomes.

Developing a cultural context for conducting a neuropsychological evaluation with a culturally diverse client: the ECLECTIC framework.

Science.gov (United States)

Fujii, Daryl E M

2018-02-20

With the increasing diversification of the American population, the discipline of neuropsychology is challenged to develop appropriate tools and conceptual models to meet its evolving client base. Thus far, the focus has been on developing appropriate tests and norms to obtain accurate testing data. By contrast, far less attention has been paid to the contextual impact of culture on an evaluation. This paper attempts to address this shortcoming. This manuscript introduces the ECLECTIC framework for conceptualizing different facets of culture pertinent for understanding a culturally diverse client when conducting a neuropsychological evaluation. Individual components of the framework (E: education and literacy; C: culture and acculturation; L: language; E: economics; C: communication; T: testing situation: comfort and motivation; I: intelligence conceptualization; and C: context of immigration) are introduced and potential biases to fairness in testing are described. In this manner, the framework specifies how individual facets of culture can impact neuropsychological test performance. Clinical implementation of the framework will be illustrated with a case sample. Strengths and weaknesses of the framework are discussed as well as recommendations for implementation.

Comparative Human Health Impact Assessment of Engineered Nanomaterials in the Framework of Life Cycle Assessment.

Science.gov (United States)

Fransman, Wouter; Buist, Harrie; Kuijpers, Eelco; Walser, Tobias; Meyer, David; Zondervan-van den Beuken, Esther; Westerhout, Joost; Klein Entink, Rinke H; Brouwer, Derk H

2017-07-01

For safe innovation, knowledge on potential human health impacts is essential. Ideally, these impacts are considered within a larger life-cycle-based context to support sustainable development of new applications and products. A methodological framework that accounts for human health impacts caused by inhalation of engineered nanomaterials (ENMs) in an indoor air environment has been previously developed. The objectives of this study are as follows: (i) evaluate the feasibility of applying the CF framework for NP exposure in the workplace based on currently available data; and (ii) supplement any resulting knowledge gaps with methods and data from the life cycle approach and human risk assessment (LICARA) project to develop a modified case-specific version of the framework that will enable near-term inclusion of NP human health impacts in life cycle assessment (LCA) using a case study involving nanoscale titanium dioxide (nanoTiO 2 ). The intent is to enhance typical LCA with elements of regulatory risk assessment, including its more detailed measure of uncertainty. The proof-of-principle demonstration of the framework highlighted the lack of available data for both the workplace emissions and human health effects of ENMs that is needed to calculate generalizable characterization factors using common human health impact assessment practices in LCA. The alternative approach of using intake fractions derived from workplace air concentration measurements and effect factors based on best-available toxicity data supported the current case-by-case approach for assessing the human health life cycle impacts of ENMs. Ultimately, the proposed framework and calculations demonstrate the potential utility of integrating elements of risk assessment with LCA for ENMs once the data are available. © 2016 Society for Risk Analysis.

A proposed analytic framework for determining the impact of an antimicrobial resistance intervention.

Science.gov (United States)

Grohn, Yrjo T; Carson, Carolee; Lanzas, Cristina; Pullum, Laura; Stanhope, Michael; Volkova, Victoriya

2017-06-01

Antimicrobial use (AMU) is increasingly threatened by antimicrobial resistance (AMR). The FDA is implementing risk mitigation measures promoting prudent AMU in food animals. Their evaluation is crucial: the AMU/AMR relationship is complex; a suitable framework to analyze interventions is unavailable. Systems science analysis, depicting variables and their associations, would help integrate mathematics/epidemiology to evaluate the relationship. This would identify informative data and models to evaluate interventions. This National Institute for Mathematical and Biological Synthesis AMR Working Group's report proposes a system framework to address the methodological gap linking livestock AMU and AMR in foodborne bacteria. It could evaluate how AMU (and interventions) impact AMR. We will evaluate pharmacokinetic/dynamic modeling techniques for projecting AMR selection pressure on enteric bacteria. We study two methods to model phenotypic AMR changes in bacteria in the food supply and evolutionary genotypic analyses determining molecular changes in phenotypic AMR. Systems science analysis integrates the methods, showing how resistance in the food supply is explained by AMU and concurrent factors influencing the whole system. This process is updated with data and techniques to improve prediction and inform improvements for AMU/AMR surveillance. Our proposed framework reflects both the AMR system's complexity, and desire for simple, reliable conclusions.

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

Science.gov (United States)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

Informing the NCA: EPA's Climate Change Impact and Risk Analysis Framework

Science.gov (United States)

Sarofim, M. C.; Martinich, J.; Kolian, M.; Crimmins, A. R.

2017-12-01

The Climate Change Impact and Risk Analysis (CIRA) framework is designed to quantify the physical impacts and economic damages in the United States under future climate change scenarios. To date, the framework has been applied to 25 sectors, using scenarios and projections developed for the Fourth National Climate Assessment. The strength of this framework has been in the use of consistent climatic, socioeconomic, and technological assumptions and inputs across the impact sectors to maximize the ease of cross-sector comparison. The results of the underlying CIRA sectoral analyses are informing the sustained assessment process by helping to address key gaps related to economic valuation and risk. Advancing capacity and scientific literature in this area has created opportunity to consider future applications and strengthening of the framework. This presentation will describe the CIRA framework, present results for various sectors such as heat mortality, air & water quality, winter recreation, and sea level rise, and introduce potential enhancements that can improve the utility of the framework for decision analysis.

Project evaluation: one framework - four approaches

DEFF Research Database (Denmark)

Rode, Anna Le Gerstrøm; Svejvig, Per

. Introducing a framework that can help structure such evaluations, the aim of this paper is to contribute to project theory and practice by inspiring project researchers and aiding project workers in their efforts to open up the black box of projects and deliver relevant and valuable results......There are many theoretical and practical reasons for evaluating projects – including explorative arguments focusing on expanding descriptive knowledge on projects as well as normative arguments focusing on developing prescriptive knowledge of project management. Despite the need for effective...... project management and research methods that can assess effective project management methodologies, extant literature on evaluation procedures or guidelines on how to evaluate projects and/or project management is scarce. To address this challenge, this paper introduces an evaluation framework consisting...

Using an Environmental Intelligence Framework to Evaluate the Impacts of Ocean Acidification in the Arctic

Science.gov (United States)

Mathis, J. T.; Baskin, M.; Cross, J.

2016-12-01

The highly productive coastal seas of the Arctic Ocean are located in areas that are projected to experience strong global change, including rapid transitions in temperature and ocean acidification-driven changes in pH and other chemical parameters. Many of the marine organisms that may be most intensely affected by ocean acidification (OA) and other environmental stressors contribute substantially to the commercial fisheries of the Bering Sea and traditional subsistence food supplies across the Arctic. This could represent a looming challenge in many communities as the average prevalence of household food insecurity and very low food security in Alaska are already 12 percent and 4.3 percent, respectively. Here, we evaluate the patterns of dependence on marine resources within Alaska's Arctic that could be negatively impacted by OA and current community characteristics to assess the potential risk to the fishery sector from OA. We used a risk assessment framework to analyze an earth-system global model of ocean chemistry, fisheries harvest data, and demographic information. The analysis showed that regions around Alaska vary in their vulnerability to OA, but that each one will have to deal with possible impacts. Therefore, OA merits consideration in policy planning, as it may represent another challenge to Alaskan communities, some of which are already under acute socio-economic strains. With this in mind, we will present a number of adaptation strategies for communities living throughout Alaska's Arctic that could be applicable to other Arctic regions.

Evaluation of Frameworks for HSCT Design Optimization

Science.gov (United States)

Krishnan, Ramki

1998-01-01

This report is an evaluation of engineering frameworks that could be used to augment, supplement, or replace the existing FIDO 3.5 (Framework for Interdisciplinary Design and Optimization Version 3.5) framework. The report begins with the motivation for this effort, followed by a description of an "ideal" multidisciplinary design and optimization (MDO) framework. The discussion then turns to how each candidate framework stacks up against this ideal. This report ends with recommendations as to the "best" frameworks that should be down-selected for detailed review.

A framework for predicting impacts on ecosystem services ...

Science.gov (United States)

Protection of ecosystem services is increasingly emphasized as a risk-assessment goal, but there are wide gaps between current ecological risk-assessment endpoints and potential effects on services provided by ecosystems. The authors present a framework that links common ecotoxicological endpoints to chemical impacts on populations and communities and the ecosystem services that they provide. This framework builds on considerable advances in mechanistic effects models designed to span multiple levels of biological organization and account for various types of biological interactions and feedbacks. For illustration, the authors introduce 2 case studies that employ well-developed and validated mechanistic effects models: the inSTREAM individual-based model for fish populations and the AQUATOX ecosystem model. They also show how dynamic energy budget theory can provide a common currency for interpreting organism-level toxicity. They suggest that a framework based on mechanistic models that predict impacts on ecosystem services resulting from chemical exposure, combined with economic valuation, can provide a useful approach for informing environmental management. The authors highlight the potential benefits of using this framework as well as the challenges that will need to be addressed in future work. The framework introduced here represents an ongoing initiative supported by the National Institute of Mathematical and Biological Synthesis (NIMBioS; http://www.nimbi

Measuring the impact of methodological research: a framework and methods to identify evidence of impact.

Science.gov (United States)

Brueton, Valerie C; Vale, Claire L; Choodari-Oskooei, Babak; Jinks, Rachel; Tierney, Jayne F

2014-11-27

Providing evidence of impact highlights the benefits of medical research to society. Such evidence is increasingly requested by research funders and commonly relies on citation analysis. However, other indicators may be more informative. Although frameworks to demonstrate the impact of clinical research have been reported, no complementary framework exists for methodological research. Therefore, we assessed the impact of methodological research projects conducted or completed between 2009 and 2012 at the UK Medical Research Council Clinical Trials Unit Hub for Trials Methodology Research Hub, with a view to developing an appropriate framework. Various approaches to the collection of data on research impact were employed. Citation rates were obtained using Web of Science (http://www.webofknowledge.com/) and analyzed descriptively. Semistructured interviews were conducted to obtain information on the rates of different types of research output that indicated impact for each project. Results were then pooled across all projects. Finally, email queries pertaining to methodology projects were collected retrospectively and their content analyzed. Simple citation analysis established the citation rates per year since publication for 74 methodological publications; however, further detailed analysis revealed more about the potential influence of these citations. Interviews that spanned 20 individual research projects demonstrated a variety of types of impact not otherwise collated, for example, applications and further developments of the research; release of software and provision of guidance materials to facilitate uptake; formation of new collaborations and broad dissemination. Finally, 194 email queries relating to 6 methodological projects were received from 170 individuals across 23 countries. They provided further evidence that the methodologies were impacting on research and research practice, both nationally and internationally. We have used the information

Health services research evaluation principles. Broadening a general framework for evaluating health information technology.

Science.gov (United States)

Sockolow, P S; Crawford, P R; Lehmann, H P

2012-01-01

Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned. Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks. A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR. The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged. We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

A methodology for evaluating social impact of Environmental Education Master Training Program

Directory of Open Access Journals (Sweden)

Loret de Mola, E.

2014-01-01

Full Text Available The paper is intended to describe a methodology for evaluating social impact of Environmental Education master training program by presenting its main stages. The framework serving as starting point and other empirical methods lead to systematized and define the terms of environmental professional training, professional performance of the environmental educator, evaluation, evaluation of professional performance of environmental educators and impact evaluation; as well as distinguishing the functions of impact evaluation in the postgraduate program favoring professor, tutors and trainees development. Previously appraised by consulting experts who gave it high ranks, this methodology is currently being used in evaluating second and third editions.

Assessing concentrations and health impacts of air quality management strategies: Framework for Rapid Emissions Scenario and Health impact ESTimation (FRESH-EST).

Science.gov (United States)

Milando, Chad W; Martenies, Sheena E; Batterman, Stuart A

2016-09-01

In air quality management, reducing emissions from pollutant sources often forms the primary response to attaining air quality standards and guidelines. Despite the broad success of air quality management in the US, challenges remain. As examples: allocating emissions reductions among multiple sources is complex and can require many rounds of negotiation; health impacts associated with emissions, the ultimate driver for the standards, are not explicitly assessed; and long dispersion model run-times, which result from the increasing size and complexity of model inputs, limit the number of scenarios that can be evaluated, thus increasing the likelihood of missing an optimal strategy. A new modeling framework, called the "Framework for Rapid Emissions Scenario and Health impact ESTimation" (FRESH-EST), is presented to respond to these challenges. FRESH-EST estimates concentrations and health impacts of alternative emissions scenarios at the urban scale, providing efficient computations from emissions to health impacts at the Census block or other desired spatial scale. In addition, FRESH-EST can optimize emission reductions to meet specified environmental and health constraints, and a convenient user interface and graphical displays are provided to facilitate scenario evaluation. The new framework is demonstrated in an SO2 non-attainment area in southeast Michigan with two optimization strategies: the first minimizes emission reductions needed to achieve a target concentration; the second minimizes concentrations while holding constant the cumulative emissions across local sources (e.g., an emissions floor). The optimized strategies match outcomes in the proposed SO2 State Implementation Plan without the proposed stack parameter modifications or shutdowns. In addition, the lower health impacts estimated for these strategies suggest that FRESH-EST could be used to identify potentially more desirable pollution control alternatives in air quality management planning

Sediment Evaluation Framework for the Pacific Northwest

Science.gov (United States)

The Sediment Evaluation Framework provides a regional framework for assessment, characterization and management of sediments in the Pacific Northwest to determine suitability for unconfined in-water disposal.

Applying air pollution modelling within a multi-criteria decision analysis framework to evaluate UK air quality policies

Science.gov (United States)

Chalabi, Zaid; Milojevic, Ai; Doherty, Ruth M.; Stevenson, David S.; MacKenzie, Ian A.; Milner, James; Vieno, Massimo; Williams, Martin; Wilkinson, Paul

2017-10-01

A decision support system for evaluating UK air quality policies is presented. It combines the output from a chemistry transport model, a health impact model and other impact models within a multi-criteria decision analysis (MCDA) framework. As a proof-of-concept, the MCDA framework is used to evaluate and compare idealized emission reduction policies in four sectors (combustion in energy and transformation industries, non-industrial combustion plants, road transport and agriculture) and across six outcomes or criteria (mortality, health inequality, greenhouse gas emissions, biodiversity, crop yield and air quality legal compliance). To illustrate a realistic use of the MCDA framework, the relative importance of the criteria were elicited from a number of stakeholders acting as proxy policy makers. In the prototype decision problem, we show that reducing emissions from industrial combustion (followed very closely by road transport and agriculture) is more advantageous than equivalent reductions from the other sectors when all the criteria are taken into account. Extensions of the MCDA framework to support policy makers in practice are discussed.

Impact evaluation in multicultural educational projects : case: ADAPTYKES project

OpenAIRE

Kuusisto, Miika

2014-01-01

The objective of this thesis was to examine the common evaluation concepts of the European Union’s funded projects. Such concepts inter alia are effectiveness, impacts and sustainability. The aim was to study how these are realized in multicultural educational case–project in a context, where the project is funded by the European Commission’s Leonardo DaVinci Programme. Thesis introduces two evaluation approaches, which are Logical Framework Approach and Realistic evaluation model. The fi...

[How can the impact of Health Technology Assessment (HTA) in the Austrian healthcare system be assessed? Design of a conceptual framework].

Science.gov (United States)

Schumacher, I; Zechmeister, I

2012-04-01

In Austria research in Health Technology Assessment (HTA) has been conducted since the 1990s. Research in HTA aims at supporting an adequate and efficient use of health care resources in order to sustain a publicly financed and solidary health care system. Ultimately, HTA research should result in better health of the population. Research results should provide independent information for decision makers. For legitimizing further research resources and for prioritizing future HTA research and guaranteeing the value of future research, HTA research needs itself to undergo evaluation. Aim of the study is to design a conceptual framework for evaluating the impact of HTA research in Austria on the basis of the existing literature. An already existing review which presents methods and concepts how to evaluate HTA-impact was updated by a systematic research including literature of the years 2004-January 2010. Results were analysed in regard to 4 categories: definition of the term impact, target groups and system levels, operationalisation of indicators and evaluation methods. Overall, 19 publications were included. Referring to the 4 categories, an explanation of impact has to take into account HTAs multidisciplinary setting and needs a context related definition. Target groups, system levels, indicators and methods depend on the impact defined. Studies investigated direct and indirect impact and were focused on different target groups like physicians, nurses and decision makers on the micro-, and meso level, as well as politicians and reimbursement institutions on the macro level. Except for one reference all studies applied already known and mostly qualitative methods for measuring the impact of HTA research. Thus, an appropriate pool of instruments seems to be available. There is a lack of information about validity of applied methods and indicators. By adapting adequate methods and concepts a conceptual framework for the Austrian HTA-Impact evaluation has been

Evaluating genomic tests from bench to bedside: a practical framework

Directory of Open Access Journals (Sweden)

Lin Jennifer S

2012-10-01

Full Text Available Abstract The development of genomic tests is one of the most significant technological advances in medical testing in recent decades. As these tests become increasingly available, so does the need for a pragmatic framework to evaluate the evidence base and evidence gaps in order to facilitate informed decision-making. In this article we describe such a framework that can provide a common language and benchmarks for different stakeholders of genomic testing. Each stakeholder can use this framework to specify their respective thresholds for decision-making, depending on their perspective and particular needs. This framework is applicable across a broad range of test applications and can be helpful in the application and communication of a regulatory science for genomic testing. Our framework builds upon existing work and incorporates principles familiar to researchers involved in medical testing (both diagnostic and prognostic generally, as well as those involved in genomic testing. This framework is organized around six phases in the development of genomic tests beginning with marker identification and ending with population impact, and highlights the important knowledge gaps that need to be filled in establishing the clinical relevance of a test. Our framework focuses on the clinical appropriateness of the four main dimensions of test research questions (population/setting, intervention/index test, comparators/reference test, and outcomes rather than prescribing a hierarchy of study designs that should be used to address each phase.

A framework for evaluating the accessibility of raw materials from end-of-life products and the Earth's crust.

Science.gov (United States)

Mueller, Sandra R; Wäger, Patrick A; Turner, David A; Shaw, Peter J; Williams, Ian D

2017-10-01

An increasing number of geochemically scarce metallic raw materials are entering into our lives via new technologies. A reversal of this trend is not foreseeable, leading to concerns regarding the security of their supply. However, the evaluation of raw material supply is currently hampered by inconsistent use of fundamental terminologies and incomplete assessment criteria. In this paper, we aim to establish a consistent framework for evaluating raw material supply from both anthropogenic and geological sources. A method for concept extraction was applied to evaluate systematically the use of fundamental terms in the evaluation of raw material supply. The results have shown that 'availability' is commonly used in raw material supply evaluations, whilst other researchers suggest that raw material supply should be evaluated based on 'accessibility'. It was revealed that 'accessibility' actually comprises two aspects: 'availability' and 'approachability'. Raw material 'approachability' has not previously been explicitly addressed at a system level. A novel, consistent framework for evaluating raw material supply was therefore developed. To demonstrate the application of the established framework, we evaluated the raw material supply of four rare earth element case studies. Three case studies are End-of-Life products (the anthroposphere) from Switzerland: (i) phosphors in fluorescent lamps, (i) permanent magnets in the drive motors of electric cars and (iii) fibre optic cable. The fourth case study source is the Earth's crust (the geosphere): Mount Weld deposit in Australia. The framework comprises a comprehensive evaluation of six components relating to raw material mining and processing: their geological knowledge, eligibility, technology, economic, societal and environmental impacts. Our results show that metals are not considered to be fully accessible in any of the case studies due to a lack of necessary technologies and potential societal and environmental

Integrated evaluation framework. Based on the logical framework approach for project cycle management

International Nuclear Information System (INIS)

1996-11-01

This Integrated Evaluation Framework (IEF) was developed by TC Evaluation with the aim of presenting in a comprehensive manner the logic of thinking used when evaluating projects and programmes. Thus, in the first place, the intended audience for this report are evaluation officers, so that when applying the evaluation procedures and check lists, data can be organized following a systematic and logical scheme and conclusions can be derived ''objectively''. The value of such a framework for reporting on performance and in providing a quality reference for disbursements represents one of its major advantages. However, when developing and applying the IEF, it was realized that a Logical Framework Approach (LFA), like the one upon which the IEF is based, needs to be followed throughout the project life cycle, from the Country Programme Framework planning stage, through project design and implementation. Then, the helpful consequences flow into project design quality and smooth implementation. It is only in such an environment that meaningful and consistent evaluation can take place. Therefore the main audience for this report are Agency staff involved in planning, designing and implementing TC projects as well as their counterparts in Member States. In this understanding, the IEF was subjected to review by a consultants meeting, which included both external consultants and Agency staff. This Consultants Review Meeting encouraged the Secretariat to further adopt the LFA into the TC management process

A Framework for Assessing the Impacts of Mining Development on Regional Water Resources in Colombia

Directory of Open Access Journals (Sweden)

Neil McIntyre

2018-03-01

Full Text Available Developing its large-scale mining industry is an economic priority for Colombia. However, national capacity to assess and manage the water resource impacts of mining is currently limited. This includes lack of baseline data, lack of suitable hydrological models and lack of frameworks for evaluating risks. Furthermore, public opposition to large scale mining is high and is a barrier to many proposed new mining projects mainly because of concerns about impacts on water resources. There are also concerns about impacts on the uplands that are important water sources, particularly the páramo ecosystem. This paper argues the case for a new framework for Strategic Assessment of Regional Water Impacts of Mining, aiming to support land use planning decisions by government for selected mining and prospective mining regions. The proposed framework is modelled on the Australian Government’s Bioregional Assessments program, converted into seven stages plus supporting activities that meet the Colombian development context. The seven stages are: (1 Contextual information; (2 Scenario definition; (3 Risk scoping; (4 Model development; (5 Risk analysis; (6 Database development; and (7 Dissemination by government to stakeholders including the general public. It is emphasised that the process and results should be transparent, the data and models publicly accessible, and dissemination aimed at all levels of expertise.

Defining a quantitative framework for evaluation and optimisation of the environmental impacts of mega-event projects.

Science.gov (United States)

Parkes, Olga; Lettieri, Paola; Bogle, I David L

2016-02-01

This paper presents a novel quantitative methodology for the evaluation and optimisation of the environmental impacts of the whole life cycle of a mega-event project: construction and staging the event and post-event site redevelopment and operation. Within the proposed framework, a mathematical model has been developed that takes into account greenhouse gas (GHG) emissions resulting from use of transportation fuel, energy, water and construction materials used at all stages of the mega-event project. The model is applied to a case study - the London Olympic Park. Three potential post-event site design scenarios of the Park have been developed: Business as Usual (BAU), Commercial World (CW) and High Rise High Density (HRHD). A quantitative summary of results demonstrates that the highest GHG emissions associated with the actual event are almost negligible compared to those associated with the legacy phase. The highest share of emissions in the legacy phase is attributed to embodied emissions from construction materials (almost 50% for the BAU and HRHD scenarios) and emissions resulting from the transportation of residents, visitors and employees to/from the site (almost 60% for the CW scenario). The BAU scenario is the one with the lowest GHG emissions compared to the other scenarios. The results also demonstrate how post-event site design scenarios can be optimised to minimise the GHG emissions. The overall outcomes illustrate how the proposed framework can be used to support decision making process for mega-event projects planning. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

An ecosystem-based approach and management framework for the integrated evaluation of bivalve aquaculture impacts

DEFF Research Database (Denmark)

Cranford, Peter J.; Kamermans, Pauline; Krause, Gesche

2012-01-01

for bivalve aquaculture be based on a tiered indicator monitoring system that is structured on the principle that increased environmental risk requires increased monitoring effort. More than 1 threshold for each indicator would permit implementation of predetermined impact prevention and mitigation measures......An ecosystem-based approach to bivalve aquaculture management is a strategy for the integration of aquaculture within the wider ecosystem, including human aspects, in such a way that it promotes sustainable development, equity, and resilience of ecosystems. Given the linkage between social...... and ecological systems, marine regulators require an ecosystem-based decision framework that structures and integrates the relationships between these systems and facilitates communication of aquaculture–environment interactions and policy-related developments and decisions. The Drivers-Pressures-State Change-Impact-Response...

The training for health equity network evaluation framework: a pilot study at five health professional schools.

Science.gov (United States)

Ross, Simone J; Preston, Robyn; Lindemann, Iris C; Matte, Marie C; Samson, Rex; Tandinco, Filedito D; Larkins, Sarah L; Palsdottir, Bjorg; Neusy, Andre-Jacques

2014-01-01

The Training for Health Equity Network (THEnet), a group of diverse health professional schools aspiring toward social accountability, developed and pilot tested a comprehensive evaluation framework to assess progress toward socially accountable health professions education. The evaluation framework provides criteria for schools to assess their level of social accountability within their organization and planning; education, research and service delivery; and the direct and indirect impacts of the school and its graduates, on the community and health system. This paper describes the pilot implementation of testing the evaluation framework across five THEnet schools, and examines whether the evaluation framework was practical and feasible across contexts for the purposes of critical reflection and continuous improvement in terms of progress towards social accountability. In this pilot study, schools utilized the evaluation framework using a mixed method approach of data collection comprising of workshops, qualitative interviews and focus group discussions, document review and collation and analysis of existing quantitative data. The evaluation framework allowed each school to contextually gather evidence on how it was meeting the aspirational goals of social accountability across a range of school activities, and to identify strengths and areas for improvement and development. The evaluation framework pilot study demonstrated how social accountability can be assessed through a critically reflective and comprehensive process. As social accountability focuses on the relationship between health professions schools and health system and health population outcomes, each school was able to demonstrate to students, health professionals, governments, accrediting bodies, communities and other stakeholders how current and future health care needs of populations are addressed in terms of education, research, and service learning.

Evaluation Framework for NASA's Educational Outreach Programs

Science.gov (United States)

Berg, Rick; Booker, Angela; Linde, Charlotte; Preston, Connie

1999-01-01

The objective of the proposed work is to develop an evaluation framework for NASA's educational outreach efforts. We focus on public (rather than technical or scientific) dissemination efforts, specifically on Internet-based outreach sites for children.The outcome of this work is to propose both methods and criteria for evaluation, which would enable NASA to do a more analytic evaluation of its outreach efforts. The proposed framework is based on IRL's ethnographic and video-based observational methods, which allow us to analyze how these sites are actually used.

A Conceptual Framework for Vulnerability Assessment of Climate Change Impact on Critical Oil and Gas Infrastructure in the Niger Delta

Directory of Open Access Journals (Sweden)

Justin Udie

2018-02-01

Full Text Available The impact of climate change on the Niger Delta is severe, as extreme weather events have inflicted various degrees of stress on critical oil/gas infrastructure. Typically, assets managers and government agencies lack a clear framework for evaluating the vulnerability of these systems. This paper presents a participatory framework for the vulnerability assessment of critical oil/gas infrastructure to climate change impacts in the Niger Delta context. Through a critical review of relevant literature and triangulating observational and exploratory data from the field, this paper has developed a conceptual framework with three elements: (1 a preliminary scoping activity; (2 the vulnerability assessment; and (3 mainstreaming the results into institutional asset management codes. Scoping involves the definition of research aims and objectives, review of prevailing climate burdens and impacts, exploratory investigation, screening for new (planned assets and selection of relevant infrastructure. The emphasis on screening for planned infrastructure is to facilitate the incorporation of sustainable adaptive capacities into the original design of identified systems. A conceptual framework for vulnerability assessment is presented as a robust systematic iterative model for the evaluation of selected assets using an appropriate methodology. In this study, analytic hierarchy process (AHP is applied while mainstreaming as part of the research framework is emphasised to aid commercial implementation from an expert-based perspective. The study recommends the use of other suitable methodologies and systematic approaches to test the flexibility of the framework.

A framework for evaluating the public health impact of e-cigarettes and other vaporized nicotine products.

Science.gov (United States)

Levy, David T; Cummings, K Michael; Villanti, Andrea C; Niaura, Ray; Abrams, David B; Fong, Geoffrey T; Borland, Ron

2017-01-01

The use of vaporized nicotine products (VNPs), especially e-cigarettes and, to a lesser extent, pressurized aerosol nicotine products and heat-not-burn tobacco products, are being adopted increasingly as an alternative to smoking combusted products, primarily cigarettes. Considerable controversy has accompanied their marketing and use. We propose a framework that describes and incorporates patterns of VNP and combustible cigarette use in determining the total amount of toxic exposure effects on population health. We begin by considering toxicity and the outcomes relevant to population health. We then present the framework and define different measures of VNP use; namely, trial and long-term use for exclusive cigarette smokers, exclusive VNP and dual (cigarette and VNP) use. Using a systems thinking framework and decision theory we considered potential pathways for current, former and never users of VNPs. We then consider the evidence to date and the probable impacts of VNP use on public health, the potential effects of different policy approaches and the possible influence of the tobacco industry on VNP and cigarette use. © 2016 Society for the Study of Addiction.

Development of Quantitative Framework for Event Significance Evaluation

International Nuclear Information System (INIS)

Lee, Durk Hun; Kim, Min Chull; Kim, Inn Seock

2010-01-01

There is an increasing trend in quantitative evaluation of the safety significance of operational events using Probabilistic Safety Assessment (PSA) technique. An integrated framework for evaluation of event significance has been developed by Korea Institute of Nuclear Safety (KINS), which consists of an assessment hierarchy and a number of matrices. The safety significance of various events, e.g., internal or external initiating events that occurred during at-power or shutdown conditions, can be quantitatively analyzed using this framework, and then, the events rated according to their significance. This paper briefly describes the basic concept of the integrated quantitative framework for evaluation of event significance, focusing on the assessment hierarchy

A Comprehensive Framework for Evaluation in Design Science Research

DEFF Research Database (Denmark)

Pries-Heje, Jan; Baskerville, Richard; Venable, John

2012-01-01

Evaluation is a central and essential activity in conducting rigorous Design Science Research (DSR), yet there is surprisingly little guidance about designing the DSR evaluation activity beyond suggesting possible methods that could be used for evaluation. This paper extends the notable exception...... of the existing framework of Pries-Heje et al [11] to address this problem. The paper proposes an extended DSR evaluation framework together with a DSR evaluation design method that can guide DSR researchers in choosing an appropriate strategy for evaluation of the design artifacts and design theories that form...... the output from DSR. The extended DSR evaluation framework asks the DSR researcher to consider (as input to the choice of the DSR evaluation strategy) contextual factors of goals, conditions, and constraints on the DSR evaluation, e.g. the type and level of desired rigor, the type of artifact, the need...

Evaluating the environmental sustainability of biomass-based energy strategy: Using an impact matrix framework

Energy Technology Data Exchange (ETDEWEB)

Weldu, Yemane W., E-mail: ywweldem@ucalgary.ca [Faculty of Environmental Design, University of Calgary, Calgary, Alberta 2500, University Drive NW, T2N 1N4 (Canada); Assefa, Getachew [Faculty of Environmental Design, University of Calgary, Calgary, Alberta 2500, University Drive NW, T2N 1N4 (Canada); Athena Chair in Life Cycle Assessment in Design (Canada)

2016-09-15

A roadmap for a more sustainable energy strategy is complex, as its development interacts critically with the economic, social, and environmental dimensions of sustainable development. This paper applied an impact matrix method to evaluate the environmental sustainability and to identify the desirable policy objectives of biomass-based energy strategy for the case of Alberta. A matrix with the sustainability domains on one axis and areas of environmental impact on the other was presented to evaluate the nexus effect of policy objectives and bioenergy production. As per to our analysis, economic diversification, technological innovation, and resource conservation came up as the desirable policy objectives of sustainable development for Alberta because they demonstrated environmental benefits in all environmental impact categories, namely climate change, human health, and ecosystem. On the other hand, human health and ecosystem impacts were identified as trade-offs when the policy objectives for sustainability were energy security, job creation, and climate change. Thus, bioenergy can mitigate climate change but may impact human health and ecosystem which then in turn can become issues of concern. Energy strategies may result in shifting of risks from one environmental impact category to another, and from one sustainable domain to another if the technical and policy-related issues are not identified.

Evaluating the environmental sustainability of biomass-based energy strategy: Using an impact matrix framework

International Nuclear Information System (INIS)

Weldu, Yemane W.; Assefa, Getachew

2016-01-01

A roadmap for a more sustainable energy strategy is complex, as its development interacts critically with the economic, social, and environmental dimensions of sustainable development. This paper applied an impact matrix method to evaluate the environmental sustainability and to identify the desirable policy objectives of biomass-based energy strategy for the case of Alberta. A matrix with the sustainability domains on one axis and areas of environmental impact on the other was presented to evaluate the nexus effect of policy objectives and bioenergy production. As per to our analysis, economic diversification, technological innovation, and resource conservation came up as the desirable policy objectives of sustainable development for Alberta because they demonstrated environmental benefits in all environmental impact categories, namely climate change, human health, and ecosystem. On the other hand, human health and ecosystem impacts were identified as trade-offs when the policy objectives for sustainability were energy security, job creation, and climate change. Thus, bioenergy can mitigate climate change but may impact human health and ecosystem which then in turn can become issues of concern. Energy strategies may result in shifting of risks from one environmental impact category to another, and from one sustainable domain to another if the technical and policy-related issues are not identified.

Theoretical Framework for Robustness Evaluation

DEFF Research Database (Denmark)

Sørensen, John Dalsgaard

2011-01-01

This paper presents a theoretical framework for evaluation of robustness of structural systems, incl. bridges and buildings. Typically modern structural design codes require that ‘the consequence of damages to structures should not be disproportional to the causes of the damages’. However, although...... the importance of robustness for structural design is widely recognized the code requirements are not specified in detail, which makes the practical use difficult. This paper describes a theoretical and risk based framework to form the basis for quantification of robustness and for pre-normative guidelines...

The Macro- and Micropolitics of Personnel Evaluation: A Framework.

Science.gov (United States)

Bridges, Edwin M.; Groves, Barry R.

1999-01-01

Explicates a conceptual framework for analyzing the politics of personnel evaluation in an educational context. Using several elements of the framework, discusses the politics of teacher evaluation in California in relation to the types of personnel evaluation decisions, the actors, their access to these decisions, sources and levels of power, and…

An evaluation paradigm for cumulative impact analysis

Science.gov (United States)

Stakhiv, Eugene Z.

1988-09-01

Cumulative impact analysis is examined from a conceptual decision-making perspective, focusing on its implicit and explicit purposes as suggested within the policy and procedures for environmental impact analysis of the National Environmental Policy Act of 1969 (NEPA) and its implementing regulations. In this article it is also linked to different evaluation and decision-making conventions, contrasting a regulatory context with a comprehensive planning framework. The specific problems that make the application of cumulative impact analysis a virtually intractable evaluation requirement are discussed in connection with the federal regulation of wetlands uses. The relatively familiar US Army Corps of Engineers' (the Corps) permit program, in conjunction with the Environmental Protection Agency's (EPA) responsibilities in managing its share of the Section 404 regulatory program requirements, is used throughout as the realistic context for highlighting certain pragmatic evaluation aspects of cumulative impact assessment. To understand the purposes of cumulative impact analysis (CIA), a key distinction must be made between the implied comprehensive and multiobjective evaluation purposes of CIA, promoted through the principles and policies contained in NEPA, and the more commonly conducted and limited assessment of cumulative effects (ACE), which focuses largely on the ecological effects of human actions. Based on current evaluation practices within the Corps' and EPA's permit programs, it is shown that the commonly used screening approach to regulating wetlands uses is not compatible with the purposes of CIA, nor is the environmental impact statement (EIS) an appropriate vehicle for evaluating the variety of objectives and trade-offs needed as part of CIA. A heuristic model that incorporates the basic elements of CIA is developed, including the idea of trade-offs among social, economic, and environmental protection goals carried out within the context of environmental

A framework for the evaluation of new interventional procedures.

Science.gov (United States)

Lourenco, Tania; Grant, Adrian M; Burr, Jennifer M; Vale, Luke

2012-03-01

The introduction of new interventional procedures is less regulated than for other health technologies such as pharmaceuticals. Decisions are often taken on evidence of efficacy and short-term safety from small-scale usually observational studies. This reflects the particular challenges of evaluating interventional procedures - the extra facets of skill and training and the difficulty defining a 'new' technology. Currently, there is no framework to evaluate new interventional procedures before they become available in clinical practice as opposed to new pharmaceuticals. This paper proposes a framework to guide the evaluation of a new interventional procedure. A framework was developed consisting of a four-stage progressive evaluation for a new interventional procedure: Stage 1: Development; Stage 2: Efficacy and short-term safety; Stage 3: Effectiveness and cost-effectiveness; and Stage 4: Implementation. The framework also suggests the types of studies or data collection methods that can be used to satisfy each stage. This paper makes a first step on a framework for generating evidence on new interventional procedures. The difficulties and limitations of applying such a framework are discussed. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

A life cycle assessment framework combining nutritional and environmental health impacts of diet: a case study on milk

DEFF Research Database (Denmark)

Stylianou, Katerina S.; Heller, Martin C.; Fulgoni III, Victor L.

2016-01-01

of less healthy foods (sugar-sweetened beverages). Further studies are needed to test whether this conclusion holds within a more comprehensive assessment of environmental and nutritional health impacts. Conclusions This case study provides the first quantitative epidemiology-based estimate......Purpose While there has been considerable effort to understand the environmental impact of a food or diet, nutritional effects are not usually included in food-related life cycle assessment (LCA). Methods We developed a novel Combined Nutritional and Environmental Life Cycle Assessment (CONE......-LCA) framework that evaluates and compares in parallel the environmental and nutritional effects of foods or diets. We applied this framework to assess human health impacts, expressed in Disability Adjusted Life Years (DALYs), in a proof-of conceptcase study that investigated the environmental and nutritional...

Developing an evaluation framework for clinical redesign programs: lessons learnt.

Science.gov (United States)

Samaranayake, Premaratne; Dadich, Ann; Fitzgerald, Anneke; Zeitz, Kathryn

2016-09-19

Purpose The purpose of this paper is to present lessons learnt through the development of an evaluation framework for a clinical redesign programme - the aim of which was to improve the patient journey through improved discharge practices within an Australian public hospital. Design/methodology/approach The development of the evaluation framework involved three stages - namely, the analysis of secondary data relating to the discharge planning pathway; the analysis of primary data including field-notes and interview transcripts on hospital processes; and the triangulation of these data sets to devise the framework. The evaluation framework ensured that resource use, process management, patient satisfaction, and staff well-being and productivity were each connected with measures, targets, and the aim of clinical redesign programme. Findings The application of business process management and a balanced scorecard enabled a different way of framing the evaluation, ensuring measurable outcomes were connected to inputs and outputs. Lessons learnt include: first, the importance of mixed-methods research to devise the framework and evaluate the redesigned processes; second, the need for appropriate tools and resources to adequately capture change across the different domains of the redesign programme; and third, the value of developing and applying an evaluative framework progressively. Research limitations/implications The evaluation framework is limited by its retrospective application to a clinical process redesign programme. Originality/value This research supports benchmarking with national and international practices in relation to best practice healthcare redesign processes. Additionally, it provides a theoretical contribution on evaluating health services improvement and redesign initiatives.

Theoretical Framework for Robustness Evaluation

DEFF Research Database (Denmark)

Sørensen, John Dalsgaard

2011-01-01

This paper presents a theoretical framework for evaluation of robustness of structural systems, incl. bridges and buildings. Typically modern structural design codes require that ‘the consequence of damages to structures should not be disproportional to the causes of the damages’. However, althou...

EcoMark: Evaluating Models of Vehicular Environmental Impact

DEFF Research Database (Denmark)

Guo, Chenjuan; Ma, Mike; Yang, Bin

2012-01-01

The reduction of greenhouse gas (GHG) emissions from transporta- tion is essential for achieving politically agreed upon emissions re- duction targets that aim to combat global climate change. So-called eco-routing and eco-driving are able to substantially reduce GHG emissions caused by vehicular...... the vehicle travels in. We develop an evaluation framework, called EcoMark, for such environmental impact models. In addition, we survey all eleven state-of-the-art impact models known to us. To gain insight into the capabilities of the models and to understand the effectiveness of the EcoMark, we apply...

A qualitative evaluation approach for energy system modelling frameworks

DEFF Research Database (Denmark)

Wiese, Frauke; Hilpert, Simon; Kaldemeyer, Cord

2018-01-01

properties define how useful it is in regard to the existing challenges. For energy system models, evaluation methods exist, but we argue that many decisions upon properties are rather made on the model generator or framework level. Thus, this paper presents a qualitative approach to evaluate frameworks...

A framework for modeling scenario-based barrier island storm impacts

Science.gov (United States)

Mickey, Rangley; Long, Joseph W.; Dalyander, P. Soupy; Plant, Nathaniel G.; Thompson, David M.

2018-01-01

Methods for investigating the vulnerability of existing or proposed coastal features to storm impacts often rely on simplified parametric models or one-dimensional process-based modeling studies that focus on changes to a profile across a dune or barrier island. These simple studies tend to neglect the impacts to curvilinear or alongshore varying island planforms, influence of non-uniform nearshore hydrodynamics and sediment transport, irregular morphology of the offshore bathymetry, and impacts from low magnitude wave events (e.g. cold fronts). Presented here is a framework for simulating regionally specific, low and high magnitude scenario-based storm impacts to assess the alongshore variable vulnerabilities of a coastal feature. Storm scenarios based on historic hydrodynamic conditions were derived and simulated using the process-based morphologic evolution model XBeach. Model results show that the scenarios predicted similar patterns of erosion and overwash when compared to observed qualitative morphologic changes from recent storm events that were not included in the dataset used to build the scenarios. The framework model simulations were capable of predicting specific areas of vulnerability in the existing feature and the results illustrate how this storm vulnerability simulation framework could be used as a tool to help inform the decision-making process for scientists, engineers, and stakeholders involved in coastal zone management or restoration projects.

Development of a Framework for the Evaluation of the Environmental Benefits of Controlled Traffic Farming

Directory of Open Access Journals (Sweden)

Abdul Mounem Mouazen

2015-07-01

Full Text Available Although controlled traffic farming (CTF is an environmentally friendly soil management system, no quantitative evaluation of environmental benefits is available. This paper aims at establishing a framework for quantitative evaluation of the environmental benefits of CTF, considering a list of environmental benefits, namely, reducing soil compaction, runoff/erosion, energy requirement and greenhouse gas emission (GHG, conserving organic matter, enhancing soil biodiversity and fertiliser use efficiency. Based on a comprehensive literature review and the European Commission Soil Framework Directive, the choice of and the weighting of the impact of each of the environmental benefits were made. The framework was validated using data from three selected farms. For Colworth farm (Unilever, UK, the framework predicted the largest overall environmental benefit of 59.3% of the theoretically maximum achievable benefits (100%, as compared to the other two farms in Scotland (52% and Australia (47.3%. This overall benefit could be broken down into: reducing soil compaction (24%, tillage energy requirement (10% and GHG emissions (3%, enhancing soil biodiversity (7% and erosion control (6%, conserving organic matter (6%, and improving fertiliser use efficiency (3%. Similar evaluation can be performed for any farm worldwide, providing that data on soil properties, topography, machinery, and weather are available.

Towards an evaluation framework for Laboratory Information Systems.

Science.gov (United States)

Yusof, Maryati M; Arifin, Azila

Laboratory testing and reporting are error-prone and redundant due to repeated, unnecessary requests and delayed or missed reactions to laboratory reports. Occurring errors may negatively affect the patient treatment process and clinical decision making. Evaluation on laboratory testing and Laboratory Information System (LIS) may explain the root cause to improve the testing process and enhance LIS in supporting the process. This paper discusses a new evaluation framework for LIS that encompasses the laboratory testing cycle and the socio-technical part of LIS. Literature review on discourses, dimensions and evaluation methods of laboratory testing and LIS. A critical appraisal of the Total Testing Process (TTP) and the human, organization, technology-fit factors (HOT-fit) evaluation frameworks was undertaken in order to identify error incident, its contributing factors and preventive action pertinent to laboratory testing process and LIS. A new evaluation framework for LIS using a comprehensive and socio-technical approach is outlined. Positive relationship between laboratory and clinical staff resulted in a smooth laboratory testing process, reduced errors and increased process efficiency whilst effective use of LIS streamlined the testing processes. The TTP-LIS framework could serve as an assessment as well as a problem-solving tool for the laboratory testing process and system. Copyright © 2016 King Saud Bin Abdulaziz University for Health Sciences. Published by Elsevier Ltd. All rights reserved.

Outcome-based ventilation: A framework for assessing performance, health, and energy impacts to inform office building ventilation decisions.

Science.gov (United States)

Rackes, A; Ben-David, T; Waring, M S

2018-04-23

This article presents an outcome-based ventilation (OBV) framework, which combines competing ventilation impacts into a monetized loss function ($/occ/h) used to inform ventilation rate decisions. The OBV framework, developed for U.S. offices, considers six outcomes of increasing ventilation: profitable outcomes realized from improvements in occupant work performance and sick leave absenteeism; health outcomes from occupant exposure to outdoor fine particles and ozone; and energy outcomes from electricity and natural gas usage. We used the literature to set low, medium, and high reference values for OBV loss function parameters, and evaluated the framework and outcome-based ventilation rates using a simulated U.S. office stock dataset and a case study in New York City. With parameters for all outcomes set at medium values derived from literature-based central estimates, higher ventilation rates' profitable benefits dominated negative health and energy impacts, and the OBV framework suggested ventilation should be ≥45 L/s/occ, much higher than the baseline ~8.5 L/s/occ rate prescribed by ASHRAE 62.1. Only when combining very low parameter estimates for profitable impacts with very high ones for health and energy impacts were all outcomes on the same order. Even then, however, outcome-based ventilation rates were often twice the baseline rate or more. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Overview of the Special Issue: A Multi-Model Framework to Achieve Consistent Evaluation of Climate Change Impacts in the United States

Energy Technology Data Exchange (ETDEWEB)

Waldhoff, Stephanie T.; Martinich, Jeremy; Sarofim, Marcus; DeAngelo, B. J.; McFarland, Jim; Jantarasami, Lesley; Shouse, Kate C.; Crimmins, Allison; Ohrel, Sara; Li, Jia

2015-07-01

The Climate Change Impacts and Risk Analysis (CIRA) modeling exercise is a unique contribution to the scientific literature on climate change impacts, economic damages, and risk analysis that brings together multiple, national-scale models of impacts and damages in an integrated and consistent fashion to estimate climate change impacts, damages, and the benefits of greenhouse gas (GHG) mitigation actions in the United States. The CIRA project uses three consistent socioeconomic, emissions, and climate scenarios across all models to estimate the benefits of GHG mitigation policies: a Business As Usual (BAU) and two policy scenarios with radiative forcing (RF) stabilization targets of 4.5 W/m2 and 3.7 W/m2 in 2100. CIRA was also designed to specifically examine the sensitivity of results to uncertainties around climate sensitivity and differences in model structure. The goals of CIRA project are to 1) build a multi-model framework to produce estimates of multiple risks and impacts in the U.S., 2) determine to what degree risks and damages across sectors may be lowered from a BAU to policy scenarios, 3) evaluate key sources of uncertainty along the causal chain, and 4) provide information for multiple audiences and clearly communicate the risks and damages of climate change and the potential benefits of mitigation. This paper describes the motivations, goals, and design of the CIRA modeling exercise and introduces the subsequent papers in this special issue.

Framework for Evaluation of Equity Initiatives

Science.gov (United States)

Bexley, Emmaline; Harris, Kerri-Lee; James, Richard

2010-01-01

The Framework for Evaluation of Equity Initiatives has been prepared to support the Go8 Equity Strategy. Its purpose is to assist Group of Eight (Go8) universities to evaluate the effectiveness of their equity initiatives and interventions in the context of federal policies and the distinctive missions and responsibilities of the individual Go8…

A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies

Science.gov (United States)

van Limburg, Maarten; Ossebaard, Hans C; Kelders, Saskia M; Eysenbach, Gunther; Seydel, Erwin R

2011-01-01

Background Many eHealth technologies are not successful in realizing sustainable innovations in health care practices. One of the reasons for this is that the current development of eHealth technology often disregards the interdependencies between technology, human characteristics, and the socioeconomic environment, resulting in technology that has a low impact in health care practices. To overcome the hurdles with eHealth design and implementation, a new, holistic approach to the development of eHealth technologies is needed, one that takes into account the complexity of health care and the rituals and habits of patients and other stakeholders. Objective The aim of this viewpoint paper is to improve the uptake and impact of eHealth technologies by advocating a holistic approach toward their development and eventual integration in the health sector. Methods To identify the potential and limitations of current eHealth frameworks (1999–2009), we carried out a literature search in the following electronic databases: PubMed, ScienceDirect, Web of Knowledge, PiCarta, and Google Scholar. Of the 60 papers that were identified, 44 were selected for full review. We excluded those papers that did not describe hands-on guidelines or quality criteria for the design, implementation, and evaluation of eHealth technologies (28 papers). From the results retrieved, we identified 16 eHealth frameworks that matched the inclusion criteria. The outcomes were used to posit strategies and principles for a holistic approach toward the development of eHealth technologies; these principles underpin our holistic eHealth framework. Results A total of 16 frameworks qualified for a final analysis, based on their theoretical backgrounds and visions on eHealth, and the strategies and conditions for the research and development of eHealth technologies. Despite their potential, the relationship between the visions on eHealth, proposed strategies, and research methods is obscure, perhaps due to a

A framework to predict the impacts of shale gas infrastructures on the forest fragmentation of an agroforest region.

Science.gov (United States)

Racicot, Alexandre; Babin-Roussel, Véronique; Dauphinais, Jean-François; Joly, Jean-Sébastien; Noël, Pascal; Lavoie, Claude

2014-05-01

We propose a framework to facilitate the evaluation of the impacts of shale gas infrastructures (well pads, roads, and pipelines) on land cover features, especially with regards to forest fragmentation. We used a geographic information system and realistic development scenarios largely inspired by the PA (United States) experience, but adapted to a region of QC (Canada) with an already fragmented forest cover and a high gas potential. The scenario with the greatest impact results from development limited by regulatory constraints only, with no access to private roads for connecting well pads to the public road network. The scenario with the lowest impact additionally integrates ecological constraints (deer yards, maple woodlots, and wetlands). Overall the differences between these two scenarios are relatively minor, with shale gas industry, we show that it is possible, within a reasonable time frame, to produce a robust assessment of the impacts of shale gas extraction. The framework we propose could easily be applied to other contexts or jurisdictions.

A Framework for Usability Evaluation in EHR Procurement.

Science.gov (United States)

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

Evaluation of mobile systems: an integrative framework.

NARCIS (Netherlands)

Högler, T.; Versendaal, J.; Batenburg, R.

2015-01-01

This work presents an integrative framework for the evaluation of mobile systems. In comparison to stationary systems, mobile systems have a bundle of specific singularities that should be considered for evaluation. Further analysis of existing approaches clarifies that an integrative approach for

A Framework for Evaluating Stay Detection Approaches

Directory of Open Access Journals (Sweden)

Cornelia Schneider

2017-10-01

Full Text Available In recent years, sensors of mobile devices are increasingly used in the research field of Active and Assisted Living (AAL, in particular, for movement analysis. Questions, such as where users typically stay (and for how long, where they have been or where they will most likely be going to, are of utmost importance for implementing smart AAL services. Due to the plethora of application scenarios and varying requirements, the challenge is the identification of an appropriate stay detection approach. Thus, this paper presents a comprehensive framework covering the entire process from data acquisition, pre-processing, parameterization to evaluation so that it can be applied to evaluate various stay detection methods. Additionally, ground truth data as well as application field data are used within the framework. The framework has been validated with three different spatio-temporal clustering approaches (time-based/incremental clustering, extended density based clustering, and a mixed method approach. Using the framework with ground truth data and data from the AAL field, it can be concluded that the time-based/incremental clustering approach is most suitable for this type of AAL applications. Furthermore, using two different datasets has proven successful as it provides additional data for selecting the appropriate method. Finally, the way the framework is designed it might be applied to other domains such as transportation, mobility, or tourism by adapting the pre-selection criteria.

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

Science.gov (United States)

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

An evaluation framework for business process management products

NARCIS (Netherlands)

Koster, Stefan R.; Iacob, Maria Eugenia; Ferreira Pires, Luis; Rinderle-Ma, Stefanie; Sadiq, Shazia; Leymann, Frank

2010-01-01

The number of BPM products available has increased substantially in the last years, so that choosing among these products became a difficult task for potential BPM users. This paper defines a framework for evaluating BPM products, and discusses how this framework has been applied in the development

Conceptual framework for describing selected urban and community impacts of federal energy policies

Energy Technology Data Exchange (ETDEWEB)

Morris, F.A,; Marcus, A.A.; Keller, D.

1980-06-01

A conceptual framework is presented for describing selected urban and community impacts of Federal energy policies. The framework depends on a simple causal model. The outputs of the model are impacts, changes in the state of the world of particular interest to policymakers. At any given time, a set of determinants account for the state of the world with respect to an impact category. Application of the model to a particular impact category requires: establishing a definition and measure for the impact category and identifying the determinants of these impacts. Analysis of the impact of a particular policy requires the following: identifying the policy and its effects (as estimated by others), isolating any effects that themselves constitute an urban and community impact, identifying any effects that change the value of determinants, and describing the impact with reference to the new values of determinants. This report provides a framework for these steps. Three impacts addressed are: neighborhood stability, housing availability, and quality and availability of public services. In each chapter, a definition and measure for the impact are specified; its principal determinants are identified; how the causal model can be used to estimate impacts by applying it to three illustrative Federal policies (domestic oil price decontrol, building energy performance standards, and increased Federal aid for mass transit) is demonstrated. (MCW)

From expert-derived user needs to user-perceived ease of use and usefulness: a two-phase mixed-methods evaluation framework.

Science.gov (United States)

Boland, Mary Regina; Rusanov, Alexander; So, Yat; Lopez-Jimenez, Carlos; Busacca, Linda; Steinman, Richard C; Bakken, Suzanne; Bigger, J Thomas; Weng, Chunhua

2014-12-01

Underspecified user needs and frequent lack of a gold standard reference are typical barriers to technology evaluation. To address this problem, this paper presents a two-phase evaluation framework involving usability experts (phase 1) and end-users (phase 2). In phase 1, a cross-system functionality alignment between expert-derived user needs and system functions was performed to inform the choice of "the best available" comparison system to enable a cognitive walkthrough in phase 1 and a comparative effectiveness evaluation in phase 2. During phase 2, five quantitative and qualitative evaluation methods are mixed to assess usability: time-motion analysis, software log, questionnaires - System Usability Scale and the Unified Theory of Acceptance of Use of Technology, think-aloud protocols, and unstructured interviews. Each method contributes data for a unique measure (e.g., time motion analysis contributes task-completion-time; software log contributes action transition frequency). The measures are triangulated to yield complementary insights regarding user-perceived ease-of-use, functionality integration, anxiety during use, and workflow impact. To illustrate its use, we applied this framework in a formative evaluation of a software called Integrated Model for Patient Care and Clinical Trials (IMPACT). We conclude that this mixed-methods evaluation framework enables an integrated assessment of user needs satisfaction and user-perceived usefulness and usability of a novel design. This evaluation framework effectively bridges the gap between co-evolving user needs and technology designs during iterative prototyping and is particularly useful when it is difficult for users to articulate their needs for technology support due to the lack of a baseline. Copyright © 2013 Elsevier Inc. All rights reserved.

A Study on the Development of Improved Event Severity Evaluation Framework

International Nuclear Information System (INIS)

Lee, Yong Suk; Kim, Ji Tae; Lee, Durk Hun

2011-01-01

An integrated framework for evaluation of event significance developed early in 2010 (which is named as KNES framework). This framework allowed determination of the integrated event significance and the appropriate level of event response. However, the improvement of Knees framework was needed because the framework had the following limitations : - The KNES framework had some overlaps between the specific factors in matrices in many steps. - The KNES framework had not detailed guideline for event severity determination in some steps (for example, human factor assessment steps) - It was not easy to determine the event severity within a short time using the KNES framework. Etc. The KNES framework developed in 2010 has been recently improved by Korea Institute of Nuclear Safety (KINS). This paper describes the basic concept of the improved framework for evaluation of event significance, focusing on the assessment hierarchy

Evaluation of Learning Materials: A Holistic Framework

Science.gov (United States)

Bundsgaard, Jeppe; Hansen, Thomas Illum

2011-01-01

This paper presents a holistic framework for evaluating learning materials and designs for learning. A holistic evaluation comprises investigations of the potential learning potential, the actualised learning potential, and the actual learning. Each aspect is explained and exemplified through theoretical models and definitions. (Contains 3 figures…

Monitoring 'monitoring' and evaluating 'evaluation': an ethical framework for monitoring and evaluation in public health.

Science.gov (United States)

Gopichandran, Vijayaprasad; Indira Krishna, Anil Kumar

2013-01-01

Monitoring and evaluation (M&E) is an essential part of public health programmes. Since M&E is the backbone of public health programmes, ethical considerations are important in their conduct. Some of the key ethical considerations are avoiding conflicts of interest, maintaining independence of judgement, maintaining fairness, transparency, full disclosure, privacy and confidentiality, respect, responsibility, accountability, empowerment and sustainability. There are several ethical frameworks in public health, but none focusing on the monitoring and evaluation process. There is a need to institutionalise the ethical review of M&E proposals. A theoretical framework for ethical considerations is proposed in this paper. This proposed theoretical framework can act as the blueprint for building the capacity of ethics committees to review M&E proposals. A case study is discussed in this context. After thorough field testing, this practical and field-based ethical framework can be widely used by donor agencies, M&E teams, institutional review boards and ethics committees.

A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation

Science.gov (United States)

Chen, Yinpeng; Duff, Margaret; Lehrer, Nicole; Sundaram, Hari; He, Jiping; Wolf, Steven L.; Rikakis, Thanassis

2011-06-01

This paper presents a novel generalized computational framework for quantitative kinematic evaluation of movement in a rehabilitation clinic setting. The framework integrates clinical knowledge and computational data-driven analysis together in a systematic manner. The framework provides three key benefits to rehabilitation: (a) the resulting continuous normalized measure allows the clinician to monitor movement quality on a fine scale and easily compare impairments across participants, (b) the framework reveals the effect of individual movement components on the composite movement performance helping the clinician decide the training foci, and (c) the evaluation runs in real-time, which allows the clinician to constantly track a patient's progress and make appropriate adaptations to the therapy protocol. The creation of such an evaluation is difficult because of the sparse amount of recorded clinical observations, the high dimensionality of movement and high variations in subject's performance. We address these issues by modeling the evaluation function as linear combination of multiple normalized kinematic attributes y = Σwiφi(xi) and estimating the attribute normalization function φi(ṡ) by integrating distributions of idealized movement and deviated movement. The weights wi are derived from a therapist's pair-wise comparison using a modified RankSVM algorithm. We have applied this framework to evaluate upper limb movement for stroke survivors with excellent results—the evaluation results are highly correlated to the therapist's observations.

A framework for performance evaluation of model-based optical trackers

NARCIS (Netherlands)

Smit, F.A.; Liere, van R.

2008-01-01

We describe a software framework to evaluate the performance of model-based optical trackers in virtual environments. The framework can be used to evaluate and compare the performance of different trackers under various conditions, to study the effects of varying intrinsic and extrinsic camera

Framework Proposal for DevOps Maturity Evaluation

Directory of Open Access Journals (Sweden)

Carlos de Amorim Levita

2018-01-01

Full Text Available This paper proposes a framework for evaluating the DevOps maturity in organizations. The methodology was based on a literature review from which a theory was developed that sought to relate the main DevOps practices. For each of them, some research constructs were defined, which are precisely the objects to be measured by this model. Through a structure based on questions with graded answers, it is possible to indicate how much the unit of analysis that is being evaluated adheres to a DevOps approach in the development and implementation of applications. Therefore, the main contribution of this work is the DevOps maturity evaluation framework that can be easily replicated and, because of that, may be used by several companies to map possible improvement points in their implementation of the DevOps perspective for software development.

A Conceptual Framework for the Evaluation of Emergency Risk Communications

Science.gov (United States)

Lin, Leesa; Gamhewage, Gaya M.

2017-01-01

Objectives. To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). Methods. The framework proposed is based on a systematic review of the scientific literature (2001–2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. Results. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees’ data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Conclusions. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies. PMID:28892436

A Conceptual Framework for the Evaluation of Emergency Risk Communications.

Science.gov (United States)

Savoia, Elena; Lin, Leesa; Gamhewage, Gaya M

2017-09-01

To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). The framework proposed is based on a systematic review of the scientific literature (2001-2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees' data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies.

Monitoring and evaluation of spatially managed areas: A generic framework for implementation of ecosystem based marine management and its application

DEFF Research Database (Denmark)

Stelzenmüller, Vanessa; Breen, Patricia; Stamford, Tammy

2013-01-01

This study introduces a framework for the monitoring and evaluation of spatially managed areas (SMAs), which is currently being tested by nine European case studies. The framework provides guidance on the selection, mapping, and assessment of ecosystem components and human pressures, the evaluati...... on qualitative information are addressed. The lessons learned will provide a better insight into the full range of methods and approaches required to support the implementation of the ecosystem approach to marine spatial management in Europe and elsewhere.......This study introduces a framework for the monitoring and evaluation of spatially managed areas (SMAs), which is currently being tested by nine European case studies. The framework provides guidance on the selection, mapping, and assessment of ecosystem components and human pressures, the evaluation...... of management effectiveness and potential adaptations to management. Moreover, it provides a structured approach with advice on spatially explicit tools for practical tasks like the assessment of cumulative impacts of human pressures or pressure-state relationships. The case studies revealed emerging challenges...

The MIXED framework: A novel approach to evaluating mixed-methods rigor.

Science.gov (United States)

Eckhardt, Ann L; DeVon, Holli A

2017-10-01

Evaluation of rigor in mixed-methods (MM) research is a persistent challenge due to the combination of inconsistent philosophical paradigms, the use of multiple research methods which require different skill sets, and the need to combine research at different points in the research process. Researchers have proposed a variety of ways to thoroughly evaluate MM research, but each method fails to provide a framework that is useful for the consumer of research. In contrast, the MIXED framework is meant to bridge the gap between an academic exercise and practical assessment of a published work. The MIXED framework (methods, inference, expertise, evaluation, and design) borrows from previously published frameworks to create a useful tool for the evaluation of a published study. The MIXED framework uses an experimental eight-item scale that allows for comprehensive integrated assessment of MM rigor in published manuscripts. Mixed methods are becoming increasingly prevalent in nursing and healthcare research requiring researchers and consumers to address issues unique to MM such as evaluation of rigor. © 2017 John Wiley & Sons Ltd.

A Conceptual Framework Curriculum Evaluation Electrical Engineering Education

Science.gov (United States)

Imansari, Nurulita; Sutadji, Eddy

2017-01-01

This evaluation is a conceptual framework that has been analyzed in the hope that can help research related an evaluation of the curriculum. The Model of evaluation used was CIPPO model. CIPPO Model consists of "context," "input," "process," "product," and "outcomes." On the dimension of the…

Measuring the health systems impact of disease control programmes: a critical reflection on the WHO building blocks framework.

Science.gov (United States)

Mounier-Jack, Sandra; Griffiths, Ulla K; Closser, Svea; Burchett, Helen; Marchal, Bruno

2014-03-25

The WHO health systems Building Blocks framework has become ubiquitous in health systems research. However, it was not developed as a research instrument, but rather to facilitate investments of resources in health systems. In this paper, we reflect on the advantages and limitations of using the framework in applied research, as experienced in three empirical vaccine studies we have undertaken. We argue that while the Building Blocks framework is valuable because of its simplicity and ability to provide a common language for researchers, it is not suitable for analysing dynamic, complex and inter-linked systems impacts. In our three studies, we found that the mechanical segmentation of effects by the WHO building blocks, without recognition of their interactions, hindered the understanding of impacts on systems as a whole. Other important limitations were the artificial equal weight given to each building block and the challenge in capturing longer term effects and opportunity costs. Another criticism is not of the framework per se, but rather how it is typically used, with a focus on the six building blocks to the neglect of the dynamic process and outcome aspects of health systems.We believe the framework would be improved by making three amendments: integrating the missing "demand" component; incorporating an overarching, holistic health systems viewpoint and including scope for interactions between components. If researchers choose to use the Building Blocks framework, we recommend that it be adapted to the specific study question and context, with formative research and piloting conducted in order to inform this adaptation. As with frameworks in general, the WHO Building Blocks framework is valuable because it creates a common language and shared understanding. However, for applied research, it falls short of what is needed to holistically evaluate the impact of specific interventions on health systems. We propose that if researchers use the framework, it

A framework for m-health service development and success evaluation.

Science.gov (United States)

Sadegh, S Saeedeh; Khakshour Saadat, Parisa; Sepehri, Mohammad Mehdi; Assadi, Vahid

2018-04-01

The emergence of mobile technology has influenced many service industries including health care. Mobile health (m-Health) applications have been used widely, and many services have been developed that have changed delivery systems and have improved effectiveness of health care services. Stakeholders of m-Health services have various resources and rights that lends to a complexity in service delivery. In addition, abundance of different m-Health services makes it difficult to choose an appropriate service for these stakeholders that include customers, patients, users or even providers. Moreover, a comprehensive framework is not yet provided in the literature that would help manage and evaluate m-health services, considering various stakeholder's benefits. In this paper, a comprehensive literature review has been done on famous frameworks and models in the field of Information Technology and electronic health with the aim of finding different aspects of developing and managing m-health services. Using the results of literature review and conducting a stakeholder analysis, we have proposed an m-health evaluation framework which evaluates the success of a given m-health service through a three-stage life cycle: (1) Service Requirement Analysis, (2) Service Development, and (3) Service Delivery. Key factors of m-health evaluation in each step are introduced in the proposed framework considering m-health key stakeholder's benefits. The proposed framework is validated via expert interviews, and key factors in each evaluation step is validated using PLS model. Results show that path coefficients are higher than their threshold which supports the validity of proposed framework. Copyright © 2018 Elsevier B.V. All rights reserved.

Evaluating health-promoting schools in Hong Kong: development of a framework.

Science.gov (United States)

Lee, Albert; Cheng, Frances F K; St Leger, Lawry

2005-06-01

Health-promoting schools (HPS)/healthy schools have existed internationally for about 15 years. Yet there are few comprehensive evaluation frameworks available which enable the outcomes of HPS initiatives to be assessed. This paper identifies an evaluation framework developed in Hong Kong. The framework uses a range of approaches to explore what schools actually do in their health promotion and health education initiatives. The framework, which is based on the WHO (Western Pacific Regional Office) Guidelines for HPS, is described in detail. The appropriate instruments for data collection are described and their origins identified. The evaluation plan and protocol, which underpinned the very comprehensive evaluation in Hong Kong, are explained. Finally, a case is argued for evaluation of HPS to be more in line with the educational dynamics of schools and the research literature on effective schooling, rather than focusing primarily on health-related measures.

A framework for the monitoring and evaluation of international surgical initiatives in low- and middle-income countries.

Science.gov (United States)

Ibrahim, George M; Cadotte, David W; Bernstein, Mark

2015-01-01

An estimated two billion people worldwide lack adequate access to surgical care. To address this humanitarian emergency, an increasing number of international surgical partnerships are emerging between developed and low- and middle-income countries (LMICs). At present, there are no clear indicators that may be used to assess the effectiveness of such initiatives. We conducted an international qualitative study of 31 surgeons from developed and LMICs involved in international partnerships across a variety of subspecialties. Thematic analysis and grounded theory were applied in order to develop a practical framework that may be applied to monitor and evaluate global surgical initiatives. Several themes emerged from the study: (i) there is a large unmet need to establish and maintain prospective databases in LMICs to inform the monitoring and evaluation of international surgical partnerships; (ii) assessment of initiatives must occur longitudinally over the span of several years; (ii) the domains of assessment are contextual and encompass cultural, institutional and regional factors; and (iv) evaluation strategies should explore broader impact within the community and country. Based on thematic analysis within the domains of inputs, outputs and outcomes, a framework for the monitoring and evaluation of international surgical initiatives, the Framework for the Assessment of InteRNational Surgical Success (FAIRNeSS) is proposed. In response to the increasing number of surgical partnerships between developed and LMICs, we propose a framework to monitor and evaluate international surgical initiatives.

Outlining an analytical framework for mapping research evaluation landscapes

Energy Technology Data Exchange (ETDEWEB)

Åström, F.

2016-07-01

This paper suggests an infrastructure perspective, as suggested by Star and Bowker (2006), as an analytical framework for studying the research evaluation landscape. An infrastructure is suggested to be understood, not as a concrete technology, but as a system of contextual factors including ‘Actors/Stakeholders’, ‘Technical systems’, and ‘Evaluation practices’. How the framework can be operationationalized is exemplified by examples from previous and ongoing research, as well as by identify gaps in current research. (Author)

Framework for assessment of environmental impact (Fasset)

International Nuclear Information System (INIS)

Larsson, C.M.

2002-01-01

The overall aim of the FASSET project is to develop a framework within which assessment models, relevant to the impact of ionising radiation on the environment, can be applied and results analysed for European ecosystems. Complete documentation on the FASSET project can be found on the FASSET's web-site (www.fasset.org). This paper describes the current state of the project, based on the project's first Annual Report. Seven European ecosystems are considered; four terrestrial (natural forests, semi-natural pastures, agricultural ecosystems and wetlands) and three aquatic (marine, brackish and freshwater). In FASSET Deliverable 1 a list of candidate generic reference organisms has been drawn up on the basis of expert judgement of exposure situations in the selected ecosystems. They serve as a starting points for development of dosimetric models, and for pooling available information on ecological relevance and biological effects. Further analysis of the candidate reference organisms is performed to justify their choice and assess their applicability in different situations, taking into account modelling of radionuclide transfer, estimates of internal and external dose rates, ecological significance and biological effects. Four general 'umbrella' radiation effects on biota are considered that, when manifested in an individual, may have an impact at population level or at higher levels of the organisational hierarchy. The four 'umbrellas' are: morbidity (fitness or well-being), mortality (death directly attributable to radiation), reproductive success (changed number of offspring) and scorable cytogenetic effects (molecular actions, aberrations). A database is being assembled, compiling dose and dose rates data from the literature for a number of organism categories for each of these four umbrella effects. The database also considers the suitability of data to derive the relative biological efficiency (RBE) for different types of radiation. The work from the three

Development of a Conceptual Framework to Measure the Social Impact of Burns.

Science.gov (United States)

Marino, Molly; Soley-Bori, Marina; Jette, Alan M; Slavin, Mary D; Ryan, Colleen M; Schneider, Jeffrey C; Resnik, Linda; Acton, Amy; Amaya, Flor; Rossi, Melinda; Soria-Saucedo, Rene; Kazis, Lewis E

Measuring community reintegration following burn injury is important to assess the efficacy of therapies designed to optimize recovery. This project aims to develop and validate a conceptual framework for understanding the social impact of burn injuries in adults. The framework is critical for developing the item banks used for a computerized adaptive test. We performed a comprehensive literature review and consulted with clinical experts and burn survivors about social life areas impacted by burn injury. Focus groups with burn survivors and clinicians were conducted to inform and validate the framework. Transcripts were coded using grounded theory methodology. The World Health Organization's International Classification of Functioning, Disability and Health, was chosen to ground the content model. The primary construct identified was social participation, which contains two concepts: societal role and personal relationships. The subdomains chosen for item development were work, recreation and leisure, relating with strangers, and romantic, sexual, family, and informal relationships. Qualitative results strongly suggest that the conceptual model fits the constructs for societal role and personal relationships with the respective subdomains. This conceptual framework has guided the implementation of a large-scale calibration study currently underway which will lead to a computerized adaptive test for monitoring the social impacts of burn injuries during recovery.

Evaluation of Augmented Reality Frameworks for Android Development

Directory of Open Access Journals (Sweden)

Iulia Marneanu

2014-10-01

Full Text Available Augmented Reality (AR is the evolution of the concept of Virtual Reality (VR. Its goal is to enhance a person's perception of the surrounding world. AR is a fast growing state of the art technology and a variety of implementation tools thereof exist today. Due to the heterogeneity of available technologies, the choice of the appropriate framework for a mobile application is difficult to make. These frameworks implement different tracking techniques and have to provide support to various constraints. This publication aims to point out that the choice of the appropriate framework depends on the context of the app to be developed. As expected, it is accurate that no framework is entirely the best, but rather that each exhibits strong and weak points. Our results demonstrate that given a set of constraints, one framework can outperform others. We anticipate our research to be the starting point for testing of other frameworks, given various constraints. The frameworks evaluated here are open-source or have been purchased under Academic License.

A framework for quantifying the extent of impact to plants from linear construction.

Science.gov (United States)

Xiao, Jun; Shi, Peng; Wang, Ya-Feng; Yu, Yang; Yang, Lei

2017-05-30

We present a novel framework that accurately evaluates the extent of a linear project's effect from the variability of the structure of the plant community while avoiding interference caused by pioneer species and invasive species. This framework was based on the change of dominant species in the plant community affected by construction. TWINSPAN classification and variation of the integrated importance value (IIV) of each plant species group were used to characterize the process of change in the structure of the plant community. Indicator species group and its inflection point were defined and used to judge the extent of the effects of pipelines. Our findings revealed that dominant species in the working area of the pipeline construction were different from the original plant communities. With the disturbance decreased, the composition and structure of the plant communities gradually changed. We considered the outer limit of the area affected by the construction to be the first area in which the plant community reached a steady state and was similar to the original community. The framework could be used in the post eco-environment impact assessment of linear construction to estimate the intensity of disturbance and recovery condition.

A conceptual framework for evaluation of public health and primary care system performance in iran.

Science.gov (United States)

Jahanmehr, Nader; Rashidian, Arash; Khosravi, Ardeshir; Farzadfar, Farshad; Shariati, Mohammad; Majdzadeh, Reza; Akbari Sari, Ali; Mesdaghinia, Alireza

2015-01-26

The main objective of this study was to design a conceptual framework, according to the policies and priorities of the ministry of health to evaluate provincial public health and primary care performance and to assess their share in the overall health impacts of the community. We used several tools and techniques, including system thinking, literature review to identify relevant attributes of health system performance framework and interview with the key stakeholders. The PubMed, Scopus, web of science, Google Scholar and two specialized databases of Persian language literature (IranMedex and SID) were searched using main terms and keywords. Following decision-making and collective agreement among the different stakeholders, 51 core indicators were chosen from among 602 obtained indicators in a four stage process, for monitoring and evaluation of Health Deputies. We proposed a conceptual framework by identifying the performance area for Health Deputies between other determinants of health, as well as introducing a chain of results, for performance, consisting of Input, Process, Output and Outcome indicators. We also proposed 5 dimensions for measuring the performance of Health Deputies, consisting of efficiency, effectiveness, equity, access and improvement of health status. The proposed Conceptual Framework illustrates clearly the Health Deputies success in achieving best results and consequences of health in the country. Having the relative commitment of the ministry of health and Health Deputies at the University of Medical Sciences is essential for full implementation of this framework and providing the annual performance report.

Health Information Technology Evaluation Framework (HITREF) Comprehensiveness as Assessed in Electronic Point-of-Care Documentation Systems Evaluations.

Science.gov (United States)

Sockolow, Paulina S; Bowles, Kathryn H; Rogers, Michelle

2015-01-01

We assessed the Health Information Technology (HIT) Reference-based Evaluation Framework (HITREF) comprehensiveness in two HIT evaluations in settings different from that in which the HITREF was developed. Clinician satisfaction themes that emerged from clinician interviews in the home care and the hospital studies were compared to the framework components. Across both studies, respondents commented on 12 of the 20 HITREF components within 5 of the 6 HITREF concepts. No new components emerged that were missing from the HITREF providing evidence that the HITREF is a comprehensive framework. HITREF use in a range of HIT evaluations by researchers new to the HITREF demonstrates that it can be used as intended. Therefore, we continue to recommend the HITREF as a comprehensive, research-based HIT evaluation framework to increase the capacity of informatics evaluators' use of best practice and evidence-based practice to support the credibility of their findings for fulfilling the purpose of program evaluation.

Development of a qualitative evaluation framework for performance shaping factors (PSFs) in advanced MCR HRA

International Nuclear Information System (INIS)

Lee, Seung Woo; Kim, Ar Ryum; Ha, Jun Su; Seong, Poong Hyun

2011-01-01

Highlights: → Context changes in advanced MCR have impact on PSFs. → PSFs in the 1st and 2nd generation HRA methods are reviewed. → We made a qualitative evaluation framework for PSF based on human factor issues. - Abstract: Human reliability analysis (HRA) is performed as part of the probabilistic risk assessment to identify and quantify human actions and the associated impacts on structures, systems, and components of complex facilities. In performing HRA, conditions that influence human performance have been analyzed in terms of several context factors. These context factors, which are called performance shaping factors (PSFs) are used to adjust the basic human error probability (BHEP), and PSFs have been derived in various ways depending on the HRA methods used. As the design of instrumentation and control (I and C) systems for nuclear power plants (NPPs) is rapidly moving toward fully digital I and C, and modern computer techniques have been gradually introduced into the design of advanced main control room (MCR), computer-based human-system interfaces (HSIs), such as CRT-based displays, large display panels (LDPs), advanced information systems, soft control, and computerized procedure system (CPS) will be applied in advanced MCR. Environmental changes in MCR have some implications for PSFs, and they have an influence on when PSFs should be applied in HRA because different situations might induce different internal or external factors which can lead to human errors. In this study, PSFs for advanced MCR HRA are derived, and a new qualitative evaluation framework for these PSFs is suggested. First, PSFs from various HRA methods are collected, and these PSFs are further grouped into PSFs categories to be used in advanced MCR HRA. Second, human factor (HF) issues in advanced MCR are analyzed and derived to be used as an evaluation framework for PSFs.

Evaluating social outcomes of HIV/AIDS interventions: a critical assessment of contemporary indicator frameworks.

Science.gov (United States)

Mannell, Jenevieve; Cornish, Flora; Russell, Jill

2014-01-01

Contemporary HIV-related theory and policy emphasize the importance of addressing the social drivers of HIV risk and vulnerability for a long-term response. Consequently, increasing attention is being given to social and structural interventions, and to social outcomes of HIV interventions. Appropriate indicators for social outcomes are needed in order to institutionalize the commitment to addressing social outcomes. This paper critically assesses the current state of social indicators within international HIV/AIDS monitoring and evaluation frameworks. We analyzed the indicator frameworks of six international organizations involved in efforts to improve and synchronize the monitoring and evaluation of the HIV/AIDS response. Our analysis classifies the 328 unique indicators according to what they measure and assesses the degree to which they offer comprehensive measurement across three dimensions: domains of the social context, levels of change and organizational capacity. The majority of indicators focus on individual-level (clinical and behavioural) interventions and outcomes, neglecting structural interventions, community interventions and social outcomes (e.g. stigma reduction; community capacity building; policy-maker sensitization). The main tool used to address social aspects of HIV/AIDS is the disaggregation of data by social group. This raises three main limitations. Indicator frameworks do not provide comprehensive coverage of the diverse social drivers of the epidemic, particularly neglecting criminalization, stigma, discrimination and gender norms. There is a dearth of indicators for evaluating the social impacts of HIV interventions. Indicators of organizational capacity focus on capacity to effectively deliver and manage clinical services, neglecting capacity to respond appropriately and sustainably to complex social contexts. Current indicator frameworks cannot adequately assess the social outcomes of HIV interventions. This limits knowledge about

Framework for ecological risk assessment

International Nuclear Information System (INIS)

Rodier, D.; Norton, S.

1992-02-01

Increased interest in ecological issues such as global climate change, habitat loss, acid deposition, reduced biological diversity, and the ecological impacts of pesticides and toxic chemicals prompts this U.S. Environmental Protection Agency (EPA) report, A Framework for Ecological Risk Assessment ('Framework Report'). The report describes basic elements, or a framework, for evaluating scientific information on the adverse effects of physical and chemical stressors on the environment. The framework offers starting principles and a simple structure as guidance for current ecological risk assessments and as a foundation for future EPA proposals for risk assessment guidelines

Electricity price, energy production and emissions impact : evaluating proposed GHG emission reduction frameworks for the Alberta electricity industry : updated reference case and sensitivity results prepared for CASA EPT Greenhouse Gas Allocation Subgroup

International Nuclear Information System (INIS)

2004-01-01

This document presents the results of a study which quantified the potential impact of various greenhouse gas (GHG) policy scenarios on Alberta generators' energy production, airborne emissions and electricity wholesale market price. The study examined proactive policy frameworks compared to business as usual scenarios. A reference case scenario was included to represent the status quo environment where electricity demand continues on its current path. Five additional sensitivity cases were examined, of which 3 evaluated the impact of many key assumptions regarding progressive GHG reduction levels and costs related to meeting GHG requirements. The other two evaluated an all-coal future electricity supply both with and without GHG emission reduction costs. Environmental costs were also evaluated in terms of emissions of nitrous oxides, sulphurous oxides, mercury and particulate matter. The impact of generation retirement and renewable energy source development was also analyzed. Demand and supply forecasts for oil, natural gas, electric energy and energy sales were presented along with generation supply forecasts for the reference case scenario, coal generation and natural gas fired retirements. refs., tabs., figs

Assessing the economic benefits of vaccines based on the health investment life course framework: a review of a broader approach to evaluate malaria vaccination.

Science.gov (United States)

Constenla, Dagna

2015-03-24

Economic evaluations have routinely understated the net benefits of vaccination by not including the full range of economic benefits that accrue over the lifetime of a vaccinated person. Broader approaches for evaluating benefits of vaccination can be used to more accurately calculate the value of vaccination. This paper reflects on the methodology of one such approach - the health investment life course approach - that looks at the impact of vaccine investment on lifetime returns. The role of this approach on vaccine decision-making will be assessed using the malaria health investment life course model example. We describe a framework that measures the impact of a health policy decision on government accounts over many generations. The methodological issues emerging from this approach are illustrated with an example from a recently completed health investment life course analysis of malaria vaccination in Ghana. Beyond the results, various conceptual and practical challenges of applying this framework to Ghana are discussed in this paper. The current framework seeks to understand how disease and available technologies can impact a range of economic parameters such as labour force participation, education, healthcare consumption, productivity, wages or economic growth, and taxation following their introduction. The framework is unique amongst previous economic models in malaria because it considers future tax revenue for governments. The framework is complementary to cost-effectiveness and budget impact analysis. The intent of this paper is to stimulate discussion on how existing and new methodology can add to knowledge regarding the benefits from investing in new and underutilized vaccines. Copyright © 2015 Elsevier Ltd. All rights reserved.

An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

Science.gov (United States)

Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

2016-01-01

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Towards a Framework for Evaluating Mobile Mental Health Apps.

Science.gov (United States)

Chan, Steven; Torous, John; Hinton, Ladson; Yellowlees, Peter

2015-12-01

Mobile phones are ubiquitous in society and owned by a majority of psychiatric patients, including those with severe mental illness. Their versatility as a platform can extend mental health services in the areas of communication, self-monitoring, self-management, diagnosis, and treatment. However, the efficacy and reliability of publicly available applications (apps) have yet to be demonstrated. Numerous articles have noted the need for rigorous evaluation of the efficacy and clinical utility of smartphone apps, which are largely unregulated. Professional clinical organizations do not provide guidelines for evaluating mobile apps. Guidelines and frameworks are needed to evaluate medical apps. Numerous frameworks and evaluation criteria exist from the engineering and informatics literature, as well as interdisciplinary organizations in similar fields such as telemedicine and healthcare informatics. We propose criteria for both patients and providers to use in assessing not just smartphone apps, but also wearable devices and smartwatch apps for mental health. Apps can be evaluated by their usefulness, usability, and integration and infrastructure. Apps can be categorized by their usability in one or more stages of a mental health provider's workflow. Ultimately, leadership is needed to develop a framework for describing apps, and guidelines are needed for both patients and mental health providers.

A holistic model for evaluating the impact of individual technology-enhanced learning resources.

Science.gov (United States)

Pickering, James D; Joynes, Viktoria C T

2016-12-01

The use of technology within education has now crossed the Rubicon; student expectations, the increasing availability of both hardware and software and the push to fully blended learning environments mean that educational institutions cannot afford to turn their backs on technology-enhanced learning (TEL). The ability to meaningfully evaluate the impact of TEL resources nevertheless remains problematic. This paper aims to establish a robust means of evaluating individual resources and meaningfully measure their impact upon learning within the context of the program in which they are used. Based upon the experience of developing and evaluating a range of mobile and desktop based TEL resources, this paper outlines a new four-stage evaluation process, taking into account learner satisfaction, learner gain, and the impact of a resource on both the individual and the institution in which it has been adapted. A new multi-level model of TEL resource evaluation is proposed, which includes a preliminary evaluation of need, learner satisfaction and gain, learner impact and institutional impact. Each of these levels are discussed in detail, and in relation to existing TEL evaluation frameworks. This paper details a holistic, meaningful evaluation model for individual TEL resources within the specific context in which they are used. It is proposed that this model is adopted to ensure that TEL resources are evaluated in a more meaningful and robust manner than is currently undertaken.

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program

Science.gov (United States)

Davis, LaShara A.; Morgan, Susan E.; Mobley, Amy R.

2016-01-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported…

A Conceptual Framework for Evaluation of Public Health and Primary Care System Performance in Iran

Science.gov (United States)

Jahanmehr, Nader; Rashidian, Arash; Khosravi, Ardeshir; Farzadfar, Farshad; Shariati, Mohammad; Majdzadeh, Reza; Sari, Ali Akbari; Mesdaghinia, Alireza

2015-01-01

Introduction: The main objective of this study was to design a conceptual framework, according to the policies and priorities of the ministry of health to evaluate provincial public health and primary care performance and to assess their share in the overall health impacts of the community. Methods: We used several tools and techniques, including system thinking, literature review to identify relevant attributes of health system performance framework and interview with the key stakeholders. The PubMed, Scopus, web of science, Google Scholar and two specialized databases of Persian language literature (IranMedex and SID) were searched using main terms and keywords. Following decision-making and collective agreement among the different stakeholders, 51 core indicators were chosen from among 602 obtained indicators in a four stage process, for monitoring and evaluation of Health Deputies. Results: We proposed a conceptual framework by identifying the performance area for Health Deputies between other determinants of health, as well as introducing a chain of results, for performance, consisting of Input, Process, Output and Outcome indicators. We also proposed 5 dimensions for measuring the performance of Health Deputies, consisting of efficiency, effectiveness, equity, access and improvement of health status. Conclusion: The proposed Conceptual Framework illustrates clearly the Health Deputies success in achieving best results and consequences of health in the country. Having the relative commitment of the ministry of health and Health Deputies at the University of Medical Sciences is essential for full implementation of this framework and providing the annual performance report. PMID:25946937

Towards a framework for the quantitative assessment of trawling impact on the seabed and benthic ecosystem

DEFF Research Database (Denmark)

Rijnsdorp, A. D.; Bastardie, Francois; Bolam, S.G.

2016-01-01

A framework to assess the impact of mobile fishing gear on the seabed and benthic ecosystem is presented. The framework that can be used at regional and local scales provides indicators for both trawling pressureand ecological impact. It builds on high-resolution maps of trawlingintensity and con...

Cumulative impact assessments and bird/wind farm interactions: Developing a conceptual framework

International Nuclear Information System (INIS)

Masden, Elizabeth A.; Fox, Anthony D.; Furness, Robert W.; Bullman, Rhys; Haydon, Daniel T.

2010-01-01

The wind power industry has grown rapidly in the UK to meet EU targets of sourcing 20% of energy from renewable sources by 2020. Although wind power is a renewable energy source, there are environmental concerns over increasing numbers of wind farm proposals and associated cumulative impacts. Individually, a wind farm, or indeed any action, may have minor effects on the environment, but collectively these may be significant, potentially greater than the sum of the individual parts acting alone. EU and UK legislation requires a cumulative impact assessment (CIA) as part of Environmental Impact Assessments (EIA). However, in the absence of detailed guidance and definitions, such assessments within EIA are rarely adequate, restricting the acquisition of basic knowledge about the cumulative impacts of wind farms on bird populations. Here we propose a conceptual framework to promote transparency in CIA through the explicit definition of impacts, actions and scales within an assessment. Our framework requires improved legislative guidance on the actions to include in assessments, and advice on the appropriate baselines against which to assess impacts. Cumulative impacts are currently considered on restricted scales (spatial and temporal) relating to individual development EIAs. We propose that benefits would be gained from elevating CIA to a strategic level, as a component of spatially explicit planning.

A framework for evaluating and utilizing medical terminology mappings.

Science.gov (United States)

Hussain, Sajjad; Sun, Hong; Sinaci, Anil; Erturkmen, Gokce Banu Laleci; Mead, Charles; Gray, Alasdair J G; McGuinness, Deborah L; Prud'Hommeaux, Eric; Daniel, Christel; Forsberg, Kerstin

2014-01-01

Use of medical terminologies and mappings across them are considered to be crucial pre-requisites for achieving interoperable eHealth applications. Built upon the outcomes of several research projects, we introduce a framework for evaluating and utilizing terminology mappings that offers a platform for i) performing various mappings strategies, ii) representing terminology mappings together with their provenance information, and iii) enabling terminology reasoning for inferring both new and erroneous mappings. We present the results of the introduced framework from SALUS project where we evaluated the quality of both existing and inferred terminology mappings among standard terminologies.

A Collaborative Evaluation Framework for Biometric Connected Devices in Healthcare.

Science.gov (United States)

Farnia, Troskah; Jaulent, Marie Christine; Marchand, Guillaume; Yasini, Mobin

2017-01-01

A large number of biometric connected devices are currently available with a variety of designs. Healthcare users cannot easily choose the reliable ones that correspond the best to their healthcare problems. The existing evaluation methods do not consider at the same time aspects of connectivity and healthcare usage. In this study, a collaborative evaluation framework for biometric connected devices in healthcare usage is proposed. This framework contains six dimensions: medical validity, technical reliability, usability, ergonomy, legal compliance, and accuracy of measurements. In a first step, these dimensions were assessed by designing a self administered questionnaire answered by the stakeholders (patients, health professionals, payers, and manufacturers). A case study was then carried out in a second step to test this framework in a project of telemonitoring for heart failure patients. The results are in favor of the efficiency of the proposed framework as a decision making tool in healthcare usage.

A proposed benefits evaluation framework for health information systems in Canada.

Science.gov (United States)

Lau, Francis; Hagens, Simon; Muttitt, Sarah

2007-01-01

This article describes a benefits evaluation framework for the health information systems currently being implemented across Canada through Canada Health Infoway with its jurisdictional partners and investment programs. This framework is based on the information systems success model by DeLone and McLean, the empirical analysis by van der Meijden on the use of this model in the health setting and our own review of evaluation studies and systematic review articles in health information systems. The current framework includes three dimensions of quality (system, information and service), two dimensions of system usage (use and user satisfaction) and three dimensions of net benefits (quality, access and productivity). Measures have been developed and work is under way to establish detailed evaluation plans and instruments for the individual investment programs to launch a series of benefits evaluation field studies across jurisdictions later this year.

A Framework to Assess the Cumulative Hydrological Impacts of Dams on flow Regime

Science.gov (United States)

Wang, Y.; Wang, D.

2016-12-01

In this study we proposed a framework to assess the cumulative impact of dams on hydrological regime, and the impacts of the Three Gorges Dam on flow regime in Yangtze River were investigated with the framework. We reconstructed the unregulated flow series to compare with the regulated flow series in the same period. Eco-surplus and eco-deficit and the Indicators of Hydrologic Alteration parameters were used to examine the hydrological regime change. Among IHA parameters, Wilcoxon signed-rank test and Principal Components Analysis identified the representative indicators of hydrological alterations. Eco-surplus and eco-deficit showed that the reservoir also changed the seasonal regime of the flows in autumn and winter. Annual extreme flows and October flows changes lead to negative ecological implications downstream from the Three Gorges Dam. Ecological operation for the Three Gorges Dam is necessary to mitigate the negative effects on the river ecosystem in the middle reach of Yangtze River. The framework proposed here could be a robust method to assess the cumulative impacts of reservoir operation.

California Curriculum Frameworks: A Handbook for Production, Implementation, and Evaluation Activities.

Science.gov (United States)

California State Dept. of Education, Sacramento.

This booklet describes the characteristics and role of curriculum frameworks and describes how they can be used in developing educational programs. It is designed as a guide for writers of frameworks, for educators who are responsible for implementing frameworks, or for evaluators of educational programs. It provides a concise description of the…

SERVAL: a new framework for the evaluation of animal health surveillance.

Science.gov (United States)

Drewe, J A; Hoinville, L J; Cook, A J C; Floyd, T; Gunn, G; Stärk, K D C

2015-02-01

Animal health surveillance programmes may change in response to altering requirements or perceived weaknesses but are seldom subjected to any formal evaluation to ensure that they provide valuable information in an efficient manner. The literature on the evaluation of animal health surveillance systems is sparse, and those that are published may be unstructured and therefore incomplete. To address this gap, we have developed SERVAL, a SuRveillance EVALuation framework, which is novel and aims to be generic and therefore suitable for the evaluation of any animal health surveillance system. The inclusion of socio-economic criteria ensures that economic evaluation is an integral part of this framework. SERVAL was developed with input from a technical workshop of international experts followed by a consultation process involving providers and users of surveillance and evaluation data. It has been applied to a range of case studies encompassing different surveillance and evaluation objectives. Here, we describe the development, structure and application of the SERVAL framework. We discuss users' experiences in applying SERVAL to evaluate animal health surveillance systems in Great Britain. © 2013 Crown Copyright. This article is published with the permission of the Controller of HMSO and the Queen's Printer for Scotland.

Using the Quadruple Aim Framework to Measure Impact of Heath Technology Implementation: A Case Study of eConsult.

Science.gov (United States)

Liddy, Clare; Keely, Erin

2018-01-01

Health technology solutions are too often implemented without a true understanding of the system-level problem they seek to address, resulting in excessive costs, poor adoption, ineffectiveness, and ultimately failure. Before implementing or adopting health care innovations, stakeholders should complete a thorough assessment to ensure effectiveness and value. In this article, we describe how to evaluate the impact of a health technology innovation through the 4 dimensions of care outlined by the Quadruple Aim Framework, using our experience with the Champlain Building Access to Specialists through eConsultation (BASE) eConsult service as a case example. A descriptive overview of data was collected between April 1, 2011, and August 31, 2017, using 4 dimensions of care outlined by the Quadruple Aim Framework: patient experience, provider experience, costs, and population health. Findings were drawn from use data, primary care provider closeout surveys, surveys/interviews with patients and provider, and costing data. Overall, patients have received access to specialist advice within days and find the advice useful in 86% of cases. Provider experience is very positive, with satisfaction ratings of high/very high value in 94% of cases. The service cost a weighted average of $47.35/case, compared with $133.60/case for traditional referrals. In total, 1,299 primary care providers have enrolled in the service, completing 28,838 cases since 2011. Monthly case volumes have grown from an average of 13 cases/month in 2011 to 969 cases/month in 2016. The eConsult service has been widely adopted in our region and is currently expanding to new jurisdictions across Canada. However, although we successfully demonstrated eConsult's impact on patient experience, provider satisfaction, and reducing costs, we met several challenges in evaluating its impact on population health. More work is needed to evaluate eConsult's impact on key population health metrics (eg, mortality, morbidity

Understanding the impact of career academy attendance: an application of the principal stratification framework for causal effects accounting for partial compliance.

Science.gov (United States)

Page, Lindsay C

2012-04-01

Results from MDRC's longitudinal, random-assignment evaluation of career-academy high schools reveal that several years after high-school completion, those randomized to receive the academy opportunity realized a $175 (11%) increase in monthly earnings, on average. In this paper, I investigate the impact of duration of actual academy enrollment, as nearly half of treatment group students either never enrolled or participated for only a portion of high school. I capitalize on data from this experimental evaluation and utilize a principal stratification framework and Bayesian inference to investigate the causal impact of academy participation. This analysis focuses on a sample of 1,306 students across seven sites in the MDRC evaluation. Participation is measured by number of years of academy enrollment, and the outcome of interest is average monthly earnings in the period of four to eight years after high school graduation. I estimate an average causal effect of treatment assignment on subsequent monthly earnings of approximately $588 among males who remained enrolled in an academy throughout high school and more modest impacts among those who participated only partially. Different from an instrumental variables approach to treatment non-compliance, which allows for the estimation of linear returns to treatment take-up, the more general framework of principal stratification allows for the consideration of non-linear returns, although at the expense of additional model-based assumptions.

Country programme frameworks. A special evaluation

International Nuclear Information System (INIS)

1996-05-01

As a result of the recommendations of the TC Policy Review Seminar held in 1994 the Department of Technical Co-operation initiated Country Programme Framework (CPF) related activities in early 1995. Draft Guidelines for carrying out the CPF process were issued in February 1995. An agenda was propose for carrying gout the CPF process, which also included field missions to those countries where the information on national programmes and priorities available at the Agency was believed to be insufficient. In December 1995 the Evaluation Section was requested by the TC management to evaluate the approach and the progress achieved to date. The findings and conclusions of this evaluation have been formulated after extensive discussions with both in-house staff and external evaluation consultants. They thus represent a distillation of the views expressed by all. 2 figs, 1 tab

Evaluation of the UNREST questionnaire for testing the social resistance framework.

Science.gov (United States)

Factor, Roni; Kawachi, Ichiro; Williams, David R

2013-07-01

The recently developed social resistance framework addresses a widespread pattern whereby non-dominant minority groups, such as ethnic/racial minorities and people of low socioeconomic status, often engage in unhealthy and risky behaviours at higher rates compared with society at large. The framework suggests that power relations within society may encourage members of non-dominant minority groups to actively engage in acts of everyday resistance, which may include risky and unhealthy behaviours. The current paper develops and psychometrically evaluates a research tool to test this innovative framework. The UNREST questionnaire measures the key concepts of the framework, along with four high-risk and unhealthy behaviours, as well as demographic and socioeconomic characteristics. A pilot survey was conducted among representative subsamples of a non-dominant group (African-Americans) and a dominant group (Caucasians). Consistent with the general premises of the framework, the evaluation of the questionnaire produced six valid and reliable scales, which were significantly correlated with some criterion-related items as well as unhealthy and risky behaviours. The preliminary results of our pilot study suggest that the new tool may be useful for testing the framework. The results also provide support for the framework in general.

Evaluation of the causal framework used for setting national ambient air quality standards.

Science.gov (United States)

Goodman, Julie E; Prueitt, Robyn L; Sax, Sonja N; Bailey, Lisa A; Rhomberg, Lorenz R

2013-11-01

Abstract A scientifically sound assessment of the potential hazards associated with a substance requires a systematic, objective and transparent evaluation of the weight of evidence (WoE) for causality of health effects. We critically evaluated the current WoE framework for causal determination used in the United States Environmental Protection Agency's (EPA's) assessments of the scientific data on air pollutants for the National Ambient Air Quality Standards (NAAQS) review process, including its methods for literature searches; study selection, evaluation and integration; and causal judgments. The causal framework used in recent NAAQS evaluations has many valuable features, but it could be more explicit in some cases, and some features are missing that should be included in every WoE evaluation. Because of this, it has not always been applied consistently in evaluations of causality, leading to conclusions that are not always supported by the overall WoE, as we demonstrate using EPA's ozone Integrated Science Assessment as a case study. We propose additions to the NAAQS causal framework based on best practices gleaned from a previously conducted survey of available WoE frameworks. A revision of the NAAQS causal framework so that it more closely aligns with these best practices and the full and consistent application of the framework will improve future assessments of the potential health effects of criteria air pollutants by making the assessments more thorough, transparent, and scientifically sound.

Conceptualising the effectiveness of impact assessment processes

International Nuclear Information System (INIS)

Chanchitpricha, Chaunjit; Bond, Alan

2013-01-01

This paper aims at conceptualising the effectiveness of impact assessment processes through the development of a literature-based framework of criteria to measure impact assessment effectiveness. Four categories of effectiveness were established: procedural, substantive, transactive and normative, each containing a number of criteria; no studies have previously brought together all four of these categories into such a comprehensive, criteria-based framework and undertaken systematic evaluation of practice. The criteria can be mapped within a cycle/or cycles of evaluation, based on the ‘logic model’, at the stages of input, process, output and outcome to enable the identification of connections between the criteria across the categories of effectiveness. This framework is considered to have potential application in measuring the effectiveness of many impact assessment processes, including strategic environmental assessment (SEA), environmental impact assessment (EIA), social impact assessment (SIA) and health impact assessment (HIA). -- Highlights: • Conceptualising effectiveness of impact assessment processes. • Identification of factors influencing effectiveness of impact assessment processes. • Development of criteria within a framework for evaluating IA effectiveness. • Applying the logic model to examine connections between effectiveness criteria

Conceptualising the effectiveness of impact assessment processes

Energy Technology Data Exchange (ETDEWEB)

Chanchitpricha, Chaunjit, E-mail: chaunjit@g.sut.ac.th [School of Environmental Health, Suranaree University of Technology, 111 University Avenue, Maung District, Nakhon Ratchasima 30000 (Thailand); Bond, Alan, E-mail: alan.bond@uea.ac.uk [School of Environmental Sciences, University of East Anglia, Norwich NR4 7TJ (United Kingdom); Unit for Environmental Sciences and Management School of Geo and Spatial Sciences, Internal Box 375, North West University (Potchefstroom campus) (South Africa)

2013-11-15

This paper aims at conceptualising the effectiveness of impact assessment processes through the development of a literature-based framework of criteria to measure impact assessment effectiveness. Four categories of effectiveness were established: procedural, substantive, transactive and normative, each containing a number of criteria; no studies have previously brought together all four of these categories into such a comprehensive, criteria-based framework and undertaken systematic evaluation of practice. The criteria can be mapped within a cycle/or cycles of evaluation, based on the ‘logic model’, at the stages of input, process, output and outcome to enable the identification of connections between the criteria across the categories of effectiveness. This framework is considered to have potential application in measuring the effectiveness of many impact assessment processes, including strategic environmental assessment (SEA), environmental impact assessment (EIA), social impact assessment (SIA) and health impact assessment (HIA). -- Highlights: • Conceptualising effectiveness of impact assessment processes. • Identification of factors influencing effectiveness of impact assessment processes. • Development of criteria within a framework for evaluating IA effectiveness. • Applying the logic model to examine connections between effectiveness criteria.

Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs)

LENUS (Irish Health Repository)

Wallace, Emma

2011-10-14

Abstract Clinical Prediction Rules (CPRs) are tools that quantify the contribution of symptoms, clinical signs and available diagnostic tests, and in doing so stratify patients according to the probability of having a target outcome or need for a specified treatment. Most focus on the derivation stage with only a minority progressing to validation and very few undergoing impact analysis. Impact analysis studies remain the most efficient way of assessing whether incorporating CPRs into a decision making process improves patient care. However there is a lack of clear methodology for the design of high quality impact analysis studies. We have developed a sequential four-phased framework based on the literature and the collective experience of our international working group to help researchers identify and overcome the specific challenges in designing and conducting an impact analysis of a CPR. There is a need to shift emphasis from deriving new CPRs to validating and implementing existing CPRs. The proposed framework provides a structured approach to this topical and complex area of research.

Multidimensional journal evaluation analyzing scientific periodicals beyond the impact factor

CERN Document Server

Haustein, Stefanie

2012-01-01

Scientific communication depends primarily on publishing in journals. The most important indicator to determine the influence of a journal is the Impact Factor. Since this factor only measures the average number of citations per article in a certain time window, it can be argued that it does not reflect the actual value of a periodical. This book defines five dimensions, which build a framework for a multidimensional method of journal evaluation. The author is winner of the Eugene Garfield Doctoral Dissertation Scholarship 2011.

Adapting to climate change. Towards a European framework for action. Impact Assessment

International Nuclear Information System (INIS)

2009-04-01

This report accompanies the Commission's White Paper on Adaptation to Climate Change. Its objective is to raise the profile of adaptation and to build a coherent approach at institutional level across the EU. The proposed EU Framework would complement and re-enforce Member States actions, particularly through existing funding channels, the provision of accurate climate information and appropriate guidance, ensuring that adaptation is integrated in important EU policy sectors and guaranteeing solidarity between countries/regions. The White Paper adopts a phased approach: Phase 1 (2009-2012) will lay the ground work for the preparation of a more comprehensive adaptation strategy for the EU to be implemented during phase 2 commencing in 2012. This report is first and foremost a taking-stock exercise, reviewing the literature and gathering the views of services and stakeholders, on the basis of the 2007 Green Paper. It is also meant to serve as a reference framework to develop an EU adaptation policy in future. It is a cross-cutting exercise and it is complemented by sectoral papers on water, coasts and marine issues, agriculture and health. Chapter 1 explains briefly the process for the elaboration of both documents since the publication of the Green Paper on Adaptation in 2007 and the broad internal and external consultation. Chapter 2 defines key concepts such as impacts, vulnerability and adaptive capacity. It identifies the uncertainties and the knowledge gaps to be filled to establish priorities and monitor further action. It provides an overview of the vulnerability of EU sectors, regions or groups, to Climate Change impacts. Taking into account how national, regional and sectoral adaptation strategies already address some of these challenges, it evaluates the scope for EU action, focusing on mainstreaming adaptation into EU policies and on the necessary co-ordination of the different policy levels. Chapter 3 describes the objectives of the IA and explains how

The DONE framework: Creation, evaluation, and updating of an interdisciplinary, dynamic framework 2.0 of determinants of nutrition and eating

Science.gov (United States)

Stok, F. Marijn; Hoffmann, Stefan; Volkert, Dorothee; Boeing, Heiner; Ensenauer, Regina; Stelmach-Mardas, Marta; Kiesswetter, Eva; Weber, Alisa; Rohm, Harald; Lien, Nanna; Brug, Johannes; Holdsworth, Michelle; Renner, Britta

2017-01-01

The question of which factors drive human eating and nutrition is a key issue in many branches of science. We describe the creation, evaluation, and updating of an interdisciplinary, interactive, and evolving “framework 2.0” of Determinants Of Nutrition and Eating (DONE). The DONE framework was created by an interdisciplinary workgroup in a multiphase, multimethod process. Modifiability, relationship strength, and population-level effect of the determinants were rated to identify areas of priority for research and interventions. External experts positively evaluated the usefulness, comprehensiveness, and quality of the DONE framework. An approach to continue updating the framework with the help of experts was piloted. The DONE framework can be freely accessed (http://uni-konstanz.de/DONE) and used in a highly flexible manner: determinants can be sorted, filtered and visualized for both very specific research questions as well as more general queries. The dynamic nature of the framework allows it to evolve as experts can continually add new determinants and ratings. We anticipate this framework will be useful for research prioritization and intervention development. PMID:28152005

The DONE framework: Creation, evaluation, and updating of an interdisciplinary, dynamic framework 2.0 of determinants of nutrition and eating.

Science.gov (United States)

Stok, F Marijn; Hoffmann, Stefan; Volkert, Dorothee; Boeing, Heiner; Ensenauer, Regina; Stelmach-Mardas, Marta; Kiesswetter, Eva; Weber, Alisa; Rohm, Harald; Lien, Nanna; Brug, Johannes; Holdsworth, Michelle; Renner, Britta

2017-01-01

The question of which factors drive human eating and nutrition is a key issue in many branches of science. We describe the creation, evaluation, and updating of an interdisciplinary, interactive, and evolving "framework 2.0" of Determinants Of Nutrition and Eating (DONE). The DONE framework was created by an interdisciplinary workgroup in a multiphase, multimethod process. Modifiability, relationship strength, and population-level effect of the determinants were rated to identify areas of priority for research and interventions. External experts positively evaluated the usefulness, comprehensiveness, and quality of the DONE framework. An approach to continue updating the framework with the help of experts was piloted. The DONE framework can be freely accessed (http://uni-konstanz.de/DONE) and used in a highly flexible manner: determinants can be sorted, filtered and visualized for both very specific research questions as well as more general queries. The dynamic nature of the framework allows it to evolve as experts can continually add new determinants and ratings. We anticipate this framework will be useful for research prioritization and intervention development.

A New Framework for Evaluating the Functional Capabilities of Intra-Enterprise Application Integration Technologies

Directory of Open Access Journals (Sweden)

Hossein Moradi

2010-10-01

Full Text Available Enterprise Application Integration (EAI technologies facilitate the sharing of information and business processes of interrelated information systems in order to achieve the target integrated systems. Different EAI solutions and technologies provide various capabilities which lead to the complexity of their evaluation process. To reduce this complexity, appropriate tools for evaluating the functional capabilities of EAI technologies are required. This paper proposes a new framework for evaluating the functional capabilities of EAI technologies, which simplify the process of evaluating the functional capabilities of intra-enterprise integration technologies and solutions.The proposed framework for evaluating the EAI technologies was enhanced using the structural and conceptual aspects of previous frameworks. It offers a new schema for which various EAI technologies are categorized in different classes and are evaluated based on their supporting level for functional integration capabilities’ criteria.The new framework offers two lists containing integration technologies and their associated classifications, and functional capabilities of integration technologies. The proposed framework is a novel one which can be used by information system experts for evaluation and comparison purposes of various integration technologies.

A Framework for the Evaluation of CASE Tool Learnability in Educational Environments

Science.gov (United States)

Senapathi, Mali

2005-01-01

The aim of the research is to derive a framework for the evaluation of Computer Aided Software Engineering (CASE) tool learnability in educational environments. Drawing from the literature of Human Computer Interaction and educational research, a framework for evaluating CASE tool learnability in educational environments is derived. The two main…

Proposed evaluation framework for assessing operator performance with multisensor displays

Science.gov (United States)

Foyle, David C.

1992-01-01

Despite aggressive work on the development of sensor fusion algorithms and techniques, no formal evaluation procedures have been proposed. Based on existing integration models in the literature, an evaluation framework is developed to assess an operator's ability to use multisensor, or sensor fusion, displays. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The operator's performance with the sensor fusion display can be compared to the models' predictions based on the operator's performance when viewing the original sensor displays prior to fusion. This allows for the determination as to when a sensor fusion system leads to: 1) poorer performance than one of the original sensor displays (clearly an undesirable system in which the fused sensor system causes some distortion or interference); 2) better performance than with either single sensor system alone, but at a sub-optimal (compared to the model predictions) level; 3) optimal performance (compared to model predictions); or, 4) super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays. An experiment demonstrating the usefulness of the proposed evaluation framework is discussed.

Techno-Economic, Sustainability & Environmental Impact Diagnosis (TESED) Framework

DEFF Research Database (Denmark)

Loureiro da Costa Lira Gargalo, Carina; Carvalho, Ana; Matos, Henrique A.

2014-01-01

that truly sustainable design alternatives can befound.This work proposes a framework,called ‘Techno-Economic Sustainability Environmental Impact Diagnosis’ (TESED) that allows users to assess chemical/biochemical processes in a product oriented analysis.TESED is asystematic and generic approach that can......Nowadays, companies are looking for new sustainable design alternatives that improve their original processes.To assesst he best designalternative, economic aspects have been the preferred indicators. However, environmental and social concerns should also be included in the decision process so...

The outcome competency framework for practitioners in infection prevention and control: use of the outcome logic model for evaluation.

Science.gov (United States)

Burnett, E; Curran, E; Loveday, H P; Kiernan, M A; Tannahill, M

2014-01-01

Healthcare is delivered in a dynamic environment with frequent changes in populations, methods, equipment and settings. Infection prevention and control practitioners (IPCPs) must ensure that they are competent in addressing the challenges they face and are equipped to develop infection prevention and control (IPC) services in line with a changing world of healthcare provision. A multifaceted Framework was developed to assist IPCPs to enhance competence at an individual, team and organisational level to enable quality performance and improved quality of care. However, if these aspirations are to be met, it is vital that competency frameworks are fit for purpose or they risk being ignored. The aim of this unique study was to evaluate short and medium term outcomes as set out in the Outcome Logic Model to assist with the evaluation of the impact and success of the Framework. This study found that while the Framework is being used effectively in some areas, it is not being used as much or in the ways that were anticipated. The findings will enable future work on revision, communication and dissemination, and will provide intelligence to those initiating education and training in the utilisation of the competences.

Evaluation of the climate change impact on wind resources in Taiwan Strait

International Nuclear Information System (INIS)

Chang, Tsang-Jung; Chen, Chun-Lung; Tu, Yi-Long; Yeh, Hung-Te; Wu, Yu-Ting

2015-01-01

Highlights: • We propose a new statistical downscaling framework to evaluate the climate change impact on wind resources in Taiwan Strait. • The statistical model relates Weibull distribution parameters to output of a GCM model and regression coefficients. • Validation of the simulated wind speed distribution presents an acceptable agreement with meteorological data. • Three chosen GCMs show the same tendency that the eastern half of Taiwan Strait stores higher wind resources. - Abstract: A new statistical downscaling framework is proposed to evaluate the climate change impact on wind resources in Taiwan Strait. In this framework, a two-parameter Weibull distribution function is used to estimate the wind energy density distribution in the strait. An empirically statistical downscaling model that relates the Weibull parameters to output of a General Circulation Model (GCM) and regression coefficients is adopted. The regression coefficients are calculated using wind speed results obtained from a past climate (1981–2000) simulation reconstructed by a Weather Research and Forecasting (WRF) model. These WRF-reconstructed wind speed results are validated with data collected at a weather station on an islet inside the strait. The comparison shows that the probability distributions of the monthly wind speeds obtained from WRF-reconstructed and measured wind speed data are in acceptable agreement, with small discrepancies of 10.3% and 7.9% for the shape and scale parameters of the Weibull distribution, respectively. The statistical downscaling framework with output from three chosen GCMs (i.e., ECHAM5, CM2.1 and CGCM2.3.2) is applied to evaluate the wind energy density distribution in Taiwan Strait for three future climate periods of 2011–2040, 2041–2070, and 2071–2100. The results show that the wind energy density distributions in the future climate periods are higher in the eastern half of Taiwan Strait, but reduce slightly by 3% compared with that in the

'Healthy Eating and Lifestyle in Pregnancy (HELP)' trial: Process evaluation framework.

Science.gov (United States)

Simpson, Sharon A; Cassidy, Dunla; John, Elinor

2014-07-01

We developed and tested in a cluster RCT a theory-driven group-based intervention for obese pregnant women. It was designed to support women to moderate weight gain during pregnancy and reduce BMI one year after birth, in addition to targeting secondary health and wellbeing outcomes. In line with MRC guidance on developing and evaluating complex interventions in health, we conducted a process evaluation alongside the trial. This paper describes the development of the process evaluation framework. This cluster RCT recruited 598 pregnant women. Women in the intervention group were invited to attend a weekly weight-management group. Following a review of relevant literature, we developed a process evaluation framework which outlined key process indicators that we wanted to address and how we would measure these. Central to the process evaluation was to understand the mechanism of effect of the intervention. We utilised a logic-modelling approach to describe the intervention which helped us focus on what potential mediators of intervention effect to measure, and how. The resulting process evaluation framework was designed to address 9 core elements; context, reach, exposure, recruitment, fidelity, recruitment, retention, contamination and theory-testing. These were assessed using a variety of qualitative and quantitative approaches. The logic model explained the processes by which intervention components bring about change in target outcomes through various mediators and theoretical pathways including self-efficacy, social support, self-regulation and motivation. Process evaluation is a key element in assessing the effect of any RCT. We developed a process evaluation framework and logic model, and the results of analyses using these will offer insights into why the intervention is or is not effective. Copyright © 2014.

A Framework for Evaluation and Use of Automated Scoring

Science.gov (United States)

Williamson, David M.; Xi, Xiaoming; Breyer, F. Jay

2012-01-01

A framework for evaluation and use of automated scoring of constructed-response tasks is provided that entails both evaluation of automated scoring as well as guidelines for implementation and maintenance in the context of constantly evolving technologies. Consideration of validity issues and challenges associated with automated scoring are…

A Need for a Framework for Curriculum Evaluation in Oman

Science.gov (United States)

Al-Jardani, Khalid Salim; Siraj, Saedah; Abedalaziz, Nabeel

2012-01-01

The field of curriculum evaluation is a key part of the educational process. This means that this area needs to be developed continuously and requires ongoing research. This paper highlights curriculum evaluation in Oman, different evaluation procedures and methods and instruments used. The need for a framework for curriculum evaluation is a vital…

Strategies towards Evaluation beyond Scientific Impact. Pathways not only for Agricultural Research

Directory of Open Access Journals (Sweden)

Birge M. Wolf

2013-12-01

Full Text Available Various research fields, like organic agricultural research, are dedicated to solving real-world problems and contributing to sustainable development. Therefore, systems research and the application of interdisciplinary and transdisciplinary approaches are increasingly endorsed. However, research performance depends not only on self-conception, but also on framework conditions of the scientific system, which are not always of benefit to such research fields. Recently, science and its framework conditions have been under increasing scrutiny as regards their ability to serve societal benefit. This provides opportunities for (organic agricultural research to engage in the development of a research system that will serve its needs. This article focuses on possible strategies for facilitating a balanced research evaluation that recognises scientific quality as well as societal relevance and applicability. These strategies are (a to strengthen the general support for evaluation beyond scientific impact, and (b to provide accessible data for such evaluations. Synergies of interest are found between open access movements and research communities focusing on global challenges and sustainability. As both are committed to increasing the societal benefit of science, they may support evaluation criteria such as knowledge production and dissemination tailored to societal needs, and the use of open access. Additional synergies exist between all those who scrutinise current research evaluation systems for their ability to serve scientific quality, which is also a precondition for societal benefit. Here, digital communication technologies provide opportunities to increase effectiveness, transparency, fairness and plurality in the dissemination of scientific results, quality assurance and reputation. Furthermore, funders may support transdisciplinary approaches and open access and improve data availability for evaluation beyond scientific impact. If they begin to

Using the RE-AIM framework to evaluate physical activity public health programs in México.

Science.gov (United States)

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

A framework for outcome-level evaluation of in-service training of health care workers.

Science.gov (United States)

O'Malley, Gabrielle; Perdue, Thomas; Petracca, Frances

2013-10-01

In-service training is a key strategic approach to addressing the severe shortage of health care workers in many countries. However, there is a lack of evidence linking these health care worker trainings to improved health outcomes. In response, the United States President's Emergency Plan for AIDS Relief's Human Resources for Health Technical Working Group initiated a project to develop an outcome-focused training evaluation framework. This paper presents the methods and results of that project. A general inductive methodology was used for the conceptualization and development of the framework. Fifteen key informant interviews were conducted to explore contextual factors, perceived needs, barriers and facilitators affecting the evaluation of training outcomes. In addition, a thematic analysis of 70 published articles reporting health care worker training outcomes identified key themes and categories. These were integrated, synthesized and compared to several existing training evaluation models. This formed an overall typology which was used to draft a new framework. Finally, the framework was refined and validated through an iterative process of feedback, pilot testing and revision. The inductive process resulted in identification of themes and categories, as well as relationships among several levels and types of outcomes. The resulting framework includes nine distinct types of outcomes that can be evaluated, which are organized within three nested levels: individual, organizational and health system/population. The outcome types are: (1) individual knowledge, attitudes and skills; (2) individual performance; (3) individual patient health; (4) organizational systems; (5) organizational performance; (6) organizational-level patient health; (7) health systems; (8) population-level performance; and (9) population-level health. The framework also addresses contextual factors which may influence the outcomes of training, as well as the ability of evaluators to

A framework of risk-informed seismic safety evaluation of nuclear power plants in Japan

International Nuclear Information System (INIS)

Kondo, S.; Sakagami, M.; Hirano, M.; Shiba, M.

2001-01-01

A framework of risk-informed seismic design and safety evaluation of nuclear power plants is under consideration in Japan so as to utilize the progress in the seismic probabilistic safety assessment methodology. Issues resolved to introduce this framework are discussed after the concept, evaluation process and characteristics of the framework are described. (author)

A GIS framework for the assessment of tick impact on human health in a changing climate.

Science.gov (United States)

Estrada-Peña, Agustin; Venzal, José M

2007-05-01

A framework to evaluate the impact of ticks on human health under various scenarios of climate change is proposed. The purpose is not to provide a comprehensive plan (e.g. the economic impact of ticks on human society is not included), instead we wish to describe a series of indices that would be helpful by obtaining homogeneous comparisons of impact and vulnerability exerted by ticks in different regions, countries or continents, using normalized sets of population, vegetation, climate and physical attributes of the territory. Three tick species, i.e. Dermacentor marginatus, Rhipicephalus turanicus and Hyalomma marginatum, have been traced over the territory of Spain to further explain the computation of these indices. The discussion is based on tick habitat suitability, used as a measure of the abiotic (climate) fitness of the habitat for the species in question, and the sensitivity of each tick species to the rate of change of habitat suitability with respect to climate change. The impact is the rate of change in habitat suitability weighted with a fuzzy logic function evaluating the total number of people in an area, percent of rural population and accessibility of the geographical divisions (expressed as hexagons with a 10 km radius) used in the study. The different climate scenarios evaluated in relation to ticks show that the north-western part of Spain would suffer the greatest impact in case the mean temperature would increase, while the Mediterranean region would suffer the highest impact if temperatures decreased. Vulnerability, based on the sanitary structure of the territory and on the impact on human activities due to the change in tick distribution and abundance, is proposed as a measure of adaptation of society to these climate scenarios. The cost is evaluated as a function of land use and tick habitat suitability in a buffer zone surrounding each geographic division. All indices proposed have been obtained by search of common and/or publicly

Steps toward improving ethical evaluation in health technology assessment: a proposed framework.

Science.gov (United States)

Assasi, Nazila; Tarride, Jean-Eric; O'Reilly, Daria; Schwartz, Lisa

2016-06-06

While evaluation of ethical aspects in health technology assessment (HTA) has gained much attention during the past years, the integration of ethics in HTA practice still presents many challenges. In response to the increasing demand for expansion of health technology assessment (HTA) methodology to include ethical issues more systematically, this article reports on a multi-stage study that aimed at construction of a framework for improving the integration of ethics in HTA. The framework was developed through the following phases: 1) a systematic review and content analysis of guidance documents for ethics in HTA; 2) identification of factors influencing the integration of ethical considerations in HTA; 3) preparation of an action-oriented framework based on the key elements of the existing guidance documents and identified barriers to and facilitators of their implementation; and 4) expert consultation and revision of the framework. The proposed framework consists of three main components: an algorithmic flowchart, which exhibits the different steps of an ethical inquiry throughout the HTA process, including: defining the objectives and scope of the evaluation, stakeholder analysis, assessing organizational capacity, framing ethical evaluation questions, ethical analysis, deliberation, and knowledge translation; a stepwise guide, which focuses on the task objectives and potential questions that are required to be addressed at each step; and a list of some commonly recommended or used tools to help facilitate the evaluation process. The proposed framework can be used to support and promote good practice in integration of ethics into HTA. However, further validation of the framework through case studies and expert consultation is required to establish its utility for HTA practice.

An Integrated Modeling Framework Forecasting Ecosystem Exposure-- A Systems Approach to the Cumulative Impacts of Multiple Stressors

Science.gov (United States)

Johnston, J. M.

2013-12-01

Freshwater habitats provide fishable, swimmable and drinkable resources and are a nexus of geophysical and biological processes. These processes in turn influence the persistence and sustainability of populations, communities and ecosystems. Climate change and landuse change encompass numerous stressors of potential exposure, including the introduction of toxic contaminants, invasive species, and disease in addition to physical drivers such as temperature and hydrologic regime. A systems approach that includes the scientific and technologic basis of assessing the health of ecosystems is needed to effectively protect human health and the environment. The Integrated Environmental Modeling Framework 'iemWatersheds' has been developed as a consistent and coherent means of forecasting the cumulative impact of co-occurring stressors. The Framework consists of three facilitating technologies: Data for Environmental Modeling (D4EM) that automates the collection and standardization of input data; the Framework for Risk Assessment of Multimedia Environmental Systems (FRAMES) that manages the flow of information between linked models; and the Supercomputer for Model Uncertainty and Sensitivity Evaluation (SuperMUSE) that provides post-processing and analysis of model outputs, including uncertainty and sensitivity analysis. Five models are linked within the Framework to provide multimedia simulation capabilities for hydrology and water quality processes: the Soil Water Assessment Tool (SWAT) predicts surface water and sediment runoff and associated contaminants; the Watershed Mercury Model (WMM) predicts mercury runoff and loading to streams; the Water quality Analysis and Simulation Program (WASP) predicts water quality within the stream channel; the Habitat Suitability Index (HSI) model scores physicochemical habitat quality for individual fish species; and the Bioaccumulation and Aquatic System Simulator (BASS) predicts fish growth, population dynamics and bioaccumulation

A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research.

Science.gov (United States)

Reeves, Todd D; Marbach-Ad, Gili; Miller, Kristen R; Ridgway, Judith; Gardner, Grant E; Schussler, Elisabeth E; Wischusen, E William

2016-01-01

Biology graduate teaching assistants (GTAs) are significant contributors to the educational mission of universities, particularly in introductory courses, yet there is a lack of empirical data on how to best prepare them for their teaching roles. This essay proposes a conceptual framework for biology GTA teaching professional development (TPD) program evaluation and research with three overarching variable categories for consideration: outcome variables, contextual variables, and moderating variables. The framework's outcome variables go beyond GTA satisfaction and instead position GTA cognition, GTA teaching practice, and undergraduate learning outcomes as the foci of GTA TPD evaluation and research. For each GTA TPD outcome variable, key evaluation questions and example assessment instruments are introduced to demonstrate how the framework can be used to guide GTA TPD evaluation and research plans. A common conceptual framework is also essential to coordinating the collection and synthesis of empirical data on GTA TPD nationally. Thus, the proposed conceptual framework serves as both a guide for conducting GTA TPD evaluation at single institutions and as a means to coordinate research across institutions at a national level. © 2016 T. D. Reeves et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Integrated Computer-aided Framework for Sustainable Chemical Product Design and Evaluation

DEFF Research Database (Denmark)

Kalakul, Sawitree; Cignitti, Stefano; Zhang, Lei

2016-01-01

This work proposes an integrated model-based framework for chemical product design and evaluation based on which the software, VPPD-Lab (The Virtual Product-Process Design Laboratory) has been developed. The framework allows the following options: (1) design a product using design templates...

All this grassroots, real life knowledge: Comparing perceived with realised concerns of including non-academic evaluators in societal impact assessment

Energy Technology Data Exchange (ETDEWEB)

Derrick, G.E.; Samuel, G.S.

2016-07-01

New research assessment frameworks that include societal impact criteria, also require the inclusion on non-academic evaluators (users) as part of the assessment panels. Little research has been conducted on how these user evaluators are received by traditionally academic-led panels, and how their presence influences evaluation outcomes. This is especially the case for evaluations including societal impact criteria. This article uses a mixed-methods approach to explore academic-evaluator concerns about the inclusion of user-evaluators in the assessment process. In addition, it explores how their involvement, influenced the outcomes of the evaluation process. (Author)

Cumulative biological impacts framework for solar energy projects in the California Desert

Science.gov (United States)

Davis, Frank W.; Kreitler, Jason R.; Soong, Oliver; Stoms, David M.; Dashiell, Stephanie; Hannah, Lee; Wilkinson, Whitney; Dingman, John

2013-01-01

This project developed analytical approaches, tools and geospatial data to support conservation planning for renewable energy development in the California deserts. Research focused on geographical analysis to avoid, minimize and mitigate the cumulative biological effects of utility-scale solar energy development. A hierarchical logic model was created to map the compatibility of new solar energy projects with current biological conservation values. The research indicated that the extent of compatible areas is much greater than the estimated land area required to achieve 2040 greenhouse gas reduction goals. Species distribution models were produced for 65 animal and plant species that were of potential conservation significance to the Desert Renewable Energy Conservation Plan process. These models mapped historical and projected future habitat suitability using 270 meter resolution climate grids. The results were integrated into analytical frameworks to locate potential sites for offsetting project impacts and evaluating the cumulative effects of multiple solar energy projects. Examples applying these frameworks in the Western Mojave Desert ecoregion show the potential of these publicly-available tools to assist regional planning efforts. Results also highlight the necessity to explicitly consider projected land use change and climate change when prioritizing areas for conservation and mitigation offsets. Project data, software and model results are all available online.

A framework for quantitative assessment of impacts related to energy and mineral resource development

Science.gov (United States)

Haines, Seth S.; Diffendorfer, James; Balistrieri, Laurie S.; Berger, Byron R.; Cook, Troy A.; Gautier, Donald L.; Gallegos, Tanya J.; Gerritsen, Margot; Graffy, Elisabeth; Hawkins, Sarah; Johnson, Kathleen; Macknick, Jordan; McMahon, Peter; Modde, Tim; Pierce, Brenda; Schuenemeyer, John H.; Semmens, Darius; Simon, Benjamin; Taylor, Jason; Walton-Day, Katherine

2013-01-01

Natural resource planning at all scales demands methods for assessing the impacts of resource development and use, and in particular it requires standardized methods that yield robust and unbiased results. Building from existing probabilistic methods for assessing the volumes of energy and mineral resources, we provide an algorithm for consistent, reproducible, quantitative assessment of resource development impacts. The approach combines probabilistic input data with Monte Carlo statistical methods to determine probabilistic outputs that convey the uncertainties inherent in the data. For example, one can utilize our algorithm to combine data from a natural gas resource assessment with maps of sage grouse leks and piñon-juniper woodlands in the same area to estimate possible future habitat impacts due to possible future gas development. As another example: one could combine geochemical data and maps of lynx habitat with data from a mineral deposit assessment in the same area to determine possible future mining impacts on water resources and lynx habitat. The approach can be applied to a broad range of positive and negative resource development impacts, such as water quantity or quality, economic benefits, or air quality, limited only by the availability of necessary input data and quantified relationships among geologic resources, development alternatives, and impacts. The framework enables quantitative evaluation of the trade-offs inherent in resource management decision-making, including cumulative impacts, to address societal concerns and policy aspects of resource development.

Gross national happiness as a framework for health impact assessment

International Nuclear Information System (INIS)

Pennock, Michael; Ura, Karma

2011-01-01

The incorporation of population health concepts and health determinants into Health Impact Assessments has created a number of challenges. The need for intersectoral collaboration has increased; the meaning of 'health' has become less clear; and the distinctions between health impacts, environmental impacts, social impacts and economic impacts have become increasingly blurred. The Bhutanese concept of Gross National Happiness may address these issues by providing an over-arching evidence-based framework which incorporates health, social, environmental and economic contributors as well as a number of other key contributors to wellbeing such as culture and governance. It has the potential to foster intersectoral collaboration by incorporating a more limited definition of health which places the health sector as one of a number of contributors to wellbeing. It also allows for the examination of the opportunity costs of health investments on wellbeing, is consistent with whole-of-government approaches to public policy and emerging models of social progress.

An evaluation framework for participatory modelling

Science.gov (United States)

Krueger, T.; Inman, A.; Chilvers, J.

2012-04-01

Strong arguments for participatory modelling in hydrology can be made on substantive, instrumental and normative grounds. These arguments have led to increasingly diverse groups of stakeholders (here anyone affecting or affected by an issue) getting involved in hydrological research and the management of water resources. In fact, participation has become a requirement of many research grants, programs, plans and policies. However, evidence of beneficial outcomes of participation as suggested by the arguments is difficult to generate and therefore rare. This is because outcomes are diverse, distributed, often tacit, and take time to emerge. In this paper we develop an evaluation framework for participatory modelling focussed on learning outcomes. Learning encompasses many of the potential benefits of participation, such as better models through diversity of knowledge and scrutiny, stakeholder empowerment, greater trust in models and ownership of subsequent decisions, individual moral development, reflexivity, relationships, social capital, institutional change, resilience and sustainability. Based on the theories of experiential, transformative and social learning, complemented by practitioner experience our framework examines if, when and how learning has occurred. Special emphasis is placed on the role of models as learning catalysts. We map the distribution of learning between stakeholders, scientists (as a subgroup of stakeholders) and models. And we analyse what type of learning has occurred: instrumental learning (broadly cognitive enhancement) and/or communicative learning (change in interpreting meanings, intentions and values associated with actions and activities; group dynamics). We demonstrate how our framework can be translated into a questionnaire-based survey conducted with stakeholders and scientists at key stages of the participatory process, and show preliminary insights from applying the framework within a rural pollution management situation in

DRUG EVALUATION AND DECISION MAKING IN CATALONIA: DEVELOPMENT AND VALIDATION OF A METHODOLOGICAL FRAMEWORK BASED ON MULTI-CRITERIA DECISION ANALYSIS (MCDA) FOR ORPHAN DRUGS.

Science.gov (United States)

Gilabert-Perramon, Antoni; Torrent-Farnell, Josep; Catalan, Arancha; Prat, Alba; Fontanet, Manel; Puig-Peiró, Ruth; Merino-Montero, Sandra; Khoury, Hanane; Goetghebeur, Mireille M; Badia, Xavier

2017-01-01

The aim of this study was to adapt and assess the value of a Multi-Criteria Decision Analysis (MCDA) framework (EVIDEM) for the evaluation of Orphan drugs in Catalonia (Catalan Health Service). The standard evaluation and decision-making procedures of CatSalut were compared with the EVIDEM methodology and contents. The EVIDEM framework was adapted to the Catalan context, focusing on the evaluation of Orphan drugs (PASFTAC program), during a Workshop with sixteen PASFTAC members. The criteria weighting was done using two different techniques (nonhierarchical and hierarchical). Reliability was assessed by re-test. The EVIDEM framework and methodology was found useful and feasible for Orphan drugs evaluation and decision making in Catalonia. All the criteria considered for the development of the CatSalut Technical Reports and decision making were considered in the framework. Nevertheless, the framework could improve the reporting of some of these criteria (i.e., "unmet needs" or "nonmedical costs"). Some Contextual criteria were removed (i.e., "Mandate and scope of healthcare system", "Environmental impact") or adapted ("population priorities and access") for CatSalut purposes. Independently of the weighting technique considered, the most important evaluation criteria identified for orphan drugs were: "disease severity", "unmet needs" and "comparative effectiveness", while the "size of the population" had the lowest relevance for decision making. Test-retest analysis showed weight consistency among techniques, supporting reliability overtime. MCDA (EVIDEM framework) could be a useful tool to complement the current evaluation methods of CatSalut, contributing to standardization and pragmatism, providing a method to tackle ethical dilemmas and facilitating discussions related to decision making.

Measuring the Impact of a Moving Target: Towards a Dynamic Framework for Evaluating Collaborative Adaptive Interactive Technologies

OpenAIRE

O?Grady, Laura; Witteman, Holly; Bender, Jacqueline L; Urowitz, Sara; Wiljer, David; Jadad, Alejandro R

2009-01-01

Background Website evaluation is a key issue for researchers, organizations, and others responsible for designing, maintaining, endorsing, approving, and/or assessing the use and impact of interventions designed to influence health and health services. Traditionally, these evaluations have included elements such as content credibility, interface usability, and overall design aesthetics. With the emergence of collaborative, adaptive, and interactive ("Web 2.0") technologies such as wikis and o...

Implementing Relative Ranking Evaluation Framework at Department of Energy (DOE) installations

International Nuclear Information System (INIS)

Sharma, S.K.; Williamson, D.; Treichel, L.C.; James, L.M.

1996-01-01

The US Department of Energy (DOE) Office of Environmental Restoration (EM-40) has developed the Relative Ranking Evaluation Framework (RREF) to help categorize release sites, facilities and buildings requiring restoration or decommissioning. Based on this framework, a computer tool, the Relative Rank Evaluation Program (RREP) has been developed to evaluate release sites, facilities and buildings, and to manage information pertaining to relative ranking evaluations. The relative ranking information is being used by both Headquarters and field project managers, and other environmental personnel responsible for planning, executing and evaluation environmental restoration activities at DOE installations. External stakeholders, such as representatives of federal and state regulatory agencies, local governments and communities in the vicinity of current and formerly used DOE installations may use this data to review proposed and planned activities

The AgMIP Framework to Evaluate Agricultural Pathways

Science.gov (United States)

Ruane, Alex

2015-01-01

This talk will describe the community and research framework that AgMIP has built to enable evidence-based adaptation investment. We provide expertise on the ground and connect various disciplines in order to allow specific adaptations to be evaluated for their biophysical and socio-economic ramifications.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

Science.gov (United States)

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies

Assessing the health impact of transnational corporations: its importance and a framework.

Science.gov (United States)

Baum, Frances E; Sanders, David M; Fisher, Matt; Anaf, Julia; Freudenberg, Nicholas; Friel, Sharon; Labonté, Ronald; London, Leslie; Monteiro, Carlos; Scott-Samuel, Alex; Sen, Amit

2016-06-15

The adverse health and equity impacts of transnational corporations' (TNCs) practices have become central public health concerns as TNCs increasingly dominate global trade and investment and shape national economies. Despite this, methodologies have been lacking with which to study the health equity impacts of individual corporations and thus to inform actions to mitigate or reverse negative and increase positive impacts. This paper reports on a framework designed to conduct corporate health impact assessment (CHIA), developed at a meeting held at the Rockefeller Foundation Bellagio Center in May 2015. On the basis of the deliberations at the meeting it was recommended that the CHIA should be based on ex post assessment and follow the standard HIA steps of screening, scoping, identification, assessment, decision-making and recommendations. A framework to conduct the CHIA was developed and designed to be applied to a TNC's practices internationally, and within countries to enable comparison of practices and health impacts in different settings. The meeting participants proposed that impacts should be assessed according to the TNC's global and national operating context; its organisational structure, political and business practices (including the type, distribution and marketing of its products); and workforce and working conditions, social factors, the environment, consumption patterns, and economic conditions within countries. We anticipate that the results of the CHIA will be used by civil society for capacity building and advocacy purposes, by governments to inform regulatory decision-making, and by TNCs to lessen their negative health impacts on health and fulfil commitments made to corporate social responsibility.

Evaluation of the Suitability of Alluxio for Hadoop Processing Frameworks

CERN Document Server

Lawrie, Christopher; CERN. Geneva. IT Department

2016-01-01

Alluxio is an open source memory speed virtual distributed storage platform. It sits between the storage and processing framework layers for big data processing and claims to heavily improve performance when data is required to be written/read at a high throughput; for example when a dataset is used by many jobs simultaneously. This report evaluates the viability of using Alluxio at CERN for Hadoop processing frameworks.

Evaluation Framework and Analyses for Thermal Energy Storage Integrated with Packaged Air Conditioning

Energy Technology Data Exchange (ETDEWEB)

Kung, F.; Deru, M.; Bonnema, E.

2013-10-01

Few third-party guidance documents or tools are available for evaluating thermal energy storage (TES) integrated with packaged air conditioning (AC), as this type of TES is relatively new compared to TES integrated with chillers or hot water systems. To address this gap, researchers at the National Renewable Energy Laboratory conducted a project to improve the ability of potential technology adopters to evaluate TES technologies. Major project outcomes included: development of an evaluation framework to describe key metrics, methodologies, and issues to consider when assessing the performance of TES systems integrated with packaged AC; application of multiple concepts from the evaluation framework to analyze performance data from four demonstration sites; and production of a new simulation capability that enables modeling of TES integrated with packaged AC in EnergyPlus. This report includes the evaluation framework and analysis results from the project.

Measuring the Impact of Research: Lessons from the UK's Research Excellence Framework 2014.

Directory of Open Access Journals (Sweden)

Gobinda Chowdhury

Full Text Available Impactful academic research plays a stellar role in society, pressing to ask the question of how one measures the impact created by different areas of academic research. Measuring the societal, cultural, economic and scientific impact of research is currently the priority of the National Science Foundation, European Commission and several research funding agencies. The recently concluded United Kingdom's national research quality exercise, the Research Excellence Framework (REF 2014, which piloted impact assessment as part of the overall evaluation offers a lens to view how impact of research in different disciplines can be measured. Overall research quality was assessed through quality of outputs, 'impact' and research environment. We performed two studies using the REF 2014 as a case study. The first study on 363 Impact Case Studies (ICSs submitted in 5 research areas (UoAs reveals that, in general, the impact scores were constructed upon a combination of factors i.e. quantity of quartile-one (Q1 publications, quantity and value of grants/income, number of researchers stated in the ICSs, spin-offs created, discoveries/patents and presentation of esteem data, informing researchers/ academics of the factors to consider in order to achieve a better impact score in research impact assessments. However, there were differences among disciplines in terms of the role played by the factors in achieving their overall scores for the ICSs. The outcome of this study is thus a set of impact indicators, and their relationship with the overall score of impact of research in different disciplines as determined in REF2014, which would in the first instance provide some answers to impact measures that would be useful for researchers in different disciplines. The second study extracts the general themes of impact reported by universities by performing a word frequency analysis in all the ICSs submitted in the five chosen research areas, which were substantially

Extending the Multi Regional Input-Output framework to labor related impacts

DEFF Research Database (Denmark)

Hardadi, Gilang; Pizzol, Massimo

2017-01-01

-O framework to social impacts. These challenges are addressed in this study where the Exiobase database was extended with new data on five quantitative indicators available from the International Labor Organization: employment; working hours; salary; occupational accident cases; and unemployment....... This required modeling steps, such as the disaggregation of data from sector to product group level, and filling the data gaps for missing countries by primary data collection or interpolation. A characterization step where indicator values are converted into social impacts on human productivity and human well...

Development of an evaluation framework for African-European hospital patient safety partnerships.

Science.gov (United States)

Rutter, Paul; Syed, Shamsuzzoha B; Storr, Julie; Hightower, Joyce D; Bagheri-Nejad, Sepideh; Kelley, Edward; Pittet, Didier

2014-04-01

Patient safety is recognised as a significant healthcare problem worldwide, and healthcare-associated infections are an important aspect. African Partnerships for Patient Safety is a WHO programme that pairs hospitals in Africa with hospitals in Europe with the objective to work together to improve patient safety. To describe the development of an evaluation framework for hospital-to-hospital partnerships participating in the programme. The framework was structured around the programme's three core objectives: facilitate strong interhospital partnerships, improve in-hospital patient safety and spread best practices nationally. Africa-based clinicians, their European partners and experts in patient safety were closely involved in developing the evaluation framework in an iterative process. The process defined six domains of partnership strength, each with measurable subdomains. We developed a questionnaire to measure these subdomains. Participants selected six indicators of hospital patient safety improvement from a short-list of 22 based on their relevance, sensitivity to intervention and measurement feasibility. Participants proposed 20 measures of spread, which were refined into a two-part conceptual framework, and a data capture tool created. Taking a highly participatory approach that closely involved its end users, we developed an evaluation framework and tools to measure partnership strength, patient safety improvements and the spread of best practice.

POLE.VAULT: A Semantic Framework for Health Policy Evaluation and Logical Testing.

Science.gov (United States)

Shaban-Nejad, Arash; Okhmatovskaia, Anya; Shin, Eun Kyong; Davis, Robert L; Buckeridge, David L

2017-01-01

The major goal of our study is to provide an automatic evaluation framework that aligns the results generated through semantic reasoning with the best available evidence regarding effective interventions to support the logical evaluation of public health policies. To this end, we have designed the POLicy EVAlUation & Logical Testing (POLE.VAULT) Framework to assist different stakeholders and decision-makers in making informed decisions about different health-related interventions, programs and ultimately policies, based on the contextual knowledge and the best available evidence at both individual and aggregate levels.

Economic impacts of climate change in Australia: framework and analysis

International Nuclear Information System (INIS)

Ford, Melanie

2007-01-01

Full text: There is growing interest in understanding the potential impacts of climate change in Australia, and especially the economic impacts of 'inaction'. In this study, a preliminary analysis of the possible economic impacts of future climate change in Australia is undertaken using ABARE's general equilibrium model of the global economy, GTEM. In order to understand the potential economy-wide economic impacts, the broad climatic trends that Australia is likely to experience over the next several decades are canvassed and the potential economic and non-economic impacts on key risk areas, such as water resources, agriculture and forests, health, industry and human settlements and the ecosystems, are identified. A more detailed analysis of the economic impacts of climate change are undertaken by developing two case studies. In the first case study, the economic impact of climate change and reduced water availability on the agricultural sector is assessed in the Murray-Darling Basin. In the second case study, the sectoral economic impacts on the Australian resources sector of a projected decline in global economic activity due to climate change is analysed. The key areas of required development to more fully understand the economy-wide and sectoral impacts of climate change are also discussed including issues associated with estimating both non-market and market impacts. Finally, an analytical framework for undertaking integrated assessment of climate change impacts domestically and globally is developed

Toward a Comprehensive Framework for Evaluating the Core Integration Features of Enterprise Integration Middleware Technologies

Directory of Open Access Journals (Sweden)

Hossein Moradi

2013-01-01

Full Text Available To achieve greater automation of their business processes, organizations face the challenge of integrating disparate systems. In attempting to overcome this problem, organizations are turning to different kinds of enterprise integration. Implementing enterprise integration is a complex task involving both technological and business challenges and requires appropriate middleware technologies. Different enterprise integration solutions provide various functions and features which lead to the complexity of their evaluation process. To overcome this complexity, appropriate tools for evaluating the core integration features of enterprise integration solutions is required. This paper proposes a new comprehensive framework for evaluating the core integration features of both intra-enterprise and inter-enterprise Integration's enabling technologies, which simplify the process of evaluating the requirements met by enterprise integration middleware technologies.The proposed framework for evaluating the core integration features of enterprise integration middleware technologies was enhanced using the structural and conceptual aspects of previous frameworks. It offers a new schema for which various enterprise integration middleware technologies are categorized in different classifications and are evaluated based on their supporting level for the core integration features' criteria. These criteria include the functional and supporting features. The proposed framework, which is a revised version of our previous framework in this area, has developed the scope, structure and content of the mentioned framework.

Towards an evaluation framework for process mining systems

NARCIS (Netherlands)

Ailenei, I.; Rozinat, A.; Eckert, A.; Aalst, van der W.M.P.

2011-01-01

Process mining is an emerging topic in the BPM marketplace. Recently, several (commercial) software solutions have become available. Due to the lack of an evaluation framework, it is very dif¿cult for potential users to assess the strengths and weaknesses of these process mining tools. As the ¿rst

Towards an evaluation framework for process mining algorithms

NARCIS (Netherlands)

Rozinat, A.; Alves De Medeiros, A.K.; Günther, C.W.; Weijters, A.J.M.M.; Aalst, van der W.M.P.

2007-01-01

Although there has been a lot of progress in developing process mining algorithms in recent years, no effort has been put in developing a common means of assessing the quality of the models discovered by these algorithms. In this paper, we outline elements of an evaluation framework that is intended

A framework for the quantitative assessment of climate change impacts on water-related activities at the basin scale

Directory of Open Access Journals (Sweden)

D. Anghileri

2011-06-01

Full Text Available While quantitative assessment of the climate change impact on hydrology at the basin scale is quite addressed in the literature, extension of quantitative analysis to impact on the ecological, economic and social sphere is still limited, although well recognized as a key issue to support water resource planning and promote public participation. In this paper we propose a framework for assessing climate change impact on water-related activities at the basin scale. The specific features of our approach are that: (i the impact quantification is based on a set of performance indicators defined together with the stakeholders, thus explicitly taking into account the water-users preferences; (ii the management policies are obtained by optimal control techniques, linking stakeholder expectations and decision-making; (iii the multi-objective nature of the management problem is fully preserved by simulating a set of Pareto-optimal management policies, which allows for evaluating not only variations in the indicator values but also tradeoffs among conflicting objectives. The framework is demonstrated by application to a real world case study, Lake Como basin (Italy. We show that the most conflicting water-related activities within the basin (i.e. hydropower production and agriculture are likely to be negatively impacted by climate change. We discuss the robustness of the estimated impacts to the climate natural variability and the approximations in modeling the physical system and the socio-economic system, and perform an uncertainty analysis of several sources of uncertainty. We demonstrate that the contribution of natural climate uncertainty is rather remarkable and that, among different modelling uncertainty sources, the one from climate modeling is very significant.

Creating Evaluation Profiles for Games Designed to be Fun: An Interpretive Framework for Serious Game Mechanics

DEFF Research Database (Denmark)

Ulrich, Frank; Helms, Niels Henrik

2017-01-01

an interpretive evaluation framework that can identify the educational value in COTS games. Application. The presented framework can create evaluative profiles of the learning, social, game, and immersive mechanics of COTS games as educational tools. Moreover, the framework can position COTS games between four...... intertwined dimensions, namely pedagogical, design, knowledge, and sociotechnical considerations. Demonstration. To validate the practical application of the interpretive framework, we apply it to a real-world example. Our demonstration reveals the usefulness of the framework. Conclusions. The framework...

Multiple Criteria Decision Analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: The Advance Value Framework.

Science.gov (United States)

Angelis, Aris; Kanavos, Panos

2017-09-01

Escalating drug prices have catalysed the generation of numerous "value frameworks" with the aim of informing payers, clinicians and patients on the assessment and appraisal process of new medicines for the purpose of coverage and treatment selection decisions. Although this is an important step towards a more inclusive Value Based Assessment (VBA) approach, aspects of these frameworks are based on weak methodologies and could potentially result in misleading recommendations or decisions. In this paper, a Multiple Criteria Decision Analysis (MCDA) methodological process, based on Multi Attribute Value Theory (MAVT), is adopted for building a multi-criteria evaluation model. A five-stage model-building process is followed, using a top-down "value-focused thinking" approach, involving literature reviews and expert consultations. A generic value tree is structured capturing decision-makers' concerns for assessing the value of new medicines in the context of Health Technology Assessment (HTA) and in alignment with decision theory. The resulting value tree (Advance Value Tree) consists of three levels of criteria (top level criteria clusters, mid-level criteria, bottom level sub-criteria or attributes) relating to five key domains that can be explicitly measured and assessed: (a) burden of disease, (b) therapeutic impact, (c) safety profile (d) innovation level and (e) socioeconomic impact. A number of MAVT modelling techniques are introduced for operationalising (i.e. estimating) the model, for scoring the alternative treatment options, assigning relative weights of importance to the criteria, and combining scores and weights. Overall, the combination of these MCDA modelling techniques for the elicitation and construction of value preferences across the generic value tree provides a new value framework (Advance Value Framework) enabling the comprehensive measurement of value in a structured and transparent way. Given its flexibility to meet diverse requirements and

A framework for evaluating distributed control systems in nuclear power plants

International Nuclear Information System (INIS)

O'Donell, C.; Jiang, J.

2004-01-01

A framework for evaluating the use of distributed control systems (DCS) in nuclear power plants (NPP) is proposed in this paper. The framework consists of advanced communication, control, hardware and software technology. This paper presents the results of an experiment using the framework test-bench, and elaborates on a variety of other research possibilities. Using a hardware in the loop system (HIL) a DeltaV M3 controller from Emerson Process is connected to a desktop NPP simulator. The industry standard communication protocol, Modbus, has been selected in this study. A simplified boiler pressure control (BPC) module is created on the NPP simulator. The test-bench provides an interface between the controller and the simulator. Through software monitoring the performance of the DCS can be evaluated. Controller access and response times over the Modbus network are observed and compared with theoretical values. The controller accomplishes its task under the specifications set out for the BPC. This novel framework allows a performance metric to be applied against different industrial controllers. (author)

A new framework for evaluating the health impacts of treatment for Gaucher disease type 1

Directory of Open Access Journals (Sweden)

Michael L. Ganz

2017-02-01

Full Text Available Abstract Background The Disease Severity Scoring System (DS3 is a validated measure for evaluating Gaucher disease type 1 (GD1 severity. We developed a new framework, consisting of health states, transition probabilities between those states, and preferences for those states (utilities based on the DS3 to predict long-term outcomes of patients starting treatment. We defined nine mutually exclusive (alive health states based on three DS3 categories: mild (0 ≤ DS3 ≤ 3.5 without symptoms of bone disease; mild with bone pain, mild with severe skeletal complications (SSC defined as lytic lesions, avascular necrosis, or fracture; moderate (3.5 < DS3 ≤ 6.5 without SSC; moderate with SSC; marked (6.5 < DS3 ≤ 9.5 without SSC; marked with SSC; severe (9.5 < DS3 ≤ 19 without SSC; and severe with SSC. Health-state transition probabilities and utilities were estimated from a longitudinal sample of patients with GD1 who started enzyme replacement therapy (the DS3 Score Study. Age dependent GD1-specific mortality was derived from published data. We used a Markov state-transition model to illustrate how to estimate time spent in each health state. Results The average predicted utilities for each health state ranged from 0.76 for mild disease with no clinical symptoms of bone disease to 0.52 with severe disease with SSC. Transition probabilities depended on disease severity (DS3 score at treatment initiation and whether patients had undergone a total splenectomy or had an intact spleen/partial splenectomy prior to starting treatment. Patients who started treatment with intact or residual spleens spent more time in better health states than those who started treatment with total splenectomy. Conclusions This new framework, which is based on the DS3, can be used to project the long-term outcomes of GD1 patients starting treatment. The framework could also be used to compare the long-term outcomes of different GD1 treatment options. Trial

Process change evaluation framework for allogeneic cell therapies: impact on drug development and commercialization.

Science.gov (United States)

Hassan, Sally; Huang, Hsini; Warren, Kim; Mahdavi, Behzad; Smith, David; Jong, Simcha; Farid, Suzanne S

2016-04-01

Some allogeneic cell therapies requiring a high dose of cells for large indication groups demand a change in cell expansion technology, from planar units to microcarriers in single-use bioreactors for the market phase. The aim was to model the optimal timing for making this change. A development lifecycle cash flow framework was created to examine the implications of process changes to microcarrier cultures at different stages of a cell therapy's lifecycle. The analysis performed under assumptions used in the framework predicted that making this switch earlier in development is optimal from a total expected out-of-pocket cost perspective. From a risk-adjusted net present value view, switching at Phase I is economically competitive but a post-approval switch can offer the highest risk-adjusted net present value as the cost of switching is offset by initial market penetration with planar technologies. The framework can facilitate early decision-making during process development.

Framework of Comprehensive Proliferation Resistance Evaluation Methodology

International Nuclear Information System (INIS)

Kim, Min Su; Jo, Seong Youn; Kim, Min Soo; Kim, Jae San; Lee, Hyun Kyung

2007-01-01

Civilian nuclear programs can be used as a pretext to acquire technologies, materials, equipment for military weapon programs. Consequently, international society has a strong incentive to develop a nuclear system more proliferation resistant to assure that the civilian nuclear energy system is an unattractive and least desirable route for diversion of weapon usable material. The First step developing a more proliferation resistant nuclear energy system is to develop a systematic and standardized evaluation methodology to ensure that any future nuclear energy system satisfies the proliferation resistance goals. Many attempts to develop systematic evaluation methodology have been proposed and many systems for assessing proliferation resistance have been previously studied. However, a comprehensive proliferation resistance evaluation can not be achieved by simply applying one method since complicated proliferation resistance characteristics, including inherent features and extrinsic features, should be completely evaluated. Therefore, it is necessary to develop one incorporated evaluation methodology to make up for weak points of each evaluation method. The objective of this study is to provide a framework of comprehensive proliferation resistance evaluation methodology by incorporating two generally used evaluation methods, attribute and scenario analysis

Framework of outcome measures recommended for use in the evaluation of childhood obesity treatment interventions: the CoOR framework.

Science.gov (United States)

Bryant, M; Ashton, L; Nixon, J; Jebb, S; Wright, J; Roberts, K; Brown, J

2014-12-01

Consensus is lacking in determining appropriate outcome measures for assessment of childhood obesity treatments. Inconsistency in the use and reporting of such measures impedes comparisons between treatments and limits consideration of effectiveness. This study aimed to produce a framework of recommended outcome measures: the Childhood obesity treatment evaluation Outcomes Review (CoOR) framework. A systematic review including two searches was conducted to identify (1) existing trial outcome measures and (2) manuscripts describing development/evaluation of outcome measures. Outcomes included anthropometry, diet, eating behaviours, physical activity, sedentary time/behaviour, fitness, physiology, environment, psychological well-being and health-related quality of life. Eligible measures were appraised by the internal team using a system developed from international guidelines, followed by appraisal from national external expert collaborators. A total of 25,486 papers were identified through both searches. Eligible search 1 trial papers cited 417 additional papers linked to outcome measures, of which 56 were eligible. A further 297 outcome development/evaluation papers met eligibility criteria from search 2. Combined, these described 191 outcome measures. After internal and external appraisal, 52 measures across 10 outcomes were recommended for inclusion in the CoOR framework. Application of the CoOR framework will ensure greater consistency in choosing robust outcome measures that are appropriate to population characteristics. © 2014 The Authors. Pediatric Obesity © 2014 International Association for the Study of Obesity.

Adaptation strategies for health impacts of climate change in Western Australia: Application of a Health Impact Assessment framework

International Nuclear Information System (INIS)

Spickett, Jeffery T.; Brown, Helen L.; Katscherian, Dianne

2011-01-01

Climate change is one of the greatest challenges facing the globe and there is substantial evidence that this will result in a number of health impacts, regardless of the level of greenhouse gas mitigation. It is therefore apparent that a combined approach of mitigation and adaptation will be required to protect public health. While the importance of mitigation is recognised, this project focused on the role of adaptation strategies in addressing the potential health impacts of climate change. The nature and magnitude of these health impacts will be determined by a number of parameters that are dependent upon the location. Firstly, climate change will vary between regions. Secondly, the characteristics of each region in terms of population and the ability to adapt to changes will greatly influence the extent of the health impacts that are experienced now and into the future. Effective adaptation measures therefore need to be developed with these differences in mind. A Health Impact Assessment (HIA) framework was used to consider the implications of climate change on the health of the population of Western Australia (WA) and to develop a range of adaptive responses suited to WA. A broad range of stakeholders participated in the HIA process, providing informed input into developing an understanding of the potential health impacts and potential adaptation strategies from a diverse sector perspective. Potential health impacts were identified in relation to climate change predictions in WA in the year 2030. The risk associated with each of these impacts was assessed using a qualitative process that considered the consequences and the likelihood of the health impact occurring. Adaptations were then developed which could be used to mitigate the identified health impacts and provide responses which could be used by Government for future decision making. The periodic application of a HIA framework is seen as an ideal tool to develop appropriate adaptation strategies to

Integrating resource efficiency and EU State aid. An evaluation of resource efficiency considerations in the current EU State aid framework

Energy Technology Data Exchange (ETDEWEB)

Bennink, D.; Faber, J.; Smit, M. [CE Delft, Delft (Netherlands); Goba, V. [SIA Estonian, Latvian and Lithuanian Environment ELLE, Tallinn (Estonia); Miller, K.; Williams, E. [AEA Technology plc, London (United Kingdom)

2012-10-15

This study, for the European Commission, analyses the issues that need to be addressed in the revision of the EU State aid framework to ensure that they do not hinder environmental, resource efficiency and sustainable development goals. In some cases, State aid can be considered an environmentally harmful subsidy (EHS). The study analyses (1) the extent to which the Environmental Aid Guidelines (EAG) need to be changed to take into account recent European environmental policy developments; (2) existing and potential resource efficiency considerations in a) the Regional Aid Guidelines; b) the Research, Development and Innovation (RDI) Guidelines and c) the Agriculture and Forestry Guidelines; assesses cases and schemes using these guidelines to identify whether resource efficiency considerations are taken into account. The study also considers the social, environmental and economic impacts of these cases and schemes. It develops recommendations for the review of the EAG and a number of horizontal guidelines. One of the conclusions of the analysis is that the way in which multiple objectives and impacts are balanced, when deciding to approve state aid, is unclear. Also, EU member states are not required to provide information on certain types of (estimated) impacts. To guarantee that multiple objectives and impacts are sufficiently balanced, it is recommended that the State aid framework prescribes that applicants identify social, economic and environmental objectives and impacts and describe how these are taken into account in the procedure of balancing multiple (conflicting) objectives. Objectives and impacts should be quantified as much as possible, for example by making use of the method of external cost calculation laid down in 'the Handbook on estimation of external costs in the transport Sector'. The results of the study are used by the European Commission as an input for evaluating and improving the EU State aid framework.

Integrating resource efficiency and EU State aid. An evaluation of resource efficiency considerations in the current EU State aid framework

Energy Technology Data Exchange (ETDEWEB)

Bennink, D.; Faber, J.; Smit, M. [CE Delft, Delft (Netherlands); Goba, V. [SIA Estonian, Latvian and Lithuanian Environment ELLE, Tallinn (Estonia); Miller, K.; Williams, E. [AEA Technology plc, London (United Kingdom)

2012-10-15

This study, for the European Commission, analyses the issues that need to be addressed in the revision of the EU State aid framework to ensure that they do not hinder environmental, resource efficiency and sustainable development goals. In some cases, State aid can be considered an environmentally harmful subsidy (EHS). The study analyses (1) the extent to which the Environmental Aid Guidelines (EAG) need to be changed to take into account recent European environmental policy developments; (2) existing and potential resource efficiency considerations in a) the Regional Aid Guidelines; b) the Research, Development and Innovation (RDI) Guidelines and c) the Agriculture and Forestry Guidelines; assesses cases and schemes using these guidelines to identify whether resource efficiency considerations are taken into account. The study also considers the social, environmental and economic impacts of these cases and schemes. It develops recommendations for the review of the EAG and a number of horizontal guidelines. One of the conclusions of the analysis is that the way in which multiple objectives and impacts are balanced, when deciding to approve state aid, is unclear. Also, EU member states are not required to provide information on certain types of (estimated) impacts. To guarantee that multiple objectives and impacts are sufficiently balanced, it is recommended that the State aid framework prescribes that applicants identify social, economic and environmental objectives and impacts and describe how these are taken into account in the procedure of balancing multiple (conflicting) objectives. Objectives and impacts should be quantified as much as possible, for example by making use of the method of external cost calculation laid down in 'the Handbook on estimation of external costs in the transport Sector'. The results of the study are used by the European Commission as an input for evaluating and improving the EU State aid framework.

Implementing a framework for goal setting in community based stroke rehabilitation: a process evaluation.

Science.gov (United States)

Scobbie, Lesley; McLean, Donald; Dixon, Diane; Duncan, Edward; Wyke, Sally

2013-05-24

Goal setting is considered 'best practice' in stroke rehabilitation; however, there is no consensus regarding the key components of goal setting interventions or how they should be optimally delivered in practice. We developed a theory-based goal setting and action planning framework (G-AP) to guide goal setting practice. G-AP has 4 stages: goal negotiation, goal setting, action planning & coping planning and appraisal & feedback. All stages are recorded in a patient-held record. In this study we examined the implementation, acceptability and perceived benefits of G-AP in one community rehabilitation team with people recovering from stroke. G-AP was implemented for 6 months with 23 stroke patients. In-depth interviews with 8 patients and 8 health professionals were analysed thematically to investigate views of its implementation, acceptability and perceived benefits. Case notes of interviewed patients were analysed descriptively to assess the fidelity of G-AP implementation. G-AP was mostly implemented according to protocol with deviations noted at the planning and appraisal and feedback stages. Each stage was felt to make a useful contribution to the overall process; however, in practice, goal negotiation and goal setting merged into one stage and the appraisal and feedback stage included an explicit decision making component. Only two issues were raised regarding G-APs acceptability: (i) health professionals were concerned about the impact of goal non-attainment on patient's well-being (patients did not share their concerns), and (ii) some patients and health professionals found the patient-held record unhelpful. G-AP was felt to have a positive impact on patient goal attainment and professional goal setting practice. Collaborative partnerships between health professionals and patients were apparent throughout the process. G-AP has been perceived as both beneficial and broadly acceptable in one community rehabilitation team; however, implementation of novel

Implementing a framework for goal setting in community based stroke rehabilitation: a process evaluation

Science.gov (United States)

2013-01-01

Background Goal setting is considered ‘best practice’ in stroke rehabilitation; however, there is no consensus regarding the key components of goal setting interventions or how they should be optimally delivered in practice. We developed a theory-based goal setting and action planning framework (G-AP) to guide goal setting practice. G-AP has 4 stages: goal negotiation, goal setting, action planning & coping planning and appraisal & feedback. All stages are recorded in a patient-held record. In this study we examined the implementation, acceptability and perceived benefits of G-AP in one community rehabilitation team with people recovering from stroke. Methods G-AP was implemented for 6 months with 23 stroke patients. In-depth interviews with 8 patients and 8 health professionals were analysed thematically to investigate views of its implementation, acceptability and perceived benefits. Case notes of interviewed patients were analysed descriptively to assess the fidelity of G-AP implementation. Results G-AP was mostly implemented according to protocol with deviations noted at the planning and appraisal and feedback stages. Each stage was felt to make a useful contribution to the overall process; however, in practice, goal negotiation and goal setting merged into one stage and the appraisal and feedback stage included an explicit decision making component. Only two issues were raised regarding G-APs acceptability: (i) health professionals were concerned about the impact of goal non-attainment on patient’s well-being (patients did not share their concerns), and (ii) some patients and health professionals found the patient-held record unhelpful. G-AP was felt to have a positive impact on patient goal attainment and professional goal setting practice. Collaborative partnerships between health professionals and patients were apparent throughout the process. Conclusions G-AP has been perceived as both beneficial and broadly acceptable in one community

Setting Healthcare Priorities at the Macro and Meso Levels: A Framework for Evaluation.

Science.gov (United States)

Barasa, Edwine W; Molyneux, Sassy; English, Mike; Cleary, Susan

2015-09-16

Priority setting in healthcare is a key determinant of health system performance. However, there is no widely accepted priority setting evaluation framework. We reviewed literature with the aim of developing and proposing a framework for the evaluation of macro and meso level healthcare priority setting practices. We systematically searched Econlit, PubMed, CINAHL, and EBSCOhost databases and supplemented this with searches in Google Scholar, relevant websites and reference lists of relevant papers. A total of 31 papers on evaluation of priority setting were identified. These were supplemented by broader theoretical literature related to evaluation of priority setting. A conceptual review of selected papers was undertaken. Based on a synthesis of the selected literature, we propose an evaluative framework that requires that priority setting practices at the macro and meso levels of the health system meet the following conditions: (1) Priority setting decisions should incorporate both efficiency and equity considerations as well as the following outcomes; (a) Stakeholder satisfaction, (b) Stakeholder understanding, (c) Shifted priorities (reallocation of resources), and (d) Implementation of decisions. (2) Priority setting processes should also meet the procedural conditions of (a) Stakeholder engagement, (b) Stakeholder empowerment, (c) Transparency, (d) Use of evidence, (e) Revisions, (f) Enforcement, and (g) Being grounded on community values. Available frameworks for the evaluation of priority setting are mostly grounded on procedural requirements, while few have included outcome requirements. There is, however, increasing recognition of the need to incorporate both consequential and procedural considerations in priority setting practices. In this review, we adapt an integrative approach to develop and propose a framework for the evaluation of priority setting practices at the macro and meso levels that draws from these complementary schools of thought. © 2015

Setting Healthcare Priorities at the Macro and Meso Levels: A Framework for Evaluation

Science.gov (United States)

Barasa, Edwine W.; Molyneux, Sassy; English, Mike; Cleary, Susan

2015-01-01

Background: Priority setting in healthcare is a key determinant of health system performance. However, there is no widely accepted priority setting evaluation framework. We reviewed literature with the aim of developing and proposing a framework for the evaluation of macro and meso level healthcare priority setting practices. Methods: We systematically searched Econlit, PubMed, CINAHL, and EBSCOhost databases and supplemented this with searches in Google Scholar, relevant websites and reference lists of relevant papers. A total of 31 papers on evaluation of priority setting were identified. These were supplemented by broader theoretical literature related to evaluation of priority setting. A conceptual review of selected papers was undertaken. Results: Based on a synthesis of the selected literature, we propose an evaluative framework that requires that priority setting practices at the macro and meso levels of the health system meet the following conditions: (1) Priority setting decisions should incorporate both efficiency and equity considerations as well as the following outcomes; (a) Stakeholder satisfaction, (b) Stakeholder understanding, (c) Shifted priorities (reallocation of resources), and (d) Implementation of decisions. (2) Priority setting processes should also meet the procedural conditions of (a) Stakeholder engagement, (b) Stakeholder empowerment, (c) Transparency, (d) Use of evidence, (e) Revisions, (f) Enforcement, and (g) Being grounded on community values. Conclusion: Available frameworks for the evaluation of priority setting are mostly grounded on procedural requirements, while few have included outcome requirements. There is, however, increasing recognition of the need to incorporate both consequential and procedural considerations in priority setting practices. In this review, we adapt an integrative approach to develop and propose a framework for the evaluation of priority setting practices at the macro and meso levels that draws from these

Setting Healthcare Priorities at the Macro and Meso Levels: A Framework for Evaluation

Directory of Open Access Journals (Sweden)

Edwine W. Barasa

2015-11-01

Full Text Available Background Priority setting in healthcare is a key determinant of health system performance. However, there is no widely accepted priority setting evaluation framework. We reviewed literature with the aim of developing and proposing a framework for the evaluation of macro and meso level healthcare priority setting practices. Methods We systematically searched Econlit, PubMed, CINAHL, and EBSCOhost databases and supplemented this with searches in Google Scholar, relevant websites and reference lists of relevant papers. A total of 31 papers on evaluation of priority setting were identified. These were supplemented by broader theoretical literature related to evaluation of priority setting. A conceptual review of selected papers was undertaken. Results Based on a synthesis of the selected literature, we propose an evaluative framework that requires that priority setting practices at the macro and meso levels of the health system meet the following conditions: (1 Priority setting decisions should incorporate both efficiency and equity considerations as well as the following outcomes; (a Stakeholder satisfaction, (b Stakeholder understanding, (c Shifted priorities (reallocation of resources, and (d Implementation of decisions. (2 Priority setting processes should also meet the procedural conditions of (a Stakeholder engagement, (b Stakeholder empowerment, (c Transparency, (d Use of evidence, (e Revisions, (f Enforcement, and (g Being grounded on community values. Conclusion Available frameworks for the evaluation of priority setting are mostly grounded on procedural requirements, while few have included outcome requirements. There is, however, increasing recognition of the need to incorporate both consequential and procedural considerations in priority setting practices. In this review, we adapt an integrative approach to develop and propose a framework for the evaluation of priority setting practices at the macro and meso levels that draws from

An Analytical Framework for the Steady State Impact of Carbonate Compensation on Atmospheric CO2

Science.gov (United States)

Omta, Anne Willem; Ferrari, Raffaele; McGee, David

2018-04-01

The deep-ocean carbonate ion concentration impacts the fraction of the marine calcium carbonate production that is buried in sediments. This gives rise to the carbonate compensation feedback, which is thought to restore the deep-ocean carbonate ion concentration on multimillennial timescales. We formulate an analytical framework to investigate the impact of carbonate compensation under various changes in the carbon cycle relevant for anthropogenic change and glacial cycles. Using this framework, we show that carbonate compensation amplifies by 15-20% changes in atmospheric CO2 resulting from a redistribution of carbon between the atmosphere and ocean (e.g., due to changes in temperature, salinity, or nutrient utilization). A counterintuitive result emerges when the impact of organic matter burial in the ocean is examined. The organic matter burial first leads to a slight decrease in atmospheric CO2 and an increase in the deep-ocean carbonate ion concentration. Subsequently, enhanced calcium carbonate burial leads to outgassing of carbon from the ocean to the atmosphere, which is quantified by our framework. Results from simulations with a multibox model including the minor acids and bases important for the ocean-atmosphere exchange of carbon are consistent with our analytical predictions. We discuss the potential role of carbonate compensation in glacial-interglacial cycles as an example of how our theoretical framework may be applied.

Evaluation of a Framework to Implement Electronic Health Record Systems Based on the openEHR Standard

Science.gov (United States)

Orellana, Diego A.; Salas, Alberto A.; Solarz, Pablo F.; Medina Ruiz, Luis; Rotger, Viviana I.

2016-04-01

The production of clinical information about each patient is constantly increasing, and it is noteworthy that the information is created in different formats and at diverse points of care, resulting in fragmented, incomplete, inaccurate and isolated, health information. The use of health information technology has been promoted as having a decisive impact to improve the efficiency, cost-effectiveness, quality and safety of medical care delivery. However in developing countries the utilization of health information technology is insufficient and lacking of standards among other situations. In the present work we evaluate the framework EHRGen, based on the openEHR standard, as mean to reach generation and availability of patient centered information. The framework has been evaluated through the provided tools for final users, that is, without intervention of computer experts. It makes easier to adopt the openEHR ideas and provides an open source basis with a set of services, although some limitations in its current state conspire against interoperability and usability. However, despite the described limitations respect to usability and semantic interoperability, EHRGen is, at least regionally, a considerable step toward EHR adoption and interoperability, so that it should be supported from academic and administrative institutions.

Evaluating construction projects of hotels based on environmental sustainability with MCDM framework

Directory of Open Access Journals (Sweden)

Sarfaraz Hashemkhani Zolfani

2018-03-01

Full Text Available Environmental issues have got incredible attention among daily life activities. Sustainability penetrated in all society practices specially construction industry due to its substantial impact on the environment. Monitoring and controlling architectural project contains a decision problem with multi-varieties analysis. This study aimed to evaluate construction projects of hotels regarding environmental sustainability. To this end, a hybrid Multiple Criteria Decision Making (MCDM model is proposed. Step‐wise Weight Assessment Ratio Analysis (SWARA and Complex proportional assessment (COPRAS compose a unified framework. A private construction project is supposed as a case study. The project is based on establishing a five star hotel in Tehran, Iran. In this research SWARA produces criteria weights and COPRAS will rank decision alternatives. This study can be a strategic route for other similar researches in other fields. Keywords: Architecture projects, Sustainability, Environmental sustainability, SWARA, COPRAS

A framework for evaluating automatic indexing or classification in the context of retrieval

DEFF Research Database (Denmark)

Golub, Korajlka; Soergel, Dagobert; Buchanan, George

2016-01-01

subject indexing, hard scientific evidence of their performance in operating information environments is scarce. A major reason for this is that research is usually conducted in laboratory conditions, excluding the complexities of real-life systems and situations. The paper reviews and discusses issues...... with existing evaluation approaches such as problems of aboutness and relevance assessments, implying the need to use more than a single “gold standard” method when evaluating indexing and retrieval and proposes a comprehensive evaluation framework. The framework is informed by a systematic review...

Evaluation of Conceptual Frameworks Applicable to the Study of Isolation Precautions Effectiveness

Science.gov (United States)

Crawford, Catherine; Shang, Jingjing

2015-01-01

Aims A discussion of conceptual frameworks applicable to the study of isolation precautions effectiveness according to Fawcett and DeSanto-Madeya’s (2013) evaluation technique and their relative merits and drawbacks for this purpose Background Isolation precautions are recommended to control infectious diseases with high morbidity and mortality, but effectiveness is not established due to numerous methodological challenges. These challenges, such as identifying empirical indicators and refining operational definitions, could be alleviated though use of an appropriate conceptual framework. Design Discussion paper Data Sources In mid-April 2014, the primary author searched five electronic, scientific literature databases for conceptual frameworks applicable to study isolation precautions, without limiting searches by publication date. Implications for Nursing By reviewing promising conceptual frameworks to support isolation precautions effectiveness research, this paper exemplifies the process to choose an appropriate conceptual framework for empirical research. Hence, researchers may build on these analyses to improve study design of empirical research in multiple disciplines, which may lead to improved research and practice. Conclusion Three frameworks were reviewed: the epidemiologic triad of disease, Donabedian’s healthcare quality framework and the Quality Health Outcomes model. Each has been used in nursing research to evaluate health outcomes and contains concepts relevant to nursing domains. Which framework can be most useful likely depends on whether the study question necessitates testing multiple interventions, concerns pathogen-specific characteristics and yields cross-sectional or longitudinal data. The Quality Health Outcomes model may be slightly preferred as it assumes reciprocal relationships, multi-level analysis and is sensitive to cultural inputs. PMID:26179813

A multi-criteria evaluation framework for tradable white certificate schemes

International Nuclear Information System (INIS)

Mundaca, Luis; Neij, Lena

2009-01-01

Recent years have witnessed regained political momentum on energy efficiency and interest in establishing markets is growing. As a result, Tradable White Certificate (TWC) schemes of differing design have been implemented in Great Britain, Italy and France. Much attention is being paid to justifying and evaluating such schemes. In this paper, we develop and apply a multi-criteria framework for evaluating TWC schemes-an approach that attempts to cover their individual design features. A broad evaluation is conducted regarding energy-saving and environmental effectiveness, economic efficiency, cost-effectiveness, transaction costs, political feasibility, administrative burden and technical change. The results show the design and performance of TWC schemes to be case and context-specific, and generalisations are thus inappropriate. This evaluation supports the cost-effectiveness modelled for the British scheme and the assumption that a TWC scheme is an economically efficient policy instrument. For the other, more complex TWC schemes, more data and experience are needed to judge their ex-post merit. On the whole, the proposed multi-criteria evaluation requires considerable data and complementary methods. However, the framework improves the understanding of the broad effects and attributes of TWC schemes. It deals with various empirical and normative aspects that can be applied in their evaluation.

A Framework for Evaluating Economic Impacts of Rooftop PV Systems with or without Energy Storage on Thai Distribution Utilities and Ratepayers

Science.gov (United States)

Chaianong, A.; Bangviwat, A.; Menke, C.

2017-07-01

Driven by decreasing PV and energy storage prices, increasing electricity costs and policy supports from Thai government (self-consumption era), rooftop PV and energy storage systems are going to be deployed in the country rapidly that may disrupt existing business models structure of Thai distribution utilities due to revenue erosion and lost earnings opportunities. The retail rates that directly affect ratepayers (non-solar customers) are expected to increase. This paper focuses on a framework for evaluating impacts of PV with and without energy storage systems on Thai distribution utilities and ratepayers by using cost-benefit analysis (CBA). Prior to calculation of cost/benefit components, changes in energy sales need to be addressed. Government policies for the support of PV generation will also help in accelerating the rooftop PV installation. Benefit components include avoided costs due to transmission losses and deferring distribution capacity with appropriate PV penetration level, while cost components consist of losses in revenue, program costs, integration costs and unrecovered fixed costs. It is necessary for Thailand to compare total costs and total benefits of rooftop PV and energy storage systems in order to adopt policy supports and mitigation approaches, such as business model innovation and regulatory reform, effectively.

A Framework for Including Family Health Spillovers in Economic Evaluation.

Science.gov (United States)

Al-Janabi, Hareth; van Exel, Job; Brouwer, Werner; Coast, Joanna

2016-02-01

Health care interventions may affect the health of patients' family networks. It has been suggested that these "health spillovers" should be included in economic evaluation, but there is not a systematic method for doing this. In this article, we develop a framework for including health spillovers in economic evaluation. We focus on extra-welfarist economic evaluations where the objective is to maximize health benefits from a health care budget (the "health care perspective"). Our framework involves adapting the conventional cost-effectiveness decision rule to include 2 multiplier effects to internalize the spillover effects. These multiplier effects express the ratio of total health effects (for patients and their family networks) to patient health effects. One multiplier effect is specified for health benefit generated from providing a new intervention, one for health benefit displaced by funding this intervention. We show that using multiplier effects to internalize health spillovers could change the optimal funding decisions and generate additional health benefits to society. © The Author(s) 2015.

Evidence-Based Evaluation of Practice and Innovation in Physical Therapy Using the IDEAL-Physio Framework.

Science.gov (United States)

Beard, David; Hamilton, David; Davies, Loretta; Cook, Jonathan; Hirst, Allison; McCulloch, Peter; Paez, Arsenio

2018-02-01

The IDEAL framework is an established method for initial and ongoing evaluations of innovation and practice for complex health care interventions. First derived for surgical sciences and embedded at a global level for evaluating surgery/surgical devices, the IDEAL framework is based on the principle that innovation and evaluation in clinical practice can, and should, evolve together in an ordered manner: from conception to development and then to validation by appropriate clinical studies and, finally, longer-term follow-up. This framework is highly suited to other complex, nonpharmacological interventions, such as physical therapist interventions. This perspective outlines the application of IDEAL to physical therapy in the new IDEAL-Physio framework. The IDEAL-Physio framework comprises 5 stages. In stage 1, the idea phase, formal data collection should begin. Stage 2a is the phase for iterative improvement and adjustment with thorough data recording. Stage 2b involves the onset of formal evaluation using systematically collected group or cohort data. Stage 3 is the phase for formal comparative assessment of treatment, usually involving randomized studies. Stage 4 involves long-term follow-up. The IDEAL-Physio framework is recommended as a method for guiding and evaluating both innovation and practice in physical therapy, with the overall goal of providing better evidence-based care. © 2017 American Physical Therapy Association.

A spatial assessment framework for evaluating flood risk under extreme climates.

Science.gov (United States)

Chen, Yun; Liu, Rui; Barrett, Damian; Gao, Lei; Zhou, Mingwei; Renzullo, Luigi; Emelyanova, Irina

2015-12-15

Australian coal mines have been facing a major challenge of increasing risk of flooding caused by intensive rainfall events in recent years. In light of growing climate change concerns and the predicted escalation of flooding, estimating flood inundation risk becomes essential for understanding sustainable mine water management in the Australian mining sector. This research develops a spatial multi-criteria decision making prototype for the evaluation of flooding risk at a regional scale using the Bowen Basin and its surroundings in Queensland as a case study. Spatial gridded data, including climate, hydrology, topography, vegetation and soils, were collected and processed in ArcGIS. Several indices were derived based on time series of observations and spatial modeling taking account of extreme rainfall, evapotranspiration, stream flow, potential soil water retention, elevation and slope generated from a digital elevation model (DEM), as well as drainage density and proximity extracted from a river network. These spatial indices were weighted using the analytical hierarchy process (AHP) and integrated in an AHP-based suitability assessment (AHP-SA) model under the spatial risk evaluation framework. A regional flooding risk map was delineated to represent likely impacts of criterion indices at different risk levels, which was verified using the maximum inundation extent detectable by a time series of remote sensing imagery. The result provides baseline information to help Bowen Basin coal mines identify and assess flooding risk when making adaptation strategies and implementing mitigation measures in future. The framework and methodology developed in this research offers the Australian mining industry, and social and environmental studies around the world, an effective way to produce reliable assessment on flood risk for managing uncertainty in water availability under climate change. Copyright © 2015. Published by Elsevier B.V.

Towards an IMU Evaluation Framework for Human Body Tracking.

Science.gov (United States)

Venek, Verena; Kremser, Wolfgang; Schneider, Cornelia

2018-01-01

Existing full-body tracking systems, which use Inertial Measurement Units (IMUs) as sensing unit, require expert knowledge for setup and data collection. Thus, the daily application for human body tracking is difficult. In particular, in the field of active and assisted living (AAL), tracking human movements would enable novel insights not only into the quantity but also into the quality of human movement, for example by monitoring functional training. While the current market offers a wide range of products with vastly different properties, literature lacks guidelines for choosing IMUs for body tracking applications. Therefore, this paper introduces developments towards an IMU evaluation framework for human body tracking which compares IMUs against five requirement areas that consider device features and data quality. The data quality is assessed by conducting a static and a dynamic error analysis. In a first application to four IMUs of different component consumption, the IMU evaluation framework convinced as promising tool for IMU selection.

Mitigation for one & all: An integrated framework for mitigation of development impacts on biodiversity and ecosystem services

Energy Technology Data Exchange (ETDEWEB)

Tallis, Heather, E-mail: htallis@tnc.org [The Nature Conservancy, 415 Alta Vista Dr., Santa Cruz, CA 95060 (United States); Kennedy, Christina M., E-mail: ckennedy@tnc.org [The Nature Conservancy, 117 East Mountain Ave., Ft. Collins, CO 80524 (United States); Ruckelshaus, Mary [The Natural Capital Project, 371 Serra Mall, Stanford, CA 94305 (United States); Goldstein, Joshua; Kiesecker, Joseph M. [The Nature Conservancy, 117 East Mountain Ave., Ft. Collins, CO 80524 (United States)

2015-11-15

Emerging development policies and lending standards call for consideration of ecosystem services when mitigating impacts from development, yet little guidance exists to inform this process. Here we propose a comprehensive framework for advancing both biodiversity and ecosystem service mitigation. We have clarified a means for choosing representative ecosystem service targets alongside biodiversity targets, identified servicesheds as a useful spatial unit for assessing ecosystem service avoidance, impact, and offset options, and discuss methods for consistent calculation of biodiversity and ecosystem service mitigation ratios. We emphasize the need to move away from area- and habitat-based assessment methods for both biodiversity and ecosystem services towards functional assessments at landscape or seascape scales. Such comprehensive assessments more accurately reflect cumulative impacts and variation in environmental quality, social needs and value preferences. The integrated framework builds on the experience of biodiversity mitigation while addressing the unique opportunities and challenges presented by ecosystem service mitigation. These advances contribute to growing potential for economic development planning and execution that will minimize impacts on nature and maximize human wellbeing. - Highlights: • This is the first framework for biodiversity and ecosystem service mitigation. • Functional, landscape scale assessments are ideal for avoidance and offsets. • Servicesheds define the appropriate spatial extent for ecosystem service mitigation. • Mitigation ratios should be calculated consistently and based on standard factors. • Our framework meets the needs of integrated mitigation assessment requirements.

Mitigation for one & all: An integrated framework for mitigation of development impacts on biodiversity and ecosystem services

International Nuclear Information System (INIS)

Tallis, Heather; Kennedy, Christina M.; Ruckelshaus, Mary; Goldstein, Joshua; Kiesecker, Joseph M.

2015-01-01

Emerging development policies and lending standards call for consideration of ecosystem services when mitigating impacts from development, yet little guidance exists to inform this process. Here we propose a comprehensive framework for advancing both biodiversity and ecosystem service mitigation. We have clarified a means for choosing representative ecosystem service targets alongside biodiversity targets, identified servicesheds as a useful spatial unit for assessing ecosystem service avoidance, impact, and offset options, and discuss methods for consistent calculation of biodiversity and ecosystem service mitigation ratios. We emphasize the need to move away from area- and habitat-based assessment methods for both biodiversity and ecosystem services towards functional assessments at landscape or seascape scales. Such comprehensive assessments more accurately reflect cumulative impacts and variation in environmental quality, social needs and value preferences. The integrated framework builds on the experience of biodiversity mitigation while addressing the unique opportunities and challenges presented by ecosystem service mitigation. These advances contribute to growing potential for economic development planning and execution that will minimize impacts on nature and maximize human wellbeing. - Highlights: • This is the first framework for biodiversity and ecosystem service mitigation. • Functional, landscape scale assessments are ideal for avoidance and offsets. • Servicesheds define the appropriate spatial extent for ecosystem service mitigation. • Mitigation ratios should be calculated consistently and based on standard factors. • Our framework meets the needs of integrated mitigation assessment requirements

A framework to support preceptors' evaluation and development of new nurses' clinical judgment.

Science.gov (United States)

Nielsen, Ann; Lasater, Kathie; Stock, Mary

2016-07-01

In today's complex, fast-paced world of hospital nursing, new graduate nurses do not have well-developed clinical judgment skills. Nurse preceptors are charged with bridging the gap between new graduates' learning in school and their autonomous practice as RNs. In one large, urban medical center in the U.S., a clinical judgment model and rubric were used as a framework for a new evaluation and orientation process. Preceptors of new graduate nurses who had used the former and new processes described their experiences using the framework. The findings indicated that having a structured framework provided objective ways to evaluate and help develop new graduate nurses' clinical judgment. It is hypothesized that academic clinical supervisors may find such a framework useful to prepare students for transition to practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

FEDS : A Framework for Evaluation in Design Science Research

DEFF Research Database (Denmark)

Venable, John; Pries-Heje, Jan; Baskerville, Richard

2015-01-01

Evaluation of design artefacts and design theories is a key activity in Design Science Research (DSR), as it provides feedback for further development and (if done correctly) assures the rigour of the research. However, the extant DSR literature provides insufficient guidance on evaluation...... to enable Design Science Researchers to effectively design and incorporate evaluation activities into a DSR project that can achieve DSR goals and objectives. To address this research gap, this research paper develops, explicates, and provides evidence for the utility of a Framework for Evaluation in Design...... Science (FEDS) together with a process to guide design science researchers in developing a strategy for evaluating the artefacts they develop within a DSR project. A FEDS strategy considers why, when, how, and what to evaluate. FEDS includes a two-dimensional characterisation of DSR evaluation episodes...

Framework for measuring sustainable development in catchment systems.

Science.gov (United States)

Walmsley, Jay J

2002-02-01

Integrated catchment management represents an approach to managing the resources of a catchment by integrating environmental, economic, and social issues. It is aimed at deriving sustainable benefits for future generations, while protecting natural resources, particularly water, and minimizing possible adverse social, economic, and environmental consequences. Indicators of sustainable development, which summarize information for use in decision-making, are invaluable when trying to assess the diverse, interacting components of catchment processes and resource management actions. The Driving-Forces--Pressure--State--Impact--Response (DPSIR) indicator framework is useful for identifying and developing indicators of sustainable development for catchment management. Driving forces have been identified as the natural conditions occurring in a catchment and the level of development and economic activity. Pressures include the natural and anthropogenic supply of water, water demand, and water pollution. State indicators can be split into those of quantity and those of quality. Impacts include those that affect the ecosystems directly and those that impact the use value of the resource. It core indicators are identified within each of the categories given in the framework, most major catchment-based management issues can be evaluated. This framework is applied to identify key issues in catchment management in South Africa, and develop a set of indicators for evaluating catchments throughout the country.

Urban Partnership Agreement and Congestion Reduction Demonstration : National Evaluation Framework

Science.gov (United States)

2008-11-21

This report provides an analytical framework for evaluating six deployments under the United States Department of Transportation (U.S. DOT) Urban Partnership Agreement (UPA) and Congestion Reduction Demonstration (CRD) Programs. The six UPA/CRD sites...

Red-impact project: First results of the evaluations of the impact of P and T on geological disposal

International Nuclear Information System (INIS)

Marivoet, Jan; Vokal, Antonin; Gudowski, Waclaw

2006-01-01

The Red-Impact project (Impact of partitioning, transmutation and waste reduction technologies on the final nuclear waste disposal) is a research project in the 6. Framework Programme of the European Commission. The main objective of the project is to assess the impact of partitioning and transmutation (P and T) on geological disposal and waste management. The project started with the identification of a number of representative fuel cycle scenarios. Five basis scenarios are considered for the evaluations: 2 industrial scenarios and 3 innovative scenarios. Mass flow schemes have been prepared for each basis fuel cycle scenario and the corresponding neutronic calculations have been made. A first list of performance indicators that will be calculated or estimated in the project has been prepared. As a first step the impact of 2 fuel cycle scenarios, the reference 'open cycle' scenario and of the innovative 'fast neutron Gen IV' scenario, on geological repositories in granite and clay formations have been evaluated. The results obtained show that the introduction of innovative fuel cycle scenarios can result in a considerable reduction of the needed size of the geological repository. However, the impact on the radiological consequences is rather limited. Indeed, the maximum dose, which is expected to occur a few tens of thousands year after the disposal of the waste, is essentially due to fission products and their amount is about proportional to the heat generated by nuclear fissions. (authors)

Analysis of Resource and Emission Impacts: An Emergy-Based Multiple Spatial Scale Framework for Urban Ecological and Economic Evaluation

Directory of Open Access Journals (Sweden)

Lixiao Zhang

2011-03-01

Full Text Available The development of the complex and multi-dimensional urban socio-economic system creates impacts on natural capital and human capital, which range from a local to a global scale. An emergy-based multiple spatial scale analysis framework and a rigorous accounting method that can quantify the values of human-made and natural capital losses were proposed in this study. With the intent of comparing the trajectory of Beijing over time, the characteristics of the interface between different scales are considered to explain the resource trade and the impacts of emissions. In addition, our improved determination of emergy analysis and acceptable management options that are in agreement with Beijing’s overall sustainability strategy were examined. The results showed that Beijing’s economy was closely correlated with the consumption of nonrenewable resources and exerted rising pressure on the environment. Of the total emergy use by the economic system, the imported nonrenewable resources from other provinces contribute the most, and the multi‑scale environmental impacts of waterborne and airborne pollution continued to increase from 1999 to 2006. Given the inputs structure, Beijing was chiefly making greater profits by shifting resources from other provinces in China and transferring the emissions outside. The results of our study should enable urban policy planners to better understand the multi-scale policy planning and development design of an urban ecological economic system.

Measurement and monitoring of safety: impact and challenges of putting a conceptual framework into practice.

Science.gov (United States)

Chatburn, Eleanor; Macrae, Carl; Carthey, Jane; Vincent, Charles

2018-03-06

The Measurement and Monitoring of Safety Framework provides a conceptual model to guide organisations in assessing safety. The Health Foundation funded a large-scale programme to assess the value and impact of applying the Framework in regional and frontline care settings. We explored the experiences and reflections of key participants in the programme. The study was conducted in the nine healthcare organisations in England and Scotland testing the Framework (three regional improvement bodies, six frontline settings). Post hoc interviews with clinical and managerial staff were analysed using template analysis. Participants reported that the Framework promoted a substantial shift in their thinking about how safety is actively managed in their environment. It provided a common language, facilitated a more inquisitive approach and encouraged a more holistic view of the components of safety. These changes in conceptual understanding, however, did not always translate into broader changes in practice, with many sites only addressing some aspects of the Framework. One of the three regions did embrace the Framework in its entirety and achieved wider impact with a range of interventions. This region had committed leaders who took time to fully understand the concepts, who maintained a flexible approach to exploring the utility of the Framework and who worked with frontline staff to translate the concepts for local settings. The Measuring and Monitoring of Safety Framework has the potential to support a broader and richer approach to organisational safety. Such a conceptually based initiative requires both committed leaders who themselves understand the concepts and more time to establish understanding and aims than might be needed in a standard improvement programme. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Framework for Modeling High-Impact, Low-Frequency Power Grid Events to Support Risk-Informed Decisions

Energy Technology Data Exchange (ETDEWEB)

Veeramany, Arun; Unwin, Stephen D.; Coles, Garill A.; Dagle, Jeffery E.; Millard, W. David; Yao, Juan; Glantz, Clifford S.; Gourisetti, Sri Nikhil Gup

2015-12-03

Natural and man-made hazardous events resulting in loss of grid infrastructure assets challenge the electric power grid’s security and resilience. However, the planning and allocation of appropriate contingency resources for such events requires an understanding of their likelihood and the extent of their potential impact. Where these events are of low likelihood, a risk-informed perspective on planning can be problematic as there exists an insufficient statistical basis to directly estimate the probabilities and consequences of their occurrence. Since risk-informed decisions rely on such knowledge, a basis for modeling the risk associated with high-impact low frequency events (HILFs) is essential. Insights from such a model can inform where resources are most rationally and effectively expended. The present effort is focused on development of a HILF risk assessment framework. Such a framework is intended to provide the conceptual and overarching technical basis for the development of HILF risk models that can inform decision makers across numerous stakeholder sectors. The North American Electric Reliability Corporation (NERC) 2014 Standard TPL-001-4 considers severe events for transmission reliability planning, but does not address events of such severity that they have the potential to fail a substantial fraction of grid assets over a region, such as geomagnetic disturbances (GMD), extreme seismic events, and coordinated cyber-physical attacks. These are beyond current planning guidelines. As noted, the risks associated with such events cannot be statistically estimated based on historic experience; however, there does exist a stable of risk modeling techniques for rare events that have proven of value across a wide range of engineering application domains. There is an active and growing interest in evaluating the value of risk management techniques in the State transmission planning and emergency response communities, some of this interest in the context of

Development and use of mathematical models and software frameworks for integrated analysis of agricultural systems and associated water use impacts

Science.gov (United States)

Fowler, K. R.; Jenkins, E.W.; Parno, M.; Chrispell, J.C.; Colón, A. I.; Hanson, Randall T.

2016-01-01

The development of appropriate water management strategies requires, in part, a methodology for quantifying and evaluating the impact of water policy decisions on regional stakeholders. In this work, we describe the framework we are developing to enhance the body of resources available to policy makers, farmers, and other community members in their e orts to understand, quantify, and assess the often competing objectives water consumers have with respect to usage. The foundation for the framework is the construction of a simulation-based optimization software tool using two existing software packages. In particular, we couple a robust optimization software suite (DAKOTA) with the USGS MF-OWHM water management simulation tool to provide a flexible software environment that will enable the evaluation of one or multiple (possibly competing) user-defined (or stakeholder) objectives. We introduce the individual software components and outline the communication strategy we defined for the coupled development. We present numerical results for case studies related to crop portfolio management with several defined objectives. The objectives are not optimally satisfied for any single user class, demonstrating the capability of the software tool to aid in the evaluation of a variety of competing interests.

Does supplier evaluation impact process improvement?

Directory of Open Access Journals (Sweden)

Shiva Prasad h c

2016-09-01

Full Text Available Purpose: The research explores and examines factors for supplier evaluation and its impact on process improvement particularly aiming on a steel pipe manufacturing firm in Gujarat, India. Design/Methodology/approach: The conceptual research framework was developed and hypotheses were stated considering the analysis of literature and discussions with the managers and engineers of a steel pipe manufacturing company in Gujarat, India. Data was collected using in-depth interview. The questionnaire primarily involves the perception of evaluation of supplier. Factors influencing supplier evaluation and its influence on process improvement is also examined in this study. The model testing and validation was done using partial least square method. Outcomes signified that the factors that influence evaluation of the supplier are quality, cost, delivery and supplier relationship management. Findings: The study depicted that quality and cost factors for supplier evaluation are insignificant. The delivery and supplier relationship management have significant influence on evaluation of the supplier. The research also depicted that supplier evaluation has significant influence on process improvement. Research limitations/implications: The study has been made specifically for ABC steel pipe manufacturing industry in Gujarat, India and may not be appropriate to the other industries or any parts of the world. There is a possibility of response bias as the conclusions of this research was interpreted on survey responses taken from the employees of case study company, so it is suggested that future research can overcome this problem by employing various methodologies in addition to surveys like carrying out focus group and in-depth interviews, brainstorming sessions with the experts etc. Originality/value: Many researchers have considered quality, cost and delivery as the factors for evaluating the suppliers. But for a company it is quintessential to have good

A Bayesian Framework of Uncertainties Integration in 3D Geological Model

Science.gov (United States)

Liang, D.; Liu, X.

2017-12-01

3D geological model can describe complicated geological phenomena in an intuitive way while its application may be limited by uncertain factors. Great progress has been made over the years, lots of studies decompose the uncertainties of geological model to analyze separately, while ignored the comprehensive impacts of multi-source uncertainties. Great progress has been made over the years, while lots of studies ignored the comprehensive impacts of multi-source uncertainties when analyzed them item by item from each source. To evaluate the synthetical uncertainty, we choose probability distribution to quantify uncertainty, and propose a bayesian framework of uncertainties integration. With this framework, we integrated data errors, spatial randomness, and cognitive information into posterior distribution to evaluate synthetical uncertainty of geological model. Uncertainties propagate and cumulate in modeling process, the gradual integration of multi-source uncertainty is a kind of simulation of the uncertainty propagation. Bayesian inference accomplishes uncertainty updating in modeling process. Maximum entropy principle makes a good effect on estimating prior probability distribution, which ensures the prior probability distribution subjecting to constraints supplied by the given information with minimum prejudice. In the end, we obtained a posterior distribution to evaluate synthetical uncertainty of geological model. This posterior distribution represents the synthetical impact of all the uncertain factors on the spatial structure of geological model. The framework provides a solution to evaluate synthetical impact on geological model of multi-source uncertainties and a thought to study uncertainty propagation mechanism in geological modeling.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

Science.gov (United States)

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

A green profitability framework to quantify the impact of green supply chain management in South Africa

Directory of Open Access Journals (Sweden)

Nandie Coetzee

2016-10-01

Full Text Available Background: The greenhouse gas emissions of South Africa are the largest contribution by a country in the African continent. If the carbon emissions are not reduced, they will continue to grow exponentially. South Africa’s emissions are placed in the top 20 in the world when considering per capita emissions. Objectives: The aim of the research article was to investigate how the impact of implementing environmental initiatives on business profitability and sustainability can best be quantified in a South African business. Method: Various methods, theories and best practices were researched to aid in the development of the green business profitability framework. This framework was applied to two case studies in different areas of the supply chain of a South African fast-moving consumer goods business. Results: Results indicated that the green profitability framework can be used successfully to quantify both the environmental and profitability impact of green supply chain initiatives. The framework is therefore more suitable for the South African company than other existing frameworks in the literature because of its ability to quantify both profitability and sustainability in short- and long-term planning scenarios. Conclusion: The results from the case studies indicated that the green business profitability framework enabled the tracking of environmental initiatives back to logistics operations and profitability, which makes it easier to understand and implement. The developed framework also helped to link the carbon emissions to source, and to translate green supply chain actions into goals.

Computerized evaluation of flood impact

International Nuclear Information System (INIS)

Gagnon, J.; Quach, T.T.; Marche, C.; Lessard, G.

1998-01-01

A computerized evaluation process for assessing the economic impacts of a potential dam failure is described. The DOMINO software, which was developed by Hydro-Quebec, takes into account flow data from dam break simulations of floods, the territory involved, plus the economic evaluations of the real estate and infrastructures affected. Some examples of software applications and impact evaluations are presented. The principal elements involved in estimating economic or other types of impacts induced by natural flooding or dam failure, are: (1) flow forecasting, (2) defining the contour of the involved territory, and (3) accounting for the various impacts identified in the affected zone. Owing to its wide range of functions and utilities, DOMINO has proven to be a very useful, user-friendly and portable decision-making tool. 5 refs., 6 tabs

A unified framework for evaluating the risk of re-identification of text de-identification tools.

Science.gov (United States)

Scaiano, Martin; Middleton, Grant; Arbuckle, Luk; Kolhatkar, Varada; Peyton, Liam; Dowling, Moira; Gipson, Debbie S; El Emam, Khaled

2016-10-01

It has become regular practice to de-identify unstructured medical text for use in research using automatic methods, the goal of which is to remove patient identifying information to minimize re-identification risk. The metrics commonly used to determine if these systems are performing well do not accurately reflect the risk of a patient being re-identified. We therefore developed a framework for measuring the risk of re-identification associated with textual data releases. We apply the proposed evaluation framework to a data set from the University of Michigan Medical School. Our risk assessment results are then compared with those that would be obtained using a typical contemporary micro-average evaluation of recall in order to illustrate the difference between the proposed evaluation framework and the current baseline method. We demonstrate how this framework compares against common measures of the re-identification risk associated with an automated text de-identification process. For the probability of re-identification using our evaluation framework we obtained a mean value for direct identifiers of 0.0074 and a mean value for quasi-identifiers of 0.0022. The 95% confidence interval for these estimates were below the relevant thresholds. The threshold for direct identifier risk was based on previously used approaches in the literature. The threshold for quasi-identifiers was determined based on the context of the data release following commonly used de-identification criteria for structured data. Our framework attempts to correct for poorly distributed evaluation corpora, accounts for the data release context, and avoids the often optimistic assumptions that are made using the more traditional evaluation approach. It therefore provides a more realistic estimate of the true probability of re-identification. This framework should be used as a basis for computing re-identification risk in order to more realistically evaluate future text de-identification tools

Matching methods evaluation framework for stereoscopic breast x-ray images.

Science.gov (United States)

Rousson, Johanna; Naudin, Mathieu; Marchessoux, Cédric

2016-01-01

Three-dimensional (3-D) imaging has been intensively studied in the past few decades. Depth information is an important added value of 3-D systems over two-dimensional systems. Special focuses were devoted to the development of stereo matching methods for the generation of disparity maps (i.e., depth information within a 3-D scene). Dedicated frameworks were designed to evaluate and rank the performance of different stereo matching methods but never considering x-ray medical images. Yet, 3-D x-ray acquisition systems and 3-D medical displays have already been introduced into the diagnostic market. To access the depth information within x-ray stereoscopic images, computing accurate disparity maps is essential. We aimed at developing a framework dedicated to x-ray stereoscopic breast images used to evaluate and rank several stereo matching methods. A multiresolution pyramid optimization approach was integrated to the framework to increase the accuracy and the efficiency of the stereo matching techniques. Finally, a metric was designed to score the results of the stereo matching compared with the ground truth. Eight methods were evaluated and four of them [locally scaled sum of absolute differences (LSAD), zero mean sum of absolute differences, zero mean sum of squared differences, and locally scaled mean sum of squared differences] appeared to perform equally good with an average error score of 0.04 (0 is the perfect matching). LSAD was selected for generating the disparity maps.

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc. (United States); O' Connor, Alan C. [RTI International, Research Triangle Park, NC (United States); Loomis, Ross J. [RTI International, Research Triangle Park, NC (United States)

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

An evaluation framework and comparative analysis of the widely used first programming languages.

Directory of Open Access Journals (Sweden)

Muhammad Shoaib Farooq

Full Text Available Computer programming is the core of computer science curriculum. Several programming languages have been used to teach the first course in computer programming, and such languages are referred to as first programming language (FPL. The pool of programming languages has been evolving with the development of new languages, and from this pool different languages have been used as FPL at different times. Though the selection of an appropriate FPL is very important, yet it has been a controversial issue in the presence of many choices. Many efforts have been made for designing a good FPL, however, there is no ample way to evaluate and compare the existing languages so as to find the most suitable FPL. In this article, we have proposed a framework to evaluate the existing imperative, and object oriented languages for their suitability as an appropriate FPL. Furthermore, based on the proposed framework we have devised a customizable scoring function to compute a quantitative suitability score for a language, which reflects its conformance to the proposed framework. Lastly, we have also evaluated the conformance of the widely used FPLs to the proposed framework, and have also computed their suitability scores.

An evaluation framework and comparative analysis of the widely used first programming languages.

Science.gov (United States)

Farooq, Muhammad Shoaib; Khan, Sher Afzal; Ahmad, Farooq; Islam, Saeed; Abid, Adnan

2014-01-01

Computer programming is the core of computer science curriculum. Several programming languages have been used to teach the first course in computer programming, and such languages are referred to as first programming language (FPL). The pool of programming languages has been evolving with the development of new languages, and from this pool different languages have been used as FPL at different times. Though the selection of an appropriate FPL is very important, yet it has been a controversial issue in the presence of many choices. Many efforts have been made for designing a good FPL, however, there is no ample way to evaluate and compare the existing languages so as to find the most suitable FPL. In this article, we have proposed a framework to evaluate the existing imperative, and object oriented languages for their suitability as an appropriate FPL. Furthermore, based on the proposed framework we have devised a customizable scoring function to compute a quantitative suitability score for a language, which reflects its conformance to the proposed framework. Lastly, we have also evaluated the conformance of the widely used FPLs to the proposed framework, and have also computed their suitability scores.

Framework for conducting environmental assessments of trade negotiations

International Nuclear Information System (INIS)

2001-02-01

This document described the complex task of assessing the environmental impacts of trade negotiations with particular emphasis on the framework of the Strategic Environmental Assessment which the Government of Canada will conduct through a systematic process which can identify and evaluate possible and significant environmental impacts of an initiative. The objective of the assessment is to integrate environmental considerations into decision-making processes at the earliest possible stage. The first part of the framework identifies the importance of recognizing environmental considerations of trade and explains how the framework will contribute to environmental policy. The second part of the framework outlines the process and analytical requirements for conducting an environmental assessment of a trade negotiation. Environmental Assessment Committees will be formed by the Department of Foreign Affairs and International Trade, and will include representatives from federal government departments and agencies. All analyses will be conducted in four stages which will include identifying the economic effect of the negotiation, identifying the likely environmental impact of such changes, assessing the significance of the likely environmental impacts, and identifying enhancement/mitigation options to inform the negotiations. The framework is designed to be flexible enough to be used at current and future trade negotiations in the World Trade Organization, the Free Trade Area of the Americas and in bilateral Free Trade Agreements. An environmental assessment of trade negotiations is considered to be an important decision-making tool for promoting sustainable development. 16 refs., 1 tab

An innovative strategy in evaluation: using a student engagement framework to evaluate a role-based simulation.

Science.gov (United States)

Smith, Morgan; Warland, Jane; Smith, Colleen

2012-03-01

Online role-play has the potential to actively engage students in authentic learning experiences and help develop their clinical reasoning skills. However, evaluation of student learning for this kind of simulation focuses mainly on the content and outcome of learning, rather than on the process of learning through student engagement. This article reports on the use of a student engagement framework to evaluate an online role-play offered as part of a course in Bachelor of Nursing and Bachelor of Midwifery programs. Instruments that measure student engagement to date have targeted large numbers of students at program and institutional levels, rather than at the level of a specific learning activity. Although the framework produced some useful findings for evaluation purposes, further refinement of the questions is required to be certain that deep learning results from the engagement that occurs with course-level learning initiatives. Copyright 2012, SLACK Incorporated.

Measuring research impact in medical research institutes: a qualitative study of the attitudes and opinions of Australian medical research institutes towards research impact assessment frameworks.

Science.gov (United States)

Deeming, Simon; Reeves, Penny; Ramanathan, Shanthi; Attia, John; Nilsson, Michael; Searles, Andrew

2018-03-16

The question of how to measure, assess and optimise the returns from investment in health and medical research (HMR) is a highly policy-relevant issue. Research Impact Assessment Frameworks (RIAFs) provide a conceptual measurement framework to assess the impact from HMR. The aims of this study were (1) to elicit the views of Medical Research Institutes (MRIs) regarding objectives, definitions, methods, barriers, potential scope and attitudes towards RIAFs, and (2) to investigate whether an assessment framework should represent a retrospective reflection of research impact or a prospective approach integrated into the research process. The wider objective was to inform the development of a draft RIAF for Australia's MRIs. Purposive sampling to derive a heterogeneous sample of Australian MRIs was used alongside semi-structured interviews with senior executives responsible for research translation or senior researchers affected by research impact initiatives. Thematic analysis of the interview transcriptions using the framework approach was then performed. Interviews were conducted with senior representatives from 15 MRIs. Participants understood the need for greater research translation/impact, but varied in their comprehension and implementation of RIAFs. Common concerns included the time lag to the generation of societal impacts from basic or discovery science, and whether impact reflected a narrow commercialisation agenda. Broad support emerged for the use of metrics, case study and economic methods. Support was also provided for the rationale of both standardised and customised metrics. Engendering cultural change in the approach to research translation was acknowledged as both a barrier to greater impact and a critical objective for the assessment process. Participants perceived that the existing research environment incentivised the generation of academic publications and track records, and often conflicted with the generation of wider impacts. The potential to

Performance Indicator Framework for Evaluation of Sustainable Tourism in the Taiwan Coastal Zone

Directory of Open Access Journals (Sweden)

Shih-Hao Wang

2016-07-01

Full Text Available Surrounded by the ocean, Taiwan has been increasingly developing coastal tourism projects. Concerns that negative impacts might be brought about by prosperous tourism have resulted in a recent focus on sustainable tourism. Sustainable tourism involves policies that acknowledge the interdependences among the environment, the community, and the economy. The goal of sustainable tourism is to enhance and protect the environment while satisfying basic human requirements, as well as those of the contemporary and future tourism industries to improve quality of life. On the other hand, unsustainable coastal tourism might undermine the natural environment and society, resulting in air, water, and soil pollution, wildlife habitat disruption, and changes of local community cultural characteristics. Therefore, performance evaluation of coastal tourism, using an indicator framework to facilitate sustainable development and enhance the effectiveness of coastal resources exploitation, is critical. Through a literature review and expert surveys using the methods of the fuzzy Delphi method (FDM and the fuzzy analytic hierarchy process (FAHP, this study builds a performance indicator framework and identifies the key factors affecting the sustainable development of coastal tourism in Taiwan. The results can serve as a reference for the public sector to be used for the sustainable planning and development of coastal tourism.

The Disposal Systems Evaluation Framework for DOE-NE

International Nuclear Information System (INIS)

Blink, J.A.; Greenberg, H.R.; Halsey, W.G.; Jove-Colon, C.; Nutt, W.M.; Sutton, M.

2010-01-01

The Used Fuel Disposition (UFD) Campaign within DOE-NE is evaluating storage and disposal options for a range of waste forms and a range of geologic environments. For each waste form and geologic environment combination, there are multiple options for repository conceptual design. The Disposal Systems Evaluation Framework (DSEF) is being developed to formalize the development and documentation of options for each waste form and environment combination. The DSEF is being implemented in two parts. One part is an Excel workbook with multiple sheets. This workbook is designed to be user friendly, such that anyone within the UFD Campaign can use it as a guide to develop and document repository conceptual designs that respect thermal, geometric, and other constraints. The other part is an Access relational database file that will be centrally maintained to document the ensemble of conceptual designs developed with individual implementations of the Excel workbook. The DSEF Excel workbook includes sheets for waste form, environment, geometric constraints, engineered barrier system (EBS) design, thermal, performance assessment (PA), materials, cost, and fuel cycle system impacts. Each of these sheets guides the user through the process of developing internally consistent design options, and documenting the thought process. The sheets interact with each other to transfer information and identify inconsistencies to the user. In some cases, the sheets are stand-alone, and in other cases (such as PA), the sheets refer the user to another tool, with the user being responsible to transfer summary results into the DSEF sheet. Finally, the DSEF includes three top-level sheets: inputs and results, interface parameters, and knowledge management (references). These sheets enable users and reviewers to see the overall picture on only a few summary sheets, while developing the design option systematically using the detailed sheets. The DSEF Access relational database file collects the

An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from an Author’s Perspective

Science.gov (United States)

2014-12-01

An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from an Author’s Perspective by Robert A Sottilare, Keith W...Intelligent Framework for Tutoring (GIFT) from an Author’s Perspective Robert A Sottilare and Keith W Brawner Human Research and Engineering...SUBTITLE An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from an Author’s Perspective 5a. CONTRACT NUMBER 5b. GRANT

Developing an Evaluation Framework of Quality Indicators for Learning Analytics

NARCIS (Netherlands)

Scheffel, Maren; Drachsler, Hendrik; Specht, Marcus

2017-01-01

This paper presents results from the continuous process of developing an evaluation framework of quality indicators for learning analytics (LA). Building on a previous study, a group concept mapping approach that uses multidimensional scaling and hierarchical clustering, the study presented here

A critical review of frameworks used for evaluating reliability and relevance of (eco)toxicity data: Perspectives for an integrated eco-human decision-making framework.

Science.gov (United States)

Roth, N; Ciffroy, P

2016-10-01

Considerable efforts have been invested so far to evaluate and rank the quality and relevance of (eco)toxicity data for their use in regulatory risk assessment to assess chemical hazards. Many frameworks have been developed to improve robustness and transparency in the evaluation of reliability and relevance of individual tests, but these frameworks typically focus on either environmental risk assessment (ERA) or human health risk assessment (HHRA), and there is little cross talk between them. There is a need to develop a common approach that would support a more consistent, transparent and robust evaluation and weighting of the evidence across ERA and HHRA. This paper explores the applicability of existing Data Quality Assessment (DQA) frameworks for integrating environmental toxicity hazard data into human health assessments and vice versa. We performed a comparative analysis of the strengths and weaknesses of eleven frameworks for evaluating reliability and/or relevance of toxicity and ecotoxicity hazard data. We found that a frequent shortcoming is the lack of a clear separation between reliability and relevance criteria. A further gaps and needs analysis revealed that none of the reviewed frameworks satisfy the needs of a common eco-human DQA system. Based on our analysis, some key characteristics, perspectives and recommendations are identified and discussed for building a common DQA system as part of a future integrated eco-human decision-making framework. This work lays the basis for developing a common DQA system to support the further development and promotion of Integrated Risk Assessment. Copyright © 2016 Elsevier Ltd. All rights reserved.

MBI FRAMEWORK EXTENSION TOWARDS CLOUD SERVICE IMPROVEMENT FROM CONSUMER PERSPECTIVE

Directory of Open Access Journals (Sweden)

Soňa Karkošková

2017-03-01

Full Text Available Cloud computing is changing the way that organizations utilize IT resources with a corresponding impact on the role of IT management. To help organizations with managing their business informatics, Management of Business Informatics (MBI framework has been developed. The problem was that this framework did not explicitly reflect managing cloud services from cloud service consumer perspective and specifically did not address managing of cloud service improvement from consumer perspective. Therefore, analysis of MBI framework was performed from cloud service consumer viewpoint to design extension of MBI framework towards cloud service improvement management. Proposal of MBI framework extension in an output of research process according to Design Science Research Methodology and its evaluation approach is based on methodology for the design and implementation of case studies for scientific purposes and on descriptive evaluation method using scenario.

Use of the Theoretical Domains Framework to evaluate factors driving successful implementation of the Accelerated Chest pain Risk Evaluation (ACRE) project.

Science.gov (United States)

Skoien, Wade; Page, Katie; Parsonage, William; Ashover, Sarah; Milburn, Tanya; Cullen, Louise

2016-10-12

was a successful programme and likely that each of these domains was important for the implementation. However, a lack of variance in the responses hampered us from concluding which factors were most influential in driving the success of the implementation. The TDF offers a useful framework to conceptualise and evaluate factors impacting on implementation success. However, its broad scope makes it necessary to tailor the framework to allow evaluation of specific projects.

SurF: an innovative framework in biosecurity and animal health surveillance evaluation.

Science.gov (United States)

Muellner, Petra; Watts, Jonathan; Bingham, Paul; Bullians, Mark; Gould, Brendan; Pande, Anjali; Riding, Tim; Stevens, Paul; Vink, Daan; Stärk, Katharina Dc

2018-05-16

Surveillance for biosecurity hazards is being conducted by the New Zealand Competent Authority, the Ministry for Primary Industries (MPI) to support New Zealand's biosecurity system. Surveillance evaluation should be an integral part of the surveillance life cycle, as it provides a means to identify and correct problems and to sustain and enhance the existing strengths of a surveillance system. The surveillance evaluation Framework (SurF) presented here was developed to provide a generic framework within which the MPI biosecurity surveillance portfolio, and all of its components, can be consistently assessed. SurF is an innovative, cross-sectoral effort that aims to provide a common umbrella for surveillance evaluation in the animal, plant, environment and aquatic sectors. It supports the conduct of the following four distinct components of an evaluation project: (i) motivation for the evaluation, (ii) scope of the evaluation, (iii) evaluation design and implementation and (iv) reporting and communication of evaluation outputs. Case studies, prepared by MPI subject matter experts, are included in the framework to guide users in their assessment. Three case studies were used in the development of SurF in order to assure practical utility and to confirm usability of SurF across all included sectors. It is anticipated that the structured approach and information provided by SurF will not only be of benefit to MPI but also to other New Zealand stakeholders. Although SurF was developed for internal use by MPI, it could be applied to any surveillance system in New Zealand or elsewhere. © 2018 2018 The Authors. Transboundary and Emerging Diseases Published by Blackwell Verlag GmbH.

A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

Science.gov (United States)

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

2017-04-01

Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Toward an analytical framework for understanding complex social-ecological systems when conducting environmental impact assessments in South Africa

Directory of Open Access Journals (Sweden)

Rebecca Bowd

2015-03-01

Full Text Available Consideration of biophysical impacts has historically dominated environmental impact assessment (EIA practice. Despite the emergence of social impact assessment, the consideration of socioeconomic impacts in EIA is variable, as is the extent of their integration in EIA findings. There is growing recognition for the need to move EIA practice toward sustainability assessment, characterized by comprehensiveness, i.e., scope of impacts, integration, i.e., of biophysical and socioeconomic impacts, and a greater strategic focus. This is particularly the case in developing regions and in countries like South Africa, which have statutory requirements for the full consideration of socioeconomic impacts in EIA. We suggest that EIA practice could benefit from incorporating evolving theory around social-ecological systems (SES as an effective way of moving toward sustainability assessment. As far as we are aware, our study constitutes the first attempt to apply and formalize SES constructs to EIA practice within a regulated procedure. Our framework goes beyond conventional scoping approaches reliant on checklists and matrices by requiring the EIA practitioner to cocreate a conceptual model of the current and future social-ecological system with the implicated communities. This means social and biophysical impacts are assessed integratively, and that communities participate meaningfully in the EIA process, thereby helping address two of the most common shortfalls of EIA practice. The framework was applied in two case studies, establishment of community-based accommodation linked to existing tourism infrastructure (Eastern Cape, South Africa, and a proposed wine estate (KwaZulu-Natal, South Africa. The framework revealed impacts, which would not be considered in a biophysically-oriented EIA, and helped identify development synergies and institutional and governance needs that are equally likely to have been overlooked. We suggest the framework has value as a

Assessment of information impacts in power system security against malicious attacks in a general framework

International Nuclear Information System (INIS)

Bompard, E.; Napoli, R.; Xue, F.

2009-01-01

In the analysis of power systems security, recently a new concern related to possible malicious attacks caught much attention. Coordination among different transmission system operators (TSO) in an interconnected power system to counteract such attacks has become an important problem. This paper presents a general framework for describing the physical, cyber and decision-making aspects of the problem and their interrelations; within this framework, an analytic tool for the assessment of information impacts in handling on-line security after a malicious attack is proposed and discussed. The model is based on the socially rational multi-agent systems and the equilibrium of a fictitious play is considered to analyze the impacts of various levels of information available to the interconnected system operators on the outcomes of the decision-making process under attack. A 34-buses test system, with 3 systems interconnected by tie-lines, is presented to illustrate the model and compare the impacts of different information scenarios

Assessment of information impacts in power system security against malicious attacks in a general framework

Energy Technology Data Exchange (ETDEWEB)

Bompard, E. [Dipartimento di Ingegneria Elettrica, Politecnico di Torino, I-10129 Torino (Italy)], E-mail: ettore.bompard@polito.it; Napoli, R.; Xue, F. [Dipartimento di Ingegneria Elettrica, Politecnico di Torino, I-10129 Torino (Italy)

2009-06-15

In the analysis of power systems security, recently a new concern related to possible malicious attacks caught much attention. Coordination among different transmission system operators (TSO) in an interconnected power system to counteract such attacks has become an important problem. This paper presents a general framework for describing the physical, cyber and decision-making aspects of the problem and their interrelations; within this framework, an analytic tool for the assessment of information impacts in handling on-line security after a malicious attack is proposed and discussed. The model is based on the socially rational multi-agent systems and the equilibrium of a fictitious play is considered to analyze the impacts of various levels of information available to the interconnected system operators on the outcomes of the decision-making process under attack. A 34-buses test system, with 3 systems interconnected by tie-lines, is presented to illustrate the model and compare the impacts of different information scenarios.

An evaluation of automatic coronary artery calcium scoring methods with cardiac CT using the orCaScore framework.

Science.gov (United States)

Wolterink, Jelmer M; Leiner, Tim; de Vos, Bob D; Coatrieux, Jean-Louis; Kelm, B Michael; Kondo, Satoshi; Salgado, Rodrigo A; Shahzad, Rahil; Shu, Huazhong; Snoeren, Miranda; Takx, Richard A P; van Vliet, Lucas J; van Walsum, Theo; Willems, Tineke P; Yang, Guanyu; Zheng, Yefeng; Viergever, Max A; Išgum, Ivana

2016-05-01

for patient CVD risk categorization by the evaluated methods ranged from 0.80 to 1.00. A publicly available standardized framework for the evaluation of (semi)automatic methods for CAC identification in cardiac CT is described. An evaluation of five (semi)automatic methods within this framework shows that automatic per patient CVD risk categorization is feasible. CAC lesions at ambiguous locations such as the coronary ostia remain challenging, but their detection had limited impact on CVD risk determination.

Impact of the European Water framework directive on knowledge of biodiversity Impact of the European Water framework directive on knowledge of biodiversity

Directory of Open Access Journals (Sweden)

Christine Argillier and Mario Lepage

2011-03-01

Full Text Available The European Water framework directive requires observation and monitoring of certain biological communities to assess the ecological status of aquatic environments. How does the WFD contribute to knowledge and evaluation of aquatic biodiversity? What may be the results in terms of monitoring?The concept of biodiversity is complex and difficult to describe in an exhaustive manner. The Water Framework Directive (WFD, through its aquatic ecosystem monitoring network, aims to assess the ecological and chemical status of water bodies. This assessment requires observations on certain biological communities in a definite number of European sites representing continental, transitional and coastal water bodies. Consequently, the WFD contributes to improving knowledge on biodiversity. Nevertheless, genetic diversity and some communities are clearly not targeted and the monitoring networks are not well designed to assess changes in biodiversity. However, we may expect improvements in scientific knowledge of ecosystems and in the monitoring programmes that will make possible better convergence of environmental objectives.

Capturing Budget Impact Considerations Within Economic Evaluations: A Systematic Review of Economic Evaluations of Rotavirus Vaccine in Low- and Middle-Income Countries and a Proposed Assessment Framework.

Science.gov (United States)

Carvalho, Natalie; Jit, Mark; Cox, Sarah; Yoong, Joanne; Hutubessy, Raymond C W

2018-01-01

In low- and middle-income countries, budget impact is an important criterion for funding new interventions, particularly for large public health investments such as new vaccines. However, budget impact analyses remain less frequently conducted and less well researched than cost-effectiveness analyses. The objective of this study was to fill the gap in research on budget impact analyses by assessing (1) the quality of stand-alone budget impact analyses, and (2) the feasibility of extending cost-effectiveness analyses to capture budget impact. We developed a budget impact analysis checklist and scoring system for budget impact analyses, which we then adapted for cost-effectiveness analyses, based on current International Society for Pharmacoeconomics and Outcomes Research Task Force recommendations. We applied both budget impact analysis and cost-effectiveness analysis checklists and scoring systems to examine the extent to which existing economic evaluations provide sufficient evidence about budget impact to enable decision making. We used rotavirus vaccination as an illustrative case in which low- and middle-income countries uptake has been limited despite demonstrated cost effectiveness. A systematic literature review was conducted to identify economic evaluations of rotavirus vaccine in low- and middle-income countries published between January 2000 and February 2017. We critically appraised the quality of budget impact analyses, and assessed the extension of cost-effectiveness analyses to provide useful budget impact information. Six budget impact analyses and 60 cost-effectiveness analyses were identified. Budget impact analyses adhered to most International Society for Pharmacoeconomics and Outcomes Research recommendations, with key exceptions being provision of undiscounted financial streams for each budget period and model validation. Most cost-effectiveness analyses could not be extended to provide useful budget impact information; cost

Judgment under uncertainty; a probabilistic evaluation framework for decision-making about sanitation systems in low-income countries.

Science.gov (United States)

Malekpour, Shirin; Langeveld, Jeroen; Letema, Sammy; Clemens, François; van Lier, Jules B

2013-03-30

This paper introduces the probabilistic evaluation framework, to enable transparent and objective decision-making in technology selection for sanitation solutions in low-income countries. The probabilistic framework recognizes the often poor quality of the available data for evaluations. Within this framework, the evaluations will be done based on the probabilities that the expected outcomes occur in practice, considering the uncertainties in evaluation parameters. Consequently, the outcome of evaluations will not be single point estimates; but there exists a range of possible outcomes. A first trial application of this framework for evaluation of sanitation options in the Nyalenda settlement in Kisumu, Kenya, showed how the range of values that an evaluation parameter may obtain in practice would influence the evaluation outcomes. In addition, as the probabilistic evaluation requires various site-specific data, sensitivity analysis was performed to determine the influence of each data set quality on the evaluation outcomes. Based on that, data collection activities could be (re)directed, in a trade-off between the required investments in those activities and the resolution of the decisions that are to be made. Copyright © 2013 Elsevier Ltd. All rights reserved.

Incorporating consideration of health impacts into land use development approval processes: Development of a Health Background Study Framework.

Science.gov (United States)

Moloughney, Brent W; Bursey, Gayle E; Neumann, Jana; Leeming, Daniel H; Gutmann, Christine E; Sivanand, Bhavna; Mowat, David L

2014-09-12

This project involved development of a Health Background Study (HBS) Framework to support consideration of health impacts within municipalities' approval process for land use development. Peel Public Health and Toronto Public Health led the project with the participation of planners, urban designers, engineers, public health staff and development industry representatives. Historical growth in the Region of Peel and suburban Toronto has resulted in extensive low-density development, creating car-dependent communities with disconnected streets and segregated land uses. The inclusion of an HBS in developers' applications to municipalities is one approach by which health-related expectations for the built environment can be established within the approval process. Development of the HBS Framework used the six core elements of the built environment with the strongest evidence for impact on health and was informed by analysis of the provincial and local policy contexts, practices of other municipalities and stakeholder interviews. The Framework's contents were refined according to feedback from multidisciplinary stakeholder workshops. The HBS Framework identifies minimum standards for built environment core elements that developers need to address in their applications. The Framework was created to be simple and instructive with applicability to a range of development locations and scales, and to various stages of the development approval process. Peel Public Health is leading several initiatives to support the use of the HBS as a part of the development application process. The HBS Framework is a tool that public health and planning can use to support the consideration of health impacts within municipalities' land use development processes.

Guiding principles for evaluating the impacts of conservation interventions on human well-being.

Science.gov (United States)

Woodhouse, Emily; Homewood, Katherine M; Beauchamp, Emilie; Clements, Tom; McCabe, J Terrence; Wilkie, David; Milner-Gulland, E J

2015-11-05

Measures of socio-economic impacts of conservation interventions have largely been restricted to externally defined indicators focused on income, which do not reflect people's priorities. Using a holistic, locally grounded conceptualization of human well-being instead provides a way to understand the multi-faceted impacts of conservation on aspects of people's lives that they value. Conservationists are engaging with well-being for both pragmatic and ethical reasons, yet current guidance on how to operationalize the concept is limited. We present nine guiding principles based around a well-being framework incorporating material, relational and subjective components, and focused on gaining knowledge needed for decision-making. The principles relate to four key components of an impact evaluation: (i) defining well-being indicators, giving primacy to the perceptions of those most impacted by interventions through qualitative research, and considering subjective well-being, which can affect engagement with conservation; (ii) attributing impacts to interventions through quasi-experimental designs, or alternative methods such as theory-based, case study and participatory approaches, depending on the setting and evidence required; (iii) understanding the processes of change including evidence of causal linkages, and consideration of trajectories of change and institutional processes; and (iv) data collection with methods selected and applied with sensitivity to research context, consideration of heterogeneity of impacts along relevant societal divisions, and conducted by evaluators with local expertise and independence from the intervention. © 2015 The Authors.

A framework for including family health spillovers in economic evaluation

NARCIS (Netherlands)

H. Al-Janabi (Hareth); N.J.A. van Exel (Job); W.B.F. Brouwer (Werner); J. Coast (Joanna)

2016-01-01

textabstractHealth care interventions may affect the health of patients' family networks. It has been suggested that these health spillovers? should be included in economic evaluation, but there is not a systematic method for doing this. In this article, we develop a framework for including health

A framework for evaluating forest landscape model predictions using empirical data and knowledge

Science.gov (United States)

Wen J. Wang; Hong S. He; Martin A. Spetich; Stephen R. Shifley; Frank R. Thompson; William D. Dijak; Qia. Wang

2014-01-01

Evaluation of forest landscape model (FLM) predictions is indispensable to establish the credibility of predictions. We present a framework that evaluates short- and long-term FLM predictions at site and landscape scales. Site-scale evaluation is conducted through comparing raster cell-level predictions with inventory plot data whereas landscape-scale evaluation is...

A framework for ensuring a balanced accounting of the impact of antimicrobial stewardship interventions.

Science.gov (United States)

Toma, Madalina; Davey, Peter G; Marwick, Charis A; Guthrie, Bruce

2017-12-01

Drawing on a Cochrane systematic review, this paper examines the relatively limited range of outcomes measured in published evaluations of antimicrobial stewardship interventions (ASIs) in hospitals. We describe a structured framework for considering the range of consequences that ASIs can have, in terms of their desirability and the extent to which they were expected when planning an ASI: expected, desirable consequences (intervention goals); expected, undesirable consequences (intervention trade-offs); unexpected, undesirable consequences (unpleasant surprises); and unexpected, desirable consequences (pleasant surprises). Of 49 randomized controlled trials identified by the Cochrane review, 28 (57%) pre-specified increased length of stay and/or mortality as potential trade-offs of ASI, with measurement intended to provide reassurance about safety. In actuality, some studies found unexpected decreases in length of stay (a pleasant surprise). In contrast, only 11 (10%) of 110 interrupted time series studies included any information about unintended consequences, with 10 examining unexpected, undesirable outcomes (unpleasant surprises) using case-control, qualitative or cohort designs. Overall, a large proportion of the ASIs reported in the literature only assess impact on their targeted process goals-antimicrobial prescribing-with limited examination of other potential outcomes, including microbial and clinical outcomes. Achieving a balanced accounting of the impact of an ASI requires careful consideration of expected undesirable effects (potential trade-offs) from the outset, and more consideration of unexpected effects after implementation (both pleasant and unpleasant surprises, although the latter will often be more important). The proposed framework supports the systematic consideration of all types of consequences of improvement before and after implementation. © The Author 2017. Published by Oxford University Press on behalf of the British Society for

A framework for the cross-sectoral integration of multi-model impact projections: land use decisions under climate impacts uncertainties

Science.gov (United States)

Frieler, K.; Levermann, A.; Elliott, J.; Heinke, J.; Arneth, A.; Bierkens, M. F. P.; Ciais, P.; Clark, D. B.; Deryng, D.; Döll, P.; Falloon, P.; Fekete, B.; Folberth, C.; Friend, A. D.; Gellhorn, C.; Gosling, S. N.; Haddeland, I.; Khabarov, N.; Lomas, M.; Masaki, Y.; Nishina, K.; Neumann, K.; Oki, T.; Pavlick, R.; Ruane, A. C.; Schmid, E.; Schmitz, C.; Stacke, T.; Stehfest, E.; Tang, Q.; Wisser, D.; Huber, V.; Piontek, F.; Warszawski, L.; Schewe, J.; Lotze-Campen, H.; Schellnhuber, H. J.

2015-07-01

Climate change and its impacts already pose considerable challenges for societies that will further increase with global warming (IPCC, 2014a, b). Uncertainties of the climatic response to greenhouse gas emissions include the potential passing of large-scale tipping points (e.g. Lenton et al., 2008; Levermann et al., 2012; Schellnhuber, 2010) and changes in extreme meteorological events (Field et al., 2012) with complex impacts on societies (Hallegatte et al., 2013). Thus climate change mitigation is considered a necessary societal response for avoiding uncontrollable impacts (Conference of the Parties, 2010). On the other hand, large-scale climate change mitigation itself implies fundamental changes in, for example, the global energy system. The associated challenges come on top of others that derive from equally important ethical imperatives like the fulfilment of increasing food demand that may draw on the same resources. For example, ensuring food security for a growing population may require an expansion of cropland, thereby reducing natural carbon sinks or the area available for bio-energy production. So far, available studies addressing this problem have relied on individual impact models, ignoring uncertainty in crop model and biome model projections. Here, we propose a probabilistic decision framework that allows for an evaluation of agricultural management and mitigation options in a multi-impact-model setting. Based on simulations generated within the Inter-Sectoral Impact Model Intercomparison Project (ISI-MIP), we outline how cross-sectorally consistent multi-model impact simulations could be used to generate the information required for robust decision making. Using an illustrative future land use pattern, we discuss the trade-off between potential gains in crop production and associated losses in natural carbon sinks in the new multiple crop- and biome-model setting. In addition, crop and water model simulations are combined to explore irrigation

The Climate Change Education Evidence Base: Lessons Learned from NOAA's Monitoring and Evaluation Framework Implementation

Science.gov (United States)

Baek, J.

2012-12-01

Federal science mission agencies are under increased pressure to ensure that their STEM education investments accomplish several objectives, including the identification and use of evidence-based approaches. Climate change education and climate literacy programs fall under these broader STEM initiatives. This paper is designed as a primer for climate change education evaluators and researchers to understand the policy context on the use of evidence. Recent initiatives, that include the National Science Foundation (NSF), the National Aeronautics and Space Administration (NASA), the National Oceanic and Atmospheric Administration (NOAA), point to a need for shared goals and measurements amongst the climate change education community. The Tri-agency Climate Change Education (CCE) collaboration, which includes NSF, NASA, and NOAA, developed the Tri-Agency Climate Change Education Common Evaluation Framework Initiative Stakeholder Statement (2012). An excerpt: From the perspective of the tri-agency collaboration, and its individual agency members, the goal of the common framework is not to build a required evaluation scheme or a set of new requirements for our funded climate change education initiatives. Rather, the collaboration would be strengthened by the development of a framework that includes tools, instruments, and/or documentation to: ● Help the agencies see and articulate the relationships between the individual pieces of the tri-agency CCE portfolio; ● Guide the agencies in reporting on the progress, lessons learned, and impacts of the collaboration between the three agencies in developing a coordinated portfolio of climate education initiatives; and ● Help the individual projects, as part of this broader portfolio, understand where they fit into a larger picture. The accomplishments of this initiative to date have been based on the collaborative nature of evaluators the climate change education community within the tri-agency portfolio. While this

An analysis of the influence of framework aspects on the study design of health economic modeling evaluations.

Science.gov (United States)

Gurtner, Sebastian

2013-04-01

Research and practical guidelines have many implications for how to structure a health economic study. A major focus in recent decades has been the quality of health economic research. In practice, the factors influencing a study design are not limited to the quest for quality. Moreover, the framework of the study is important. This research addresses three major questions related to these framework aspects. First, we want to know whether the design of health economic studies has changed over time. Second, we want to know how the subject of a study, whether it is a process or product innovation, influences the parameters of the study design. Third, one of the most important questions we will answer is whether and how the study's source of funding has an impact on the design of the research. To answer these questions, a total of 234 health economic studies were analyzed using a correspondence analysis and a logistic regression analysis. All three categories of framework factors have an influence on the aspects of the study design. Health economic studies have evolved over time, leading to the use of more advanced methods like complex sensitivity analyses. Additionally, the patient's point of view has increased in importance. The evaluation of product innovations has focused more on utility concepts. On the other hand, the source of funding may influence only a few aspects of the study design, such as the use of evaluation methods, the source of data, and the use of certain utility measures. The most important trends in health care, such as the emphasis on the patients' point of view, become increasingly established in health economic evaluations with the passage of time. Although methodological challenges remain, modern information and communication technologies provide a basis for increasing the complexity and quality of health economic studies if used frequently.

A conceptual framework for evaluating data suitability for observational studies.

Science.gov (United States)

Shang, Ning; Weng, Chunhua; Hripcsak, George

2017-09-08

To contribute a conceptual framework for evaluating data suitability to satisfy the research needs of observational studies. Suitability considerations were derived from a systematic literature review on researchers' common data needs in observational studies and a scoping review on frequent clinical database design considerations, and were harmonized to construct a suitability conceptual framework using a bottom-up approach. The relationships among the suitability categories are explored from the perspective of 4 facets of data: intrinsic, contextual, representational, and accessible. A web-based national survey of domain experts was conducted to validate the framework. Data suitability for observational studies hinges on the following key categories: Explicitness of Policy and Data Governance, Relevance, Availability of Descriptive Metadata and Provenance Documentation, Usability, and Quality. We describe 16 measures and 33 sub-measures. The survey uncovered the relevance of all categories, with a 5-point Likert importance score of 3.9 ± 1.0 for Explicitness of Policy and Data Governance, 4.1 ± 1.0 for Relevance, 3.9 ± 0.9 for Availability of Descriptive Metadata and Provenance Documentation, 4.2 ± 1.0 for Usability, and 4.0 ± 0.9 for Quality. The suitability framework evaluates a clinical data source's fitness for research use. Its construction reflects both researchers' points of view and data custodians' design features. The feedback from domain experts rated Usability, Relevance, and Quality categories as the most important considerations. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Mitigation of socio-economic impacts due to the construction of energy projects in rural communities: an evaluation of the Hartsville nuclear power plant transportation-mitigation program

International Nuclear Information System (INIS)

Whitney, T.C.

1982-01-01

This study analyzes the effects of a commuter ride-sharing program in mitigating the harmful socio-economic impacts of a short-term, labor-intensive nuclear-power-plant construction project. The major hypothesis is that transportation-mitigation programs are more cost-effective in reducing the undesirable socio-economic impacts of large-scale construction projects than programs designed to mitigate impacts through the provision of public services for migrating workers. The dissertation begins by delineating the socio-economic effects of large-scale construction projects in rural areas. It proceeds to show how some of the deleterious impacts were mitigated using a commuter ride-sharing program. After the range of potential socio-economic impacts was established, a framework was developed to evaluate the effects of the transportation-mitigation program in mediating the harmful impacts. The framework involved the integration of the cost-benefit technique with social-impact assessment. The evaluation was grounded in a comparative framework whereby the Hartsville project community was compared with a similar community undergoing the construction of a nuclear power plant but without a commuter ride-sharing program, and a community not experiencing a major construction project. The research findings indicated that the transportation-mitigation program substantially reduced the in-migration of construction workers into the Hartsville-Trousdale County area. Further, the program was cost effective, with a benefit-cost ratio of 2.5 and net benefits totalling 28 million dollars

Economic Evaluation of Climate Change Impacts and Adaptation in Italy

International Nuclear Information System (INIS)

Gambarelli, G.; Goria, A.

2004-07-01

The paper deals with the social and economic dimensions of climate change impacts and adaptation in Italy. The ultimate aim of the paper is to provide policy makers and experts with a conceptual framework, as well as methodological and operational tools for dealing with climate change impacts and adaptation from an economic perspective. In order to do so, first a conceptual and theoretical framework of the economic assessment of climate change impacts is presented and the state of the art about impact assessment studies is briefly analysed. Then, the Italian case is taken into account, by underlying the main impacts and adaptation challenges that are likely to be implied by climate change in the next decades. The analysis of the Italian case is particularly addressed through the description of the methodology and results of two case studies. The first one, dealing mainly with impact assessment, is carried out at the national level and is part of a EC funded project on Weather Impacts on Natural, Social and Economic Systems (WISE). The second one is carried out at the local level and focuses on sea level rise impacts and adaptation in a plane south of Rome. The two case studies allow to propose simple and flexible methodologies for the economic impact assessment and the economic valuation of adaptation strategies

Evaluation of a new data staging framework for the ARC middleware

International Nuclear Information System (INIS)

Cameron, D; Karpenko, D; Konstantinov, A; Filipčič, A

2012-01-01

Staging data to and from remote storage services on the Grid for users’ jobs is a vital component of the ARC computing element. A new data staging framework for the computing element has recently been developed to address issues with the present framework, which has essentially remained unchanged since its original implementation 10 years ago. This new framework consists of an intelligent data transfer scheduler which handles priorities and fair-share, a rapid caching system, and the ability to delegate data transfer over multiple nodes to increase network throughput. This paper uses data from real user jobs running on production ARC sites to present an evaluation of the new framework. It is shown to make more efficient use of the available resources, reduce the overall time to run jobs, and avoid the problems seen with the previous simplistic scheduling system. In addition, its simple design coupled with intelligent logic provides greatly increased flexibility for site administrators, end users and future development.

23 CFR 777.7 - Evaluation of impacts.

Science.gov (United States)

2010-04-01

... 23 Highways 1 2010-04-01 2010-04-01 false Evaluation of impacts. 777.7 Section 777.7 Highways... IMPACTS TO WETLANDS AND NATURAL HABITAT § 777.7 Evaluation of impacts. (a) The reasonableness of the... related to: (1) The importance of the impacted wetlands and natural habitats; (2) The extent of highway...

Supporting the Evaluation and Implementation of Musculoskeletal Models of Care: A Globally Informed Framework for Judging Readiness and Success.

Science.gov (United States)

Briggs, Andrew M; Jordan, Joanne E; Jennings, Matthew; Speerin, Robyn; Bragge, Peter; Chua, Jason; Woolf, Anthony D; Slater, Helen

2017-04-01

To develop a globally informed framework to evaluate readiness for implementation and success after implementation of musculoskeletal models of care (MOCs). Three phases were undertaken: 1) a qualitative study with 27 Australian subject matter experts (SMEs) to develop a draft framework; 2) an eDelphi study with an international panel of 93 SMEs across 30 nations to evaluate face validity, and refine and establish consensus on the framework components; and 3) translation of the framework into a user-focused resource and evaluation of its acceptability with the eDelphi panel. A comprehensive evaluation framework was developed for judging the readiness and success of musculoskeletal MOCs. The framework consists of 9 domains, with each domain containing a number of themes underpinned by detailed elements. In the first Delphi round, scores of "partly agree" or "completely agree" with the draft framework ranged 96.7%-100%. In the second round, "essential" scores ranged 58.6%-98.9%, resulting in 14 of 34 themes being classified as essential. SMEs strongly agreed or agreed that the final framework was useful (98.8%), usable (95.1%), credible (100%) and appealing (93.9%). Overall, 96.3% strongly supported or supported the final structure of the framework as it was presented, while 100%, 96.3%, and 100% strongly supported or supported the content within the readiness, initiating implementation, and success streams, respectively. An empirically derived framework to evaluate the readiness and success of musculoskeletal MOCs was strongly supported by an international panel of SMEs. The framework provides an important internationally applicable benchmark for the development, implementation, and evaluation of musculoskeletal MOCs. © 2016, American College of Rheumatology.

A framework for assessing impact of units of scholarly communication based on OAI-PMH harvesting of usage information

CERN Multimedia

CERN. Geneva; Van de Sompel, Herbert

2005-01-01

The wide-spread implementation of institutional repositories (IR), digital libraries, preprint services, and open access journals has dramatically changed the communication options that are available to scholars. At the same time, scholarship itself is becoming digital, thereby fundamentally extending the notion of a unit of scholarly communication beyond journal papers to include multimedia files, data sets, simulations, visualizations, etc. Meanwhile, the evaluation of scholarly performance remains bound to the use of citation data derived from a subset of all available communication channels (pre-selected journals), and an ever decreasing subset of all communicated units (journal papers). Clearly, there is a need for frameworks that allow measuring scholarly activity and its impact in the context of this new reality. We discuss the architecture of a system that is being developed at the Los Alamos National Laboratory that aims at determining impact and prestige rankings on the basis of aggregated usage dat...

Normalisation process theory: a framework for developing, evaluating and implementing complex interventions

LENUS (Irish Health Repository)

Murray, Elizabeth

2010-10-20

Abstract Background The past decade has seen considerable interest in the development and evaluation of complex interventions to improve health. Such interventions can only have a significant impact on health and health care if they are shown to be effective when tested, are capable of being widely implemented and can be normalised into routine practice. To date, there is still a problematic gap between research and implementation. The Normalisation Process Theory (NPT) addresses the factors needed for successful implementation and integration of interventions into routine work (normalisation). Discussion In this paper, we suggest that the NPT can act as a sensitising tool, enabling researchers to think through issues of implementation while designing a complex intervention and its evaluation. The need to ensure trial procedures that are feasible and compatible with clinical practice is not limited to trials of complex interventions, and NPT may improve trial design by highlighting potential problems with recruitment or data collection, as well as ensuring the intervention has good implementation potential. Summary The NPT is a new theory which offers trialists a consistent framework that can be used to describe, assess and enhance implementation potential. We encourage trialists to consider using it in their next trial.

Normalisation process theory: a framework for developing, evaluating and implementing complex interventions

Directory of Open Access Journals (Sweden)

Ong Bie

2010-10-01

Full Text Available Abstract Background The past decade has seen considerable interest in the development and evaluation of complex interventions to improve health. Such interventions can only have a significant impact on health and health care if they are shown to be effective when tested, are capable of being widely implemented and can be normalised into routine practice. To date, there is still a problematic gap between research and implementation. The Normalisation Process Theory (NPT addresses the factors needed for successful implementation and integration of interventions into routine work (normalisation. Discussion In this paper, we suggest that the NPT can act as a sensitising tool, enabling researchers to think through issues of implementation while designing a complex intervention and its evaluation. The need to ensure trial procedures that are feasible and compatible with clinical practice is not limited to trials of complex interventions, and NPT may improve trial design by highlighting potential problems with recruitment or data collection, as well as ensuring the intervention has good implementation potential. Summary The NPT is a new theory which offers trialists a consistent framework that can be used to describe, assess and enhance implementation potential. We encourage trialists to consider using it in their next trial.

Proposed Framework for the Evaluation of Standalone Corpora Processing Systems: An Application to Arabic Corpora

Directory of Open Access Journals (Sweden)

Abdulmohsen Al-Thubaity

2014-01-01

Full Text Available Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP, corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to evaluate seven freely available systems. The proposed framework considers the usability, functionality, and performance of the evaluated systems while taking into consideration their suitability for Arabic corpora. While the results show that most of the evaluated systems exhibited comparable usability scores, the scores for functionality and performance were substantially different with respect to support for the Arabic language and N-grams profile generation. The results of our evaluation will help potential users of the evaluated systems to choose the system that best meets their needs. More importantly, the results will help the developers of the evaluated systems to enhance their systems and developers of new corpora processing systems by providing them with a reference framework.

Proposed framework for the evaluation of standalone corpora processing systems: an application to Arabic corpora.

Science.gov (United States)

Al-Thubaity, Abdulmohsen; Al-Khalifa, Hend; Alqifari, Reem; Almazrua, Manal

2014-01-01

Despite the accessibility of numerous online corpora, students and researchers engaged in the fields of Natural Language Processing (NLP), corpus linguistics, and language learning and teaching may encounter situations in which they need to develop their own corpora. Several commercial and free standalone corpora processing systems are available to process such corpora. In this study, we first propose a framework for the evaluation of standalone corpora processing systems and then use it to evaluate seven freely available systems. The proposed framework considers the usability, functionality, and performance of the evaluated systems while taking into consideration their suitability for Arabic corpora. While the results show that most of the evaluated systems exhibited comparable usability scores, the scores for functionality and performance were substantially different with respect to support for the Arabic language and N-grams profile generation. The results of our evaluation will help potential users of the evaluated systems to choose the system that best meets their needs. More importantly, the results will help the developers of the evaluated systems to enhance their systems and developers of new corpora processing systems by providing them with a reference framework.

From life cycle analysis approach to monetarisation of the impacts: an evaluation in term of decision process

International Nuclear Information System (INIS)

Darras, M.

2002-01-01

The life cycle analysis offers a new tool in the direction of integration of the multiple physical flows of matters around industrial processes and products, including the usage stage. Simultaneously, it stresses the multidimensional impact of the human activities, first in term of physical flows, but then in term of impact on the goals stated above. In this perspective, integrating framework for decision are needed, especially at the more global level. One of the proposed frameworks is the monetarisation and cost-benefit analysis, as an extension of the quantitative economy. The multi-dimensional choice, unfit for strict order choice, is reduce to one variable.In the presentation below, because of the importance of this approach in connection with Life Cycle Analysis and public policies, we concentrate on the;analysis of this framework. We will show that it might shed light on the decision process, especially if associated with its uncertainties, its limits in term of process or criteria taken into account, the indication of other social criteria not taken into account, and other method of evaluation. At the end, this is mainly a source for a better multi-criteria decision process. (author)

A Framework for Comparative Assessments of Energy Efficiency Policy Measures

Energy Technology Data Exchange (ETDEWEB)

Blum, Helcio; Atkinson, Barbara; Lekov, Alex

2011-05-24

When policy makers propose new policies, there is a need to assess the costs and benefits of the proposed policy measures, to compare them to existing and alternative policies, and to rank them according to their effectiveness. In the case of equipment energy efficiency regulations, comparing the effects of a range of alternative policy measures requires evaluating their effects on consumers’ budgets, on national energy consumption and economics, and on the environment. Such an approach should be able to represent in a single framework the particularities of each policy measure and provide comparable results. This report presents an integrated methodological framework to assess prospectively the energy, economic, and environmental impacts of energy efficiency policy measures. The framework builds on the premise that the comparative assessment of energy efficiency policy measures should (a) rely on a common set of primary data and parameters, (b) follow a single functional approach to estimate the energy, economic, and emissions savings resulting from each assessed measure, and (c) present results through a set of comparable indicators. This framework elaborates on models that the U.S. Department of Energy (DOE) has used in support of its rulemakings on mandatory energy efficiency standards. In addition to a rigorous analysis of the impacts of mandatory standards, DOE compares the projected results of alternative policy measures to those projected to be achieved by the standards. The framework extends such an approach to provide a broad, generic methodology, with no geographic or sectoral limitations, that is useful for evaluating any type of equipment energy efficiency market intervention. The report concludes with a demonstration of how to use the framework to compare the impacts estimated for twelve policy measures focusing on increasing the energy efficiency of gas furnaces in the United States.

A Framework for the Cross-Sectoral Integration of Multi-Model Impact Projections: Land Use Decisions Under Climate Impacts Uncertainties

Science.gov (United States)

Frieler, K.; Elliott, Joshua; Levermann, A.; Heinke, J.; Arneth, A.; Bierkens, M. F. P.; Ciais, P.; Clark, D. B.; Deryng, D.; Doll, P.;

A framework and case studies for evaluation of enzyme ontogeny in children's health risk evaluation.

Science.gov (United States)

Ginsberg, Gary; Vulimiri, Suryanarayana V; Lin, Yu-Sheng; Kancherla, Jayaram; Foos, Brenda; Sonawane, Babasaheb

2017-01-01

Knowledge of the ontogeny of Phase I and Phase II metabolizing enzymes may be used to inform children's vulnerability based upon likely differences in internal dose from xenobiotic exposure. This might provide a qualitative assessment of toxicokinetic (TK) variability and uncertainty pertinent to early lifestages and help scope a more quantitative physiologically based toxicokinetic (PBTK) assessment. Although much is known regarding the ontogeny of metabolizing systems, this is not commonly utilized in scoping and problem formulation stage of human health risk evaluation. A framework is proposed for introducing this information into problem formulation which combines data on enzyme ontogeny and chemical-specific TK to explore potential child/adult differences in internal dose and whether such metabolic differences may be important factors in risk evaluation. The framework is illustrated with five case study chemicals, including some which are data rich and provide proof of concept, while others are data poor. Case studies for toluene and chlorpyrifos indicate potentially important child/adult TK differences while scoping for acetaminophen suggests enzyme ontogeny is unlikely to increase early-life risks. Scoping for trichloroethylene and aromatic amines indicates numerous ways that enzyme ontogeny may affect internal dose which necessitates further evaluation. PBTK modeling is a critical and feasible next step to further evaluate child-adult differences in internal dose for a number of these chemicals.

A systematic framework for the feasibility and technical evaluation of reactive distillation processes

NARCIS (Netherlands)

Shah, M.R.; Kiss, A.A.; Zondervan, E.; Haan, de A.B.

2012-01-01

This study presents a novel design methodology for the feasibility and technical evaluation of reactive distillation (RD), and discusses the applicability of various design methods of RD. The proposed framework for the feasibility evaluation determines the boundary conditions (e.g. relative

A framework to evaluate proposals for scientific activities in wilderness

Science.gov (United States)

Peter Landres

2010-01-01

Every year, the four Federal wilderness management agencies - U.S. DOI Bureau of Land Management, Fish and Wildlife Service, National Park Service, and the USDA Forest Service - receive hundreds of proposals to conduct scientific studies within wilderness. There is no consistent and comprehensive framework for evaluating such proposals that accounts for the unique...

The development of an operational LCIA-methodology with impact categories based on the control variables in the Planetary Boundaries framework

DEFF Research Database (Denmark)

Ryberg, Morten; Owsianiak, Mikolaj; Hauschild, Michael Zwicky

2016-01-01

This study presents a first attempt at an operational LCIA-methodology basing the definition of the impact categories on the control variables as defined in the Planetary Boundaries (PB) framework. The PB-framework introduced a set of biophysical Earth system processes and defined quantitative PBs...... that have to be respected for Earth to remain in the Holocene state. The concept is attracting a strong interest from in dustry as companies seek to assess and communicate the environmental performance of their products relative to the PBs. The PB -framework has previously been attempted included in LCA...... variables in the PB-framework and current LCIA impact categories. The new insights can be used for communicating the product’s environmental performance and to support definitions of absolute reduction targets relative to the PBs....

Evaluating the applicability of integrated domestic energy consumption frameworks in the UK

International Nuclear Information System (INIS)

Keirstead, James

2006-01-01

Domestic energy consumption (DEC) has been traditionally understood using disciplinary perspectives, focusing on specific components of the energy consumption system such as technologies or costs. However, early attempts to encourage energy conservation demonstrated that these frameworks often miss important contextual factors such as cultural values and behavioural interactions with technologies. This evidence, combined with the present need for energy policies that can address environmental, social, and economic concerns, suggests that a broader perspective is needed. Integrated frameworks of DEC were first proposed over 20 years ago but very little has been said about the ideas proposed in these papers, whether it be critiquing their form or assessing their impact on theory and practice. This paper attempts to fill this gap by examining the influence of integrated frameworks in academic literature and in UK energy policy. It is argued that a common language could stimulate renewed interest in the integrated perspective and thereby help policy makers meet these diverse goals. To this end, a flexible agent-based framework is proposed to stimulate debate and clarify the role of an integrated approach to domestic energy policy

Green and sustainable remediation (GSR) evaluation: framework, standards, and tool. A case study in Taiwan.

Science.gov (United States)

Huang, Wen-Yen; Hung, Weiteng; Vu, Chi Thanh; Chen, Wei-Ting; Lai, Jhih-Wei; Lin, Chitsan

2016-11-01

Taiwan has a large number of poorly managed contaminated sites in need of remediation. This study proposes a framework, a set of standards, and a spreadsheet-based evaluation tool for implementing green and sustainable principles into remediation projects and evaluating the projects from this perspective. We performed a case study to understand how the framework would be applied. For the case study, we used a spreadsheet-based evaluation tool (SEFA) and performed field scale cultivation tests on a site contaminated with total petroleum hydrocarbons (TPHs). The site was divided into two lots: one treated by chemical oxidation and the other by bioremediation. We evaluated five core elements of green and sustainable remediation (GSR): energy, air, water resources, materials and wastes, and land and ecosystem. The proposed evaluation tool and field scale cultivation test were found to efficiently assess the effectiveness of the two remediation alternatives. The framework and related tools proposed herein can potentially be used to support decisions about the remediation of contaminated sites taking into account engineering management, cost effectiveness, and social reconciliation.

Evaluation and Policy Analysis: A Communicative Framework

Directory of Open Access Journals (Sweden)

Cynthia Wallat

1997-07-01

Full Text Available A major challenge for the next generation of students of human development is to help shape the paradigms by which we analyze and evaluate public policies for children and families. Advocates of building research and policy connections point to health care and stress experiences across home, school, and community as critical policy issues that expand the scope of contexts and outcomes studied. At a minimum, development researchers and practitioners will need to be well versed in available methods of inquiry; they will need to be "methodologically multilingual" when conducting evaluation and policy analysis, producing reports, and reporting their interpretations to consumer and policy audiences. This article suggests how traditional approaches to policy inquiry can be reconsidered in light of these research inquiry and communicative skills needed by all policy researchers. A fifteen year review of both policy and discourse processes research is presented to suggest ways to conduct policy studies within a communicative framework.

An Evaluation Framework for Obesity Prevention Policy Interventions

Science.gov (United States)

Sommers, Janice; Vu, Maihan; Jernigan, Jan; Payne, Gayle; Thompson, Diane; Heiser, Claire; Farris, Rosanne; Ammerman, Alice

2012-01-01

As the emphasis on preventing obesity has grown, so have calls for interventions that extend beyond individual behaviors and address changes in environments and policies. Despite the need for policy action, little is known about policy approaches that are most effective at preventing obesity. The Centers for Disease Control and Prevention (CDC) and others are funding the implementation and evaluation of new obesity prevention policies, presenting a distinct opportunity to learn from these practice-based initiatives and build the body of evidence-based approaches. However, contributions from this policy activity are limited by the incomplete and inconsistent evaluation data collected on policy processes and outcomes. We present a framework developed by the CDC-funded Center of Excellence for Training and Research Translation that public health practitioners can use to evaluate policy interventions and identify the practice-based evidence needed to fill the gaps in effective policy approaches to obesity prevention. PMID:22742594

Assessing the Spread and Uptake of a Framework for Introducing and Evaluating Advanced Practice Nursing Roles.

Science.gov (United States)

Boyko, Jennifer A; Carter, Nancy; Bryant-Lukosius, Denise

2016-08-01

Health system researchers must ensure that the products of their work meet the needs of various stakeholder groups (e.g., patients, practitioners, and policy makers). Evidence-based frameworks can support the uptake and spread of research evidence; however, their existence as knowledge translation tools does not ensure their uptake and it is difficult to ascertain their spread into research, practice, and policy using existing methods. The purpose of this article is to report results of a study on the spread and uptake of an evidence-based framework (i.e., the participatory, evidence-based, patient-focused process for advanced practice nursing [PEPPA] framework) into research, practice, and policies relevant to the introduction and evaluation of advanced practice nursing roles. We also reflect on the utility of using a modified citation methodology to evaluate knowledge translation efforts. We searched four databases for literature published between 2004 and 2014 citing the original paper in which the PEPPA framework was published, and carried out an Internet search for grey literature using keywords. Relevant data were extracted from sources and organized using NVivo software. We analysed results descriptively. Our search yielded 164 unique sources of which 69.5% were from published literature and the majority (83.4%) of these were published in nursing journals. Most frequently (71.5%), the framework was used by researchers and students in research studies. A smaller number of citations (11.3%) reflected use of the PEPPA framework in practice settings with a focus on role development, implementation, evaluation, or a combination of these. This study demonstrates that the PEPPA framework has been used to varying degrees as intended, and provides guidance on how to evaluate the spread and uptake of research outputs (e.g., theoretical frameworks). Further research is needed about ways to determine whether evidence-informed research tools such as frameworks have been

Uncertainty-embedded dynamic life cycle sustainability assessment framework: An ex-ante perspective on the impacts of alternative vehicle options

International Nuclear Information System (INIS)

Onat, Nuri Cihat; Kucukvar, Murat; Tatari, Omer

2016-01-01

Alternative vehicle technologies have a great potential to minimize the transportation-related environmental impacts, reduce the reliance of the U.S. on imported petroleum, and increase energy security. However, they introduce new uncertainties related to their environmental, economic, and social impacts and certain challenges for widespread adoption. In this study, a novel method, uncertainty-embedded dynamic life cycle sustainability assessment framework, is developed to address both methodological challenges and uncertainties in transportation sustainability research. The proposed approach provides a more comprehensive, system-based sustainability assessment framework by capturing the dynamic relations among the parameters within the U.S. transportation system as a whole with respect to its environmental, social, and economic impacts. Using multivariate uncertainty analysis, likelihood of the impact reduction potentials of different vehicle types, as well as the behavioral limits of the sustainability potentials of each vehicle type are analyzed. Seven sustainability impact categories are dynamically quantified for four different vehicle types (internal combustion, hybrid, plug-in hybrid, and battery electric vehicles) from 2015 to 2050. Although impacts of electric vehicles have the largest uncertainty, they are expected (90% confidence) to be the best alternative in long-term for reducing human health impacts and air pollution from transportation. While results based on deterministic (average) values indicate that electric vehicles have greater potential of reducing greenhouse gas emissions, plug-in hybrid vehicles have the largest potential according to the results with 90% confidence interval. - Highlights: • Uncertainty-embedded dynamic sustainability assessment framework, is developed. • Methodological challenges and uncertainties are addressed. • Seven impact categories are quantified for four different vehicle types.

Measuring social accountability in health professional education: development and international pilot testing of an evaluation framework.

Science.gov (United States)

Larkins, Sarah L; Preston, Robyn; Matte, Marie C; Lindemann, Iris C; Samson, Rex; Tandinco, Filedito D; Buso, David; Ross, Simone J; Pálsdóttir, Björg; Neusy, André-Jacques

2013-01-01

Health professional schools are responsible for producing graduates with competencies and attitudes to address health inequities and respond to priority health needs. Health professional schools striving towards social accountability founded the Training for Health Equity Network (THEnet). This article describes the development of THEnet evaluation framework for socially accountable health professional education, presents the framework to be used as a tool by other schools and discusses the findings of pilot implementation at five schools. The framework was designed collaboratively and built on Boelen and Woollard's conceptualization, production and usability model. It includes key components, linked to aspirational statements, indicators and suggested measurement tools. Five schools completed pilot implementation, involving workshops, document/data review and focus group discussions with faculty, students and community members. Three sections of the framework consider: How does our school work?; What do we do? and What difference do we make? Pilot testing proved that the evaluation framework was acceptable and feasible across contexts and produced findings useful at school level and to compare schools. The framework is designed as a formative exercise to help schools take a critical look at their performance and progress towards social accountability. Initiatives to implement the framework more widely are underway. The framework effectively aids in identifying strengths, weaknesses and gaps, with a view to schools striving for continuous self-improvement. THEnet evaluation framework is applicable and useful across contexts. It is possible and desirable to assess progress towards social accountability in health professional schools and this is an important step in producing health professionals with knowledge, attitudes, and skills to meet the challenges of priority health needs of underserved populations.

Towards an evaluation framework for information quality management (IQM) practices for health information systems--evaluation criteria for effective IQM practices.

Science.gov (United States)

Mohammed, Siti Asma; Yusof, Maryati Mohd

2013-04-01

Poor information quality (IQ) must be understood as a business problem rather than systems problem. In health care organization, what is required is an effective quality management that continuously manages and reviews the factors influencing IQ in health information systems (HIS) so as to achieve the desired outcomes. Hence, in order to understand the issues of information quality management (IQM) practices in health care organizations, a more holistic evaluation study should be undertaken to investigate the IQM practices in health care organizations. It is the aim of this paper to identify the significant evaluation criteria that influence the production of good IQ in HIS. Six selected frameworks and best practices both from health informatics and information systems literature have been reviewed to identify the evaluation criteria from the perspective of human, organizational and technological factors. From the review, it was found that human and organization factors are of greater significance in influencing HIS IQ. Our review depicts that there is still shortage in finding a comprehensive IQM evaluation framework. Thus, the criteria from the frameworks reviewed can be used in combination for more comprehensive evaluation criteria. Integrated IQM evaluation criteria for HIS are then proposed in this study. Poor IQ is the result of complex interdependency within sociotechnical factors in health care organization and lack of formal and structured IQM practices. Thus, a feedback mechanism such as evaluation is needed to understand the issues in depth in the future. © 2012 Blackwell Publishing Ltd.

Evaluation of a community-based, family focused healthy weights initiative using the RE-AIM framework.

Science.gov (United States)

Jung, Mary E; Bourne, Jessica E; Gainforth, Heather L

2018-01-26

Childhood overweight and obesity is a major public health concern. Community-based interventions have the potential to reach caregivers and children. However, the overall health impact of these programs is rarely comprehensively assessed. This study evaluated a physical activity and healthy eating family program (Healthy Together; HT) using the RE-AIM framework. Ten sites implemented the 5-week program. Thirty-nine staff members and 277 program participants (126 caregivers [M age  = 35.6] and 151 children [M age  = 13]) participated in the evaluation. Each RE-AIM dimension was assessed independently using a mixed-methods approach. Sources of data included archival records, interviews and surveys. Effectiveness outcome variables were assessed at pre- and post-intervention and 6-month follow-up. Reach: HT participants were almost entirely recruited from existing programs within sites. Effectiveness: Caregivers' nutrition related efficacy beliefs increased following HT (ps  .05). Knowledge surrounding healthy diets and physical activity increased in children and caregivers (ps evaluations can systematically highlight areas of success and challenges. Overall HT represents a feasible community-based intervention; however further support is required in order to ensure the program is effective at positively targeting the desired outcomes. As a result of this evaluation, modifications are currently being implemented to HT.

Evaluation Framework for Non-Emergency Medical Transportation Services for Patients with End-Stage Renal Disease

Science.gov (United States)

2014-12-01

The objective of this project is to design a framework that could be used to evaluate the effectiveness and efficiency of non-emergency transportation services (NEMT) for better livability. In addition to the development of the framework, this projec...

An evaluation framework for effective public participation in EIA in Pakistan

International Nuclear Information System (INIS)

Nadeem, Obaidullah; Fischer, Thomas B.

2011-01-01

Evaluating the effectiveness of public participation in EIA related decisions is of crucial importance for developing a better understanding of overall EIA effectiveness. This paper aims to contribute to the professional debate by establishing a country specific evaluation framework for Pakistan, which, it is suggested, could also potentially be used in other developing countries. The framework is used to evaluate performance of public participation in EIA in terms of 40 attributes for four selected projects from the province of Punjab. The evaluation is based on interviews with stakeholders, review of EIA reports as well as public hearing proceedings and environmental approval conditions. The evaluation of the selected projects revealed an overall weak influence of public participation on substantive quality of EIA and on the final decision. Overall, EIA public participation has succeeded in providing a more egalitarian environment. Furthermore, it appears fair to say that sufficient time for submitting written comments on EIA reports as well as for raising concerns during public hearings had been given. Also, public consultation was significantly contributing to educating participants. Despite some impediments, it is argued that public participation in EIA is gradually gaining ground in Pakistan. Recommendations to enhance EIA public participation effectiveness in Pakistan include applying a more proactive approach which should take place before EIA is conducted and before site selection for development projects is happening.

CERCLA-linked environmental impact and benefit analysis: Evaluating remedial alternatives for the Portland Harbor Superfund Site, Portland, Oregon, USA.

Science.gov (United States)

McNally, Amanda D; Fitzpatrick, Anne G; Mirchandani, Sera; Salmon, Matthew; Edwards, Deborah A

2018-01-01

This analysis focused on evaluating the environmental consequences of remediation, providing indicators for the environmental quality pillar of 3 "pillars" of the Portland Harbor Sustainability Project (PHSP) framework (the other 2 pillars are economic viability and social equity). The project an environmental impact and benefit analysis (EIBA) and an EIBA-based cost-benefit analysis. Metrics developed in the EIBA were used to quantify and compare remedial alternatives' environmental benefits and impacts in the human and ecological domains, as a result of remedial actions (relative to no action). The cost-benefit results were used to evaluate whether remediation costs were proportionate or disproportionate to the environmental benefits. Alternatives B and D had the highest overall benefit scores, and Alternative F was disproportionately costly relative to its achieved benefits when compared to the other remedial alternatives. Indeed, the costlier alternatives with larger remedial footprints had lower overall EIBA benefit scores-because of substantially more air emissions, noise, and light impacts, and more disturbance to business, recreational access, and habitat during construction-compared to the less costly and smaller alternatives. Put another way, the adverse effects during construction tended to outweigh the long-term benefits, and the net environmental impacts of the larger remedial alternatives far outweighed their small incremental improvements in risk reduction. Results of this Comprehensive Environmental Response Compensation and Liability Act (CERCLA)-linked environmental analysis were integrated with indicators of economic and social impacts of remediation in a stakeholder values-based sustainability framework. These tools (EIBA, EIBA-based cost-benefit analysis, economic impact assessment, and the stakeholder values-based integration) provide transparent and quantitative evaluations of the benefits and impacts associated with remedial alternatives

Malaysian Mega Science Framework: The Need for Social Impact and Sustainability Assessment

OpenAIRE

Ahmad Zainal A.; Ahmad Zulfadli

2015-01-01

This review focuses on issues surrounding wastewater management as part of the National Sustainable Development (2013-2050) under the Malaysian Mega Science Framework. In line with the national priority area of water security, this review will highlight the technical reports compiled by the Academy of Sciences Malaysia (ASM) on the challenges of water resource development and wastewater management and treatment. The discussion will dwell on the social impact of pollution in water and wastewat...

Towards a Framework for Evaluating and Comparing Diagnosis Algorithms

Science.gov (United States)

Kurtoglu, Tolga; Narasimhan, Sriram; Poll, Scott; Garcia,David; Kuhn, Lukas; deKleer, Johan; vanGemund, Arjan; Feldman, Alexander

2009-01-01

Diagnostic inference involves the detection of anomalous system behavior and the identification of its cause, possibly down to a failed unit or to a parameter of a failed unit. Traditional approaches to solving this problem include expert/rule-based, model-based, and data-driven methods. Each approach (and various techniques within each approach) use different representations of the knowledge required to perform the diagnosis. The sensor data is expected to be combined with these internal representations to produce the diagnosis result. In spite of the availability of various diagnosis technologies, there have been only minimal efforts to develop a standardized software framework to run, evaluate, and compare different diagnosis technologies on the same system. This paper presents a framework that defines a standardized representation of the system knowledge, the sensor data, and the form of the diagnosis results and provides a run-time architecture that can execute diagnosis algorithms, send sensor data to the algorithms at appropriate time steps from a variety of sources (including the actual physical system), and collect resulting diagnoses. We also define a set of metrics that can be used to evaluate and compare the performance of the algorithms, and provide software to calculate the metrics.

Evaluating QR Code Case Studies Using a Mobile Learning Framework

Science.gov (United States)

Rikala, Jenni

2014-01-01

The aim of this study was to evaluate the feasibility of Quick Response (QR) codes and mobile devices in the context of Finnish basic education. The feasibility was analyzed through a mobile learning framework, which includes the core characteristics of mobile learning. The study is part of a larger research where the aim is to develop a…

The 'global health' education framework: a conceptual guide for monitoring, evaluation and practice

Science.gov (United States)

2011-01-01

Background In the past decades, the increasing importance of and rapid changes in the global health arena have provoked discussions on the implications for the education of health professionals. In the case of Germany, it remains yet unclear whether international or global aspects are sufficiently addressed within medical education. Evaluation challenges exist in Germany and elsewhere due to a lack of conceptual guides to develop, evaluate or assess education in this field. Objective To propose a framework conceptualising 'global health' education (GHE) in practice, to guide the evaluation and monitoring of educational interventions and reforms through a set of key indicators that characterise GHE. Methods Literature review; deduction. Results and Conclusion Currently, 'new' health challenges and educational needs as a result of the globalisation process are discussed and linked to the evolving term 'global health'. The lack of a common definition of this term complicates attempts to analyse global health in the field of education. The proposed GHE framework addresses these problems and presents a set of key characteristics of education in this field. The framework builds on the models of 'social determinants of health' and 'globalisation and health' and is oriented towards 'health for all' and 'health equity'. It provides an action-oriented construct for a bottom-up engagement with global health by the health workforce. Ten indicators are deduced for use in monitoring and evaluation. PMID:21501519

Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography.

Science.gov (United States)

Kirişli, H A; Schaap, M; Metz, C T; Dharampal, A S; Meijboom, W B; Papadopoulou, S L; Dedic, A; Nieman, K; de Graaf, M A; Meijs, M F L; Cramer, M J; Broersen, A; Cetin, S; Eslami, A; Flórez-Valencia, L; Lor, K L; Matuszewski, B; Melki, I; Mohr, B; Oksüz, I; Shahzad, R; Wang, C; Kitslaar, P H; Unal, G; Katouzian, A; Örkisz, M; Chen, C M; Precioso, F; Najman, L; Masood, S; Ünay, D; van Vliet, L; Moreno, R; Goldenberg, R; Vuçini, E; Krestin, G P; Niessen, W J; van Walsum, T

2013-12-01

Though conventional coronary angiography (CCA) has been the standard of reference for diagnosing coronary artery disease in the past decades, computed tomography angiography (CTA) has rapidly emerged, and is nowadays widely used in clinical practice. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms devised to detect and quantify the coronary artery stenoses, and to segment the coronary artery lumen in CTA data. The objective of this evaluation framework is to demonstrate the feasibility of dedicated algorithms to: (1) (semi-)automatically detect and quantify stenosis on CTA, in comparison with quantitative coronary angiography (QCA) and CTA consensus reading, and (2) (semi-)automatically segment the coronary lumen on CTA, in comparison with expert's manual annotation. A database consisting of 48 multicenter multivendor cardiac CTA datasets with corresponding reference standards are described and made available. The algorithms from 11 research groups were quantitatively evaluated and compared. The results show that (1) some of the current stenosis detection/quantification algorithms may be used for triage or as a second-reader in clinical practice, and that (2) automatic lumen segmentation is possible with a precision similar to that obtained by experts. The framework is open for new submissions through the website, at http://coronary.bigr.nl/stenoses/. Copyright © 2013 Elsevier B.V. All rights reserved.

Assessment of Intralaminar Progressive Damage and Failure Analysis Using an Efficient Evaluation Framework

Science.gov (United States)

Hyder, Imran; Schaefer, Joseph; Justusson, Brian; Wanthal, Steve; Leone, Frank; Rose, Cheryl

2017-01-01

Reducing the timeline for development and certification for composite structures has been a long standing objective of the aerospace industry. This timeline can be further exacerbated when attempting to integrate new fiber-reinforced composite materials due to the large number of testing required at every level of design. computational progressive damage and failure analysis (PDFA) attempts to mitigate this effect; however, new PDFA methods have been slow to be adopted in industry since material model evaluation techniques have not been fully defined. This study presents an efficient evaluation framework which uses a piecewise verification and validation (V&V) approach for PDFA methods. Specifically, the framework is applied to evaluate PDFA research codes within the context of intralaminar damage. Methods are incrementally taken through various V&V exercises specifically tailored to study PDFA intralaminar damage modeling capability. Finally, methods are evaluated against a defined set of success criteria to highlight successes and limitations.

Land use impact evaluation in life cycle assessment based on ecosystem thermodynamics

International Nuclear Information System (INIS)

Wagendorp, Tim; Gulinck, Hubert; Coppin, Pol; Muys, Bart

2006-01-01

Life Cycle Assessment (LCA) studies of products with a major part of their life cycle in biological production systems (i.e. forestry and agriculture) are often incomplete because the assessment of the land use impact is not operational. Most method proposals include the quality of the land in a descriptive way using rank scores for an arbitrarily selected set of indicators. This paper first offers a theoretical framework for the selection of suitable indicators for land use impact assessment, based on ecosystem thermodynamics. According to recent theories on the thermodynamics of open systems, a goal function of ecosystems is to maximize the dissipation of exogenic exergy fluxes by maximizing the internal exergy storage under form of biomass, biodiversity and complex trophical networks. Human impact may decrease this ecosystem exergy level by simplification, i.e. decreasing biomass and destroying internal complexity. Within this theoretical framework, we then studied possibilities for assessing the land use impact in a more direct way by measuring the ecosystems' capacity to dissipate solar exergy. Measuring ecosystem thermal characteristics by using remote sensing techniques was considered a promising tool. Once operational, it could offer a quick and cheap alternative to quantify land use impacts in any terrestrial ecosystem of any size. Recommendations are given for further exploration of this method and for its integration into an ISO compatible LCA framework

An Indicator-Based Framework to Evaluate Sustainability of Farming Systems: Review of Applications in Tuscany

Directory of Open Access Journals (Sweden)

Concetta Vazzana

2011-02-01

Full Text Available Agricultural researchers widely recognise the importance of sustainable agricultural production systems and the need to develop appropriate methods to measure sustainability at the farm level. Policymakers need accounting and evaluation tools to be able to assess the potential of sustainable production practices and to provide appropriate agro-environmental policy measures. Farmers are in search of sustainable management tools to cope with regulations and enhance efficiency. This study proposes an indicator-based framework to evaluate sustainability of farming systems. Main features of the indicators’ framework are the relevance given to different spatial scales (farm, site and field, production and pedo-climatic factors, and a holistic view of the agro-ecosystem. The framework has been conceived to tackle different purposes ranging from detailed scientific analyses to farm-level management systems and cross-compliance. Agro-environmental indicators can be calculated, simulated with models or directly measured with different levels of detail proportionally to the aims of the evaluation exercise. The framework is organised in a number of environmental and production systems and sub-systems. For each system environmental critical points are identified with corresponding agro-environmental indicators and processing methods. A review of applications of the framework in Tuscany, Italy, since 1991 is presented. Applications range from prototyping farming systems, to integrated farm ecological-economic modelling, comparisons between organic, integrated and conventional farming systems, farm eco-management voluntary audit schemes and cross-compliance. Strengths and weaknesses of the framework are discussed against generic requirements of information systems and operational issues.

A framework for quantifying net benefits of alternative prognostic models

NARCIS (Netherlands)

Rapsomaniki, E.; White, I.R.; Wood, A.M.; Thompson, S.G.; Feskens, E.J.M.; Kromhout, D.

2012-01-01

New prognostic models are traditionally evaluated using measures of discrimination and risk reclassification, but these do not take full account of the clinical and health economic context. We propose a framework for comparing prognostic models by quantifying the public health impact (net benefit)

Organic food quality: a framework for concept, definition and evaluation from the European perspective.

Science.gov (United States)

Kahl, Johannes; Baars, Ton; Bügel, Susanne; Busscher, Nicolaas; Huber, Machteld; Kusche, Daniel; Rembiałkowska, Ewa; Schmid, Otto; Seidel, Kathrin; Taupier-Letage, Bruno; Velimirov, Alberta; Załecka, Aneta

2012-11-01

Consumers buy organic food because they believe in the high quality of the product. Furthermore, the EU legal regulatory framework for organic food and farming defines high quality of the products as an important goal of production. A major challenge is the need to define food quality concepts and methods for determination. A background is described which allows embedding of the quality definitions as well as evaluation methods into a conceptual framework connected to the vision and mission of organic agriculture and food production. Organic food quality is defined through specific aspects and criteria. For evaluation each criterion has to be described by indicators. The determination of indicators should be through parameters, where parameters are described by methods. Conversely, the conceptual framework is described according to underlying principles and starting definitions are given, but further work has do be done on the detailed scientific description of the indicators. Furthermore, parameters have to be defined for the evaluation of suitability of these indicators for organic food production. Copyright © 2012 Society of Chemical Industry.

Alternative Approaches in Evaluating the EU SME Policy: Answers to the Question of Impact and Legitimization

Directory of Open Access Journals (Sweden)

Robert K. GRUENWALD

2014-08-01

Findings:  OECD  and  EU  evaluations  do  not  determine  causal  relationships  between funding allocation and effects. The evaluations of the KfW and the German Ministry of Economics  use  an  empirical  quantitative  approach  and  determine  direct  causal relations. In  order to fulfil the requirements of legitimizing functions  for  the  SME  policy,  it  is  recommended  to  further  develop  the  EU  funding policy  and  evaluation  according  to  the  “German  model”  both  in  terms  of  the institutional  framework  and  in  terms  of  the  evaluation  of  impacts  through  funding policy measures. Definition  of  minimum  requirements  and  alternative possibilities  for  EU  SME  policy  evaluation  in  order  to  close  the  legitimisation  gap between the allocation of tax money and impact proof (cost-benefit ratio.

Evaluating Modeled Impact Metrics for Human Health, Agriculture Growth, and Near-Term Climate

Science.gov (United States)

Seltzer, K. M.; Shindell, D. T.; Faluvegi, G.; Murray, L. T.

2017-12-01

Simulated metrics that assess impacts on human health, agriculture growth, and near-term climate were evaluated using ground-based and satellite observations. The NASA GISS ModelE2 and GEOS-Chem models were used to simulate the near-present chemistry of the atmosphere. A suite of simulations that varied by model, meteorology, horizontal resolution, emissions inventory, and emissions year were performed, enabling an analysis of metric sensitivities to various model components. All simulations utilized consistent anthropogenic global emissions inventories (ECLIPSE V5a or CEDS), and an evaluation of simulated results were carried out for 2004-2006 and 2009-2011 over the United States and 2014-2015 over China. Results for O3- and PM2.5-based metrics featured minor differences due to the model resolutions considered here (2.0° × 2.5° and 0.5° × 0.666°) and model, meteorology, and emissions inventory each played larger roles in variances. Surface metrics related to O3 were consistently high biased, though to varying degrees, demonstrating the need to evaluate particular modeling frameworks before O3 impacts are quantified. Surface metrics related to PM2.5 were diverse, indicating that a multimodel mean with robust results are valuable tools in predicting PM2.5-related impacts. Oftentimes, the configuration that captured the change of a metric best over time differed from the configuration that captured the magnitude of the same metric best, demonstrating the challenge in skillfully simulating impacts. These results highlight the strengths and weaknesses of these models in simulating impact metrics related to air quality and near-term climate. With such information, the reliability of historical and future simulations can be better understood.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

NARCIS (Netherlands)

Peute, L. W.; Knijnenburg, S. L.; Kremer, L. C.; Jaspers, M. W. M.

2015-01-01

The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a

Using frameworks to diagram value in complex policy and environmental interventions to prevent childhood obesity.

Science.gov (United States)

Swank, Melissa Farrell; Brennan, Laura K; Gentry, Daniel; Kemner, Allison L

2015-01-01

To date, few tools assist policy makers and practitioners in understanding and conveying the implementation costs, potential impacts, and value of policy and environmental changes to address healthy eating, active living, and childhood obesity. For the Evaluation of Healthy Kids, Healthy Communities (HKHC), evaluators considered inputs (resources and investments) that generate costs and savings as well as benefits and harms related to social, economic, environmental, and health-related outcomes in their assessment of 49 HKHC community partnerships funded from 2009 to 2014. Using data collected through individual and group interviews and an online performance monitoring system, evaluators created a socioecological framework to assess investments, resources, costs, savings, benefits, and harms at the individual, organizational, community, and societal levels. Evaluators customized frameworks for 6 focal strategies: active transportation, parks and play spaces, child care physical activity standards, corner stores, farmers' markets, and child care nutrition standards. To illustrate the Value Frameworks, this brief highlights the 38 HKHC communities implementing at least 1 active transportation strategy. Evaluators populated this conceptual Value Framework with themes from the strategy-specific inputs and outputs. The range of factors corresponding to the implementation and impact of the HKHC community partnerships are highlighted along with the inputs and outputs. The Value Frameworks helped evaluators identify gaps in current analysis models (ie, benefit-cost analysis, cost-effectiveness analysis) as well as paint a more complete picture of value for potential obesity prevention strategies. These frameworks provide a comprehensive understanding of investments needed, proposed costs and savings, and potential benefits and harms associated with economic, social, environmental, and health outcomes. This framing also allowed evaluators to demonstrate the interdependence

Sustainability Evaluation Framework of Urban Stormwater Drainage Options for Arid Environments Using Hydraulic Modeling and Multicriteria Decision-Making

Directory of Open Access Journals (Sweden)

Mohammad Alhumaid

2018-04-01

Full Text Available Stormwater drainage systems in urban areas located in arid environmental regions generally consist of storm-sewer networks and man-made ponds for the collection and disposal of runoff, respectively. Due to expansion in cities’ boundaries as a result of population growth, the capacity of existing drainage systems has been exhausted. Therefore, such systems overflow even during the smaller (than the design return period floods. At the same time, changing rainfall patterns and flash floods due to climate change are other phenomena that need appropriate attention. Consequently, the municipalities in arid environmental regions are facing challenges for effective decision-making concerning (i improvement needs for drainage networks for safe collection of stormwater, (ii selection of most feasible locations for additional ponds, and (iii evaluation of other suitable options, such as micro-tunneling. In this research, a framework has been developed to evaluate different stormwater drainage options for urban areas of arid regions. Rainfall-runoff modeling was performed with the help of Hydrological-Engineering-Centre, Hydrological-Modelling-System (HEC-HMS. To evaluate the efficacy of each option for handling a given design flood, hydraulic-modeling was performed using SewerGEMS. Meteorological and topographical data was gathered from the Municipality of Buraydah and processed to generate different inputs required for hydraulic modeling. Finally, multicriteria decision-making (MCDM was performed to evaluate all the options on the basis of four sustainability criteria, i.e., flood risk, economic viability, environmental impacts, and technical constraints. Criteria weights were established through group decision-making using the Analytic Hierarchy Process (AHP. Preference-Ranking-Organization-Method for Enrichment-Evaluation (PROMETHEE II was used for final ranking of stormwater drainage options. The proposed framework has been implemented on a case of

Smoking cessation treatment and outcomes patterns simulation: a new framework for evaluating the potential health and economic impact of smoking cessation interventions.

Science.gov (United States)

Getsios, Denis; Marton, Jenő P; Revankar, Nikhil; Ward, Alexandra J; Willke, Richard J; Rublee, Dale; Ishak, K Jack; Xenakis, James G

2013-09-01

simulation predicting 19 % more smoking-related diseases and 10 % higher costs associated with smoking-related diseases. Differences are most prominent in predictions of the time that individuals abstain from smoking: 13.2 years on average over a lifetime allowing for multiple quit attempts, versus only 1.2 years with single quit attempts. Differences in abstinence time estimates become substantial only 5 years into the simulation. In the multiple quit attempt simulations, younger individuals survived longer, yet had lower lifetime smoking-related disease and total costs, while the opposite was true for those with high levels of nicotine dependence. By allowing for multiple quit attempts over the course of individuals' lives, the simulation can provide more reliable estimates on the health and economic impact of interventions designed to increase abstinence from smoking. Furthermore, the individual nature of the simulation allows for evaluation of outcomes in populations with different baseline profiles. DES provides a framework for comprehensive and appropriate predictions when applied to smoking cessation over smoker lifetimes.

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program.

Science.gov (United States)

Davis, LaShara A; Morgan, Susan E; Mobley, Amy R

2016-06-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported as memorable and the characteristics of those memorable messages. A convenience sample of low-income, primarily African American adults (N = 58) who previously completed a series of community nutrition education lessons within an urban area of Indiana participated in a focus group (N = 8 focus groups). A lead moderator using a semistructured script conducted the focus groups to determine what information about fruits and vegetables was most memorable from the participants' nutrition lessons and why this information was memorable. All focus group audiotapes were transcribed verbatim and ATLAS.ti software was used to code and identify themes within the data. Participants cited quantity, variety, and the positive nutritional impact of eating fruits and vegetables as most memorable. Information given in the form of recipes was also cited as most memorable. For example, participants referred to the recipe demonstrations as not only fun but also key components of the program that helped with message retention and memorability. Key characteristics of memorable messages included personal relevance and message vividness. These findings indicated that the Memorable Messages Framework may serve as an intermediary program evaluation tool to identify what information and messages are most influential to participants in community nutrition education programs. © 2015 Society for Public Health Education.

Evaluation of uncertainty in geological framework models at Yucca Mountain, Nevada

International Nuclear Information System (INIS)

Bagtzoglou, A.C.; Stirewalt, G.L.; Henderson, D.B.; Seida, S.B.

1995-01-01

The first step towards determining compliance with the performance objectives for both the repository system and the geologic setting at Yucca Mountain requires the development of detailed geostratigraphic models. This paper proposes an approach for the evaluation of the degree of uncertainty inherent in geologic maps and associated three-dimensional geological models. Following this approach, an assessment of accuracy and completeness of the data and evaluation of conceptual uncertainties in the geological framework models can be performed

Quality Evaluation of Zirconium Dioxide Frameworks Produced in Five Dental Laboratories from Different Countries.

Science.gov (United States)

Schneebeli, Esther; Brägger, Urs; Scherrer, Susanne S; Keller, Andrea; Wittneben, Julia G; Hicklin, Stefan P

2017-07-01

The aim of this study was to assess and compare quality as well as economic aspects of CAD/CAM high strength ceramic three-unit FDP frameworks ordered from dental laboratories located in emerging countries and Switzerland. The master casts of six cases were sent to five dental laboratories located in Thailand (Bangkok), China (Peking and Shenzhen), Turkey (Izmir), and Switzerland (Bern). Each laboratory was using a different CAD/CAM system. The clinical fit of the frameworks was qualitatively assessed, and the thickness of the framework material, the connector height, the width, and the diameter were evaluated using a measuring sensor. The analysis of the internal fit of the frameworks was performed by means of a replica technique, whereas the inner and outer surfaces of the frameworks were evaluated for traces of postprocessing and damage to the intaglio surface with light and electronic microscopes. Groups (dental laboratories and cases) were compared for statistically significant differences using Mann-Whitney U-tests after Bonferroni correction. An acceptable clinical fit was found at 97.9% of the margins produced in laboratory E, 87.5% in B, 93.7% in C, 79.2% in A, and 62.5% in D. The mean framework thicknesses were not statistically significantly different for the premolar regions; however, for the molar area 4/8 of the evaluated sites were statistically significantly different. Circumference, surface, and width of the connectors produced in the different laboratories were statistically significantly different but not the height. There were great differences in the designs for the pontic and connector regions, and some of the frameworks would not be recommended for clinical use. Traces of heavy postprocessing were found in frameworks from some of the laboratories. The prices per framework ranged from US$177 to US$896. By ordering laboratory work in developing countries, a considerable price reduction was obtained compared to the price level in Switzerland

Developing a monitoring and evaluation framework to integrate and formalize the informal waste and recycling sector: the case of the Philippine National Framework Plan.

Science.gov (United States)

Serrona, Kevin Roy B; Yu, Jeongsoo; Aguinaldo, Emelita; Florece, Leonardo M

2014-09-01

The Philippines has been making inroads in solid waste management with the enactment and implementation of the Republic Act 9003 or the Ecological Waste Management Act of 2000. Said legislation has had tremendous influence in terms of how the national and local government units confront the challenges of waste management in urban and rural areas using the reduce, reuse, recycle and recovery framework or 4Rs. One of the sectors needing assistance is the informal waste sector whose aspiration is legal recognition of their rank and integration of their waste recovery activities in mainstream waste management. To realize this, the Philippine National Solid Waste Management Commission initiated the formulation of the National Framework Plan for the Informal Waste Sector, which stipulates approaches, strategies and methodologies to concretely involve the said sector in different spheres of local waste management, such as collection, recycling and disposal. What needs to be fleshed out is the monitoring and evaluation component in order to gauge qualitative and quantitative achievements vis-a-vis the Framework Plan. In the process of providing an enabling environment for the informal waste sector, progress has to be monitored and verified qualitatively and quantitatively and measured against activities, outputs, objectives and goals. Using the Framework Plan as the reference, this article developed monitoring and evaluation indicators using the logical framework approach in project management. The primary objective is to institutionalize monitoring and evaluation, not just in informal waste sector plans, but in any waste management initiatives to ensure that envisaged goals are achieved. © The Author(s) 2014.

Evaluating violence reduction efforts in South Africa | IDRC ...

International Development Research Centre (IDRC) Digital Library (Canada)

2015-07-10

Jul 10, 2015 ... Evaluating complex violence reduction interventions poses a wide ... Skip to main content ... and local government aimed at evaluating the violence reduction impact of VPUU. Researchers reflect on the challenges of developing and implementing an evaluation framework to measure the impact of this joint ...

Evolution of the discharge impact assessments in the French regulation framework

International Nuclear Information System (INIS)

Chartier, M.; Despres, A.; Guillaume, R.; Plazanic, P.; Supervil, S.; Hubert, P.

2000-01-01

The French regulation on discharge authorisation procedures has been modified in 1995. The French authorities are thus committed to re-examined the discharge authorisations for all French nuclear installations. A new examination of discharge authorisations is in progress. The authorisations to discharge liquid and gaseous effluents had been granted at the time of the development of the nuclear installations (power plants, laboratories, facilities) according to a procedure defined in 1976. The recommendations of the ICRP expressed in the publication n deg 60, endorsed for the main part of them by the 1996 European, modified the concept of > for discharges, inter alia with an increased stress on optimisation. This evolution is consistent with the French low which does not recognise the right to pollute but defines a regime of authorisations which are always revocable. Consequently, the French authorities committed themselves to reductions of discharge limits as low as possible, at economically affordable cost. Since 1976, the evolutions of the principles of radiation protection for populations and of the French regulation together with the experience of 25 years of operations yielded significant changes of the approach of radiological impact assessments used in the regulation framework. This paper discuss and illustrate these changes: 1. Differences between the situation in 1976 (installations were planned) and now (most installations have operated since several years or tens of years) are first put forward: discharged activities, compositions of the effluents, variations of the discharges and their grounds are now better understood; techniques to reduce discharges have been developed. The opportunities in terms of discharge reductions and accuracy of radiological impact assessment are underlined. 2. Main characteristics of the bases of the radiological impact assessments used in the French regulation framework are then described: identification of existing reference

Applying a Framework to Evaluate Assignment Marking Software: A Case Study on Lightwork

Science.gov (United States)

Heinrich, Eva; Milne, John

2012-01-01

This article presents the findings of a qualitative evaluation on the effect of a specialised software tool on the efficiency and quality of assignment marking. The software, Lightwork, combines with the Moodle learning management system and provides support through marking rubrics and marker allocations. To enable the evaluation a framework has…

Development and application of the RE-AIM QuEST mixed methods framework for program evaluation.

Science.gov (United States)

Forman, Jane; Heisler, Michele; Damschroder, Laura J; Kaselitz, Elizabeth; Kerr, Eve A

2017-06-01

To increase the likelihood of successful implementation of interventions and promote dissemination across real-world settings, it is essential to evaluate outcomes related to dimensions other than Effectiveness alone. Glasgow and colleagues' RE-AIM framework specifies four additional types of outcomes that are important to decision-makers: Reach, Adoption, Implementation (including cost), and Maintenance. To further strengthen RE-AIM, we propose integrating qualitative assessments in an expanded framework: RE-AIM Qualitative Evaluation for Systematic Translation (RE-AIM QuEST), a mixed methods framework. RE-AIM QuEST guides formative evaluation to identify real-time implementation barriers and explain how implementation context may influence translation to additional settings. RE-AIM QuEST was used to evaluate a pharmacist-led hypertension management intervention at 3 VA facilities in 2008-2009. We systematically reviewed each of the five RE-AIM dimensions and created open-ended companion questions to quantitative measures and identified qualitative and quantitative data sources, measures, and analyses. To illustrate use of the RE-AIM QuEST framework, we provide examples of real-time, coordinated use of quantitative process measures and qualitative methods to identify site-specific issues, and retrospective use of these data sources and analyses to understand variation across sites and explain outcomes. For example, in the Reach dimension, we conducted real-time measurement of enrollment across sites and used qualitative data to better understand and address barriers at a low-enrollment site. The RE-AIM QuEST framework may be a useful tool for improving interventions in real-time, for understanding retrospectively why an intervention did or did not work, and for enhancing its sustainability and translation to other settings.

A user-centred evaluation framework for the Sealife semantic web browsers.

Science.gov (United States)

Oliver, Helen; Diallo, Gayo; de Quincey, Ed; Alexopoulou, Dimitra; Habermann, Bianca; Kostkova, Patty; Schroeder, Michael; Jupp, Simon; Khelif, Khaled; Stevens, Robert; Jawaheer, Gawesh; Madle, Gemma

2009-10-01

Semantically-enriched browsing has enhanced the browsing experience by providing contextualized dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure. This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system. It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers. Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.

A Review of Telehealth Service Implementation Frameworks

Directory of Open Access Journals (Sweden)

Liezl Van Dyk

2014-01-01

Full Text Available Despite the potential of telehealth services to increase the quality and accessibility of healthcare, the success rate of such services has been disappointing. The purpose of this paper is to find and compare existing frameworks for the implementation of telehealth services that can contribute to the success rate of future endeavors. After a thorough discussion of these frameworks, this paper outlines the development methodologies in terms of theoretical background, methodology and validation. Finally, the common themes and formats are identified for consideration in future implementation. It was confirmed that a holistic implementation approach is needed, which includes technology, organizational structures, change management, economic feasibility, societal impacts, perceptions, user-friendliness, evaluation and evidence, legislation, policy and governance. Furthermore, there is some scope for scientifically rigorous framework development and validation approaches.

Evaluate, assess, treat: development and evaluation of the EAT framework to increase effective communication regarding sensitive oral-systemic health issues.

Science.gov (United States)

DeBate, R D; Cragun, D; Gallentine, A A; Severson, H H; Shaw, T; Cantwell, C; Christiansen, S; Koerber, A; Hendricson, W; Tomar, S L; McCormack Brown, K; Tedesco, L A

2012-11-01

Oral healthcare providers are likely to encounter a number of sensitive oral/systemic health issues whilst interacting with patients. The purpose of the current study was to develop and evaluate a framework aimed at oral healthcare providers to engage in active secondary prevention of eating disorders (i.e. early detection of oral manifestations of disordered eating behaviours, patient approach and communication, patient-specific oral treatment, and referral to care) for patients presenting with signs of disordered eating behaviours. The EAT Framework was developed based on the Brief Motivational Interviewing (B-MI) conceptual framework and comprises three continuous steps: Evaluating, Assessing, and Treating. Using a group-randomized control design, 11 dental hygiene (DH) and seven dental (D) classes from eight institutions were randomized to either the intervention or control conditions. Both groups completed pre- and post-intervention assessments. Hierarchical linear models were conducted to measure the effects of the intervention whilst controlling for baseline levels. Statistically significant improvements from pre- to post-intervention were observed in the Intervention group compared with the Control group on knowledge of eating disorders and oral findings, skills-based knowledge, and self-efficacy (all P oral/systemic health issues. Because the EAT Framework was developed by translating B-MI principles and procedures, the framework can be easily adopted as a non-confrontational method for patient communication. © 2012 John Wiley & Sons A/S.

An evaluation of the environmental impact assessment system in Vietnam: The gap between theory and practice

International Nuclear Information System (INIS)

Clausen, Alison; Vu, Hoang Hoa; Pedrono, Miguel

2011-01-01

Vietnam has one of the fastest growing economies in the world and has achieved significant socio-economic development in recent years. However this growth is placing increased pressure on an already depleted natural environment. Environmental impact assessment (EIA) is recognised by the Government and international organizations as an important tool in the management of the impacts of future development on the country's natural resource base. The Government's commitment to EIA has been demonstrated through the development and adoption of the Law on Environment Protection (Revised) in 2005 which sets out the requirements for EIA and which represents a major step in the development of a robust legislative framework for EIA in Vietnam. The Law on Environment Protection (Revised) 2005 has now been operational for several years and we have undertaken an evaluation of the resulting EIA system in Vietnam. We argue that while significant improvements have been achieved in the EIA policy framework, an important gap remains between EIA theory and practice. We contend that the basis of the current EIA legislation is strong and that future developments of the EIA system in Vietnam should focus on improving capacity of EIA practitioners rather than further substantial legislative change. Such improvements would allow the Vietnamese EIA system to emerge as an effective and efficient tool for environmental management in Vietnam and as a model EIA framework for other developing countries.

Evaluating the Impact of Teacher Professional Development: An Evidence-Based Framework

Science.gov (United States)

King, Fiona

2014-01-01

Does teacher professional development make a difference? How do we know? While researchers and policy-makers acknowledge that teacher professional development (PD) needs to be assessed and evaluated, there is often little clarity as to how this can be achieved. Evaluation of teacher PD by schools has been described as the weak link in the PD chain…

A conceptual framework to evaluate human-wildlife interactions within coupled human and natural systems

Directory of Open Access Journals (Sweden)

Anita T. Morzillo

2014-09-01

Full Text Available Landscape characteristics affect human-wildlife interactions. However, there is a need to better understand mechanisms that drive those interactions, particularly feedbacks that exist between wildlife-related impacts, human reaction to and behavior as a result of those impacts, and how land use and landscape characteristics may influence those components within coupled human and natural systems. Current conceptual models of human-wildlife interactions often focus on species population size as the independent variable driving those interactions. Such an approach potentially overlooks important feedbacks among and drivers of human-wildlife interactions that result from mere wildlife presence versus absence. We describe an emerging conceptual framework that focuses on wildlife as a driver of human behavior and allows us to better understand linkages between humans, wildlife, and the broader landscape. We also present results of a pilot analysis related to our own ongoing study of urban rodent control behavior to illustrate one application of this framework within a study of urban landscapes.

A Comprehensive Diagnostic Framework for Evaluating Business Intelligence and Analytics Effectiveness

Directory of Open Access Journals (Sweden)

Neil Foshay

2015-09-01

Full Text Available Business intelligence and analytics (BIA initiatives are costly, complex and experience high failure rates. Organizations require effective approaches to evaluate their BIA capabilities in order to develop strategies for their evolution. In this paper, we employ a design science paradigm to develop a comprehensive BIA effectiveness diagnostic (BIAED framework that can be easily operationalized. We propose that a useful BIAED framework must assess the correct factors, should be deployed in the proper process context and acquire the appropriate input from different constituencies within an organization. Drawing on the BIAED framework, we further develop an online diagnostic toolkit that includes a comprehensive survey instrument. We subsequently deploy the diagnostic mechanism within three large organizations in North America (involving over 1500 participants and use the results to inform BIA strategy formulation. Feedback from participating organizations indicates that BIA diagnostic toolkit provides insights that are essential inputs to strategy development. This work addresses a significant research gap in the area of BIA effectiveness assessment.

Elements to evaluate the intention in the non-compliance s or violations to the regulatory framework in the national nuclear facilities

International Nuclear Information System (INIS)

Espinosa V, J. M.; Gonzalez V, J. A.

2013-10-01

Inside the impact evaluation process to the safety of non-compliance s or violations, developed and implanted by the Comision Nacional de Seguridad Nuclear y Salvaguardias (CNSNS), the Guide for the Impact Evaluation to the Safety in the National Nuclear Facilities by Non-compliance s or Violations to the Regulatory Framework was developed, which indicates that in the determination of the severity (graveness level) of a non-compliance or violation, four factors are evaluated: real and potential consequences to the safety, the impact to the regulator process and the intention. The non-compliance s or intentional violations are of particular interest, since the development of the regulatory activities of the CNSNS considers that the personnel of the licensees, as well as their contractors, will act and will communicate with integrity and honesty. The CNSNS cannot tolerate intentional non-compliance s, for what this violations type can be considered of a level of more graveness that the subjacent non-compliance. To determine the severity of a violation that involves intention, the CNSNS also took in consideration factors as the position and the personnel's responsibilities involved in the violation, the graveness level of the non-compliance in itself, the offender's intention and the possible gain that would produce the non-compliance, if exists, either economic or of another nature. The CNSNS hopes the licensees take significant corrective actions in response to non-compliance s or intentional violations, these corrective actions should correspond to the violation graveness with the purpose of generating a dissuasive effect in the organizations of the licensees. The present article involves the legal framework that confers the CNSNS the attributions to impose administrative sanctions to its licensees, establishes the definition of the CNSNS about what constitutes a non-compliance or intentional violation and finally indicates the intention types (deliberate or

Evaluating the effectiveness of impact assessment instruments

DEFF Research Database (Denmark)

Cashmore, Matthew; Richardson, Tim; Hilding-Ryedvik, Tuija

2010-01-01

to sharpen effectiveness evaluation theory for impact assessment instruments this article critically examines the neglected issue of their political constitution. Analytical examples are used to concretely explore the nature and significance of the politicisation of impact assessment. It is argued......The central role of impact assessment instruments globally in policy integration initiatives has been cemented in recent years. Associated with this trend, but also reflecting political emphasis on greater accountability in certain policy sectors and a renewed focus on economic competitiveness...... that raising awareness about the political character of impact assessment instruments, in itself, is a vital step in advancing effectiveness evaluation theory. Broader theoretical lessons on the framing of evaluation research are also drawn from the political analysis. We conclude that, at least within...

Development of a Geomorphology-Based Framework for Cultural Resources Management, Dworshak Reservoir, Idaho

National Research Council Canada - National Science Library

Corcoran, Maureen

2001-01-01

The U.S. Army Engineer Research and Development Center developed a technical framework for identifying, evaluating, and mitigating impacts to cultural resource sites affected by reservoir operation in the Columbia River System...

A framework for evaluating hydrogen control and management

International Nuclear Information System (INIS)

Lee, Seung Dong; Suh, Kune Yul; Jae, Moosung

2003-01-01

The present paper presents a new framework for assessing accident management strategies using decision trees. The containment event tree (CET) model considers characteristics associated with the implementation of each strategy. It is constructed and quantified using data obtained from NUREG-1150, other probabilistic risk assessments, and the MAAP4 calculations. The proposed framework for evaluating hydrogen control strategies is based on the concept of a measure using a risk triplet. Ulchin units of nuclear power plants 3 and 4 are used as the reference plant. On the basis of best-estimate assessment, it is shown that it is beneficial to execute hydrogen igniters rather than to do nothing with respect to expected value of hydrogen concentration in the containment during an accident. The proposed approach is shown to be flexible in that it can be applied to various accident management strategies based on the timing of mitigation. The advantage of using the CET for assessing an accident management strategy lies with its capability for modeling both the positive and negative aspects associated with progression of the accident, which may in turn affect the containment failure mode

The evaluation framework for business process management methodologies

Directory of Open Access Journals (Sweden)

Sebastian Lahajnar

2016-06-01

Full Text Available In an intense competition in the global market, organisations seek to take advantage of all their internal and external potentials, advantages, and resources. It has been found that, in addition to competitive products and services, a good business also requires an effective management of business processes, which is the discipline of the business process management (BPM. The introduction of the BPM in the organisation requires a thoughtful selection of an appropriate methodological approach, since the latter will formalize activities, products, applications and other efforts of the organisation in this field. Despite many technology-driven solutions of software companies, recommendations of consulting companies, techniques, good practices and tools, the decision on what methodology to choose is anything but simple. The aim of this article is to simplify the adoption of such decisions by building a framework for the evaluation of BPM methodologies according to a qualitative multi-attribute decision-making method. The framework defines a hierarchical decision-making model, formalizes the decision-making process and thus contributes significantly to an independent, credible final decision that is the most appropriate for a specific organisation.

Issues and major steps in a conceptual framework for environmental costing

International Nuclear Information System (INIS)

DePape, D.; Kristjanson, E.R.; Onyebuchi, E.I.; Wojczynski, E.

1992-01-01

The concept of applying monetary values to environmental consequences as a means of integrating environmental considerations into utility resource planning is explored. The need for estimation and integration of environmental costs and benefits is becoming more important due to public concern over environmental degradation, rapidly increasing costs of mitigating environmental damage, increased liability for compensation for such damage, pressures to consider environmental externalities, and a corporate desire to operate responsibly. Manitoba Hydro established a task force to develop general approaches and specific techniques for evaluation and integration of environmental costs and benefits into utility planning. The utility's conceptual framework for monetizing and integrating environmental costs and benefits is described, including identification of potential environmental impacts, evaluation of environmental impacts, estimation of monetary and non-monetary costs and benefits, and integration of these costs and benefits into the resource planning process. Key issues that must be addressed to implement this conceptual framework include the need for earlier environmental impact assessments and the need for mitigation and compensation prediction methodologies. 1 fig., 1 tab

Evaluation of the usefulness of ecological simulation models in power plant impact assessment

International Nuclear Information System (INIS)

Swartzman, G.L.; Haar, R.T.; McKenzie, D.H.

1981-05-01

Comparisons were made of the equations, rationale, data sources and parameter values of 26 simulation models of fish and zooplankton population dynamics and energetics and results were compared in standard notation and units, process by process. The major process categories considered were consumption, predation, metabolic processes, assimilation, growth, fecundity, recruitment and mortality. A model simulation language, AEGIS (Aquatic Ecosystem General Impact Simulator) was built to compare model equations process by process allowing convenient interchange of model equations for any process module. This simulator was parameterized to a test site, Lake Keowee, South Carolina, on which resides the Oconee Nuclear Power Station. Model parameter estimation and comparison of these models with biological monitoring data allows eveluation of ecosystem models from the standpoint of prediction of behavior under normal and perturbed conditions, organization of data into an ecosystem framework, and evaluation of data to address impact questions

Evaluating and measuring impact: where and how?

CERN Multimedia

Antonella Del Rosso

2015-01-01

On 12 and 13 November, a workshop on “Evaluation in international organisations” took place at CERN. Fourteen internal auditors and planning and policy analysts, from six different international organisations, discussed whether and how to evaluate the impact of their organisations’ programmes on the target beneficiaries.      Participants of the “Evaluation in international organisations” workshop at CERN. “Evaluation”, a relatively recent but fast growing discipline, deals with the systematic and objective assessment of the impact of policies and programmes on the target beneficiaries – often society at large. In the past few years, other international organisations have created an evaluation function within their internal structure, whose role is to measure the impact of their public policies. “In the first instance we wanted to understand what the difference between evaluation a...

How Do Surgery Students Use Written Language to Say What They See? A Framework to Understand Medical Students' Written Evaluations of Their Teachers.

Science.gov (United States)

Lim, David W; White, Jonathan S

2015-11-01

There remains debate regarding the value of the written comments that medical students are traditionally asked to provide to evaluate the teaching they receive. The purpose of this study was to examine written teaching evaluations to understand how medical students conceptualize teachers' behaviors and performance. All written comments collected from medical students about teachers in the two surgery clerkships at the University of Alberta in 2009-2010 and 2010-2011 were collated and anonymized. A grounded theory approach was used for analysis, with iterative reading and open coding to identify recurring themes. A framework capturing variations observed in the data was generated until data saturation was achieved. Domains and subdomains were named using an in situ coding approach. The conceptual framework contained three main domains: "Physician as Teacher," "Physician as Person," and "Physician as Physician." Under "Physician as Teacher," students commented on specific acts of teaching and subjective perceptions of an educator's teaching values. Under the "Physician as Physician" domain, students commented on elements of their educator's physicianship, including communication and collaborative skills, medical expertise, professionalism, and role modeling. Under "Physician as Person," students commented on how both positive and negative personality traits impacted their learning. This framework describes how medical students perceive their teachers and how they use written language to attach meaning to the behaviors they observe. Such a framework can be used to help students provide more constructive feedback to teachers and to assist in faculty development efforts aimed at improving teaching performance.

E-Competent Australia: Report on the Impact of E-Commerce on the National Training Framework.

Science.gov (United States)

Mitchell, John

The impact of electronic commerce (e-commerce) on Australia's National Training Framework (NTF) was studied for the purpose of forecasting future demand for training in areas related to e-commerce and identifying appropriate responses by the NTF committee. The following were among the study's main data collection activities: reviews of the…

Framework for Testing the Effectiveness of Bat and Eagle Impact-Reduction Strategies at Wind Energy Projects

Energy Technology Data Exchange (ETDEWEB)

Sinclair, Karin [National Renewable Energy Lab. (NREL), Golden, CO (United States); DeGeorge, Elise [National Renewable Energy Lab. (NREL), Golden, CO (United States)

2016-04-13

The objectives of this framework are to facilitate the study design and execution to test the effectiveness of bat and eagle impact-reduction strategies at wind energy sites. Through scientific field research, the wind industry and its partners can help determine if certain strategies are ready for operational deployment or require further development. This framework should be considered a living document to be improved upon as fatality-reduction technologies advance from the initial concepts to proven readiness (through project- and technology-specific testing) and as scientific field methods improve.

A bi-level environmental impact assessment framework for comparing construction and demolition waste management strategies.

Science.gov (United States)

Yazdanbakhsh, Ardavan

2018-04-27

Several pioneering life cycle assessment (LCA) studies have been conducted in the past to assess the environmental impact of specific methods for managing mineral construction and demolition waste (MCDW), such as recycling the waste for use in concrete. Those studies focus on comparing the use of recycled MCDW and that of virgin components to produce materials or systems that serve specified functions. Often, the approaches adopted by the studies do not account for the potential environmental consequence of avoiding the existing or alternative waste management practices. The present work focuses on how product systems need to be defined in recycling LCA studies and what processes need to be within the system boundaries. A bi-level LCA framework is presented for modelling alternative waste management approaches in which the impacts are measured and compared at two scales of strategy and decision-making. Different functional units are defined for each level, all of which correspond to the same flow of MCDW in a cascade of product systems. For the sole purpose of demonstrating how the framework is implemented an illustrative example is presented, based on real data and a number of simplifying assumptions, which compares the impacts of a number of potential MCDW management strategies in New York City. Copyright © 2018 Elsevier Ltd. All rights reserved.

Creating Evaluation Profiles for Games Designed to be Fun: An Interpretive Framework for Serious Game Mechanics

DEFF Research Database (Denmark)

Ulrich, Frank; Helms, Niels Henrik

2017-01-01

Background. Games can be great pedagogical tools for educators and students. COTS games (commercialoff-the-shelf) are designed for the pure purpose of leisure but can also contain educational value. Aim. In this paper, we address the potential of COTS games as serious games. We develop...... an interpretive evaluation framework that can identify the educational value in COTS games. Application. The presented framework can create evaluative profiles of the learning, social, game, and immersive mechanics of COTS games as educational tools. Moreover, the framework can position COTS games between four...... enables critical reflection on the game mechanics; thereby capturing the complexity of the game mechanics that makes COTS game both educational and fun to play....

The Social Outcomes of Older Adult Learning in Taiwan: Evaluation Framework and Indicators

Science.gov (United States)

Lin, Li-Hui

2015-01-01

The purpose of this study is to explore the social outcomes of older adult learning in Taiwan. In light of our society's aging population structure, the task of establishing evaluation framework and indicators for the social outcomes of learning (SOL) as applied to older adults is urgent. In order to construct evaluation indicators for older adult…

Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas

Directory of Open Access Journals (Sweden)

Webber Daniel

2008-04-01

Full Text Available Abstract Background In recent years a wide variety of epidemiological surveillance systems have been developed to provide early identification of outbreaks of infectious disease. Each system has had its own strengths and weaknesses. In 2002 a Working Group of the Centers for Disease Control and Prevention (CDC produced a framework for evaluation, which proved suitable for many public health surveillance systems. However this did not easily adapt to the military setting, where by necessity a variety of different parameters are assessed, different constraints placed on the systems, and different objectives required. This paper describes a proposed framework for evaluation of military syndromic surveillance systems designed to detect outbreaks of disease on operational deployments. Methods The new framework described in this paper was developed from the cumulative experience of British and French military syndromic surveillance systems. The methods included a general assessment framework (CDC, followed by more specific methods of conducting evaluation. These included Knowledge/Attitude/Practice surveys (KAP surveys, technical audits, ergonomic studies, simulations and multi-national exercises. A variety of military constraints required integration into the evaluation. Examples of these include the variability of geographical conditions in the field, deployment to areas without prior knowledge of naturally-occurring disease patterns, the differences in field sanitation between locations and over the length of deployment, the mobility of military forces, turnover of personnel, continuity of surveillance across different locations, integration with surveillance systems from other nations working alongside each other, compatibility with non-medical information systems, and security. Results A framework for evaluation has been developed that can be used for military surveillance systems in a staged manner consisting of initial, intermediate and final

A framework for combining social impact assessment and risk assessment

Energy Technology Data Exchange (ETDEWEB)

Mahmoudi, Hossein, E-mail: mahmoudi@uni-hohenheim.de [Department of Social Sciences in Agriculture, University of Hohenheim (Germany); Environmental Sciences Research Institute, Shahid Beheshti University, G.C. (Iran, Islamic Republic of); Renn, Ortwin [Department of Technology and Environmental Sociology (and DIALOGIK), University of Stuttgart (Germany); Vanclay, Frank [Department of Cultural Geography, Faculty of Spatial Sciences, University of Groningen, Groningen (Netherlands); Hoffmann, Volker [Department of Social Sciences in Agriculture, University of Hohenheim (Germany); Karami, Ezatollah [College of Agriculture, Shiraz University, Shiraz (Iran, Islamic Republic of)

2013-11-15

An increasing focus on integrative approaches is one of the current trends in impact assessment. There is potential to combine impact assessment with various other forms of assessment, such as risk assessment, to make impact assessment and the management of social risks more effective. We identify the common features of social impact assessment (SIA) and social risk assessment (SRA), and discuss the merits of a combined approach. A hybrid model combining SIA and SRA to form a new approach called, ‘risk and social impact assessment’ (RSIA) is introduced. RSIA expands the capacity of SIA to evaluate and manage the social impacts of risky projects such as nuclear energy as well as natural hazards and disasters such as droughts and floods. We outline the three stages of RSIA, namely: impact identification, impact assessment, and impact management. -- Highlights: • A hybrid model to combine SIA and SRA namely RSIA is proposed. • RSIA can provide the proper mechanism to assess social impacts of natural hazards. • RSIA can play the role of ex-post as well as ex-ante assessment. • For some complicated and sensitive cases like nuclear energy, conducting a RSIA is necessary.

A framework for combining social impact assessment and risk assessment

International Nuclear Information System (INIS)

Mahmoudi, Hossein; Renn, Ortwin; Vanclay, Frank; Hoffmann, Volker; Karami, Ezatollah

2013-01-01

An increasing focus on integrative approaches is one of the current trends in impact assessment. There is potential to combine impact assessment with various other forms of assessment, such as risk assessment, to make impact assessment and the management of social risks more effective. We identify the common features of social impact assessment (SIA) and social risk assessment (SRA), and discuss the merits of a combined approach. A hybrid model combining SIA and SRA to form a new approach called, ‘risk and social impact assessment’ (RSIA) is introduced. RSIA expands the capacity of SIA to evaluate and manage the social impacts of risky projects such as nuclear energy as well as natural hazards and disasters such as droughts and floods. We outline the three stages of RSIA, namely: impact identification, impact assessment, and impact management. -- Highlights: • A hybrid model to combine SIA and SRA namely RSIA is proposed. • RSIA can provide the proper mechanism to assess social impacts of natural hazards. • RSIA can play the role of ex-post as well as ex-ante assessment. • For some complicated and sensitive cases like nuclear energy, conducting a RSIA is necessary

An Approach to a Comprehensive Test Framework for Analysis and Evaluation of Text Line Segmentation Algorithms

Directory of Open Access Journals (Sweden)

Zoran N. Milivojevic

2011-09-01

Full Text Available The paper introduces a testing framework for the evaluation and validation of text line segmentation algorithms. Text line segmentation represents the key action for correct optical character recognition. Many of the tests for the evaluation of text line segmentation algorithms deal with text databases as reference templates. Because of the mismatch, the reliable testing framework is required. Hence, a new approach to a comprehensive experimental framework for the evaluation of text line segmentation algorithms is proposed. It consists of synthetic multi-like text samples and real handwritten text as well. Although the tests are mutually independent, the results are cross-linked. The proposed method can be used for different types of scripts and languages. Furthermore, two different procedures for the evaluation of algorithm efficiency based on the obtained error type classification are proposed. The first is based on the segmentation line error description, while the second one incorporates well-known signal detection theory. Each of them has different capabilities and convenience, but they can be used as supplements to make the evaluation process efficient. Overall the proposed procedure based on the segmentation line error description has some advantages, characterized by five measures that describe measurement procedures.

The social strategy cone: Towards a framework for evaluating social media strategies

NARCIS (Netherlands)

Effing, Robin; Spil, Antonius A.M.

2016-01-01

Social media is growing rapidly. Providing both risks and opportunities for organizations as it does. The social strategy cone is developed for evaluating social media strategies. This framework comprises of seven key elements of social media strategies as based on a systematic literature review and

Assessing the impact of renewable energy deployment on local sustainability: Towards a theoretical framework

Energy Technology Data Exchange (ETDEWEB)

del Rio, Pablo [Facultad de Ciencias Juridicas y Sociales de Toledo, Universidad de Castilla-La Mancha, C/Cobertizo de S. Pedro Martir s/n, Toledo-45071 (Spain); Burguillo, Mercedes [Facultad de Ciencias Economicas y Empresariales, Universidad de Alcala, Pza. de la Victoria 3, 28802 Alcala de Henares, Madrid (Spain)

2008-06-15

Renewable energy sources (RES) have a large potential to contribute to the sustainable development (SD) of specific territories by providing them with a wide variety of socioeconomic and environmental benefits. However, the existing literature has put much emphasis on the environmental benefits (including the reduction of global and local pollutants), while socioeconomic impacts have not received a comparable attention. These include diversification of energy supply, enhanced regional and rural development opportunities, creation of a domestic industry and employment opportunities. With the exception of the diversification and security of energy supply, these benefits have usually been mentioned, but their analysis has been too general (i.e., mostly at the national level) and a focus on the regional and, even more so, the local level, has been lacking. At most, studies provide scattered evidence of some of those regional and local benefits, but without an integrated conceptual framework to analyse them. This paper tries to make a contribution in this regard by developing an integrated theoretical framework which allows a comprehensive analysis of the impact of renewable energy on local sustainability and which can be empirically applied to identify these benefits in different territories. (author)

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Impact evaluation of infrastructure interventions

DEFF Research Database (Denmark)

Hansen, Henrik; Andersen, Ole Winckler; White, Howard

2011-01-01

in this volume. Understanding impact means understanding the context in which an intervention takes place and the channels through which the impact on outcomes is expected to occur. Such analysis typically requires mixing both quantitative and qualitative approaches. The analysis will also anticipate......The focus on results in development agencies has led to increased focus on impact evaluation to demonstrate the effectiveness of development programmes. A range of methods are available for counterfactual analysis of infrastructure interventions, as illustrated by the variety of papers...

Basic Test Framework for the Evaluation of Text Line Segmentation and Text Parameter Extraction

Directory of Open Access Journals (Sweden)

Darko Brodić

2010-05-01

Full Text Available Text line segmentation is an essential stage in off-line optical character recognition (OCR systems. It is a key because inaccurately segmented text lines will lead to OCR failure. Text line segmentation of handwritten documents is a complex and diverse problem, complicated by the nature of handwriting. Hence, text line segmentation is a leading challenge in handwritten document image processing. Due to inconsistencies in measurement and evaluation of text segmentation algorithm quality, some basic set of measurement methods is required. Currently, there is no commonly accepted one and all algorithm evaluation is custom oriented. In this paper, a basic test framework for the evaluation of text feature extraction algorithms is proposed. This test framework consists of a few experiments primarily linked to text line segmentation, skew rate and reference text line evaluation. Although they are mutually independent, the results obtained are strongly cross linked. In the end, its suitability for different types of letters and languages as well as its adaptability are its main advantages. Thus, the paper presents an efficient evaluation method for text analysis algorithms.

Social Issue Entertainment 2.0: How pop culture, behavioral science and impact evaluation can motivate social and environmental change (Invited)

Science.gov (United States)

Shome, D.

2010-12-01

three broad categories (comprehension, attitude, response) for evaluation. This framework accommodates evaluation standards developed across the academic, policy, nonprofit, and commercial worlds and offers a framework for assessing the outcomes and impact of media. I will discuss why narrative and storytelling are the missing links to impactful messaging, why impact evaluation is vital, and how the Harmony Institute’s unique methodology incorporates social and environmental messaging into narrative using behavioral science theory.

Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK

Science.gov (United States)

Rienties, Bart; Boroowa, Avinash; Cross, Simon; Kubiak, Chris; Mayles, Kevin; Murphy, Sam

2016-01-01

There is an urgent need to develop an evidence-based framework for learning analytics whereby stakeholders can manage, evaluate, and make decisions about which types of interventions work well and under which conditions. In this article, we will work towards developing a foundation of an Analytics4Action Evaluation Framework (A4AEF) that is…

Upgrade in the CNSNS of the determination process about the importance for the impact evaluation to the safety of defaults or violations in the national nuclear facilities

International Nuclear Information System (INIS)

Espinosa V, J. M.; Jauregui Ch, V.

2014-10-01

Inside the process of Impact Evaluation to the Safety of the Direccion General Adjunta de Seguridad Nuclear of the Comision Nacional de Seguridad Nuclear y Salvaguardias (CNSNS) the Significance Determination Process (SDP) is used, developed by the United States Nuclear Regulatory Commission (US NRC), to evaluate the violations or defaults to the regulatory framework and to determine its importance to the risk by means of a fixed color: Green (Very low impact to the safety), White (Low impact to moderate to the safety), Yellow (Substantial impact to the safety) or Red (High impact to the safety). All this inside the seven safety foundations of the Reactor Oversight Process: Initiator Events, Mitigation Systems, Integrity of the Barriers, Preparation for Emergencies, Occupational Radiological Safety, Radiological Safety of the Public and Physical Safety. At present the US NRC has developed a new version of the SDP, which presents changes in its structure and the opportunity of carrying out informed evaluations in risk, with more detail about the violations or defaults that happen in different areas. The CNSNS carries out the adaptation of this last version of the SDP in order to have an updated tool for the violations and defaults characterization to the regulatory framework happened in the nuclear power plant of Laguna Verde. In this article is mentioned the legal framework that confers the CNSNS the attributions to impose urgency measures and administrative sanctions to its licensees, also is established the definition of the different colors that the SDP contemplates in function of the increased risk (ΔCdf), a description of the SDP objectives and the elements that conform it is presented, in the same way some examples to illustrate its application are raised. Finally, the steps to continue for their implementation are mentioned. (Author)

Integration of electro-anatomical and imaging data of the left ventricle: An evaluation framework.

Science.gov (United States)

Soto-Iglesias, David; Butakoff, Constantine; Andreu, David; Fernández-Armenta, Juan; Berruezo, Antonio; Camara, Oscar

2016-08-01

Integration of electrical and structural information for scar characterization in the left ventricle (LV) is a crucial step to better guide radio-frequency ablation therapies, which are usually performed in complex ventricular tachycardia (VT) cases. This integration requires finding a common representation where to map the electrical information from the electro-anatomical map (EAM) surfaces and tissue viability information from delay-enhancement magnetic resonance images (DE-MRI). However, the development of a consistent integration method is still an open problem due to the lack of a proper evaluation framework to assess its accuracy. In this paper we present both: (i) an evaluation framework to assess the accuracy of EAM and imaging integration strategies with simulated EAM data and a set of global and local measures; and (ii) a new integration methodology based on a planar disk representation where the LV surface meshes are quasi-conformally mapped (QCM) by flattening, allowing for simultaneous visualization and joint analysis of the multi-modal data. The developed evaluation framework was applied to estimate the accuracy of the QCM-based integration strategy on a benchmark dataset of 128 synthetically generated ground-truth cases presenting different scar configurations and EAM characteristics. The obtained results demonstrate a significant reduction in global overlap errors (50-100%) with respect to state-of-the-art integration techniques, also better preserving the local topology of small structures such as conduction channels in scars. Data from seventeen VT patients were also used to study the feasibility of the QCM technique in a clinical setting, consistently outperforming the alternative integration techniques in the presence of sparse and noisy clinical data. The proposed evaluation framework has allowed a rigorous comparison of different EAM and imaging data integration strategies, providing useful information to better guide clinical practice in

Assessing Students' Understandings of Biological Models and Their Use in Science to Evaluate a Theoretical Framework

Science.gov (United States)

Grünkorn, Juliane; Upmeier zu Belzen, Annette; Krüger, Dirk

2014-01-01

Research in the field of students' understandings of models and their use in science describes different frameworks concerning these understandings. Currently, there is no conjoint framework that combines these structures and so far, no investigation has focused on whether it reflects students' understandings sufficiently (empirical evaluation).…

Strategic planning at the national level: Evaluating and ranking energy projects by environmental impact

International Nuclear Information System (INIS)

Thorhallsdottir, Thora Ellen

2007-01-01

A method for evaluating and ranking energy alternatives based on impact upon the natural environment and cultural heritage was developed as part of the first phase of an Icelandic framework plan for the use of hydropower and geothermal energy. The three step procedure involved assessing i) site values and ii) development impacts within a multi-criteria analysis, and iii) ranking the alternatives from worst to best choice from an environmental-cultural heritage point of view. The natural environment was treated as four main classes (landscape + wilderness, geology + hydrology, species, and ecosystem/habitat types + soils), while cultural heritage constituted one class. Values and impacts were assessed within a common matrix with 6 agglomerated attributes: 1) diversity, richness, 2) rarity, 3) size (area), completeness, pristineness, 4) information (epistemological, typological, scientific and educational) and symbolic value, 5) international responsibility, and 6) scenic value. Standardized attribute scores were used to derive total class scores whose weighted sums yielded total site value and total impact. The final output was a one-dimensional ranking obtained by Analytical Hierarchical Process considering total predicted impacts, total site values, risks and uncertainties as well as special site values. The value/impact matrix is compact (31 cell scores) but was considered to be of sufficient resolution and has the advantage of facilitating overview and communication of the methods and results. The classes varied widely in the extent to which value assessments could be based on established scientific procedures and the project highlighted the immense advantage of an internationally accepted frame of reference, first for establishing the theoretical and scientific foundation, second as a tool for evaluation, and third for allowing a global perspective

A framework for the quantitative assessment of climate change impacts on water-related activities at the basin scale

OpenAIRE

Anghileri, D.; Pianosi, F.; Soncini-Sessa, R.

2011-01-01

While quantitative assessment of the climate change impact on hydrology at the basin scale is quite addressed in the literature, extension of quantitative analysis to impact on the ecological, economic and social sphere is still limited, although well recognized as a key issue to support water resource planning and promote public participation. In this paper we propose a framework for assessing climate change impact on water-related activities at the basin scale. The specific features of our ...

Introducing the Canadian Thoracic Society Framework for Guideline Dissemination and Implementation, with Concurrent Evaluation

Directory of Open Access Journals (Sweden)

Samir Gupta

2013-01-01

Full Text Available The Canadian Thoracic Society (CTS is leveraging its strengths in guideline production to enable respiratory guideline implementation in Canada. The authors describe the new CTS Framework for Guideline Dissemination and Implementation, with Concurrent Evaluation, which has three spheres of action: guideline production, implementation infrastructure and knowledge translation (KT methodological support. The Canadian Institutes of Health Research ‘Knowledge-to-Action’ process was adopted as the model of choice for conceptualizing KT interventions. Within the framework, new evidence for formatting guideline recommendations to enhance the intrinsic implementability of future guidelines were applied. Clinical assemblies will consider implementability early in the guideline production cycle when selecting clinical questions, and new practice guidelines will include a section dedicated to KT. The framework describes the development of a web-based repository and communication forum to inventory existing KT resources and to facilitate collaboration and communication among implementation stakeholders through an online discussion board. A national forum for presentation and peer-review of proposed KT projects is described. The framework outlines expert methodological support for KT planning, development and evaluation including a practical guide for implementers and a novel ‘Clinical Assembly – KT Action Team’, and in-kind logistical support and assistance in securing peer-reviewed funding.

The Road to Basel III – Quantitative Impact Study, the Basel III Framework and Implementation in the EU

OpenAIRE

Anastasia Gromova-Schneider; Caroline Niziolek

2011-01-01

In response to the financial crisis, the Basel Committee on Banking Supervision (BCBS) in December 2009 published its first consultative proposals to review the Basel II regulatory framework. Following a consultation process and a quantitative impact study (QIS), on December 16, 2010, the BCBS published the final Basel III framework for tightening the globally applicable capital adequacy and liquidity rules. The implementation of the new provisions in the EU is currently under way. The Europe...

R-IDEAL: A Framework for Systematic Clinical Evaluation of Technical Innovations in Radiation Oncology.

Science.gov (United States)

Verkooijen, Helena M; Kerkmeijer, Linda G W; Fuller, Clifton D; Huddart, Robbert; Faivre-Finn, Corinne; Verheij, Marcel; Mook, Stella; Sahgal, Arjun; Hall, Emma; Schultz, Chris

2017-01-01

The pace of innovation in radiation oncology is high and the window of opportunity for evaluation narrow. Financial incentives, industry pressure, and patients' demand for high-tech treatments have led to widespread implementation of innovations before, or even without, robust evidence of improved outcomes has been generated. The standard phase I-IV framework for drug evaluation is not the most efficient and desirable framework for assessment of technological innovations. In order to provide a standard assessment methodology for clinical evaluation of innovations in radiotherapy, we adapted the surgical IDEAL framework to fit the radiation oncology setting. Like surgery, clinical evaluation of innovations in radiation oncology is complicated by continuous technical development, team and operator dependence, and differences in quality control. Contrary to surgery, radiotherapy innovations may be used in various ways, e.g., at different tumor sites and with different aims, such as radiation volume reduction and dose escalation. Also, the effect of radiation treatment can be modeled, allowing better prediction of potential benefits and improved patient selection. Key distinctive features of R-IDEAL include the important role of predicate and modeling studies (Stage 0), randomization at an early stage in the development of the technology, and long-term follow-up for late toxicity. We implemented R-IDEAL for clinical evaluation of a recent innovation in radiation oncology, the MRI-guided linear accelerator (MR-Linac). MR-Linac combines a radiotherapy linear accelerator with a 1.5-T MRI, aiming for improved targeting, dose escalation, and margin reduction, and is expected to increase the use of hypofractionation, improve tumor control, leading to higher cure rates and less toxicity. An international consortium, with participants from seven large cancer institutes from Europe and North America, has adopted the R-IDEAL framework to work toward coordinated, evidence

The science of adaptation. A framework for assessment

International Nuclear Information System (INIS)

Smit, B.; Burton, I.; Street, R.; Klein, R.J.T.; Maciver, D.C.

1999-01-01

This paper outlines what is meant by 'adaptation' to climate change, and how it might be addressed in the IPCC Assessments. Two roles of adaptation in the climate change field are identified: adaptation as part of impact assessment (where the key question is: what adaptations are likely?), and adaptation as part of the policy response (where the central question is: what adaptations are recommended?). The concept of adaptation has been adopted in several fields including climate impact assessment and policy development, risk management, and natural hazards research. A framework for systematically defining adaptations is based on three questions: (1) adaptation to what? (2) who or what adapts? and (3) how does adaptation occur? The paper demonstrates that, for adaptation purposes, climate extremes and variability are integral parts of climate change, along with shifts in mean conditions. Attributes for differentiating adaptations include purposefulness, timing, temporal and spatial scope, effects, form and performance. The framework provides a guide for the treatment of adaptation in the IPCC assessments, both in the assessment of impacts and in the evaluation of adaptive policy options. 64 refs

Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks

NARCIS (Netherlands)

Baartman, Liesbeth; Bastiaens, Theo; Kirschner, Paul A.; Van der Vleuten, Cees

2009-01-01

Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & Van der Vleuten, C. P. M. (2007). Evaluation assessment quality in competence-based education: A qualitative comparison of two frameworks. Educational Research Review, 2, 114-129.

Toward a Framework for Resource Efficiency Evaluation in Industry: Recommendations for Research and Innovation Projects

Directory of Open Access Journals (Sweden)

Sophie Sfez

2017-01-01

Full Text Available The world is facing a tremendous resource supply challenge. One strategy of regions and nations to address this issue is to encourage research and innovation through funding programs. Most of the time, these programs require that research and innovation projects quantify potential increases in resource efficiency achieved by the projects. However, no consensus exists on how to calculate resource efficiency; therefore, a wide range of approaches is followed. As a result, resource efficiency results are not comparable between projects, and because no rules or guidelines exist to help project developers, the approach followed is not always appropriate. This paper aims to discuss the existing approaches and methods used to evaluate resource efficiency. In this context, resource efficiency is defined as the ratio between the benefits obtained from resources and the impact or amount of resources used. The most challenging step is the determination of this ratio’s denominator because a wide range of methods to quantify resource consumption exist and are being used. They can be classified as gate-to-gate or life cycle based methods and can be subdivided into accounting methods and impact assessment methods. Each method considers different aspects of resources; thus, no single method aims to answer the same research questions. Therefore, project developers must make a well informed choice about which method to use. This paper provides recommendations to support this choice, as well as the overall evaluation and the valorization of the resource efficiency ratio in the framework of research and innovation programs.

Evaluation of a performance appraisal framework for radiation therapists in planning and simulation

Energy Technology Data Exchange (ETDEWEB)

Becker, Jillian, E-mail: jillian.becker@health.qld.gov.au [Radiation Oncology Mater Centre, South Brisbane, Queensland (Australia); Bridge, Pete [School of Clinical Sciences, Queensland University of Technology, Brisbane, Queensland (Australia); Brown, Elizabeth; Lusk, Ryan; Ferrari-Anderson, Janet [Radiation Oncology, Princess Alexandra Hospital, Brisbane, Queensland (Australia); Radiation Oncology Mater Centre, South Brisbane, Queensland (Australia)

2015-06-15

Constantly evolving technology and techniques within radiation therapy require practitioners to maintain a continuous approach to professional development and training. Systems of performance appraisal and adoption of regular feedback mechanisms are vital to support this development yet frequently lack structure and rely on informal peer support. A Radiation Therapy Performance Appraisal Framework (RT-PAF) for radiation therapists in planning and simulation was developed to define expectations of practice and promote a supportive and objective culture of performance and skills appraisal. Evaluation of the framework was conducted via an anonymous online survey tool. Nine peer reviewers and fourteen recipients provided feedback on its effectiveness and the challenges and limitations of the approach. Findings from the evaluation were positive and suggested that both groups gained benefit from and expressed a strong interest in embedding the approach more routinely. Respondents identified common challenges related to the limited ability to implement suggested development strategies; this was strongly associated with time and rostering issues. This framework successfully defined expectations for practice and provided a fair and objective feedback process that focussed on skills development. It empowered staff to maintain their skills and reach their professional potential. Management support, particularly in regard to provision of protected time was highlighted as critical to the framework's ongoing success. The demonstrated benefits arising in terms of staff satisfaction and development highlight the importance of this commitment to the modern radiation therapy workforce.

Evaluation of a performance appraisal framework for radiation therapists in planning and simulation

International Nuclear Information System (INIS)

Becker, Jillian; Bridge, Pete; Brown, Elizabeth; Lusk, Ryan; Ferrari-Anderson, Janet

2015-01-01

Constantly evolving technology and techniques within radiation therapy require practitioners to maintain a continuous approach to professional development and training. Systems of performance appraisal and adoption of regular feedback mechanisms are vital to support this development yet frequently lack structure and rely on informal peer support. A Radiation Therapy Performance Appraisal Framework (RT-PAF) for radiation therapists in planning and simulation was developed to define expectations of practice and promote a supportive and objective culture of performance and skills appraisal. Evaluation of the framework was conducted via an anonymous online survey tool. Nine peer reviewers and fourteen recipients provided feedback on its effectiveness and the challenges and limitations of the approach. Findings from the evaluation were positive and suggested that both groups gained benefit from and expressed a strong interest in embedding the approach more routinely. Respondents identified common challenges related to the limited ability to implement suggested development strategies; this was strongly associated with time and rostering issues. This framework successfully defined expectations for practice and provided a fair and objective feedback process that focussed on skills development. It empowered staff to maintain their skills and reach their professional potential. Management support, particularly in regard to provision of protected time was highlighted as critical to the framework's ongoing success. The demonstrated benefits arising in terms of staff satisfaction and development highlight the importance of this commitment to the modern radiation therapy workforce

Real-Time Framework for Energy Management System of a Smart Microgrid Using Multiagent Systems

Directory of Open Access Journals (Sweden)

Roberto S. Netto

2018-03-01

Full Text Available This paper presents a framework to analyze the problem of real-time management of Smart Grids. For this purpose, the energy management is integrated with the power system through a telecommunication system. The use of Multiagent Systems (MAS leads the proposed algorithm to find the best-integrated solution, taking into consideration the operating scenario and the system characteristics. With this framework it was possible to evaluate the design of the energy management and the impact of the algorithm developed in the MAS. In the same way, the data sent from the power system to be used for energy management have a direct impact on his behavior. The proposed framework is tested with the help of a microgrid, so the results may be replicated.

Gallon Model for the evaluation of environmental impacts

International Nuclear Information System (INIS)

Gallon Martinez, Juan Carlos

2003-01-01

When it is necessary to know the impact grade that will have the environment for the introduction of a project or handling plan, it is appealed to a study of environmental impact that quantifies variables of qualitative type to obtain results of quantitative type. The evaluation of environmental impacts is necessary to know which phases or actions of the different projects have negative or positive repercussions or far-reaching about the different susceptible environmental factors to receive impacts, and to determine previously, the most important aspects to determine the level of impact of the projects or handling plans. The evaluation measures the repercussions and consequences of the different activities of the industry on the environment, allowing to evaluate the future conditions of the habitat, being an excellent tool for making decisions regarding the possible future impact that can have an industrial process or project to diminish the nature

A system-of-systems framework for the reliability analysis of distributed generation systems accounting for the impact of degraded communication networks

International Nuclear Information System (INIS)

Mo, Hua-Dong; Li, Yan-Fu; Zio, Enrico

2016-01-01

Highlights: • A system-of-systems framework is proposed for reliability analysis of DG system. • The impact of degraded communication networks is included and quantified. • Various uncertainties and contingencies in the DG system are considered. • A Monte Carlo simulation-optimal power flow computational framework is developed. • The results of the application study show the power of the proposed framework. - Abstract: Distributed generation (DG) systems install communication networks for managing real-time energy imbalance. Different from previous research, which typically assumes perfect communication networks, this work aims to quantitatively account for the impact of degraded communication networks on DG systems performance. The degraded behavior of communication networks is modeled by stochastic continuous time transmission delays and packet dropouts. On the DG systems side, we consider the inherent uncertainties of renewable energy sources, loads and energy prices. We develop a Monte Carlo simulation-optimal power flow (MCS-OPF) computational framework that is capable of generating consecutive time-dependent operating scenarios of the integrated system. Quantitative analysis is carried out to measure the impact of communication networks degradation onto the DG systems. For illustration, the framework is applied to a modified IEEE 13 nodes test feeder. The results demonstrate that the degraded communication networks can significantly deteriorate the performance of the integrated system. A grey differential model-based prediction method for reconstructing missing data is effective in mitigating the influence of the degraded communication networks.

An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from a Researcher’s or Analyst’s Perspective

Science.gov (United States)

2014-12-01

An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from a Researcher’s or Analyst’s Perspective by Robert A...Generalized Intelligent Framework for Tutoring (GIFT) from a Researcher’s or Analyst’s Perspective Robert A Sottilare and Anne M Sinatra Human...2014 4. TITLE AND SUBTITLE An Evaluation of the Generalized Intelligent Framework for Tutoring (GIFT) from a Researcher’s or Analyst’s Perspective

Prototypic Enhanced Risk Monitor Framework and Evaluation - Advanced Reactor Technology Milestone: M3AT-15PN2301054

Energy Technology Data Exchange (ETDEWEB)

Ramuhalli, Pradeep [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Hirt, Evelyn H. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Veeramany, Arun [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Bonebrake, Christopher A. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Ivans, William J. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Coles, Garill A. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Coble, Jamie B. [Univ. of Tennessee, Knoxville, TN (United States); Liu, X. [Univ. of Tennessee, Knoxville, TN (United States); Wootan, David W. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Mitchell, Mark R. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States); Brass, Mary F. [Pacific Northwest National Lab. (PNNL), Richland, WA (United States)

2015-09-24

This research report summaries the development and evaluation of a prototypic enhanced risk monitor (ERM) methodology (framework) that includes alternative risk metrics and uncertainty analysis. This updated ERM methodology accounts for uncertainty in the equipment condition assessment (ECA), the prognostic result, and the probabilistic risk assessment (PRA) model. It is anticipated that the ability to characterize uncertainty in the estimated risk and update the risk estimates in real time based on equipment condition assessment (ECA) will provide a mechanism for optimizing plant performance while staying within specified safety margins. These results (based on impacting active component O&M using real-time equipment condition information) are a step towards ERMs that, if integrated with AR supervisory plant control systems, can help control O&M costs and improve affordability of advanced reactors.

Threat evaluation for impact assessment in situation analysis systems

Science.gov (United States)

Roy, Jean; Paradis, Stephane; Allouche, Mohamad

2002-07-01

Situation analysis is defined as a process, the examination of a situation, its elements, and their relations, to provide and maintain a product, i.e., a state of situation awareness, for the decision maker. Data fusion is a key enabler to meeting the demanding requirements of military situation analysis support systems. According to the data fusion model maintained by the Joint Directors of Laboratories' Data Fusion Group, impact assessment estimates the effects on situations of planned or estimated/predicted actions by the participants, including interactions between action plans of multiple players. In this framework, the appraisal of actual or potential threats is a necessary capability for impact assessment. This paper reviews and discusses in details the fundamental concepts of threat analysis. In particular, threat analysis generally attempts to compute some threat value, for the individual tracks, that estimates the degree of severity with which engagement events will potentially occur. Presenting relevant tracks to the decision maker in some threat list, sorted from the most threatening to the least, is clearly in-line with the cognitive demands associated with threat evaluation. A key parameter in many threat value evaluation techniques is the Closest Point of Approach (CPA). Along this line of thought, threatening tracks are often prioritized based upon which ones will reach their CPA first. Hence, the Time-to-CPA (TCPA), i.e., the time it will take for a track to reach its CPA, is also a key factor. Unfortunately, a typical assumption for the computation of the CPA/TCPA parameters is that the track velocity will remain constant. When a track is maneuvering, the CPA/TCPA values will change accordingly. These changes will in turn impact the threat value computations and, ultimately, the resulting threat list. This is clearly undesirable from a command decision-making perspective. In this regard, the paper briefly discusses threat value stabilization

The equity dimension in evaluations of the quality and outcomes framework: a systematic review.

Science.gov (United States)

Boeckxstaens, Pauline; Smedt, Delphine De; Maeseneer, Jan De; Annemans, Lieven; Willems, Sara

2011-08-31

Pay-for-performance systems raise concerns regarding inequity in health care because providers might select patients for whom targets can easily be reached. This paper aims to describe the evolution of pre-existing (in)equity in health care in the period after the introduction of the Quality and Outcomes Framework (QOF) in the UK and to describe (in)equities in exception reporting. In this evaluation, a theory-based framework conceptualising equity in terms of equal access, equal treatment and equal treatment outcomes for people in equal need is used to guide the work. A systematic MEDLINE and Econlit search identified 317 studies. Of these, 290 were excluded because they were not related to the evaluation of QOF, they lacked an equity dimension in the evaluation, their qualitative research focused on experiences or on the nature of the consultation, or unsuitable methodology was used to pronounce upon equity after the introduction of QOF. None of the publications (n = 27) assessed equity in access to health care. Concerning equity in treatment and (intermediate) treatment outcomes, overall quality scores generally improved. For the majority of the observed indicators, all citizens benefit from this improvement, yet the extent to which different patient groups benefit tends to vary and to be highly dependent on the type and complexity of the indicator(s) under study, the observed patient group(s) and the characteristics of the study. In general, the introduction of QOF was favourable for the aged and for males. Total QOF scores did not seem to vary according to ethnicity. For deprivation, small but significant residual differences were observed after the introduction of QOF favouring less deprived groups. These differences are mainly due to differences at the practice level. The variance in exception reporting according to gender and socio-economic position is low. Although QOF seems not to be socially selective at first glance, this does not mean QOF does not

The equity dimension in evaluations of the quality and outcomes framework: A systematic review