WorldWideScience

Sample records for scrutinising usability evaluation

  1. Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?

    DEFF Research Database (Denmark)

    Hertzum, Morten; Hansen, Kristin Due; Andersen, Hans Henrik

    2009-01-01

    thinking aloud participants took longer to solve tasks, spent a larger part of tasks on general distributed visual behaviour, issued more commands to navigate both within and between the pages of the websites used in the experiment, and experienced higher mental workload. Implications for usability......Thinking aloud is widely used for usability evaluation. The validity of the method is, however, debatable because it is generally used in a relaxed way that conflicts with the prescriptions of the classic model for obtaining valid verbalisations of thought processes. This study investigates whether...... participants that think aloud in the classic or relaxed way behave differently compared to performing in silence. Results indicate that whereas classic thinking aloud has little or no effect on behaviour apart from prolonging tasks, relaxed thinking aloud affects behaviour in multiple ways. During relaxed...

  2. Evaluating Usability

    DEFF Research Database (Denmark)

    Nørgaard, Mie; Høegh, Rune T.

    2008-01-01

    Usability evaluation is widely accepted as a valuable activity in software development. However, how results effectively are fed back to developers is still a relatively unexplored area. We argue that usability feedback can be understood as an argument for a series of usability problems......, and that basic concepts from argumentation theory can help us understand how to create persuasive feedback. We revisit two field studies on usability feedback to study if concepts from Toulmin's model for argumentation and Aristotle's modes of persuasion can explain why some feedback formats outperform others....... We recommend that evaluators specifically back up the warrants behind their usability claims, that their arguments use several modes of persuasion, and that they present feedback in browsable amounts not to overwhelm developers with information. For complex and controversial problems, we advise...

  3. Evaluating Web Usability

    Science.gov (United States)

    Snider, Jean; Martin, Florence

    2012-01-01

    Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

  4. Analysis in usability evaluations

    DEFF Research Database (Denmark)

    Følstad, Asbjørn; Lai-Chong Law, Effie; Hornbæk, Kasper

    2010-01-01

    While the planning and implementation of usability evaluations are well described in the literature, the analysis of the evaluation data is not. We present interviews with 11 usability professionals on how they conduct analysis, describing the resources, collaboration, creation of recommendations......, and prioritization involved. The interviews indicate a lack of structure in the analysis process and suggest activities, such as generating recommendations, that are unsupported by existing methods. We discuss how to better support analysis, and propose four themes for future research on analysis in usability...

  5. Distributed usability evaluation

    DEFF Research Database (Denmark)

    Christensen, Lars; Frøkjær, Erik

    2010-01-01

    We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary......, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server......, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented...

  6. Problem Prioritization in Usability Evaluation:

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2006-01-01

    Severity assessments enable prioritization of problems encountered during usability evaluations and thereby provide a device for guiding the utilization of design resources. However, designers' response to usability evaluations is also influenced by other factors, which may overshadow severity....... With the purpose of enhancing the impact of severity assessments, this study combines a field study of factors that influence the impact of evaluations with an experimental study of severity assessments made during usability inspections. The results show that even in a project receptive to input from evaluations...... their impact was highly dependent on conducting evaluations early. This accorded with an informal method that blended elements of usability evaluation and participatory design and could be extended with user-made severity assessments. The major cost associated with the evaluations was not finding but fixing...

  7. Cultural Cognition in Usability Evaluation

    DEFF Research Database (Denmark)

    Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

    2009-01-01

    We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences' helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users' cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

  8. Cultural Cognition in Usability Evaluation

    DEFF Research Database (Denmark)

    Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

    2009-01-01

    We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences’ helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users’ cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

  9. The Evaluator Effect in Usability Tests

    DEFF Research Database (Denmark)

    Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

    1998-01-01

    Usability tests are applied in industry to evaluate systems and in research as a yardstick for other usability evaluation methods. However, one potential threat to the reliability of usability tests has been left unaddressed: the evaluator effect. In this study, four evaluators analyzed four vide...

  10. Developer Driven and User Driven Usability Evaluations

    DEFF Research Database (Denmark)

    Bruun, Anders

    2013-01-01

    Usability evaluation provide software development teams with insights on the degree to which a software application enables a user to achieve his/her goals, how fast these goals can be achieved, how easy it is to learn and how satisfactory it is in use Although usability evaluations are crucial...... in the process of developing software systems with a high level of usability, its use is still limited in the context of small software development companies. Several approaches have been proposed to support software development practitioners (SWPs) in conducting usability evaluations, and my thesis explores two...... of these: 1) The first approach is to support SWPs by training them to drive usability evaluations. 2) The second approach to support SWPs involves minimalist training of end users to drive usability evaluations. In related work, a set of five quality criteria for usability evaluations is applied...

  11. Software Development and Feedback from Usability Evaluations

    DEFF Research Database (Denmark)

    Høegh, Rune Thaarup

    2008-01-01

    This paper presents a study of the strengths and weaknesses of written, multimedia and oral feedback from usability evaluations to developers. The strengths and weaknesses are related to how well the feedback supports the developers in addressing usability problems in a software system. The study...... concludes that using the traditional written usability report, as the only form of feedback from usability evaluations is associated with problems related to the report not supporting the process of addressing the usability problems. The report is criticized for representing an overwhelming amount...... of information, while still not offering the required information to address usability problems. Other forms of feedback, such as oral or multimedia feedback helps the developer in understanding the usability problems better, but are on the other hand less cost-effective than a written description....

  12. Work-domain knowledge in usability evaluation

    DEFF Research Database (Denmark)

    Følstad, Asbjørn; Hornbæk, Kasper

    2010-01-01

    Usability evaluation helps to determine whether interactive systems support users in their work tasks. However, knowledge about those tasks and, more generally, about the work-domain is difficult to bring to bear on the processes and outcome of usability evaluation. One way to include such work......-domain knowledge might be Cooperative Usability Testing, an evaluation method that consists of (a) interaction phases, similar to classic usability testing, and (b) interpretation phases, where the test participant and the moderator discuss incidents and experiences from the interaction phases. We have studied...... whether such interpretation phases improve the relevance of usability evaluations in the development of work-domain specific systems. The study included two development cases. We conclude that the interpretation phases generate additional insight and redesign suggestions related to observed usability...

  13. Advancing Usability Evaluation through Human Reliability Analysis

    International Nuclear Information System (INIS)

    Ronald L. Boring; David I. Gertman

    2005-01-01

    This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probability of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues

  14. Usability Evaluation in a Digitally Emerging Country

    DEFF Research Database (Denmark)

    Lizano, Fulvio; Sandoval, Maria Marta; Bruun, Anders

    2013-01-01

    Several emerging countries experience increasing software development activities. With the purpose of provide useful feedback on possible courses of action for increasing application of usability evaluation in such countries, this paper explores the status of usability evaluation in a digitally...... emerging country. Our aim is to identifying common characteristics or behavioral patterns that could be compared with digitally advanced countries. We used an online survey answered by 26 software development organizations, which gave a snapshot of the application of usability evaluation...... in these organizations. We found many similarities with advanced countries, several completely new obstacles more connected with software development matters and a relatively positive improvement in the lack of “usability culture”. These findings suggest good conditions to improve conduction of usability evaluations...

  15. Evaluation of Usability Utilizing Markov Models

    Science.gov (United States)

    Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane

    2012-01-01

    Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…

  16. Usability evaluations in user-centred design

    NARCIS (Netherlands)

    Ruyter, de B.E.R.; Vet, de J.H.M.

    1997-01-01

    Improving usability of consumer applications has been the focus of much research. Estimating the advantage of these efforts, however, still is very cumbersome since evaluating product improvements in terms of their usability requires good measuring methods and tools. In this paper activities in the

  17. Three Contexts for Evaluating Organizational Usability

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2018-01-01

    Organizational usability is about the match between the user and the system, between the organization and the system, and between the environment and the system. While the first of these matches can, to a large extent, be evaluated in the lab, the two others cannot. Organizational usability must......, provide a brief example, and discuss the challenges it presents. To strengthen the focus on evaluation in the three contexts we propose the measurement of specified effects, combined with a sensitivity toward emergent effects. Incorporating effects in the evaluation of organizational usability makes...

  18. Usability Evaluation of www.budget.com

    DEFF Research Database (Denmark)

    Bruun, Anders; Jensen, Janne Jul; Skov, Mikael B.

    This report presents the results of a usability evaluation of the budget.com website. The evaluation was carried out by a team of 4 HCI experts, and it involved 10 potential users. The evaluation is based on measurement of (1) task completion time, (2) task completion, (3) user satisfaction and (4......) perceived workload. We have also analyzed the user interaction with the website for (5) usability problems. Through the evaluation, we have found the following weaknesses of the website:   Reservation takes considerably more time than promised. The website indicates that a reservation can be made in 60...... is not useful for specific purposes. The user satisfaction is generally low. Except one high and two low scores, the user satisfaction was in the middle range. There are too many severe usability problems. The evaluation identified a considerable number of usability problems. 5 of them were critical which means...

  19. Optimizing Usability Studies by Complementary Evaluation Methods

    NARCIS (Netherlands)

    Schmettow, Martin; Bach, Cedric; Scapin, Dominique

    2014-01-01

    This paper examines combinations of complementary evaluation methods as a strategy for efficient usability problem discovery. A data set from an earlier study is re-analyzed, involving three evaluation methods applied to two virtual environment applications. Results of a mixed-effects logistic

  20. Usability Evaluation of Public Web Mapping Sites

    Science.gov (United States)

    Wang, C.

    2014-04-01

    Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The

  1. A usability evaluation of the prototype Afrikaanse idiome-woordeboek

    African Journals Online (AJOL)

    When digital tools are developed it is important to consider the usability of the tool. Usability evaluation was done on the Afrikaanse idiome-woordeboek to determine with what success it can be used. Discount usability methods, viz. heuristic evaluation and usability testing were used. This article reports on the findings from ...

  2. Usability Evaluation Method for Agile Software Development

    Directory of Open Access Journals (Sweden)

    Saad Masood Butt

    2015-02-01

    Full Text Available Agile methods are the best fit for tremendously growing software industry due to its flexible and dynamic nature. But the software developed using agile methods do meet the usability standards? To answer this question we can see that majority of agile software development projects currently involve interactive user interface designs, which can only be possible by following User Centered Design (UCD in agile methods. The question here is, how to integrate UCD with agile models. Both Agile models and UCD are iterative in nature but agile models focus on coding and development of software; whereas, UCD focuses on user interface of the software. Similarly, both of them have testing features where the agile model involves automated tested code while UCD involves an expert or a user to test the user interface. In this paper, a new agile usability model is proposed and the evaluation is of the proposed model is presented by practically implementing it in three real life projects. . Key results from these projects clearly show: the proposed agile model incorporates usability evaluation methods, improves the relationship between usability experts to work with agile software experts; in addition, allows agile developers to incorporate the result from UCD into subsequent interactions.

  3. Evaluation of radiochemical data usability

    International Nuclear Information System (INIS)

    Paar, J.G.; Porterfield, D.R.

    1997-04-01

    This procedure provides a framework for implementation of radiochemical data verification and validation for environmental remediation activities. It has been developed through participation of many individuals currently involved in analytical radiochemistry, radiochemical validation, and validation program development throughout the DOE complex. It should be regarded as a guidance to use in developing an implementable radiochemical validation strategy. This procedure provides specifications for developing and implementing a radiochemical validation methodology flexible enough to allow evaluation of data useability for project-specific Data Quality Objectives (DQO). Data produced by analytical methods for which this procedure provides limited guidance are classified as open-quotes non-routineclose quotes radionuclides and methods, and analyses by these methods may necessitate adoption of modified criteria from this procedure

  4. A usability evaluation of Lazada mobile application

    Science.gov (United States)

    Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Jamaludin, Nur Hafiza; Moh, Somia T. L.

    2017-10-01

    This paper reports on a usability evaluation of Lazada mobile application, an online shopping app for mobile devices. The evaluation was conducted using 12 users of ages 18 to 24. Seven (7) were expert users and the other 5 were novice users. The study objectives were to evaluate the perceived effectiveness, efficiency and satisfaction of the mobile application. The result provides a positive feedback and shows that the mobile shopping app is effective, efficient, and satisfying as perceived by the study participants. However, there are some observed usability issues with the main menu and the payment method that necessitates improvements to increase the application's effectiveness, efficiency and satisfaction. The suggested improvements include: 1) the main menu should be capitalized and place on the left side of mobile app and 2) payment method tutorial should be included as a hyperlink in the payment method page. This observation will be helpful to the owners of the application in future version development of the app.

  5. Usability Evaluation of a Web-Based Learning System

    Science.gov (United States)

    Nguyen, Thao

    2012-01-01

    The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

  6. Lessons from an Educational Game Usability Evaluation

    Directory of Open Access Journals (Sweden)

    Gabriela Trindade Perry

    2012-04-01

    Full Text Available In this paper, we present the results of a usability evaluation for Xenubi, a cell phone game about the periodic table. We describe and discuss the issues that we faced during the evaluation, which took place in a state high school. These issues are related to conflicts between the data that were gathered through video recordings and through a questionnaire. We also point to the poor performance of the game mechanics during the evaluation. This result was unexpected because the game had an excellent performance in the pilot test. Possible causes for these differences are discussed.

  7. MATHEMATICAL MODEL FOR SOFTWARE USABILITY AUTOMATED EVALUATION AND ASSURANCE

    Directory of Open Access Journals (Sweden)

    І. Гученко

    2011-04-01

    Full Text Available The subject of the research is software usability and the aim is construction of mathematicalmodel of estimation and providing of the set level of usability. Methodology of structural analysis,methods of multicriterion optimization and theory of making decision, method of convolution,scientific methods of analysis and analogies is used in the research. The result of executed work isthe model for software usability automated evaluation and assurance that allows not only toestimate the current level of usability during every iteration of agile development but also tomanage the usability of created software products. Results can be used for the construction ofautomated support systems of management the software usability.

  8. Integrating Usability Evaluations into the Software Development Process

    DEFF Research Database (Denmark)

    Lizano, Fulvio

    as relevant and strategic human–computer interaction (HCI) activities in the software development process, there are obstacles that limit the complete, effective and efficient integration of this kind of testing into the software development process. Two main obstacles are the cost of usability evaluations...... and the software developers' resistance to accepting users’ opinions regarding the lack of usability in their software systems. The ‘cost obstacle’ refers to the constraint of conducting usability evaluations in the software process due to the significant amount of resources required by this type of testing. Some......This thesis addresses the integration of usability evaluations into the software development process. The integration here is contextualized in terms of how to include usability evaluation as an activity in the software development lifecycle. Even though usability evaluations are considered...

  9. A Framework for Usability Evaluation in EHR Procurement.

    Science.gov (United States)

    Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

    2018-01-01

    Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

  10. Next Gen One Portal Usability Evaluation

    Science.gov (United States)

    Cross, E. V., III; Perera, J. S.; Hanson, A. M.; English, K.; Vu, L.; Amonette, W.

    2018-01-01

    Each exercise device on the International Space Station (ISS) has a unique, customized software system interface with unique layouts / hierarchy, and operational principles that require significant crew training. Furthermore, the software programs are not adaptable and provide no real-time feedback or motivation to enhance the exercise experience and/or prevent injuries. Additionally, the graphical user interfaces (GUI) of these systems present information through multiple layers resulting in difficulty navigating to the desired screens and functions. These limitations of current exercise device GUI's lead to increased crew time spent on initiating, loading, performing exercises, logging data and exiting the system. To address these limitations a Next Generation One Portal (NextGen One Portal) Crew Countermeasure System (CMS) was developed, which utilizes the latest industry guidelines in GUI designs to provide an intuitive ease of use approach (i.e., 80% of the functionality gained within 5-10 minutes of initial use without/limited formal training required). This is accomplished by providing a consistent interface using common software to reduce crew training, increase efficiency & user satisfaction while also reducing development & maintenance costs. Results from the usability evaluations showed the NextGen One Portal UI having greater efficiency, learnability, memorability, usability and overall user experience than the current Advanced Resistive Exercise Device (ARED) UI used by astronauts on ISS. Specifically, the design of the One-Portal UI as an app interface similar to those found on the Apple and Google's App Store, assisted many of the participants in grasping the concepts of the interface with minimum training. Although the NextGen One-Portal UI was shown to be an overall better interface, observations by the test facilitators noted specific exercise tasks appeared to have a significant impact on the NextGen One-Portal UI efficiency. Future updates to

  11. Training Software Developers and Designers to Conduct Usability Evaluations

    Science.gov (United States)

    Skov, Mikael Brasholt; Stage, Jan

    2012-01-01

    Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

  12. Usability Evaluation for Business Intelligence Applications: A User Support Perspective

    Directory of Open Access Journals (Sweden)

    Chrisna Jooste

    2014-08-01

    Full Text Available Business Intelligence (BI applications provide business information to drive decision support. Usability is one of the factors determining the optimal use and eventual benefit derived from BI applications. The documented need for more BI usability research together with the practical necessity for BI evaluation guidelines in the mining industry provides the rationale for this study. The purpose of the study was to investigate the usability evaluation of BI applications in the context of a coal mining organization. The research is guided by the question: How can existing usability criteria be customized to evaluate the usability of BI applications. The research design included user observation, heuristic evaluation and a survey. Based on observations made during user support on a BI application used at a coal mining organization a log of usability issues was compiled. The usability issues extracted from this log was compared and contrasted with general usability criteria from literature to synthesize an initial set of BI usability evaluation criteria. These criteria were used as the basis for a heuristic evaluation of the BI application used at the coal mining organization. The same BI application was also evaluated using the Software Usability Measurement Inventory (SUMI standardized questionnaire. The results from the two evaluations were triangulated and then compared with the BI user issues again to contextualize the findings and synthesize a validated and refined set of criteria. The main contribution of the study is the usability evaluation criteria for BI applications presented as guidelines. These guidelines deviate from existing evaluation guidelines in the emphasis on information architecture, learnability and operability.

  13. Usability evaluation techniques in mobile commerce applications: A systematic review

    Science.gov (United States)

    Hussain, Azham; Mkpojiogu, Emmanuel O. C.

    2016-08-01

    Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

  14. Post-deployment usability evaluation of a radiology workstation

    NARCIS (Netherlands)

    Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi; Oudkerk, Matthijs; van Ooijen, Peter

    2015-01-01

    Objective To evaluate the usability of a radiology workstation after deployment in a hospital. Significance In radiology, it is difficult to perform valid pre-deployment usability evaluations due to the heterogeneity of the user group, the complexity of the radiological workflow, and the complexity

  15. How to Reach Evidence-Based Usability Evaluation Methods

    NARCIS (Netherlands)

    Marcilly, Romaric; Peute, Linda

    2017-01-01

    This paper discusses how and why to build evidence-based knowledge on usability evaluation methods. At each step of building evidence, requisites and difficulties to achieve it are highlighted. Specifically, the paper presents how usability evaluation studies should be designed to allow capitalizing

  16. Comparative study of heuristic evaluation and usability testing methods.

    Science.gov (United States)

    Thyvalikakath, Thankam Paul; Monaco, Valerie; Thambuganipalle, Himabindu; Schleyer, Titus

    2009-01-01

    Usability methods, such as heuristic evaluation, cognitive walk-throughs and user testing, are increasingly used to evaluate and improve the design of clinical software applications. There is still some uncertainty, however, as to how those methods can be used to support the development process and evaluation in the most meaningful manner. In this study, we compared the results of a heuristic evaluation with those of formal user tests in order to determine which usability problems were detected by both methods. We conducted heuristic evaluation and usability testing on four major commercial dental computer-based patient records (CPRs), which together cover 80% of the market for chairside computer systems among general dentists. Both methods yielded strong evidence that the dental CPRs have significant usability problems. An average of 50% of empirically-determined usability problems were identified by the preceding heuristic evaluation. Some statements of heuristic violations were specific enough to precisely identify the actual usability problem that study participants encountered. Other violations were less specific, but still manifested themselves in usability problems and poor task outcomes. In this study, heuristic evaluation identified a significant portion of problems found during usability testing. While we make no assumptions about the generalizability of the results to other domains and software systems, heuristic evaluation may, under certain circumstances, be a useful tool to determine design problems early in the development cycle.

  17. Pilot implementation Driven by Effects Specifications and Formative Usability Evaluation

    DEFF Research Database (Denmark)

    Barlach, Anders; Hertzum, Morten; Simonsen, Jesper

    2013-01-01

    This chapter reports on the usability-engineering work performed throughout the pilot implementation of an Electronic Healthcare Record (EHR). The case describes and analyzes the use of pilot implementations to formatively evaluate whether the usability of the EHR meets the effects specified for ...

  18. A Usability Evaluation of Academic Virtual Reference Services

    Science.gov (United States)

    Chow, Anthony S.; Croxton, Rebecca A.

    2014-01-01

    This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…

  19. Post-deployment usability evaluation of a radiology workstation

    NARCIS (Netherlands)

    Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A.; Oudkerk, Matthijs; Van Ooijen, Peter M. A.

    Objectives: To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical

  20. Usability evaluation of a locomotor therapy device considering different strategies

    Directory of Open Access Journals (Sweden)

    Langthaler Sonja

    2016-09-01

    Full Text Available Usability of medical devices is one of the main determining factors in preventing use errors in treatment and strongly correlates to patient safety and quality of treatment. This thesis demonstrates the usability testing and evaluation of a prototype for locomotor therapy of infants. Therefore, based on the normative requirements of the EN 62366, a concept combined of evaluation procedures and assessing methods was created to enable extensive testing and analysis of the different aspects of usability. On the basis of gathered information weak points were identified and appropriate measures were presented to increase the usability and operating safety of the locomotor prototype. The overall outcome showed an usability value of 77.4% and an evaluation score of 6.99, which can be interpreted as “satisfactory”.

  1. Direct Integration: Training Software Developers to Conduct Usability Evaluations

    DEFF Research Database (Denmark)

    Skov, Mikael B.; Stage, Jan

    2008-01-01

    is based on an empirical study where 36 teams with a total of 234 first-year university students on software development and design educations were trained in a simple approach for user-based website usability testing that was taught in a 40 hour course. This approach supported them in planning, conducting......Many improvements of the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both approaches involve...... a complete division of work between developers and evaluators, which is an undesirable complexity for many software development projects. This paper takes a different approach by exploring to what extent software developers and designers can be trained to carry out their own usability evaluations. The paper...

  2. Feedback from Usability Evaluation to User Interface Design

    DEFF Research Database (Denmark)

    Nielsen, C. M.; Overgaard, M.; Pedersen, M. B.

    2005-01-01

    This paper reports from an exploratory study of means for providing feedback from a usability evaluation to the user interface designers. In this study, we conducted a usability evaluation of a mobile system that is used by craftsmen to register use of time and materials. The results...... and weaknesses of the system. The findings indicate that detailed descriptions of problems and log descriptions of the user's interaction with the system and of system interaction are useful for the designers when trying to understand the usability problems that the users have encountered....

  3. Social Context in Usability Evaluations: Concepts, Processes and Products

    DEFF Research Database (Denmark)

    Jensen, Janne Jul

    social context is considered important, only little research has been done to identify how it influences usability evaluations. In this thesis I explore how social context affects the process and product of a usability evaluation and explain the findings in terms of the theory of behaviour settings...... leader) and non-operatives (members, spectators, neutrals and potentials) from the theory of behaviour settings to usability evaluations generates an understanding and create an awareness of the level of power possessed by each of the participants in the social context. 2. On the operative level...... and a field experiment. Findings from these activities are presented in five published paper contributions. I furthermore introduce the theory of behaviour settings as a tool to help characterise the key concepts of social context which, together with an understanding of usability evaluations, provide...

  4. Development of a Customizable Health IT Usability Evaluation Scale

    Science.gov (United States)

    Yen, Po-Yin; Wantland, Dean; Bakken, Suzanne

    2010-01-01

    We developed a customizable questionnaire, the Health Information Technology (IT) Usability Evaluation Scale (Health-ITUES) and conducted an exploratory factor analysis to examine the scale’s psychometric properties. Nurses (n=377) completed Health-ITUES to rate the usability of a web-based communication system for scheduling nursing staff. The analysis revealed a four-factor structure of Health-ITUES. The results provided preliminary evidence for the factorial validity and internal consistency reliability of Health-ITUES. PMID:21347112

  5. Evaluation Methods on Usability of M-Learning Environments

    Directory of Open Access Journals (Sweden)

    Teresa Magal-Royo

    2007-10-01

    Full Text Available Nowadays there are different evaluation methods focused in the assessment of the usability of telematic methods. The assessment of 3rd generation web environments evaluates the effectiveness and usability of application with regard to the user needs. Wireless usability and, specifically in mobile phones, is concentrated in the validation of the features and tools management using conventional interactive environments. There is not a specific and suitable criterion to evaluate created environments and m-learning platforms, where the restricted and sequential representation is a fundamental aspect to be considered.The present paper exposes the importance of the conventional usability methods to verify both: the employed contents in wireless formats, and the possible interfaces from the conception phases, to the validations of the platform with such characteristics.The development of usability adapted inspection could be complemented with the Remote’s techniques of usability testing, which are being carried out these days in the mobile devices field and which pointed out the need to apply common criteria in the validation of non-located learning scenarios.

  6. Usability evaluation model for mobile e-book applications

    Science.gov (United States)

    Matraf, Munya Saleh Ba; Hussain, Azham

    2017-10-01

    Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.

  7. Usability evaluation of augmented reality user interfaces in games and personal navigation assistants

    OpenAIRE

    Ivanec, Zorian

    2017-01-01

    This paper studies heuristic usability evaluation of user interfaces. The literature review distinguishes characteristics of augmented reality and smartphones, presents heuristic evaluation, PACMAD usability model, personal navigation assistants, video games, augmented reality and J. Nielsen usability heuristics. In research part, usability heuristics of related subject fields and design guidelines are combined. Created heuristics and control questionnaire are used for evaluation of augmented...

  8. Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

    Science.gov (United States)

    Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

    2018-02-01

    Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

  9. Dogmas in the assessment of usability evaluation methods

    DEFF Research Database (Denmark)

    Hornbæk, Kasper

    2010-01-01

    Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work ...... research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined......Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work...... on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win-lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss...

  10. Usability evaluation of mobile applications; where do we stand?

    Science.gov (United States)

    Zahra, Fatima; Hussain, Azham; Mohd, Haslina

    2017-10-01

    The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

  11. Improving the Interplay between Usability Evaluation and User Interface Design

    DEFF Research Database (Denmark)

    Hornbæk, K.; Stage, Jan

    2004-01-01

    of the workshop are motivated and an outline of the contents of the papers that were presented in the workshop is given. In addition we summarize some challenges to the interplay between usability evaluation and user interface design agreed upon at the workshop, as well as some solutions that were debated....

  12. Evaluating the usability of web pages: a case study

    NARCIS (Netherlands)

    Lautenbach, M.A.E.; Schegget, I.E. ter; Schoute, A.E.; Witteman, C.L.M.

    1999-01-01

    An evaluation of the Utrecht University website was carried out with 240 students. New criteria were drawn from the literature and operationalized for the study. These criteria are surveyability and findability. Web pages can be said to satisfy a usability criterion if their efficiency and

  13. Usability Evaluation of a Research Repository and Collaboration Web Site

    Science.gov (United States)

    Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.

    2013-01-01

    This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…

  14. Usability and accessibility evaluation of the digital doorway

    CSIR Research Space (South Africa)

    Adebesin, TF

    2011-03-01

    Full Text Available The Digital Doorway (DD) is a non-standard computer system deployed to promote computer literacy amongst underprivileged communities in South Africa. Since its inception there has been no usability evaluation of the software installed on the DD...

  15. Usability evaluation of intradermal adapters (IDA).

    Science.gov (United States)

    Tsals, Izrail

    2017-03-27

    Intradermal adapter device technology minimizes the complexity of the Mantoux technique, thereby providing predictable, reproducible intradermal (ID) injections and removing the concerns regarding the ease and reliability of Mantoux technique when using conventional needle and syringe. The technology employs a simple device with geometry designed to gently deform the skin surface and the subcutaneous tissue, providing the ideal angle and depth of needle insertion for consistently successful intradermal injections. The results of this development were presented at the First, Second and Third Skin Vaccination Summits in 2011, 2013 and 2015 respectively [1,2,3]. The current publication addresses the performance of intradermal adapters (IDA) evaluated in three preclinical studies. The evaluations were based on the assessment of bleb formation in a skin model, an accepted indicator of ID injection success. All evaluated devices share the same proprietary dermal interface technology. Devices instituting this design are easy to use, require minimal training, and employ conventionally molded parts and cannula. These studies evaluated IDAs of initial design integral with luer lock needles, IDAs for use with conventional syringes, and intradermal adapters for use with auto disable syringes (ADID adapters). The evaluated ID adapters were intended to consistently place the lancet of the needle at a depth of 0.75mm from the skin's surface. This placement depth addresses the variation in the skin thickness at immunization sites for the majority of patients independent of many other variables. Most participants preferred the intradermal adapter method over the traditional Mantoux and identified a need for the adapter at their workplace. Evaluation of IDAs by registered nurses indicated these devices increase success of bleb formation. The use of IDA increased the success of forming blebs by about 30%. Nurses felt the injections were much easier to perform, in particular by

  16. Usability evaluation of user interface of thesis title review system

    Science.gov (United States)

    Tri, Y.; Erna, A.; Gellysa, U.

    2018-03-01

    Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

  17. Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development

    DEFF Research Database (Denmark)

    Stage, Jan; Høegh, Rune Thaarup; Hornbæk, K.

    2007-01-01

    t is often argued that usability problems should be identified as early as possible during software development, but many usability evaluation methods do not fit well in early development activities. We propose a method for usability evaluation of use cases, a widely used representation of design...... ideas produced early in software development processes. The method proceeds by systematic inspection of use cases with reference to a set of guidelines for usable design. To validate the method, four evaluators inspected a set of use cases for a health care application....

  18. Multifunctional systems in vehicles:a usability evaluation

    OpenAIRE

    Rydström, Annie; Bengtsson, Peter; Grane, Camilla; Broström, Robert; Agardh, Johannes; Nilsson, Jennie

    2005-01-01

    Car Human-Machine Interaction (HMI) is becoming increasingly complex as the extension of functionality necessitates new interface concepts. Various multifunctional systems operated by haptic rotary switches, touch screen, and voice control have been developed. A usability study of multifunctional systems available on the market was carried out to evaluate and compare different manual interaction principles. The systems used in the study were the BMW iDrive and the Audi MMI, both operated by a...

  19. Usability Assessment of International Office Website of Diponegoro University With Scenario Based Usability Evaluation Method and Wammi Method

    OpenAIRE

    Ratna Purwaningsih; Ikhsan Yenifi

    2015-01-01

    Website development needs to pay attention to usability aspect which consist of four factors: efficiency, effectiveness, satisfactions and error rate. The website of International Office of Diponegoro University provides academic information for Indonesian students and foreign students. The website still has some problem, especially on searching certain information. This research aims to evaluate the design of the existing website and measures the usability. A well-designed website will help ...

  20. Usability evaluation of healthcare information systems: comparison of methods and classification of usability problems

    NARCIS (Netherlands)

    Khajouei, R.

    2011-01-01

    In ziekenhuizen wordt steeds meer gebruik gemaakt van informatiesystemen, maar de usability laat vaak te wensen over. Reza Khajouei testte twee methodes om de usability te beoordelen. Hij constateert dat beide methoden ongeveer evenveel, maar verschillende problemen aan het licht brengen. Uit een

  1. Evaluating the Usability of a Controlled Language Authoring Assistant

    Directory of Open Access Journals (Sweden)

    Miyata Rei

    2017-06-01

    Full Text Available This paper presents experimental results of a usability evaluation of a controlled language (CL authoring assistant designed to help non-professional writers create machine translatable source texts. As the author drafts the text, the system detects CL rule violations and proscribed terms. It also incorporates several support functions to facilitate rephrasing of the source. In order to assess the usability of the system, we conducted a rewriting experiment, in which we compared two groups of participants, one with the aid of the system and the other without it. The results revealed that our system helped reduce the number of CL violations by about 9% and the time to correct violations by more than 30%. The CL-applied source text resulted in higher fluency and adequacy of MT outputs. Questionnaire and interview results also implied the improved satisfaction with the task completion of those participants who used the system.

  2. A continuous usability evaluation of an electronic medication administration record application.

    Science.gov (United States)

    Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

    2017-12-01

    The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

  3. Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

    Science.gov (United States)

    Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

    2018-03-01

    At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

  4. Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

    Science.gov (United States)

    Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

    2018-01-05

    Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

  5. Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

    Science.gov (United States)

    Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

    2018-04-01

    In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

  6. Determination of the effectiveness of two methods for usability evaluation using a CPOE medication ordering system

    NARCIS (Netherlands)

    Khajouei, R.; Hasman, A.; Jaspers, M. W. M.

    2011-01-01

    Objectives: To assess the effectiveness of two usability evaluation methods, cognitive walkthrough (CW) and think aloud (TA), for identifying usability problems and to compare the performance of CW and TA in identifying different types of usability problems. Methods: A CW was performed by two

  7. Barefooted Usability Evaluation: Addressing the Mindset, Resources and Competences

    OpenAIRE

    Bruun , Anders

    2011-01-01

    Part 1: Long and Short Papers; International audience; Lack of usability specialists, high resource requirements and developer mindsets are three considerable barriers for introducing usability engineering into software companies. This Ph.D. project explores the effect of letting software developers and end users apply usability engineering methods instead of a specialist, a solution which may reduce the barriers.

  8. Usability evaluation of complex systems. A literature review

    International Nuclear Information System (INIS)

    Norros, L.; Savioja, P.

    2004-04-01

    In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In there view the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant's safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems. (orig.)

  9. Usability evaluation of in-housed developed ERP system

    Science.gov (United States)

    Faisal, Chaudhry Muhammad Nadeem; Shakeel Faridi, Muhammad; Javed, Zahid

    2011-10-01

    Enterprise Resource Planning systems are the combination of different business IS (Information System) applications that are designed according to the organization requirements. Generally ERP systems are suffering from complex user interface issues. Recent research shows that there is a need for improvement concerning, the user interface from their perspectives. In order to design the software applications that are easy to use, memorize and apply to new problems, we must know the users philosophy and something about learning, reminiscence and problems solving. The Usability engineering is the only way to study the deeds of users while interacting with ERP (Enterprise Resource & Planning). This paper will focus on the users' experiences view of financial module in ERP system. The HCI research method, explicitly survey questionnaire method was adopted to gather users understanding in order to evaluate the selected modules for in-housed ERP system. The study involved group of users from two industries, the results can not be generalized as a whole. The study was first time successfully applied Usability evaluation on in-housed ERP in local industry (Masood Textile Mills, Interloop Ltd) in Pakistan. The results may hopefully opened-up an area of research and methodology that could provide considerable further benefits to Industry in developments of Industrial information systems.

  10. A Usability Evaluation Model for Academic Library Websites: Efficiency, Effectiveness and Learnability

    Directory of Open Access Journals (Sweden)

    Soohyung Joo

    2011-12-01

    Full Text Available Purpose – This paper aimed to develop a usability evaluation model and associated survey tool in the context of academic libraries. This study not only proposed a usability evaluation model but also a practical survey tool tailored to academic library websites. Design/methodology – A usability evaluation model has been developed for academic library websites based on literature review and expert consultation. Then, the authors verified the reliability and validity of the usability evaluation model empirically using the survey data from actual users. Statistical analysis, such as descriptive statistics, internal consistency test, and a factor analysis, were applied to ensure both the reliability and validity of the usability evaluation tool. Findings – From the document analysis and expert consultation, this study identified eighteen measurement items to survey the three constructs of the usability, effectiveness, efficiency, and learnability, in academic library websites. The evaluation tool was then validated with regard to data distribution, reliability, and validity. The empirical examination based on 147 actual user responses proved the survey evaluation tool suggested herein is acceptable in assessing academic library website usability. Originality/Value – This research is one of the few studies to engender a practical survey tool in evaluating library website usability. The usability model and corresponding survey tool would be useful for librarians and library administrators in academic libraries who plan to conduct a usability evaluation involving large sample.

  11. Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

    Science.gov (United States)

    Zhou, Ronggang; Chan, Alan H S

    2017-01-01

    In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

  12. A Fuzzy method for the usability evaluation of nuclear medical equipment

    Energy Technology Data Exchange (ETDEWEB)

    Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V., E-mail: grecco@ien.gov.br, E-mail: luquetti@ien.gov.br, E-mail: msantana@ien.gov.br, E-mail: larissapfarias@ymail.com, E-mail: marques@ien.gov.br [Instituto de Engenharia Nuclear (DENN/IEN/CNEN/RJ), Rio de Janeiro, RJ (Brazil). Departamento de Engenharia Nuclear

    2017-11-01

    To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

  13. A Fuzzy method for the usability evaluation of nuclear medical equipment

    International Nuclear Information System (INIS)

    Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V.

    2017-01-01

    To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

  14. Distributed usability evaluation of the Pennsylvania Cancer Atlas.

    Science.gov (United States)

    Bhowmick, Tanuka; Robinson, Anthony C; Gruver, Adrienne; MacEachren, Alan M; Lengerich, Eugene J

    2008-07-11

    The Pennsylvania Cancer Atlas (PA-CA) is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi). In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability assessment strategy, we find that our distributed, web

  15. Distributed usability evaluation of the Pennsylvania Cancer Atlas

    Directory of Open Access Journals (Sweden)

    MacEachren Alan M

    2008-07-01

    Full Text Available Abstract Background The Pennsylvania Cancer Atlas (PA-CA is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi. In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. Results We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. Conclusion For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability

  16. A human reliability based usability evaluation method for safety-critical software

    International Nuclear Information System (INIS)

    Boring, R. L.; Tran, T. Q.; Gertman, D. I.; Ragsdale, A.

    2006-01-01

    Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thus allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)

  17. Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

    Science.gov (United States)

    Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

    2014-04-01

    This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

  18. The evaluator effect in usability studies: Problem detection and severity judgments

    DEFF Research Database (Denmark)

    Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

    1998-01-01

    Usability studies are commonly used in industry and applied in research as a yardstick for other usability evaluation methods. Though usability studies have been studied extensively, one potential threat to their reliability has been left virtually untouched: the evaluator effect. In this study......, four evaluators individually analyzed four videotaped usability test sessions. Only 20% of the 93 detected problems were detected by all evaluators, and 46% were detected by only a single evaluator. From the total set of 93 problems the evaluators individually selected the ten problems they considered...... most severe. None of the selected severe problems appeared on all four evaluators’ top-10 lists, and 4 of the 11 problems that were considered severe by more than one evaluator were only detected by one or two evaluators. Thus, both detection of usability problems and selection of the most severe...

  19. Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework.

    Science.gov (United States)

    Zhou, Ronggang; Chan, Alan H S

    2017-01-01

    In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.

  20. Health system guidance appraisal--concept evaluation and usability testing.

    Science.gov (United States)

    Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K

    2016-01-05

    Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final

  1. Evaluating Distributed Usability: the role of user interfaces in an activity system

    Directory of Open Access Journals (Sweden)

    Lejla Vrazalic

    2003-11-01

    Full Text Available Traditional definitions of usability localise this fundamental Human Computer Interaction (HCI concept in the user interface and reduce it to a variety of qualitative and quantitative attributes of the computer system. This simplistic view of usability has been used as the basis for developing design and evaluation methods in the discipline. This paper argues that, as a result, HCI methods are ineffective and suffer from various shortcomings. It is proposed that the notion of usability must be extended to include contextual factors, and viewed as being distributed across an activity system. Adopting this notion of distributed usability then requires a review of existing HCI methods. Usability testing, as a complete and self-contained HCI method, was chosen for this purpose, and the result, a distributed usability evaluation method (DUEM, is presented in this paper.

  2. An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

    Science.gov (United States)

    Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

    2016-01-01

    There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

  3. A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care

    NARCIS (Netherlands)

    Bakhshi-Raiez, F.; de Keizer, N. F.; Cornet, R.; Dorrepaal, M.; Dongelmans, D.; Jaspers, M. W. M.

    2012-01-01

    Objective: To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Design: Observational study with user-based usability evaluations

  4. The Focus of Current HCI Research in Usability Evaluation and Feedback

    DEFF Research Database (Denmark)

    Høegh, Rune Thaarup

    2007-01-01

    This paper presents the findings from a systematic literature study of the research on usability evaluation and feedback. The literature study covers the papers published from five key human-computer interaction journals for a period of four years, and depicts the most current research within...... the field with regard to usability evaluation and feedback....

  5. Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

    Science.gov (United States)

    Guo, J.; Iribarren, S.; Kapsandoy, S.; Perri, S.; Staggers, N.

    2011-01-01

    Background Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. Objective To conduct a formal usability evaluation of an implemented eMAR. Methods Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. Results Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. Conclusion The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety. PMID:23616871

  6. Can eye tracking boost usability evaluation of computer games?

    DEFF Research Database (Denmark)

    Johansen, Sune Alstrup; Noergaard, Mie; Soerensen, Janus Rau

    2008-01-01

    Good computer games need to be challenging while at the same time being easy to use. Accordingly, besides struggling with well known challenges for usability work, such as persuasiveness, the computer game industry also faces system-specific challenges, such as identifying methods that can provide...... data on players' attention during a game. This position paper discusses how eye tracking may address three core challenges faced by computer game producer IO Interactive in their on-going work to ensure games that are fun, usable, and challenging. These challenges are: (1) Persuading game designers...... about the relevance of usability results, (2) involving game designers in usability work, and (3) identifying methods that provide new data about user behaviour and experience....

  7. Evaluating Usability of E-Learning Systems in Universities

    OpenAIRE

    Nicholas Kipkurui Kiget; Professor G. Wanyembi; Anselemo Ikoha Peters

    2014-01-01

    The use of e-learning systems has increased significantly in the recent times. E-learning systems are supplementing teaching and learning in universities globally. Kenyan universities have adopted e-learning technologies as means for delivering course content. However despite adoption of these systems, there are considerable challenges facing the usability of the systems. Lecturers and students have different perceptions in regard to the usability of e-learning systems. The aim of this study ...

  8. Cultural Usability

    DEFF Research Database (Denmark)

    Shi, Qingxin

    2007-01-01

    Culture has already played an important role in the global market. It not only affects products, but also impacts on usability evaluation methods. This project aims to examine in the established thinking aloud usability evaluation method (TA UEM), how does the evaluator build a supportive...

  9. Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

    Science.gov (United States)

    von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

    2017-08-01

    The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

  10. Ionizing radiation detection meter systems usability evaluation. Technical memorandum

    International Nuclear Information System (INIS)

    Severs, Y.; Hughes, R.; Tack, D.; Bossi, L.L.M.

    2002-12-01

    In support of the Canadian Forces Nuclear Detection, Identification and Dosimetry project a usability trial of three Ionizing Radiation Detection Meter Systems (IRDMS) was conducted 18-22 June 2001 at Connaught Ranges. The systems evaluated: System 1: ANPDR 77 Operational System with PDR 77 Alpha/Beta probes and GPS (Global Positioning System) Training System; System 2: ADM 300C Operational System with ABP 100 Alpha/Beta probes and GPS Training System, and System 3: RAM R200 Operational System with PA 100M and RG12 Alpha/Beta probes and GPS Training System. Twelve military personnel (Private to Captain) determined compliance with the bid evaluation criteria. The counter-balanced study, based on a Latin square design, was divided into two assessment phases, an operational phase and a training system phase, which rotated three groups (of four participants each) concurrently through each IRDMS. Groups were trained in set-up, maintenance and operation of each bid IRDMS prior to evaluation. The operational evaluation consisted of a test/maintenance stand, an indoor/outdoor operational stand, and an indoor,/outdoor training system stand. Participants rated the utility and usability of each system, by measuring case of use/maintenance under a range of relevant operational and clothing conditions, compatibility with soldier tasks, compatibility with clothing, compatibility with equipment and operational environments, and case of learning (including an assessment of initial and refresher training implications). A 7-point Likert-like acceptability rating scale, which covered a range from completely unacceptable (1) to completely acceptable (7), was used to evaluate the measures. The combined weighted mean scores were 584.3 for System 1 (70 o /b), 682.0 for System 2 (81 %) and 756.9 for System 3 (90%) out of a total possible score of 840. Participants reported mean scores for System 1 between barely unacceptable and borderline for both indoor and outdoor operations. System 2

  11. Usability Evaluation of a Video Conferencing System in a University’s Classroom

    DEFF Research Database (Denmark)

    Khalid, Md. Saifuddin; Hossan, Md. Iqbal

    2016-01-01

    -Time Communications (e.g. Google Hangout, Adobe Connect, Cisco WebEx, and appear.in), and dedicated (e.g. Polycom). There is a lack of empirical study on usability evaluation of the interactive systems in educational contexts. This study identifies usability errors and measures user satisfaction of a dedicated VCS...

  12. Usability Evaluation of Electronic Health Record System around Clinical Notes Usage-An Ethnographic Study.

    Science.gov (United States)

    Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B

    2017-10-01

    Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.

  13. Wireless application guidelines for usability design and evaluation for developing countries

    International Nuclear Information System (INIS)

    Khoja, S.A.; Ursani, A.A.; Ali, A.

    2009-01-01

    The aim of this paper is to provide guidelines for designing wireless applications. These guidelines are developed with the help of Human Computer Interaction based Usability Evaluation surveys and tests results. These guidelines will help in making wireless applications more usable and attractive for users and will help designers to plan effective interactive applications. The guidelines presented in the paper have been derived from the results of surveys, usability tests and SET (Summative Evaluation Tests) carried out over 200 people of Karachi, Pakistan, from different walks of life with different academic and professional backgrounds, making imperative suggestions not only to improve the usability of exciting features given in wireless and mobile products, but also provide suggestions to improve usability of basic components such as, text, navigation, interactivity, multimedia, control and behavior. (author)

  14. From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies

    DEFF Research Database (Denmark)

    Kushniruk, Andre; Nøhr, Christian; Jensen, Sanne

    2013-01-01

    of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Results: Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under...... such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. Conclusion: In order to bring context of use...

  15. A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

    Science.gov (United States)

    Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

    2012-05-01

    To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

  16. Evaluation of Virtual Teaching-Learning Environments based on usability standards

    Directory of Open Access Journals (Sweden)

    Jose I. Cocunubo-Suarez

    2018-01-01

    Full Text Available The main objective of this review article is to determine the necessary sub-characteristics or aspects for the evaluation of Virtual Teaching-Learning Environments (VTLEs as final or finished products based on ISO 9126, 14598 and 25000-SQuaRE standards. A systematic information search was carried out. A total of 108 documents were retrieved about subjects such as web usability, virtual learning environments, usability, educational software, educational web evaluation, usability evaluation and web usability evaluation. Out of the 108 documents, 70 were selected by inclusion and exclusion analysis. The eight subfeatures of greater statistical frequency were identified among the subset of documents and then integrated as a proposal for standard 25000-SQuaRE.

  17. Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR.

    Science.gov (United States)

    Walji, Muhammad F; Kalenderian, Elsbeth; Piotrowski, Mark; Tran, Duong; Kookal, Krishna K; Tokede, Oluwabunmi; White, Joel M; Vaderhobli, Ram; Ramoni, Rachel; Stark, Paul C; Kimmes, Nicole S; Lagerweij, Maxim; Patel, Vimla L

    2014-05-01

    To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35). The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  18. Usability Evaluation Methods for Special Interest Internet Information Services

    Directory of Open Access Journals (Sweden)

    Eva-Maria Schön

    2014-06-01

    Full Text Available The internet provides a wide range of scientific information for different areas of research, used by the related scientific communities. Often the design or architecture of these web pages does not correspond to the mental model of their users. As a result the wanted information is difficult to find. Methods established by Usability Engineering and User Experience can help to increase the appeal of scientific internet information services by analyzing the users’ requirements. This paper describes a procedure to analyze and optimize scientific internet information services that can be accomplished with relatively low effort. It consists of a combination of methods that already have been successfully applied to practice: Personas, usability inspections, Online Questionnaire, Kano model and Web Analytics.

  19. Combinations of Methods for Collaborative Evaluation of the Usability of Interactive Software Systems

    Directory of Open Access Journals (Sweden)

    Andrés Solano

    2016-01-01

    Full Text Available Usability is a fundamental quality characteristic for the success of an interactive system. It is a concept that includes a set of metrics and methods in order to obtain easy-to-learn and easy-to-use systems. Usability Evaluation Methods, UEM, are quite diverse; their application depends on variables such as costs, time availability, and human resources. A large number of UEM can be employed to assess interactive software systems, but questions arise when deciding which method and/or combination of methods gives more (relevant information. We propose Collaborative Usability Evaluation Methods, CUEM, following the principles defined by the Collaboration Engineering. This paper analyzes a set of CUEM conducted on different interactive software systems. It proposes combinations of CUEM that provide more complete and comprehensive information about the usability of interactive software systems than those evaluation methods conducted independently.

  20. Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

    Science.gov (United States)

    Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

    The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

  1. Performance Evaluation of Two Different Usability Evaluation Methods in the Context of Collaborative Writing Systems

    OpenAIRE

    Bakhtyar, Shoaib; Afridi, Qaisar Zaman

    2010-01-01

    In today’s world of rapid technological development one cannot deny the importance of collaborative writing systems. Besides many advantages of a collaborative writing system the major one is to allow its end users to work in collaboration with each other without having to physically meet. In the past various researches has been carried out for the usability evaluation of collaborative writing systems using the think aloud protocol method however there is no study conducted on the comparison ...

  2. Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

    Science.gov (United States)

    Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

    2015-01-01

    The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

  3. Evaluating the Usability of Authoring Environments for Serious Games.

    Science.gov (United States)

    Slootmaker, Aad; Hummel, Hans; Koper, Rob

    2017-08-01

    Background . The EMERGO method and online platform enable the development and delivery of scenario-based serious games that foster students to acquire professional competence. One of the main goals of the platform is to provide a user-friendly authoring environment for creating virtual environments where students can perform authentic tasks. Aim . We present the findings of an in-depth qualitative case study of the platform's authoring environment and compare our findings on usability with those found for comparable environments in literature. Method . We carried out semi-structured interviews, with two experienced game developers who have authored a game for higher education, and a literature review of comparable environments. Findings . The analysis shows that the usability of the authoring environment is problematic, especially regarding understandability and learnability , which is in line with findings of comparable environments. Other findings are that authoring is well integrated with the EMERGO method and that functionality and reliability of the authoring environment are valued. Practical implications . The lessons learned are presented in the form of general guidelines to improve the understandability and learnability of authoring environments for serious games .

  4. The Usability of SEEQ in Quality Evaluation of Arabic Secondary Education in Malaysia

    Science.gov (United States)

    al-Muslim, M.; Arifin, Zamri

    2015-01-01

    Evaluation of the quality of Arabic education in Malaysia needs to be conducted on a continuous basis to achieve the objectives of Arabic education. Student Evaluation of Education Quality (SEEQ) was proposed as one of the evaluation instruments of the quality of Arabic education. This study aimed to evaluate the usability of SEEQ in the context…

  5. A literature review about usability evaluation methods for e-learning platforms.

    Science.gov (United States)

    Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

    2012-01-01

    The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

  6. A health literacy and usability heuristic evaluation of a mobile consumer health application.

    Science.gov (United States)

    Monkman, Helen; Kushniruk, Andre

    2013-01-01

    Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

  7. The E-health Literacy Demands of Australia's My Health Record: A Heuristic Evaluation of Usability.

    Science.gov (United States)

    Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie

    2017-01-01

    My Health Record is Australia's electronic personal health record system, which was introduced in July 2012. As of August 2017, approximately 21 percent of Australia's total population was registered to use My Health Record. Internationally, usability issues have been shown to negatively influence the uptake and use of electronic health record systems, and this scenario may particularly affect people who have low e-health literacy. It is likely that usability issues are negatively affecting the uptake and use of My Health Record in Australia. To identify potential e-health literacy-related usability issues within My Health Record through a heuristic evaluation method. Between September 14 and October 12, 2016, three of the authors conducted a heuristic evaluation of the two consumer-facing components of My Health Record-the information website and the electronic health record itself. These two components were evaluated against two sets of heuristics-the Health Literacy Online checklist and the Monkman Heuristics. The Health Literacy Online checklist and Monkman Heuristics are evidence-based checklists of web design elements with a focus on design for audiences with low health literacy. During this heuristic evaluation, the investigators individually navigated through the consumer-facing components of My Health Record, recording instances where the My Health Record did not conform to the checklist criteria. After the individual evaluations were completed, the investigators conferred and aggregated their results. From this process, a list of usability violations was constructed. When evaluated against the Health Literacy Online Checklist, the information website demonstrated violations in 12 of 35 criteria, and the electronic health record demonstrated violations in 16 of 35 criteria. When evaluated against the Monkman Heuristics, the information website demonstrated violations in 7 of 11 criteria, and the electronic health record demonstrated violations in 9 of 11

  8. The Design of Application-Specific Heuristics for the Usability Evaluation of the Digital Doorway

    Directory of Open Access Journals (Sweden)

    Funmi Adebesin

    2012-06-01

    Full Text Available The Digital Doorway (DD is a joint initiative between the South African Department of Science and Technology (DST and the Meraka Institute of the Council for Scientific and Industrial Research (CSIR. The DD is a non-standard computer system deployed amongst underprivileged communities in South Africa with the objective to promote computer literacy. Since its inception, there has been no usability or accessibility evaluation of the software installed on the DD, mainly due to lack of usability engineering or interaction design expertise within the development team. The goal of the research presented in this paper was to design a solution to this problem by developing a suitable instrument that could guide DD application developers in the design and development of more usable DD software and interfaces. Design research was used as a research methodology. We first investigated the applicability of the standard usability and accessibility evaluation methods for evaluating the software installed on the DD. During the first cycle of design research, we established that a heuristic-like evaluation method would be an appropriate method for evaluating the usability and direct accessibility support provided by the DD. During a second cycle of design research, embedded in the first, we also developed a set of multi-category heuristics as the ‘instrument’ that could guide the developers during design of applications as well as in the first-level (formative evaluation thereof. To verify the heuristics, we conducted a usability evaluation of the DD and triangulated the results with a direct field observation at a natural environment of DD use, together with user-administered questionnaires.

  9. Usability of a patient education and motivation tool using heuristic evaluation.

    Science.gov (United States)

    Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

    2009-11-06

    Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design

  10. Usability evaluation of mobile ICT support used at the building construction site

    DEFF Research Database (Denmark)

    Christiansson, Per; Svidt, Kjeld

    2006-01-01

    The paper summarizes findings from field evaluations and controlled laboratory usability evaluations of new mobile Information and Communication Technology, ICT, support used by craftsmen at construction sites as well as a discussion of methodologies for user centred ICT tools design. The finding...

  11. Usability Evaluation and Implementation of a Health Information Technology Dashboard of Evidence-Based Quality Indicators.

    Science.gov (United States)

    Schall, Mark Christopher; Cullen, Laura; Pennathur, Priyadarshini; Chen, Howard; Burrell, Keith; Matthews, Grace

    2017-06-01

    Health information technology dashboards that integrate evidence-based quality indicators can efficiently and accurately display patient risk information to promote early intervention and improve overall quality of patient care. We describe the process of developing, evaluating, and implementing a dashboard designed to promote quality care through display of evidence-based quality indicators within an electronic health record. Clinician feedback was sought throughout the process. Usability evaluations were provided by three nurse pairs and one physician from medical-surgical areas. Task completion times, error rates, and ratings of system usability were collected to compare the use of quality indicators displayed on the dashboard to the indicators displayed in a conventional electronic health record across eight experimental scenarios. Participants rated the dashboard as "highly usable" following System Usability Scale (mean, 87.5 [SD, 9.6]) and Poststudy System Usability Questionnaire (mean, 1.7 [SD, 0.5]) criteria. Use of the dashboard led to reduced task completion times and error rates in comparison to the conventional electronic health record for quality indicator-related tasks. Clinician responses to the dashboard display capabilities were positive, and a multifaceted implementation plan has been used. Results suggest application of the dashboard in the care environment may lead to improved patient care.

  12. PROOF OF CONCEPT FOR A HUMAN RELIABILITY ANALYSIS METHOD FOR HEURISTIC USABILITY EVALUATION OF SOFTWARE

    International Nuclear Information System (INIS)

    Ronald L. Boring; David I. Gertman; Jeffrey C. Joe; Julie L. Marble

    2005-01-01

    An ongoing issue within human-computer interaction (HCI) is the need for simplified or ''discount'' methods. The current economic slowdown has necessitated innovative methods that are results driven and cost effective. The myriad methods of design and usability are currently being cost-justified, and new techniques are actively being explored that meet current budgets and needs. Recent efforts in human reliability analysis (HRA) are highlighted by the ten-year development of the Standardized Plant Analysis Risk HRA (SPAR-H) method. The SPAR-H method has been used primarily for determining human centered risk at nuclear power plants. The SPAR-H method, however, shares task analysis underpinnings with HCI. Despite this methodological overlap, there is currently no HRA approach deployed in heuristic usability evaluation. This paper presents an extension of the existing SPAR-H method to be used as part of heuristic usability evaluation in HCI

  13. A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

    Science.gov (United States)

    Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

    2017-04-01

    Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

  14. Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

    Science.gov (United States)

    Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

    2016-10-04

    Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology

  15. Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

    Science.gov (United States)

    Peters, Vanessa L.; Songer, Nancy Butler

    2013-10-01

    This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

  16. Interplay between usability evaluation and software development (I-USED 2009)

    DEFF Research Database (Denmark)

    Abrahão, S.; Hornbæk, Kasper Anders Søren; Law, E.

    2009-01-01

    This workshop is aimed at bringing together researchers and practitioners from the Human-Computer Interaction (HCI) and Software Engineering (SE) fields to determine the state-of-the-art in the interplay between usability evaluation and software development and to generate ideas for new...... and improved relations between these activities. The aim is to base the determination of the current state on empirical studies. Presentations of new ideas on how to improve the interplay between HCI & SE to the design of usable software systems should also be based on empirical studies....

  17. Usability Evaluation of the Spatial OLAP Visualization and Analysis Tool (SOVAT).

    Science.gov (United States)

    Scotch, Matthew; Parmanto, Bambang; Monaco, Valerie

    2007-02-01

    Increasingly sophisticated technologies, such as On-Line Analytical Processing (OLAP) and Geospatial Information Systems (GIS), are being leveraged for conducting community health assessments (CHA). Little is known about the usability of OLAP and GIS interfaces with respect to CHA. We conducted an iterative usability evaluation of the Spatial OLAP Visualization and Analysis Tool (SOVAT), a software application that combines OLAP and GIS. A total of nine graduate students and six community health researchers were asked to think-aloud while completing five CHA questions using SOVAT. The sessions were analyzed after every three participants and changes to the interface were made based on the findings. Measures included elapsed time, answers provided, erroneous actions, and satisfaction. Traditional OLAP interface features were poorly understood by participants and combined OLAP-GIS features needed to be better emphasized. The results suggest that the changes made to the SOVAT interface resulted in increases in both usability and user satisfaction.

  18. Design research as a framework to evaluate the usability and accessibility of the digital doorway

    CSIR Research Space (South Africa)

    Adebesin, F

    2011-09-01

    Full Text Available , and then also evaluated the usability and direct accessibility support provided by the Digital Doorway, a non-standard computer system deployed amongst underprivileged communities in South Africa with the aim of promoting computer literacy. This paper discusses...

  19. Identifying usability issues for personalization during formative evaluations: a comparisons of three methods

    NARCIS (Netherlands)

    van Velsen, Lex Stefan; van der Geest, Thea; Klaassen, R.F.

    2011-01-01

    A personalized system is one that generates unique output for each individual. As a result, personalization has transformed the interaction between the user and the system, and specific new usability issues have arisen. Methods used for evaluating personalized systems should be able to reveal the

  20. DEVELOPING AND VALIDATION A USABILITY EVALUATION TOOLS FOR DISTANCE EDUCATION WEBSITES: Persian Version

    Directory of Open Access Journals (Sweden)

    Soheila HAFEZI

    2010-07-01

    Full Text Available The web is playing a central role in distance education. The word “usability” is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction. There are some useful usability evaluation instruments of websites in other languages. The aim of this study was to develop a Persian instrument to evaluate usability in distance education websites. This study was a methodology research design. According to review literature, the main structure of evaluation instrument for usability designed. It was consisted of forty-eight items divided in 8 domains. Each domain was composed of closed multiple choice questions in which an ordinal scale with three values is used (always, sometimes and never that measures the opinion of the evaluator about the frequency of visiting each item selected in the website. After that, we used face validity method. It refers to what instrument appears superficially to measure. At the final step, we omputed a formal content validity index (CVI across the experts’ ratings of each item’s relevance. The content validity index was measured by set of ten experts, who evaluated each item individually. According to CVI, the final version of instrument was composed of 40 questions divided into 8 domains: Navigation, Functionality, Feedback, Control, Language, Consistency, Error prevention and correction, and Visual clarity.CVI score for each phrase was more than 0.75. According to our findings, this instrument has enough validity to apply in evaluation usability of educational websites of Persian distance education websites. However, instrument reliability can be measured in further study.

  1. Questionnaire for usability evaluation of orthopaedic shoes: construction and reliability in patients with degenerative disorders of the foot

    NARCIS (Netherlands)

    Jannink, M.J.A.; de Vries, Jaap; Stewart, Roy E.; Groothoff, Johan W.; Lankhorst, Gustaaf J.

    2004-01-01

    Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

  2. Questionnaire for usability evaluation of orthopaedic shoes : Construction and reliability in patients with degenerative disorders of the foot

    NARCIS (Netherlands)

    Jannink, MJA; de Vries, J; Stewart, RE; Groothoff, JW; Lankhorst, GJ

    2004-01-01

    Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

  3. Questionnaire for usability evaluation of orthopaedic shoes : Construction and reliability in patients with degenerative disorders of the foot

    NARCIS (Netherlands)

    Jannink, MJA; de Vries, J; Stewart, RE; Groothoff, JW; Lankhorst, GJ

    Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

  4. Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

    Science.gov (United States)

    Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

    2018-04-01

    Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

  5. A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

    Science.gov (United States)

    Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

    Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

  6. Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards.

    Science.gov (United States)

    Moumane, Karima; Idri, Ali; Abran, Alain

    2016-01-01

    This paper presents an empirical study based on a set of measures to evaluate the usability of mobile applications running on different mobile operating systems, including Android, iOS and Symbian. The aim is to evaluate empirically a framework that we have developed on the use of the Software Quality Standard ISO 9126 in mobile environments, especially the usability characteristic. To do that, 32 users had participated in the experiment and we have used ISO 25062 and ISO 9241 standards for objective measures by working with two widely used mobile applications: Google Apps and Google Maps. The QUIS 7.0 questionnaire have been used to collect measures assessing the users' level of satisfaction when using these two mobile applications. By analyzing the results we highlighted a set of mobile usability issues that are related to the hardware as well as to the software and that need to be taken into account by designers and developers in order to improve the usability of mobile applications.

  7. Integrating Usability Evaluation into Model-Driven Video Game Development

    OpenAIRE

    Fernandez , Adrian; Insfran , Emilio; Abrahão , Silvia; Carsí , José ,; Montero , Emanuel

    2012-01-01

    Part 3: Short Papers; International audience; The increasing complexity of video game development highlights the need of design and evaluation methods for enhancing quality and reducing time and cost. In this context, Model-Driven Development approaches seem to be very promising since a video game can be obtained by transforming platform-independent models into platform-specific models that can be in turn transformed into code. Although this approach is started to being used for video game de...

  8. A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

    Science.gov (United States)

    Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M

    2015-01-01

    The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

  9. Evaluation of the Usability of Different Virtual Lab Software Used in Physics Courses

    Directory of Open Access Journals (Sweden)

    O. Karagoz

    2010-11-01

    Full Text Available In recent years the use of virtual lab software has become ubiquitous in education settings. The purpose of the current study is to de¬velop an Evaluation Scale to allow the easy and fast assessment of virtual lab software. During the development of the Evaluation Scale, theoretical and experimental studies investigating the effects of different software on learn¬ing, particularly in terms of usability, were utilized. The Evaluation Scale was created by adding new attributes to pre-existing scales, and comprises three sections – attributes related to the interface of the software; attributes related to its use as a material in education; and attributes related to product and ser¬vice support – and 79 items. Testing of the Evaluation Scale was carried out using two different virtual lab programmes, with the help of a checklist. The evaluation was carried out by physics teachers and academics that had previ¬ously used similar software, and consistency between the results was consid¬ered to represent inter-rater reliability. At the end of the study, the usability of the Evaluation Scale was tested, and the instructor evaluations regarding the usability characteristics considered sufficient and that require improvement in virtual lab software were also investigated.

  10. Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

    Science.gov (United States)

    Toombs, Elaine; Unruh, Anita; McGrath, Patrick

    2018-01-01

    This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

  11. Multi-attribute evaluation and choice of alternatives for surplus weapons-usable plutonium disposition at uncertainty

    International Nuclear Information System (INIS)

    Kosterev, V.V.; Bolyatko, V.V.; Khajretdinov, S.I.; Averkin, A.N.

    2014-01-01

    The problem of surplus weapons-usable plutonium disposition is formalized as a multi-attribute problem of a choice of alternatives from a set of possible alternatives under fuzzy conditions. Evaluation and ordering of alternatives for the surplus weapons-usable plutonium disposition and sensitivity analysis are carried out at uncertainty [ru

  12. Developing a Self-Report-Based Sequential Analysis Method for Educational Technology Systems: A Process-Based Usability Evaluation

    Science.gov (United States)

    Lin, Yi-Chun; Hsieh, Ya-Hui; Hou, Huei-Tse

    2015-01-01

    The development of a usability evaluation method for educational systems or applications, called the self-report-based sequential analysis, is described herein. The method aims to extend the current practice by proposing self-report-based sequential analysis as a new usability method, which integrates the advantages of self-report in survey…

  13. Evaluation and Satisfaction Survey on the Interface Usability of Online Publishing Software

    Directory of Open Access Journals (Sweden)

    Ying-Jye Lee

    2014-01-01

    Full Text Available Digital publishing is one of the national key programs. Different from traditional digital publishing models, consumers could create personal digital publications with the editing program provided by businesses and combine it with web-to-print to output solid publications. Nevertheless, the usability of online publishing software is related to consumers’ acceptance or intention of product purchase. In this case, Focus Group is utilized to screen representative online publishing software (including TinTint, Photobook, and Hypo for evaluating interface usability, investigating users’ Subjective Satisfaction, and further proposing suggestions for interface modification. Learnability and the number of user errors are set as the evaluation indicators of usability. Within the evaluation indicators in Learnability, the results show that nine typical tasks, except for Storing, show significant difference between various online publishing software. Typical tasks of basic information of works, appending pictures, adjusting pictures, changing type version, and changing pages in the number of user errors reveal significant difference on distinct online publishing software. Regarding the evaluation of overall Subjective Satisfaction with interface, TinTint and Hypo outperform Photobook, and no significant difference appears between TinTint and Hypo. It is expected that the research model could be the application reference of interface development and evaluation in digital content industries.

  14. The usability of ventilators: a comparative evaluation of use safety and user experience.

    Science.gov (United States)

    Morita, Plinio P; Weinstein, Peter B; Flewwelling, Christopher J; Bañez, Carleene A; Chiu, Tabitha A; Iannuzzi, Mario; Patel, Aastha H; Shier, Ashleigh P; Cafazzo, Joseph A

    2016-08-20

    The design complexity of critical care ventilators (CCVs) can lead to use errors and patient harm. In this study, we present the results of a comparison of four CCVs from market leaders, using a rigorous methodology for the evaluation of use safety and user experience of medical devices. We carried out a comparative usability study of four CCVs: Hamilton G5, Puritan Bennett 980, Maquet SERVO-U, and Dräger Evita V500. Forty-eight critical care respiratory therapists participated in this fully counterbalanced, repeated measures study. Participants completed seven clinical scenarios composed of 16 tasks on each ventilator. Use safety was measured by percentage of tasks with use errors or close calls (UE/CCs). User experience was measured by system usability and workload metrics, using the Post-Study System Usability Questionnaire (PSSUQ) and the National Aeronautics and Space Administration Task Load Index (NASA-TLX). Nine of 18 post hoc contrasts between pairs of ventilators were significant after Bonferroni correction, with effect sizes between 0.4 and 1.09 (Cohen's d). There were significantly fewer UE/CCs with SERVO-U when compared to G5 (p = 0.044) and V500 (p = 0.020). Participants reported higher system usability for G5 when compared to PB980 (p = 0.035) and higher system usability for SERVO-U when compared to G5 (p ventilators from market leaders compare and highlights the importance of medical technology design. Within the boundaries of this study, we can infer that SERVO-U demonstrated the highest levels of use safety and user experience, followed by G5. Based on qualitative data, differences in outcomes could be explained by interaction design, quality of hardware components used in manufacturing, and influence of consumer product technology on users' expectations.

  15. Usability Evaluation of Notebook Computers and Cellular Telephones Among Users with Visual and Upper Extremity Disabilities

    OpenAIRE

    Mooney, Aaron Michael

    2002-01-01

    Information appliances such as notebook computers and cellular telephones are becoming integral to the lives of many. These devices facilitate a variety of communication tasks, and are used for employment, education, and entertainment. Those with disabilities, however, have limited access to these devices, due in part to product designs that do not consider their special needs. A usability evaluation can help identify the needs and difficulties those with disabilities have when using a pro...

  16. Comparing two anesthesia information management system user interfaces: a usability evaluation.

    Science.gov (United States)

    Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M

    2012-11-01

    Anesthesia information management systems (AIMS) have been developed by multiple vendors and are deployed in thousands of operating rooms around the world, yet not much is known about measuring and improving AIMS usability. We developed a methodology for evaluating AIMS usability in a low-fidelity simulated clinical environment and used it to compare an existing user interface with a revised version. We hypothesized that the revised user interface would be more useable. In a low-fidelity simulated clinical environment, twenty anesthesia providers documented essential anesthetic information for the start of the case using both an existing and a revised user interface. Participants had not used the revised user interface previously and completed a brief training exercise prior to the study task. All participants completed a workload assessment and a satisfaction survey. All sessions were recorded. Multiple usability metrics were measured. The primary outcome was documentation accuracy. Secondary outcomes were perceived workload, number of documentation steps, number of user interactions, and documentation time. The interfaces were compared and design problems were identified by analyzing recorded sessions and survey results. Use of the revised user interface was shown to improve documentation accuracy from 85.1% to 92.4%, a difference of 7.3% (95% confidence interval [CI] for the difference 1.8 to 12.7). The revised user interface decreased the number of user interactions by 6.5 for intravenous documentation (95% CI 2.9 to 10.1) and by 16.1 for airway documentation (95% CI 11.1 to 21.1). The revised user interface required 3.8 fewer documentation steps (95% CI 2.3 to 5.4). Airway documentation time was reduced by 30.5 seconds with the revised workflow (95% CI 8.5 to 52.4). There were no significant time differences noted in intravenous documentation or in total task time. No difference in perceived workload was found between the user interfaces. Two user interface

  17. Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus?

    Science.gov (United States)

    Hermawati, Setia; Lawson, Glyn

    2016-09-01

    Heuristics evaluation is frequently employed to evaluate usability. While general heuristics are suitable to evaluate most user interfaces, there is still a need to establish heuristics for specific domains to ensure that their specific usability issues are identified. This paper presents a comprehensive review of 70 studies related to usability heuristics for specific domains. The aim of this paper is to review the processes that were applied to establish heuristics in specific domains and identify gaps in order to provide recommendations for future research and area of improvements. The most urgent issue found is the deficiency of validation effort following heuristics proposition and the lack of robustness and rigour of validation method adopted. Whether domain specific heuristics perform better or worse than general ones is inconclusive due to lack of validation quality and clarity on how to assess the effectiveness of heuristics for specific domains. The lack of validation quality also affects effort in improving existing heuristics for specific domain as their weaknesses are not addressed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  18. Checking an integrated model of web accessibility and usability evaluation for disabled people.

    Science.gov (United States)

    Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

    2005-07-08

    A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

  19. An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

    Science.gov (United States)

    Georgsson, Mattias; Staggers, Nancy

    2016-02-01

    mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability

  20. Evaluation of usability of Spanish academic library web portals using a cognitive-emotional heuristic model

    Directory of Open Access Journals (Sweden)

    Daniel Muñoz-Egido

    2017-03-01

    Full Text Available In this paper a cognitive-emotional usability analysis model based on heuristics was used to analyze eighteen academic library web portals. Starting with a review of existing literature on the subject, a set of seventy-one heuristic criteria grouped into six aspects was designed, to which the metrics developed by SIRIUS were applied. The result of the evaluation reveals that the average usability of websites of university libraries analyzed stands at 72.30 over 100 with a standard deviation of 5.57. The aspects with the lowest scores were Attention and Long Term Memory and Learning, which were therefore approached less satisfactorily from the user’s point of view.

  1. Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

    Science.gov (United States)

    Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

    2017-01-01

    Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

  2. Preliminary study of online machine translation use of nursing literature: quality evaluation and perceived usability

    Directory of Open Access Journals (Sweden)

    Anazawa Ryoko

    2012-11-01

    Full Text Available Abstract Background Japanese nurses are increasingly required to read published international research in clinical, educational, and research settings. Language barriers are a significant obstacle, and online machine translation (MT is a tool that can be used to address this issue. We examined the quality of Google Translate® (English to Japanese and Korean to Japanese, which is a representative online MT, using a previously verified evaluation method. We also examined the perceived usability and current use of online MT among Japanese nurses. Findings Randomly selected nursing abstracts were translated and then evaluated for intelligibility and usability by 28 participants, including assistants and research associates from nursing universities throughout Japan. They answered a questionnaire about their online MT use. From simple comparison of mean scores between two language pairs, translation quality was significantly better, with respect to both intelligibility and usability, for Korean-Japanese than for English-Japanese. Most respondents perceived a language barrier. Online MT had been used by 61% of the respondents and was perceived as not useful enough. Conclusion Nursing articles translated from Korean into Japanese by an online MT system could be read at an acceptable level of comprehension, but the same could not be said for English-Japanese translations. Respondents with experience using online MT used it largely to grasp the overall meanings of the original text. Enrichment in technical terms appeared to be the key to better usability. Users will be better able to use MT outputs if they improve their foreign language proficiency as much as possible. Further research is being conducted with a larger sample size and detailed analysis.

  3. Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

    Science.gov (United States)

    Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

    2015-01-01

    Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

  4. A Comparison of Quantitative and Qualitative Data from a Formative Usability Evaluation of an Augmented Reality Learning Scenario

    Directory of Open Access Journals (Sweden)

    Dragos Daniel IORDACHE

    2009-01-01

    Full Text Available The proliferation of augmented reality (AR technologies creates opportunities for the devel-opment of new learning scenarios. More recently, the advances in the design and implementation of desktop AR systems make it possible the deployment of such scenarios in primary and secondary schools. Usability evaluation is a precondition for the pedagogical effectiveness of these new technologies and requires a systematic approach for finding and fixing usability problems. In this paper we present an approach to a formative usability evaluation based on heuristic evaluation and user testing. The basic idea is to compare and integrate quantitative and qualitative measures in order to increase confidence in results and enhance the descriptive power of the usability evaluation report.

  5. Usability evaluation of low-cost virtual reality hand and arm rehabilitation games.

    Science.gov (United States)

    Seo, Na Jin; Arun Kumar, Jayashree; Hur, Pilwon; Crocher, Vincent; Motawar, Binal; Lakshminarayanan, Kishor

    2016-01-01

    The emergence of lower-cost motion tracking devices enables home-based virtual reality rehabilitation activities and increased accessibility to patients. Currently, little documentation on patients' expectations for virtual reality rehabilitation is available. This study surveyed 10 people with stroke for their expectations of virtual reality rehabilitation games. This study also evaluated the usability of three lower-cost virtual reality rehabilitation games using a survey and House of Quality analysis. The games (kitchen, archery, and puzzle) were developed in the laboratory to encourage coordinated finger and arm movements. Lower-cost motion tracking devices, the P5 Glove and Microsoft Kinect, were used to record the movements. People with stroke were found to desire motivating and easy-to-use games with clinical insights and encouragement from therapists. The House of Quality analysis revealed that the games should be improved by obtaining evidence for clinical effectiveness, including clinical feedback regarding improving functional abilities, adapting the games to the user's changing functional ability, and improving usability of the motion-tracking devices. This study reports the expectations of people with stroke for rehabilitation games and usability analysis that can help guide development of future games.

  6. A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations

    DEFF Research Database (Denmark)

    Sivaji, Ashok; Clemmensen, Torkil; Nielsen, Søren Feodor

    2017-01-01

    -educated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community’s pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting...... in Malaysia. The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA...... alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower...

  7. Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability.

    Science.gov (United States)

    de Góes, Fernanda dos Santos Nogueira; Fonseca, Luciana Mara Monti; de Camargo, Rosangela Andrade Aukar; de Oliveira, Gustavo Faria; Felipe, Helena Reche

    2015-11-01

    The use of new technology has recently grown considerably as an increasing number of college students using Internet. In nursing education, the personal computer and the Internet facilitate teaching theoretical and practical knowledge. Evaluate an educational technology known as "Anatomy and Vital Signs" with respect to content, appearance and usability. This was a first stage evaluation-by specialists to verify content and functioning, prior to a second validation as to learning by students. A methodological study in which instructional technologists (11 participants) and nursing specialists (17 participants) used the technology in an unguided manner and completed three questionnaires. The evaluation was measured by the difference between disagreement and agreement for each statement in the questionnaires. Most of the items were positively evaluated at a level higher than 70% by most of the evaluators except for the following usability criteria: grouping by shape, minimum actions and user control, which did not attain the 70% agreement level among instructional technologists. The evaluation was useful to improve the technology and guarantee suitable product for nursing education. It may be a reliable educational tool for nursing education that applies technological resources. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

  8. Investigation and evaluation into the usability of human-computer interfaces using a typical CAD system

    Energy Technology Data Exchange (ETDEWEB)

    Rickett, J D

    1987-01-01

    This research program covers three topics relating to the human-computer interface namely, voice recognition, tools and techniques for evaluation, and user and interface modeling. An investigation into the implementation of voice-recognition technologies examines how voice recognizers may be evaluated in commercial software. A prototype system was developed with the collaboration of FEMVIEW Ltd. (marketing a CAD package). A theoretical approach to evaluation leads to the hypothesis that human-computer interaction is affected by personality, influencing types of dialogue, preferred methods for providing helps, etc. A user model based on personality traits, or habitual-behavior patterns (HBP) is presented. Finally, a practical framework is provided for the evaluation of human-computer interfaces. It suggests that evaluation is an integral part of design and that the iterative use of evaluation techniques throughout the conceptualization, design, implementation and post-implementation stages will ensure systems that satisfy the needs of the users and fulfill the goal of usability.

  9. Design and Usability Evaluation of Social Mobile Diabetes Management System in the Gulf Region.

    Science.gov (United States)

    Alanzi, Turki; Istepanian, Robert; Philip, Nada

    2016-09-26

    The prevalence of diabetes in the Gulf States is one of the highest globally. It is estimated that 20% of the population in the region has been diagnosed with diabetes and according to the International Diabetes Federation (IDF), five of the IDF's "top 10" countries for diabetes prevalence in 2011 and projected for 2030 are in this region. In recent years, there have been an increasing number of clinical studies advocating the use of mobile phone technology for diabetes self-management with improved clinical outcomes. However, there are few studies to date addressing the application of mobile diabetes management in the Gulf region, particularly in the Kingdom of Saudi Arabia (KSA), where there is exponential increase in mobile phone usage and access to social networking. The objective of this paper is to present the design and development of a new mobile health system for social behavioral change and management tailored for Saudi patients with diabetes called Saudi Arabia Networking for Aiding Diabetes (SANAD). A usability study for the SANAD system is presented to validate the acceptability of using mobile technologies among patients with diabetes in the KSA and the Gulf region. The SANAD system was developed using mobile phone technology with diabetes management and social networking modules. For the usability study the Questionnaire for User Interaction Satisfaction was used to evaluate the usability aspect of the SANAD system. A total of 33 users with type 2 diabetes participated in the study. The key modules of the SANAD system consist of (1) a mobile diabetes management module; (2) a social networking module; and (3) a cognitive behavioral therapy module for behavioral change issues. The preliminary results of the usability study indicated general acceptance of the patients in using the system with higher usability rating in patients with type 2 diabetes. We found that the acceptability of the system was high among Saudi patients with diabetes, and ongoing

  10. An Evaluation of the Usability of a Computerized Decision Support System for Nursing Homes

    Science.gov (United States)

    Fossum, M.; Ehnfors, M.; Fruhling, A.; Ehrenberg, A.

    2011-01-01

    Background Computerized decision support systems (CDSSs) have the potential to significantly improve the quality of nursing care of older people by enhancing the decision making of nursing personnel. Despite this potential, health care organizations have been slow to incorporate CDSSs into nursing home practices. Objective This study describes facilitators and barriers that impact the ability of nursing personnel to effectively use a clinical CDSS for planning and treating pressure ulcers (PUs) and malnutrition and for following the suggested risk assessment guidelines for the care of nursing home residents. Methods We employed a qualitative descriptive design using varied methods, including structured group interviews, cognitive walkthrough observations and a graphical user interface (GUI) usability evaluation. Group interviews were conducted with 25 nursing personnel from four nursing homes in southern Norway. Five nursing personnel participated in cognitive walkthrough observations and the GUI usability evaluation. Text transcripts were analyzed using qualitative content analysis. Results Group interview participants reported that ease of use, usefulness and a supportive work environment were key facilitators of CDSS use. The barriers identified were lack of training, resistance to using computers and limited integration of the CDSS with the facility’s electronic health record (EHR) system. Key findings from the usability evaluation also identified the difficulty of using the CDSS within the EHR and the poorly designed GUI integration as barriers. Conclusion Overall, we found disconnect between two types of nursing personnel. Those who were comfortable with computer technology reported positive feedback about the CDSS, while others expressed resistance to using the CDSS for various reasons. This study revealed that organizations must invest more resources in educating nursing personnel on the seriousness of PUs and poor nutrition in the elderly, providing

  11. Expected usability is not a valid indicator of experienced usability

    Directory of Open Access Journals (Sweden)

    Meinald T. Thielsch

    2015-09-01

    Full Text Available Usability is a core construct of website evaluation and inherently defined as interactive. Yet, when analysing first impressions of websites, expected usability, i.e., before use, is of interest. Here we investigate to what extend ratings of expected usability are related to (a experienced usability, i.e., ratings after use, and (b objective usability measures, i.e., task performance. Furthermore, we try to elucidate how ratings of expected usability are correlated to aesthetic judgments. In an experiment, 57 participants submitted expected usability ratings after the presentation of website screenshots in three viewing-time conditions (50, 500, and 10,000 ms and after an interactive task (experienced usability. Additionally, objective usability measures (task completion and duration and subjective aesthetics evaluations were recorded for each website. The results at both the group and individual level show that expected usability ratings are not significantly related either to experienced usability or objective usability measures. Instead, they are highly correlated with aesthetics ratings. Taken together, our results highlight the need for interaction in empirical website usability testing, even when exploring very early usability impressions. In our study, user ratings of expected usability were no valid proxy neither for objective usability nor for experienced website usability.

  12. A Usability Evaluation of a Blended MOOC Environment: An Experimental Case Study

    Directory of Open Access Journals (Sweden)

    Ahmed Mohamed Fahmy Yousef

    2015-04-01

    Full Text Available In the past few years, there has been an increasing interest in Massive Open Online Courses (MOOCs as a new form of Technology-Enhanced Learning (TEL, in higher education and beyond. Recognizing the limitations of standalone MOOCs, blended MOOCs (bMOOCs that aim at bringing in-class (i.e. face-to-face interactions and online learning components together have emerged as an alternative MOOC model of teaching and learning in a higher education context. In this paper, we present the design, implementation, and evaluation details of a bMOOC course on “Teaching Methodologies” at Fayoum University, Egypt in cooperation with RWTH Aachen University, Germany, provided using the bMOOC platform L2P-bMOOC. In order to gauge the usability and effectiveness of the course, we employed an evaluation approach based on Conole’s 12 dimensions rubrics, ISONORM 9241/110-S as a general usability evaluation, and a custom effectiveness questionnaire reflecting the different MOOC stakeholder perspectives.

  13. Supporting cancer patients in illness management: usability evaluation of a mobile app.

    Science.gov (United States)

    Mirkovic, Jelena; Kaufman, David R; Ruland, Cornelia M

    2014-08-13

    Mobile phones and tablets currently represent a significant presence in people's everyday lives. They enable access to different information and services independent of current place and time. Such widespread connectivity offers significant potential in different app areas including health care. Our goal was to evaluate the usability of the Connect Mobile app. The mobile app enables mobile access to the Connect system, an online system that supports cancer patients in managing health-related issues. Along with symptom management, the system promotes better patient-provider communication, collaboration, and shared decision making. The Connect Mobile app enables access to the Connect system over both mobile phones and tablets. The study consisted of usability tests of a high fidelity prototype with 7 cancer patients where the objectives were to identify existing design and functionality issues and to provide patients with a real look-and-feel of the mobile system. In addition, we conducted semistructured interviews to obtain participants' feedback about app usefulness, identify the need for new system features and design requirements, and measure the acceptance of the mobile app and its features within everyday health management. The study revealed a total of 27 design issues (13 for mobile apps and 14 for tablet apps), which were mapped to source events (ie, errors, requests for help, participants' concurrent feedback, and moderator observation). We also applied usability heuristics to identify violations of usability principles. The majority of violations were related to enabling ease of input, screen readability, and glanceability (15 issues), as well as supporting an appropriate match between systems and the real world (7 issues) and consistent mapping of system functions and interactions (4 issues). Feedback from participants also showed the cancer patients' requirements for support systems and how these needs are influenced by different context-related factors

  14. A Model for Usability Evaluation for the Development and Implementation of Consumer eHealth Interventions.

    Science.gov (United States)

    Parry, David; Carter, Philip; Koziol-McLain, Jane; Feather, Jacqueline

    2015-01-01

    Consumer eHealth products are often used by people in their own homes or other settings without dedicated clinical supervision, and often with minimal training and limited support--much as eCommerce and eGovernment applications are currently deployed. Internet based self-care systems have been advocated for over a decade as a way to reduce costs and allow more convenient care, and--because of the expectation that they will be used to reduced health cost--, by increasing self-care and avoiding hospitalization. However, the history of consumer eHealth interventions is mixed, with many unsuccessful implementations. Many consumer eHealth products will form part of a broader complex intervention, with many possible benefits and effects on both individuals and society. This poster describes a model of consumer eHealth assessment based on multiple methods of usability evaluation at different stages in the design and fielding of eHealth systems. We argue that different methods of usability evaluation are able to give valuable insights into the likely effects of an intervention in a way that is congruent with software development processes.

  15. Evaluation bibliothekarischer Online-Angebote: Usability und Usefulness – zwei Seiten einer Medaille

    Directory of Open Access Journals (Sweden)

    Thomas Weinhold

    2013-11-01

    Full Text Available Aus Anwendersicht sind für die Qualität bibliothekarischer Online-Angebote zwei Aspekte entscheidend. Einerseits müssen für sie relevante Inhalte zur Verfügung stehen. Andererseits sollte es mög­lichst einfach und intuitiv möglich sein, diese Inhalte zu finden und auf sie zuzugreifen. Die Themen Usefulness und Usability sind daher für Bibliotheken von grosser Bedeutung. Der Beitrag beschreibt wie diese beiden Aspekte evaluiert werden können und wie Bibliotheken anhand von BibEval und PECI selb­ständig ihre Angebote überprüfen können. From the users’ point of view two aspects are essential for the quality of library online services. On the one hand, relevant content must be available. On the other hand, it should be simple and intuitive to find and to access this content. Therefore, the topics usability and usefulness are of great importance for li­braries. This article describes how these two aspects can be evaluated and how libraries can use BibEval and PECI for assessments of their own services.

  16. Engaging Community Stakeholders to Evaluate the Design, Usability, and Acceptability of a Chronic Obstructive Pulmonary Disease Social Media Resource Center

    Science.gov (United States)

    Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia

    2015-01-01

    Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was

  17. The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

    Science.gov (United States)

    Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

    2016-01-01

    Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be

  18. Usability of the remote console for virtual reality telerehabilitation: formative evaluation.

    Science.gov (United States)

    Lewis, Jeffrey A; Deutsch, Judith E; Burdea, Grigore

    2006-04-01

    The Remote Console (ReCon) is a telerehabilitation application that allows therapists to remotely communicate with patients while monitoring and controlling their virtual rehabilitation exercises. It provides therapists visual feedback of patients' movements, their exercise simulations replicated in real time and with tools to conduct training without a face-to-face session. The Recon underwent a formative evaluation (a type of usability engineering methodology) used to refine its design. Five physical therapists from different practice settings acted as representative users. During the evaluation, these users made errors related to manipulation and finding and understanding controls. Technical issues with the server and audio communication were identified. These findings were used to fine-tune the ReCon system.

  19. Usability Constructs

    DEFF Research Database (Denmark)

    Hertzum, Morten; Clemmesen, Torkil; Hornbæk, Kasper Anders Søren

    2007-01-01

    Whereas research on usability predominantly employs universal definitions of the aspects that comprise usability, people experience their use of information systems through personal constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected...... use of constructs traditionally associated with usability (e.g., easy-to-use, intuitive, and liked). Further analysis of the data is ongoing...

  20. Usability and Workflow Evaluation of “RhEumAtic Disease Activity” (READY)

    Science.gov (United States)

    Yen, Po-Yin; Lara, Barbara; Lopetegui, Marcelo; Bharat, Aseem; Ardoin, Stacy; Johnson, Bernadette; Mathur, Puneet; Embi, Peter J.

    2016-01-01

    Summary Background RhEumAtic Disease activitY (READY) is a mobile health (mHealth) application that aims to create a shared platform integrating data from both patients and physicians, with a particular emphasis on arthritis disease activity. Methods We made READY available on an iPad and pilot implemented it at a rheumatology out-patient clinic. We conducted 1) a usability evaluation study to explore patients’ and physicians’ interactions with READY, and 2) a time motion study (TMS) to observe the clinical workflow before and after the implementation. Results A total of 33 patients and 15 physicians participated in the usability evaluation. We found usability problems in navigation, data entry, pain assessment, documentation, and instructions along with error messages. Despite these issues, 25 (75,76%) patients reported they liked READY. Physicians provided mixed feedback because they were concerned about the impact of READY on clinical workflow. Six physicians participated in the TMS. We observed 47 patient visits (44.72 hours) in the pre-implementation phase, and 42 patient visits (37.82 hours) in the post-implementation phase. We found that patients spent more time on READY than paper (4.39mins vs. 2.26mins), but overall, READY did not delay the workflow (pre = 52.08 mins vs. post = 45.46 mins). This time difference may be compensated with READY eliminating a workflow step for the staff. Conclusion Patients preferred READY to paper documents. Many found it easier to input information because of the larger font size and the ease of ‘tapping’ rather than writing-out or circling answers. Even though patients spent more time on READY than using paper documents, the longer usage of READY was mainly due to when troubleshooting was needed. Most patients did not have problems after receiving initial support from the staff. This study not only enabled improvements to the software but also serves as good reference for other researchers or institutional decision

  1. Cross cultural usability testing

    DEFF Research Database (Denmark)

    Clemmensen, Torkil; Goyal, Shivam

    2005-01-01

    In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user....... This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud...... and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively...

  2. Evaluation of Web-Based Consumer Medication Information: Content and Usability of 4 Australian Websites.

    Science.gov (United States)

    Raban, Magdalena Z; Tariq, Amina; Richardson, Lauren; Byrne, Mary; Robinson, Maureen; Li, Ling; Westbrook, Johanna I; Baysari, Melissa T

    2016-07-21

    Medication is the most common intervention in health care, and written medication information can affect consumers' medication-related behavior. Research has shown that a large proportion of Australians search for medication information on the Internet. To evaluate the medication information content, based on consumer medication information needs, and usability of 4 Australian health websites: Better Health Channel, myDr, healthdirect, and NPS MedicineWise . To assess website content, the most common consumer medication information needs were identified using (1) medication queries to the healthdirect helpline (a telephone helpline available across most of Australia) and (2) the most frequently used medications in Australia. The most frequently used medications were extracted from Australian government statistics on use of subsidized medicines in the community and the National Census of Medicines Use. Each website was assessed to determine whether it covered or partially covered information and advice about these medications. To assess website usability, 16 consumers participated in user testing wherein they were required to locate 2 pieces of medication information on each website. Brief semistructured interviews were also conducted with participants to gauge their opinions of the websites. Information on prescription medication was more comprehensively covered on all websites (3 of 4 websites covered 100% of information) than nonprescription medication (websites covered 0%-67% of information). Most websites relied on consumer medicines information leaflets to convey prescription medication information to consumers. Information about prescription medication classes was less comprehensive, with no website providing all information examined about antibiotics and antidepressants. Participants (n=16) were able to locate medication information on websites in most cases (accuracy ranged from 84% to 91%). However, a number of usability issues relating to website

  3. Heuristic evaluation of paper-based Web pages: a simplified inspection usability methodology.

    Science.gov (United States)

    Allen, Mureen; Currie, Leanne M; Bakken, Suzanne; Patel, Vimla L; Cimino, James J

    2006-08-01

    Online medical information, when presented to clinicians, must be well-organized and intuitive to use, so that the clinicians can conduct their daily work efficiently and without error. It is essential to actively seek to produce good user interfaces that are acceptable to the user. This paper describes the methodology used to develop a simplified heuristic evaluation (HE) suitable for the evaluation of screen shots of Web pages, the development of an HE instrument used to conduct the evaluation, and the results of the evaluation of the aforementioned screen shots. In addition, this paper presents examples of the process of categorizing problems identified by the HE and the technological solutions identified to resolve these problems. Four usability experts reviewed 18 paper-based screen shots and made a total of 108 comments. Each expert completed the task in about an hour. We were able to implement solutions to approximately 70% of the violations. Our study found that a heuristic evaluation using paper-based screen shots of a user interface was expeditious, inexpensive, and straightforward to implement.

  4. 77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

    Science.gov (United States)

    2012-02-14

    ... usability of health information technology (HIT) systems, EHRs in particular, and performance-oriented user... the usability of health information technology (HIT) systems. NIST research is designed to: (1... DEPARTMENT OF COMMERCE National Institute of Standards and Technology [Docket No. 120123059-2058...

  5. The significance of a usability evaluation of an emerging laboratory order entry system

    NARCIS (Netherlands)

    Peute, Linda W. P.; Jaspers, Monique W. M.

    2007-01-01

    OBJECTIVES: To assess the usability of an emerging POE system, OM/Lab, for the computer-supported ordering of laboratory tests. We were more specifically interested in the relation of the usability problems detected in the user testing sessions with the order behaviour in terms of efficiency and

  6. Teaching clinical reasoning and decision-making skills to nursing students: Design, development, and usability evaluation of a serious game.

    Science.gov (United States)

    Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild

    2016-10-01

    Serious games (SGs) are a type of simulation technology that may provide nursing students with the opportunity to practice their clinical reasoning and decision-making skills in a safe and authentic environment. Despite the growing number of SGs developed for healthcare professionals, few SGs are video based or address the domain of home health care. This paper aims to describe the design, development, and usability evaluation of a video based SG for teaching clinical reasoning and decision-making skills to nursing students who care for patients with chronic obstructive pulmonary disease (COPD) in home healthcare settings. A prototype SG was developed. A unified framework of usability called TURF (Task, User, Representation, and Function) and SG theory were employed to ensure a user-centered design. The educational content was based on the clinical decision-making model, Bloom's taxonomy, and a Bachelor of Nursing curriculum. A purposeful sample of six participants evaluated the SG prototype in a usability laboratory. Cognitive walkthrough evaluations, a questionnaire, and individual interviews were used for the usability evaluation. The data were analyzed using qualitative deductive content analysis based on the TURF framework elements and related usability heuristics. The SG was perceived as being realistic, clinically relevant, and at an adequate level of complexity for the intended users. Usability issues regarding functionality and the user-computer interface design were identified. However, the SG was perceived as being easy to learn, and participants suggested that the SG could serve as a supplement to traditional training in laboratory and clinical settings. Using video based scenarios with an authentic COPD patient and a home healthcare registered nurse as actors contributed to increased realism. Using different theoretical approaches in the SG design was considered an advantage of the design process. The SG was perceived as being useful, usable, and

  7. Usability evaluation of a web-based support system for people with a schizophrenia diagnosis.

    Science.gov (United States)

    van der Krieke, Lian; Emerencia, Ando C; Aiello, Marco; Sytema, Sjoerd

    2012-02-06

    Routine Outcome Monitoring (ROM) is a systematic way of assessing service users' health conditions for the purpose of better aiding their care. ROM consists of various measures used to assess a service user's physical, psychological, and social condition. While ROM is becoming increasingly important in the mental health care sector, one of its weaknesses is that ROM is not always sufficiently service user-oriented. First, clinicians tend to concentrate on those ROM results that provide information about clinical symptoms and functioning, whereas it has been suggested that a service user-oriented approach needs to focus on personal recovery. Second, service users have limited access to ROM results and they are often not equipped to interpret them. These problems need to be addressed, as access to resources and the opportunity to share decision making has been indicated as a prerequisite for service users to become a more equal partner in communication with their clinicians. Furthermore, shared decision making has been shown to improve the therapeutic alliance and to lead to better care. Our aim is to build a web-based support system which makes ROM results more accessible to service users and to provide them with more concrete and personalized information about their functioning (ie, symptoms, housing, social contacts) that they can use to discuss treatment options with their clinician. In this study, we will report on the usability of the web-based support system for service users with schizophrenia. First, we developed a prototype of a web-based support system in a multidisciplinary project team, including end-users. We then conducted a usability study of the support system consisting of (1) a heuristic evaluation, (2) a qualitative evaluation and (3) a quantitative evaluation. Fifteen service users with a schizophrenia diagnosis and four information and communication technology (ICT) experts participated in the study. The results show that people with a

  8. Global usability

    CERN Document Server

    Douglas, Ian

    2011-01-01

    The concept of usability has become an increasingly important consideration in the design of all kinds of technology. As more products are aimed at global markets and developed through internationally distributed teams, usability design needs to be addressed in global terms. Interest in usability as a design issue and specialist area of research and education has developed steadily in North America and Europe since the 1980's. However, it is only over the last ten years that it has emerged as a global concern. Global Usability provides an introduction to the important issues in globalizing des

  9. Usability Evaluation of a Web-Based Symptom Monitoring Application for Heart Failure.

    Science.gov (United States)

    Wakefield, Bonnie; Pham, Kassie; Scherubel, Melody

    2015-07-01

    Symptom recognition and reporting by patients with heart failure are critical to avoid hospitalization. This project evaluated a patient symptom tracking application. Fourteen end users (nine patients, five clinicians) from a Midwestern Veterans Affairs Medical Center evaluated the website using a think aloud protocol. A structured observation protocol was used to assess success or failure for each task. Measures included task time, success, and satisfaction. Patients had a mean age of 70 years; clinicians averaged 42 years in age. Patients took 9.3 min and clinicians took less than 3 min per scenario. Most patients needed some assistance, but few patients were completely unable to complete some tasks. Clinicians demonstrated few problems navigating the site. Patient System Usability Scale item scores ranged from 2.0 to 3.6; clinician item scores ranged from 1.8 to 4.0. Further work is needed to determine whether using the web-based tool improves symptom recognition and reporting. © The Author(s) 2015.

  10. Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support.

    Science.gov (United States)

    Li, Alice C; Kannry, Joseph L; Kushniruk, Andre; Chrimes, Dillon; McGinn, Thomas G; Edonyabo, Daniel; Mann, Devin M

    2012-11-01

    Usability evaluations can improve the usability and workflow integration of clinical decision support (CDS). Traditional usability testing using scripted scenarios with think-aloud protocol analysis provide a useful but incomplete assessment of how new CDS tools interact with users and clinical workflow. "Near-live" clinical simulations are a newer usability evaluation tool that more closely mimics clinical workflow and that allows for a complementary evaluation of CDS usability as well as impact on workflow. This study employed two phases of testing a new CDS tool that embedded clinical prediction rules (an evidence-based medicine tool) into primary care workflow within a commercial electronic health record. Phase I applied usability testing involving "think-aloud" protocol analysis of 8 primary care providers encountering several scripted clinical scenarios. Phase II used "near-live" clinical simulations of 8 providers interacting with video clips of standardized trained patient actors enacting the clinical scenario. In both phases, all sessions were audiotaped and had screen-capture software activated for onscreen recordings. Transcripts were coded using qualitative analysis methods. In Phase I, the impact of the CDS on navigation and workflow were associated with the largest volume of negative comments (accounting for over 90% of user raised issues) while the overall usability and the content of the CDS were associated with the most positive comments. However, usability had a positive-to-negative comment ratio of only 0.93 reflecting mixed perceptions about the usability of the CDS. In Phase II, the duration of encounters with simulated patients was approximately 12 min with 71% of the clinical prediction rules being activated after half of the visit had already elapsed. Upon activation, providers accepted the CDS tool pathway 82% of times offered and completed all of its elements in 53% of all simulation cases. Only 12.2% of encounter time was spent using the

  11. The evaluation for the usability of the Varian Standard Couch modelingusing Treatment Planning System

    Energy Technology Data Exchange (ETDEWEB)

    Yang, Yong Mo; Song, Yong Min; Kim, Jin Man; Choi, Ji Min; Choi, Byeung Gi [Dept. of Radiation Oncology, Samsung Medical Center, Seoul (Korea, Republic of)

    2016-06-15

    When a radiation treatment, there is an attenuation by Carbon Fiber Couch. In this study, we tried to evaluate the usability of the Varian Standard Couch(VSC) by modeling with Treatment Planning System (TPS) VSC was scanned by CBCT(Cone Beam Computed Tomography) of the Linac(Clinac IX, VARIAN, USA), following the three conditions of VSC, Side Rail OutGrid(SROG), Side Rail InGrid(SRIG), Side Rail In OutSpine Down Bar(SRIOS). After scan, the data was transferred to TPS and modeled by contouring Side Rail, Side Bar Upper, Side Bar Lower, Spine Down Bar automatically. We scanned the Cheese Phantom(Middelton, USA) using Computed Tomography(Light Speed RT 16, GE, USA) and transfer the data to TPS, and apply VSC modeled previously with TPS to it. Dose was measured at the isocenter of Ion Chamber(A1SL, Standard imaging, USA) in Cheese Phantom using 4 and 10 MV radiation for every 5° gantry angle in a different filed size(3 X 3 cm{sup 2},10 X 10cm{sup 2}) without any change of MU(=100), and then we compared the calculated dose and measured dose. Also we included dose at the 127° in SRIG to compare the attenuation by Side Bar Upper. Results : The density of VSC by CBCT in TPS was 0.9g/cm{sup 3}, and in the case of Spine Down Bar, it was 0.7g/cm{sup 3}. The radiation was attenuated by 17.49%, 16.49%, 8.54%, and 7.59% at the Side Rail, Side Bar Upper, Side Bar Lower, and Spine Down Bar. For the accuracy of modeling, calculated dose and measured dose were compared. The average error was 1.13% and the maximum error was 1.98% at the 170° beam crossing the Spine Down Bar. To evaluate the usability for the VSC modeled by TPS, the maximum error was 1.98% as a result of compassion between calculated dose and measured dose. We found out that VSC modeling helped expect the dose, so we think that it will be helpful for the more accurate treatment.

  12. Human Machine Interface and Usability Issues: Exploring a Preliminary Mission Management System Evaluation Methodology

    National Research Council Canada - National Science Library

    Kardos, Monique

    2001-01-01

    ...) concept demonstrator test during June 2000. The questionnaire was designed to examine usability and interface issues relating to the design of the systems or tools, and to provide suggestions for future iterations of the system...

  13. Users' performance in lab and non-lab environments through online usability testing:A case of evaluating the usability of digital academic libraries' websites

    OpenAIRE

    Alharbi, Abeer; Mayhew, Pam

    2015-01-01

    The factors related to the environment in which users operate may be of a vital importance when trying to understand how they experience a particular system. It is required that we find out how we can get to know those factors to investigate if they affect the users' performance in usability testing. An online usability study has emerged that can be attempted by a large, varied pool of users' anywhere with an Internet connection. Would the usage of an online usability study help to give compr...

  14. Usability Briefing for hospital design

    DEFF Research Database (Denmark)

    Fronczek-Munter, Aneta

    This PhD thesis is a contribution to an ongoing debate in Denmark about improving the building design processes of complex buildings, especially in relation to the current hospital developments. It provides knowledge about capturing user needs and defines the process model for usability briefing...... and evaluations, can be fed into briefing and design processes. This PhD thesis proposes methods for usability briefing.Usability is a concept similar to functionality, but usability depends on: subjective view of users, context, culture, situation and experience. Understanding usability is achieved by involving...... users. This PhD thesis extends the research in usability of buildings to include all building design phases, therefore not only proposes usability evaluations, but also defines usability briefing. Briefing, also called architectural programming, is usually understood as one of the first phases...

  15. Formal usability evaluation of audio track widget graphical representation for two-dimensional stage audio mixing interface

    OpenAIRE

    Dewey, Christopher; Wakefield, Jonathan P.

    2017-01-01

    The two-dimensional stage paradigm (2DSP) has been suggested as an alternative audio mixing interface (AMI). This study seeks to refine the 2DSP by formally evaluating graphical track visualisation styles. Track visualisations considered were text only, circles containing text, individually coloured circles containing text, circles colour coded by instrument type with text, icons with text superimposed, circles with RMS related dynamic opacity and a traditional AMI. The usability evaluation f...

  16. Using scenarios and personas to enhance the effectiveness of heuristic usability evaluations for older adults and their care team.

    Science.gov (United States)

    Kneale, Laura; Mikles, Sean; Choi, Yong K; Thompson, Hilaire; Demiris, George

    2017-09-01

    Using heuristics to evaluate user experience is a common methodology for human-computer interaction studies. One challenge of this method is the inability to tailor results towards specific end-user needs. This manuscript reports on a method that uses validated scenarios and personas of older adults and care team members to enhance heuristics evaluations of the usability of commercially available personal health records for homebound older adults. Our work extends the Chisnell and Redish heuristic evaluation methodology by using a protocol that relies on multiple expert reviews of each system. It further standardizes the heuristic evaluation process through the incorporation of task-based scenarios. We were able to use the modified version of the Chisnell and Redish heuristic evaluation methodology to identify potential usability challenges of two commercially available personal health record systems. This allowed us to: (1) identify potential usability challenges for specific types of users, (2) describe improvements that would be valuable to all end-users of the system, and (3) better understand how the interactions of different users may vary within a single personal health record. The methodology described in this paper may help designers of consumer health information technology tools, such as personal health records, understand the needs of diverse end-user populations. Such methods may be particularly helpful when designing systems for populations that are difficult to recruit for end-user evaluations through traditional methods. Copyright © 2017 Elsevier Inc. All rights reserved.

  17. SU-F-J-72: A Clinical Usable Integrated Contouring Quality Evaluation Software for Radiotherapy

    International Nuclear Information System (INIS)

    Jiang, S; Dolly, S; Cai, B; Mutic, S; Li, H

    2016-01-01

    Purpose: To introduce the Auto Contour Evaluation (ACE) software, which is the clinical usable, user friendly, efficient and all-in-one toolbox for automatically identify common contouring errors in radiotherapy treatment planning using supervised machine learning techniques. Methods: ACE is developed with C# using Microsoft .Net framework and Windows Presentation Foundation (WPF) for elegant GUI design and smooth GUI transition animations through the integration of graphics engines and high dots per inch (DPI) settings on modern high resolution monitors. The industrial standard software design pattern, Model-View-ViewModel (MVVM) pattern, is chosen to be the major architecture of ACE for neat coding structure, deep modularization, easy maintainability and seamless communication with other clinical software. ACE consists of 1) a patient data importing module integrated with clinical patient database server, 2) a 2D DICOM image and RT structure simultaneously displaying module, 3) a 3D RT structure visualization module using Visualization Toolkit or VTK library and 4) a contour evaluation module using supervised pattern recognition algorithms to detect contouring errors and display detection results. ACE relies on supervised learning algorithms to handle all image processing and data processing jobs. Implementations of related algorithms are powered by Accord.Net scientific computing library for better efficiency and effectiveness. Results: ACE can take patient’s CT images and RT structures from commercial treatment planning software via direct user input or from patients’ database. All functionalities including 2D and 3D image visualization and RT contours error detection have been demonstrated with real clinical patient cases. Conclusion: ACE implements supervised learning algorithms and combines image processing and graphical visualization modules for RT contours verification. ACE has great potential for automated radiotherapy contouring quality verification

  18. Brain-computer interface controlled gaming: evaluation of usability by severely motor restricted end-users.

    Science.gov (United States)

    Holz, Elisa Mira; Höhne, Johannes; Staiger-Sälzer, Pit; Tangermann, Michael; Kübler, Andrea

    2013-10-01

    Connect-Four, a new sensorimotor rhythm (SMR) based brain-computer interface (BCI) gaming application, was evaluated by four severely motor restricted end-users; two were in the locked-in state and had unreliable eye-movement. Following the user-centred approach, usability of the BCI prototype was evaluated in terms of effectiveness (accuracy), efficiency (information transfer rate (ITR) and subjective workload) and users' satisfaction. Online performance varied strongly across users and sessions (median accuracy (%) of end-users: A=.65; B=.60; C=.47; D=.77). Our results thus yielded low to medium effectiveness in three end-users and high effectiveness in one end-user. Consequently, ITR was low (0.05-1.44bits/min). Only two end-users were able to play the game in free-mode. Total workload was moderate but varied strongly across sessions. Main sources of workload were mental and temporal demand. Furthermore, frustration contributed to the subjective workload of two end-users. Nevertheless, most end-users accepted the BCI application well and rated satisfaction medium to high. Sources for dissatisfaction were (1) electrode gel and cap, (2) low effectiveness, (3) time-consuming adjustment and (4) not easy-to-use BCI equipment. All four end-users indicated ease of use as being one of the most important aspect of BCI. Effectiveness and efficiency are lower as compared to applications using the event-related potential as input channel. Nevertheless, the SMR-BCI application was satisfactorily accepted by the end-users and two of four could imagine using the BCI application in their daily life. Thus, despite moderate effectiveness and efficiency BCIs might be an option when controlling an application for entertainment. Copyright © 2013 Elsevier B.V. All rights reserved.

  19. SU-F-J-72: A Clinical Usable Integrated Contouring Quality Evaluation Software for Radiotherapy

    Energy Technology Data Exchange (ETDEWEB)

    Jiang, S; Dolly, S; Cai, B; Mutic, S; Li, H [Washington University School of Medicine, Saint Louis, MO (United States)

    2016-06-15

    Purpose: To introduce the Auto Contour Evaluation (ACE) software, which is the clinical usable, user friendly, efficient and all-in-one toolbox for automatically identify common contouring errors in radiotherapy treatment planning using supervised machine learning techniques. Methods: ACE is developed with C# using Microsoft .Net framework and Windows Presentation Foundation (WPF) for elegant GUI design and smooth GUI transition animations through the integration of graphics engines and high dots per inch (DPI) settings on modern high resolution monitors. The industrial standard software design pattern, Model-View-ViewModel (MVVM) pattern, is chosen to be the major architecture of ACE for neat coding structure, deep modularization, easy maintainability and seamless communication with other clinical software. ACE consists of 1) a patient data importing module integrated with clinical patient database server, 2) a 2D DICOM image and RT structure simultaneously displaying module, 3) a 3D RT structure visualization module using Visualization Toolkit or VTK library and 4) a contour evaluation module using supervised pattern recognition algorithms to detect contouring errors and display detection results. ACE relies on supervised learning algorithms to handle all image processing and data processing jobs. Implementations of related algorithms are powered by Accord.Net scientific computing library for better efficiency and effectiveness. Results: ACE can take patient’s CT images and RT structures from commercial treatment planning software via direct user input or from patients’ database. All functionalities including 2D and 3D image visualization and RT contours error detection have been demonstrated with real clinical patient cases. Conclusion: ACE implements supervised learning algorithms and combines image processing and graphical visualization modules for RT contours verification. ACE has great potential for automated radiotherapy contouring quality verification

  20. Evaluation of the Usability of Selected Questionnaires Assessing Physical Activity in the Prophylaxis of Cardiovascular Diseases.

    Science.gov (United States)

    Czeczelewska, Ewa; Czeczelewski, Jan; Wasiluk, Agnieszka; Saczuk, Jerzy

    2016-01-01

    The main health problem of the Polish population is posed by cardiovascular diseases (CDVD), coronary artery disease (CAD) in particular. Respectively higher physical activity linked with energy expenditure of at least 1000 kcal/week may significantly reduce the risk of CAD development. The protective effect of exercise applies not only to persons from high-risk groups and with diagnosed chronic diseases that increase the risk of the incidence of atherosclerosis and its complications, but also to healthy individuals. The aim of this study was to evaluate the usability of the Seven-Day Physical Activity Recall (SDPAR) and International Physical Activity Questionnaire (IPAQ) in research on the correlation between physical activity and risk factors of cardiovascular diseases. A screening survey, conducted in 2012, included students (n = 340) of the Division of the Academy of Physical Education in Biała Podlaska, aged 18-29 years. Total cholesterol, triglycerides and glucose levels were analyzed, and arterial blood pressure and heart rate were measured. The physical activity of the students was estimated using IPAQ and SDPAR questionnaires. The effect of physical activity on the biochemical blood markers, arterial blood pressure and heart rate was analyzed in groups differing in weekly energy expenditure (WEE). Along with increasing WEE values, calculated with IPAQ and SDPAR questionnaires, tangible descending tendencies were observed in cholesterol concentration in both genders. Significant differences were demonstrated in mean values of the resting heart rate between terciles of women ranked according to the increasing WEE values calculated using IPAQ (p physical activity; however the SDPAR seems to be a more useful tool in CDVD prevention screening.

  1. Usability-Studie zu KonSearch : Evaluation der neuen Literatursuchmaschine der Universität Konstanz

    OpenAIRE

    Luca, Helena

    2011-01-01

    Der vorliegende Bericht beschreibt Hintergründe, Methodik und Ergebnisse einer Usability-Evaluation, die im Sommersemester 2011 im Zuge der Einführung der Literatursuchmaschine KonSearch an der Universität Konstanz durchgeführt wurde. Die neue Suchmaschine basiert auf dem Resource Discovery Service Summon der Firma SerialsSolutions. Sie soll den Benutzern der Bibliothek der Universität Konstanz eine effektive, effiziente und zufriedenstellende Suche nach wissenschaftlichen Informationen ermög...

  2. Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson's heuristics.

    Science.gov (United States)

    Joshi, Ashish; Perin, Douglas M Puricelli; Amadi, Chioma; Trout, Kate

    2015-03-05

    The study purpose was to conduct heuristic evaluation of an interactive, bilingual touchscreen-enabled breastfeeding educational programme for Hispanic women living in rural settings in Nebraska. Three raters conducted the evaluation during May 2013 using principles of Nielson's heuristics. A total of 271 screens were evaluated and included: interface (n = 5), programme sections (n = 223) and educational content (n = 43). A total of 97 heuristic violations were identified and were mostly related to interface (8 violations/5 screens) and programme components (89 violations/266 screens). The most common heuristic violations reported were recognition rather than recall (62%, n = 60), consistency and standards (14%, n = 14) and match between the system and real world (9%, n = 9). Majority of the heuristic violations had minor usability issues (73%, n = 71). The only grade 4 heuristic violation reported was due to the visibility of system status in the assessment modules. The results demonstrated that the system was more consistent with Nielsen's usability heuristics. With Nielsen's usability heuristics, it is possible to identify problems in a timely manner, and help facilitate the identification and prioritisation of problems needing urgent attention at an earlier stage before the final deployment of the system.

  3. Evaluating Ubiquitous Media Usability Challenges: Content Transfer and Channel Switching Delays

    DEFF Research Database (Denmark)

    Fleury, Alexandre; Pedersen, Jakob Schou; Larsen, Lars Bo

    2011-01-01

    As ubiquitous media is developing rapidly, new HCI challenges emerge. In this paper, we address usability issues related to the transfer of content between fixed and mobile devices, as well as channel switching delays on mobile devices. We first provide an extensive review of the field. We...

  4. Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory

    Science.gov (United States)

    Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda

    2008-01-01

    This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…

  5. Evaluating CSL/CFL Website Usability: A User-Centered Design Approach

    Science.gov (United States)

    Huang, Chung-Kai; Hsin, Ching-O; Chiu, Chiung-Hui

    2010-01-01

    With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as their…

  6. An Evaluation of the Design and Usability of a Novel Robotic Bilateral Arm Rehabilitation Device for Patients with Stroke

    Directory of Open Access Journals (Sweden)

    Yu-Cheng Pei

    2017-07-01

    Full Text Available Study designCase series.Evidence levelIV (case series.IntroductionRobot-assisted therapy for upper limb rehabilitation is an emerging research topic and its design process must integrate engineering, neurological pathophysiology, and clinical needs.Purpose of the studyThis study developed/evaluated the usefulness of a novel rehabilitation device, the MirrorPath, designed for the upper limb rehabilitation of patients with hemiplegic stroke.MethodsThe process follows Tseng’s methodology for innovative product design and development, namely two stages, device development and usability assessment. During the development process, the design was guided by patients’ rehabilitation needs as defined by patients and their therapists. The design applied synchronic movement of the bilateral upper limbs, an approach that is compatible with the bilateral movement therapy and proprioceptive neuromuscular facilitation theories. MirrorPath consists of a robotic device that guides upper limb movement linked to a control module containing software controlling the robotic movement.ResultsFive healthy subjects were recruited in the pretest, and 4 patients, 4 caregivers, and 4 therapists were recruited in the formal test for usability. All recruited subjects were allocated to the test group, completed the evaluation, and their data were all analyzed. The total system usability scale score obtained from the patients, caregivers, and therapists was 71.8 ± 11.9, indicating a high level of usability and product acceptance.Discussion and conclusionFollowing a standard development process, we could yield a design that meets clinical needs. This low-cost device provides a feasible platform for carrying out robot-assisted bilateral movement therapy of patients with hemiplegic stroke.Clinical Trial Registrationidentifier NCT02698605.

  7. Multi-method laboratory user evaluation of an actionable clinical performance information system: Implications for usability and patient safety.

    Science.gov (United States)

    Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain

    2018-01-01

    Electronic audit and feedback (e-A&F) systems are used worldwide for care quality improvement. They measure health professionals' performance against clinical guidelines, and some systems suggest improvement actions. However, little is known about optimal interface designs for e-A&F, in particular how to present suggested actions for improvement. We developed a novel theory-informed system for primary care (the Performance Improvement plaN GeneratoR; PINGR) that covers the four principal interface components: clinical performance summaries; patient lists; detailed patient-level information; and suggested actions. As far as we are aware, this is the first report of an e-A&F system with all four interface components. (1) Use a combination of quantitative and qualitative methods to evaluate the usability of PINGR with target end-users; (2) refine existing design recommendations for e-A&F systems; (3) determine the implications of these recommendations for patient safety. We recruited seven primary care physicians to perform seven tasks with PINGR, during which we measured on-screen behaviour and eye movements. Participants subsequently completed usability questionnaires, and were interviewed in-depth. Data were integrated to: gain a more complete understanding of usability issues; enhance and explain each other's findings; and triangulate results to increase validity. Participants committed a median of 10 errors (range 8-21) when using PINGR's interface, and completed a median of five out of seven tasks (range 4-7). Errors violated six usability heuristics: clear response options; perceptual grouping and data relationships; representational formats; unambiguous description; visually distinct screens for confusable items; and workflow integration. Eye movement analysis revealed the integration of components largely supported effective user workflow, although the modular design of clinical performance summaries unnecessarily increased cognitive load. Interviews and

  8. Usability evaluation through gonad shielding production of pediatric patients by gender and age rating

    International Nuclear Information System (INIS)

    Chui, Sung Hyun; Park, Jung Eun; Chun, Woon Kwan; Ju, Yong Jin; Yang, Nam Hee; Dong, Kyung Rae

    2015-01-01

    The gonad shielding is used to minimize the impact of the exposure to gonads when Abdomen, Plevis and Hip X-ray inspections are conducted on radiation impressionable pediatric patients. By the way, the gonad is palpable difficult and impossible to check visually because it's a sensitive area, so tests are conducted with the approximate location of shielding, thereby appearing problems of not shielding gonads accurately. Accordingly, this study produced shields by age and gender of pediatric patients and studied the method of positioning shields with ASIS as a reference point without palpable sensitive areas, and tried to evaluate its usability. The study surveyed 30 pediatric patients by gender and age, who came and got inspected in Department of Radiology, our hospital from February 2012 to January 2014 and obtained the value of tolerance by measuring the average size of the pelvis using the distance measurement function of Infinitt Piview with the images stored in the PACS and producing shields by age and gender of pediatric patients and specifying the areas at random for the comparative analysis of pre- and post-using. It calculated the technology statistics (mean±SD) with the value of tolerance measured the length using SPSS 12.0 statistical program. As for boys, differences in the tolerance range of pre- and post-using shields were 2.69 mm in case of 1 year old, 2.58 mm in 2 years, 2.37 mm in 3 years, 2.815 mm in 4-5 years, 2.043 mm in 7-10 years, and as for girls,1.92 mm in 1-2 years, 1.75 mm in 3-4 years, 2.52 mm in 5-6 years and 1.93 mm in 7-10. After analyzing the pre- and post-using shields for all of boys and girls, there were statistically significant differences (P<0.050). It is considered that we can minimize the exposure to gonads and get a better video for diagnosis in testing high biological impressionable pediatric, if we use shields correctly with ASIS as a reference point considering its shape and size by age and gender in Abdomen, Plevis

  9. Evaluating the Usability of a Wearable Social Skills Training Technology for Children with Autism Spectrum Disorder

    Directory of Open Access Journals (Sweden)

    Ben G. Kinsella

    2017-07-01

    Full Text Available Affecting 1 in 68, autism spectrum disorder (ASD is a complex neurodevelopmental disorder characterized by social skill impairments. While prognosis can be significantly improved with intervention, few evidence-based interventions exist for social skill deficits in ASD. Existing interventions are resource-intensive, their outcomes vary widely for different individuals, and they often do not generalize to new contexts. Technology-aided intervention is a motivating, low-cost, and versatile approach for social skills training in ASD. Although early studies support the feasibility of technology-aided intervention, existing approaches have been criticized for teaching social skills through human-to-computer interaction, paradoxically leading to increased social isolation. To address this gap, we propose a system to help guide human-to-human interaction called Holli, a wearable technology to serve as a social skills coach for children with ASD. The Google Glass-based application listens to conversations and prompts the user with appropriate social responses. In this paper, we describe a usability study we conducted to determine the feasibility of using wearable technology to prompt children with ASD throughout social conversations. Fifteen children with ASD (mean age = 12.92 ± 2.33, verbal intelligent quotient = 103.3 ± 18.73 used the application while engaging in a restaurant-themed interaction with a research assistant. The application was evaluated on its effectiveness (i.e., how accurately the application responds, efficiency (i.e., how quickly the user and the application respond, and user satisfaction (based on a post-session questionnaire. All users were able to successfully complete the 10-turn exchange while using Holli. The results indicated the Holli accurately detected and recognized user utterance in real time. Participants reported positive experiences of using the application. To the best of our knowledge, this system

  10. Usability evaluation through gonad shielding production of pediatric patients by gender and age rating

    Energy Technology Data Exchange (ETDEWEB)

    Chui, Sung Hyun; Park, Jung Eun [Dept. of Radiology, Kyung Hee University Hospital at Gangdong, Seoul (Korea, Republic of); Chun, Woon Kwan; Ju, Yong Jin; Yang, Nam Hee [Dept. of Nuclear Engineering, Chosun University, Gwangju (Korea, Republic of); Dong, Kyung Rae [Dept. of Radiological Technology, Gwangju Health University, Gwangju (Korea, Republic of)

    2015-05-15

    The gonad shielding is used to minimize the impact of the exposure to gonads when Abdomen, Plevis and Hip X-ray inspections are conducted on radiation impressionable pediatric patients. By the way, the gonad is palpable difficult and impossible to check visually because it's a sensitive area, so tests are conducted with the approximate location of shielding, thereby appearing problems of not shielding gonads accurately. Accordingly, this study produced shields by age and gender of pediatric patients and studied the method of positioning shields with ASIS as a reference point without palpable sensitive areas, and tried to evaluate its usability. The study surveyed 30 pediatric patients by gender and age, who came and got inspected in Department of Radiology, our hospital from February 2012 to January 2014 and obtained the value of tolerance by measuring the average size of the pelvis using the distance measurement function of Infinitt Piview with the images stored in the PACS and producing shields by age and gender of pediatric patients and specifying the areas at random for the comparative analysis of pre- and post-using. It calculated the technology statistics (mean±SD) with the value of tolerance measured the length using SPSS 12.0 statistical program. As for boys, differences in the tolerance range of pre- and post-using shields were 2.69 mm in case of 1 year old, 2.58 mm in 2 years, 2.37 mm in 3 years, 2.815 mm in 4-5 years, 2.043 mm in 7-10 years, and as for girls,1.92 mm in 1-2 years, 1.75 mm in 3-4 years, 2.52 mm in 5-6 years and 1.93 mm in 7-10. After analyzing the pre- and post-using shields for all of boys and girls, there were statistically significant differences (P<0.050). It is considered that we can minimize the exposure to gonads and get a better video for diagnosis in testing high biological impressionable pediatric, if we use shields correctly with ASIS as a reference point considering its shape and size by age and gender in Abdomen, Plevis

  11. Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves

    Science.gov (United States)

    Hamilton, George S.; Brookman, Stephen; Dumas, Joseph D. II; Tilghman, Neal

    2003-01-01

    Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.

  12. Mobile Usability

    DEFF Research Database (Denmark)

    Aryana, Bijan; Clemmensen, Torkil

    2013-01-01

    In this article, a country specific comparative mobile usability study is presented, using Iran and Turkey as the two chosen emerging/emergent nation exemplars of smartphone usage and adoption. In a focus group study, three mobile applications were selected by first-time users of smartphones...... personal contacts. The results and analysis establish the existence of country specific issues and concerns, as well as reveal generic usability issues. The article concludes that the source of these issues is most likely due to a combination of certain contextual features endemic to both Iran and Turkey...

  13. Usability and acceptance evaluation of ACESO: a Web-based breast cancer survivorship tool.

    Science.gov (United States)

    Kapoor, Akshat; Nambisan, Priya

    2018-01-25

    The specific objective of this research is to design and develop a personalized Web application to support breast cancer survivors after treatment, as they deal with post-treatment challenges, such as comorbidities and side effects of treatment. A mixed-methods approach, utilizing a combination of think-aloud analysis, personal interviews, and surveys, was adopted for user acceptance and usability testing among a group of breast cancer survivors. User feedback was gathered on their perceived value of the application, and any user-interface issues that may hinder the overall usability were identified. The application's portability and capability of organizing their entire breast cancer-related medical history as well as tracking various quality of life indicators were perceived to be valuable features. The application had an overall high usability; however, certain sections of the application were not as intuitive to locate. Visual elements of the website were appreciated; however, overall experience would benefit from incorporating more sociable elements that exhibit positive re-enforcement within the end user and provide a friendlier experience. The results of the study showcase the need for more personalized tools and resources to support survivors in self-management. It also demonstrates the ability to integrate breast cancer survivorship care plans from diverse providers and paves the way to add further value-added features in consumer health applications, such as personal decision support. Using a personal decision support-based tool can serve as a training tool and resource, providing these patients with pertinent information about the various aspects of their long-term health, while educating them about any related side effects and symptoms. It is hoped that making such tools more accessible could help in engaging survivors to play an active role in managing their health and encourage shared decision-making with their providers.

  14. Usability evaluation of cloud-based mapping tools for the display of very large datasets

    Science.gov (United States)

    Stotz, Nicole Marie

    The elasticity and on-demand nature of cloud services have made it easier to create web maps. Users only need access to a web browser and the Internet to utilize cloud based web maps, eliminating the need for specialized software. To encourage a wide variety of users, a map must be well designed; usability is a very important concept in designing a web map. Fusion Tables, a new product from Google, is one example of newer cloud-based distributed GIS services. It allows for easy spatial data manipulation and visualization, within the Google Maps framework. ESRI has also introduced a cloud based version of their software, called ArcGIS Online, built on Amazon's EC2 cloud. Utilizing a user-centered design framework, two prototype maps were created with data from the San Diego East County Economic Development Council. One map was built on Fusion Tables, and another on ESRI's ArcGIS Online. A usability analysis was conducted and used to compare both map prototypes in term so of design and functionality. Load tests were also ran, and performance metrics gathered on both map prototypes. The usability analysis was taken by 25 geography students, and consisted of time based tasks and questions on map design and functionality. Survey participants completed the time based tasks for the Fusion Tables map prototype quicker than those of the ArcGIS Online map prototype. While response was generally positive towards the design and functionality of both prototypes, overall the Fusion Tables map prototype was preferred. For the load tests, the data set was broken into 22 groups for a total of 44 tests. While the Fusion Tables map prototype performed more efficiently than the ArcGIS Online prototype, differences are almost unnoticeable. A SWOT analysis was conducted for each prototype. The results from this research point to the Fusion Tables map prototype. A redesign of this prototype would incorporate design suggestions from the usability survey, while some functionality would

  15. From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

    Science.gov (United States)

    Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

    2013-01-01

    The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

  16. Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson’s heuristics

    OpenAIRE

    Ashish Joshi; Douglas M Puricelli Perin; Chioma Amadi; Kate Trout

    2015-01-01

    Background: Usability challenges have to be met in an interactive computer program development and should meet all users’ needs. Objective: The study purpose was to conduct heuristic evaluation of an interactive, bilingual touch screen enabled breastfeeding educational program for Hispanic women living in rural settings.Methods: Two usability experts used Nielsen’s heuristics while reviewing the user interface in May 2013 using principles of Nielson’s Heuristics. Nielson’s heuristics are a se...

  17. The Evaluation of Web pages of State Universities’ Usability via Content Analysis

    Directory of Open Access Journals (Sweden)

    Ezgi CEVHER

    2015-12-01

    Full Text Available Within the scope of e-transformation project in Turkey, the “Preparation of Guideline for State Institutions’ Web Pages” action has been carried out for ensuring the minimal cohesiveness among government institutions’ and organizations’ Web pages in terms of design and content. As a result of those efforts, the first edition of “Guideline for State Institutions’ Web Pages” has been prepared in year 2006. The second edition of this guideline has been published in year 2009 under in simpler form under the name of “Guideline and Suggestions for the Standards of Governmental Institutions’ Web Pages”. It became compulsory for local and central level governmental institutions and organizations to obey the procedures and principles stated in Guideline. Through this Guideline, the preparation of websites of governmental institutions in harmony with mentioned standards, and updating them in parallel with changing conditions and requirements have been brought to agenda especially in recent years. In this study, by considering the characteristics stated in Guideline, the webpages of state universities’ have been assessed through “content analysis”. Considering that the webpages of universities are being visited by hundreds of visitors daily, it is required to ensure the effective, productive and comfortable usability. For this reason, by analyzing their webpages, the object is to determine to what extend the state universities implement the compulsory principles stated in Guideline, the webpages of universities have been assessed in this study from the aspects of compliance with standards, usability, and accessibility

  18. Replication Kits for the papers "Automated Usability Evaluation of Virtual Reality Applications" and "VR Interaction Modalities for the Evaluation of Technical Device Prototypes" submitted to the CHI 2018

    OpenAIRE

    Harms, Patrick; Holderied, Hanna

    2017-01-01

    This replication kit contains all necessary data to reproduce the setup and results of both papers 'Automated Usability Evaluation of Virtual Reality Applications' and 'VR Interaction Modalities for the Evaluation of Technical Device Prototypes' as submitted to the CHI 2018. It includes the Unity Projects that show a coffee machine and a copier scene (sometimes refered to as printer scene, as well, as it is an integrated device) that can be interacted with with the help of the four interactio...

  19. Evaluating the Acceptability and Usability of EASEL: A Mobile Application that Supports Guided Reflection for Experiential Learning Activities

    Directory of Open Access Journals (Sweden)

    Jerry C Schnepp

    2017-07-01

    Full Text Available Aim/Purpose: To examine the early perceptions (acceptability and usability of EASEL (Education through Application-Supported Experiential Learning, a mobile platform that delivers reflection prompts and content before, during, and after an experiential learning activity. Background: Experiential learning is an active learning approach in which students learn by doing and by reflecting on the experience. This approach to teaching is often used in disciplines such as humanities, business, and medicine. Reflection before, during, and after an experience allows the student to analyze what they learn and why it is important, which is vital in helping them to understand the relevance of the experience. A just-in-time tool (EASEL was needed to facilitate this. Methodology: To inform the development of a mobile application that facilitates real-time guided reflection and to determine the relevant feature set, we conducted a needs analysis with both students and faculty members. Data collected during this stage of the evaluation helped guide the creation of a prototype. The user experience of the prototype and interface interactions were evaluated during the usability phase of the evaluation study. Contribution: Both the needs analysis and usability assessment provided justification for continued development of EASEL as well as insight that guides current development. Findings: The interaction design of EASEL is understandable and usable. Both students and teachers value an application that facilitates real-time guided reflection. Recommendations for Practitioners: The use of a system such as EASEL can leverage time and location-based services to support students in field experiences. This technology aligns with evidence that guided reflection provides opportunities for metacognition. Recommendation for Researchers: Iterative prototyping, testing, and refinement can lead to a deliberate and effective app development process. Impact on Society: The EASEL

  20. Usability evaluation of a clinical decision support tool for osteoporosis disease management

    Directory of Open Access Journals (Sweden)

    Newton David

    2010-12-01

    Full Text Available Abstract Background Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines are available, patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions and a series of focus groups were used to develop a functional multifaceted tool that can support clinical decision-making in osteoporosis disease management at the point of care. The objective of our study was to assess how well the prototype met functional goals and usability needs. Methods We conducted a usability study for each component of the tool--the Best Practice Recommendation Prompt (BestPROMPT, the Risk Assessment Questionnaire (RAQ, and the Customised Osteoporosis Education (COPE sheet--using the framework described by Kushniruk and Patel. All studies consisted of one-on-one sessions with a moderator using a standardised worksheet. Sessions were audio- and video-taped and transcribed verbatim. Data analysis consisted of a combination of qualitative and quantitative analyses. Results In study 1, physicians liked that the BestPROMPT can provide customised recommendations based on risk factors identified from the RAQ. Barriers included lack of time to use the tool, the need to alter clinic workflow to enable point-of-care use, and that the tool may disrupt the real reason for the visit. In study 2, patients completed the RAQ in a mean of 6 minutes, 35 seconds. Of the 42 critical incidents, 60% were navigational and most occurred when the first nine participants were using the stylus pen; no critical incidents were observed with the last six participants that used the touch screen. Patients thought that the RAQ questions were easy to read and understand, but they found it difficult to initiate the questionnaire. Suggestions for improvement included improving aspects of the interface and navigation. The results of study 3 showed that most patients were able

  1. The role of usability in the evaluation of accidents: human error or design flaw?

    Science.gov (United States)

    Correia, Walter; Soares, Marcelo; Barros, Marina; Campos, Fábio

    2012-01-01

    This article aims to highlight the role of consumer products companies in the heart and the extent of accidents involving these types of products, and as such undesired events take part as an agent in influencing decision making for the purchase of a product that nature on the part of consumers and users. The article demonstrates, by reference, interviews and case studies such as the development of poorly designed products and design errors of design can influence the usage behavior of users, thus leading to accidents, and also negatively affect the next image of a company. The full explanation of these types of questions aims to raise awareness, plan on a reliable usability, users and consumers in general about the safe use of consumer products, and also safeguard their rights before a legal system of consumer protection, even far away by the CDC--Code of Consumer Protection.

  2. Evaluation of B2C website based on the usability factors by using fuzzy AHP & hierarchical fuzzy TOPSIS

    Science.gov (United States)

    Masudin, I.; Saputro, T. E.

    2016-02-01

    In today's technology, electronic trading transaction via internet has been utilized properly with rapid growth. This paper intends to evaluate related to B2C e-commerce website in order to find out the one which meets the usability factors better than another. The influential factors to B2C e-commerce website are determined for two big retailer websites. The factors are investigated based on the consideration of several studies and conformed to the website characteristics. The evaluation is conducted by using different methods namely fuzzy AHP and hierarchical fuzzy TOPSIS so that the final evaluation can be compared. Fuzzy triangular number is adopted to deal with imprecise judgment under fuzzy environment.

  3. Complementary role of two evaluation methods in the usability and accessibility evaluation of a non-standard system

    CSIR Research Space (South Africa)

    Adebesin, F

    2010-10-01

    Full Text Available and used by people with varying abilities. Although accessibility concerns are aimed at making systems usable for people with disabilities, support for direct accessibility, the built-in redundancies in an application that enable as many people as possible...

  4. Videoconferencing for site initiations in clinical studies: Mixed methods evaluation of usability, acceptability, and impact on recruitment.

    Science.gov (United States)

    Randell, Rebecca; Backhouse, Michael R; Nelson, E Andrea

    2016-12-01

    A critical issue for multicentre clinical studies is conducting site initiations, ensuring sites are trained in study procedures and comply with relevant governance requirements before they begin recruiting patients. How technology can support site initiations has not previously been explored. This study sought to evaluate use of off-the-shelf web-based videoconferencing to deliver site initiations for a large national multicentre study. Participants in the initiations, including podiatrists, diabetologists, trial coordinators, and research nurses, completed an online questionnaire based on the System Usability Scale (SUS) (N = 15). This was followed by semi-structured interviews, with a consultant diabetologist, a trial coordinator, and three research nurses, exploring perceived benefits and limitations of videoconferencing. The mean SUS score for the videoconferencing platform was 87.2 (SD = 13.7), suggesting a good level of usability. Interview participants perceived initiations delivered by videoconferencing as being more interactive and easier to follow than those delivered by teleconference. In comparison to face-to-face initiations, videoconferencing takes less time, easily fitting in with the work of staff at the local sites. Perceptions of impact on communication varied according to the hardware used. Off-the-shelf videoconferencing is a viable alternative to face-to-face site initiations and confers advantages over teleconferencing.

  5. Log files for testing usability

    NARCIS (Netherlands)

    Klein Teeselink, G.; Siepe, A.H.M.; Pijper, de J.R.

    1999-01-01

    The aim of this study is to gain insight in the usefulness of log file analysis as a method to evaluate the usability of individual interface components and their influence on the usability of the overall user interface. We selected a music player as application, with four different interfaces and

  6. Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

    Science.gov (United States)

    Wozney, Lori; Baxter, Pamela; Newton, Amanda S

    2015-12-16

    Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for

  7. Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

    Science.gov (United States)

    Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

    2010-04-01

    The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

  8. Images of Usability

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2010-01-01

    unless confronted with alternative images. This study delineates six images of usability: universal usability, situational usability, perceived usability, hedonic usability, organizational usability, and cultural usability. The different foci of the images provide opportunities for becoming sensitized...... assume different images of usability and a need for supplementary methods addressing the collaborative and long-term aspects of usability. Moreover, the images call for extending the scope of practical usability work to include the effects achieved by users during their use of systems for real work....

  9. Usability Problems in a Home Telemedicine System

    DEFF Research Database (Denmark)

    Bruun, Anders; Stage, Jan

    2010-01-01

    a high level of usability in order to enable their users to employ the required functionality, especially if the target user group is elderly people. This paper reports from a usability evaluation of a home telemedicine system. Five elderly persons carried out specified tasks with the system, and based...... on that we identified usability problems with the system. The problems are presented, analysed in relation to 12 different usability themes and related to results from other evaluations of similar systems....

  10. The impact of usability reports and user test observations on developers understanding of usability data

    DEFF Research Database (Denmark)

    Høegh, Rune Thaarup; Nielsen, Christian Monrad; Pedersen, Michael Bach

    2006-01-01

    of the system. This article presents results from an exploratory study of 2 ways of providing feedback from a usability evaluation: observation of user tests and reading usability reports. A case study and a field experiment were used to explore how observation and usability reports impact developers......' understanding of usability data. The results indicate that observation of user tests facilitated a rich understanding of usability problems and created empathy with the users and their work. The usability report had a strong impact on the developers' understanding of specific usability problems and supported...

  11. Development, Usability, and Efficacy of a Serious Game to Help Patients Learn About Pain Management After Surgery: An Evaluation Study.

    Science.gov (United States)

    Ingadottir, Brynja; Blondal, Katrin; Thue, David; Zoega, Sigridur; Thylen, Ingela; Jaarsma, Tiny

    2017-05-10

    Postoperative pain is a persistent problem after surgery and can delay recovery and develop into chronic pain. Better patient education has been proposed to improve pain management of patients. Serious games have not been previously developed to help patients to learn how to manage their postoperative pain. The aim of this study was to describe the development of a computer-based game for surgical patients to learn about postoperative pain management and to evaluate the usability, user experience, and efficacy of the game. A computer game was developed by an interdisciplinary team following a structured approach. The usability, user experience, and efficacy of the game were evaluated using self-reported questionnaires (AttrakDiff2, Postoperative Pain Management Game Survey, Patient Knowledge About Postoperative Pain Management questionnaire), semi-structured interviews, and direct observation in one session with 20 participants recruited from the general public via Facebook (mean age 48 [SD 14]; 11 women). Adjusted Barriers Questionnaire II and 3 questions on health literacy were used to collect background information. Theories of self-care and adult learning, evidence for the educational needs of patients about pain management, and principles of gamification were used to develop the computer game. Ease of use and usefulness received a median score between 2.00 (IQR 1.00) and 5.00 (IQR 2.00) (possible scores 0-5; IQR, interquartile range), and ease of use was further confirmed by observation. Participants expressed satisfaction with this novel method of learning, despite some technological challenges. The attributes of the game, measured with AttrakDiff2, received a median score above 0 in all dimensions; highest for attraction (median 1.43, IQR 0.93) followed by pragmatic quality (median 1.31, IQR 1.04), hedonic quality interaction (median 1.00, IQR 1.04), and hedonic quality stimulation (median 0.57, IQR 0.68). Knowledge of pain medication and pain management

  12. Evaluating the usability of an interactive, bi-lingual, touchscreen-enabled breastfeeding educational programme: application of Nielson’s heuristics

    Directory of Open Access Journals (Sweden)

    Ashish Joshi

    2015-03-01

    Full Text Available Background: Usability challenges have to be met in an interactive computer program development and should meet all users’ needs. Objective: The study purpose was to conduct heuristic evaluation of an interactive, bilingual touch screen enabled breastfeeding educational program for Hispanic women living in rural settings.Methods: Two usability experts used Nielsen’s heuristics while reviewing the user interface in May 2013 using principles of Nielson’s Heuristics. Nielson’s heuristics are a set of usability engineering principles developed to identify issues in user interface design and involves analysis of the interface. The heuristic evaluations were carried out in the interface, program sections, and interactive educational modules. A total of 271 screens were evaluated and included: interface (n=5, program sections (n=223 and educational content (n=43.Results: A total of 97 violations were identified and were mostly related to interface (8violations/5screens and program components (89violations/266screens. The most common violations reported were recognition rather than recall (62%, n=60, consistency and standards (14%, n=14, and match between the system and real world (9%, n= 9. Majority of the violations had minor usability issues (73%, n=71. The only catastrophic violation reported was due to the visibility of system status in the assessment modules.Conclusion: The results demonstrated that the system was more consistent with Nielsen’s usability heuristics. 

  13. Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

    Science.gov (United States)

    Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

    2013-09-01

    The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice

  14. Evaluating the usability of a virtual reality-based Android application in managing the pain experience of wheelchair users.

    Science.gov (United States)

    Spyridonis, Fotios; Gronli, Tor-Morten; Hansen, Jarle; Ghinea, Gheorghita

    2012-01-01

    Pain constitutes an important medical concern that can have severe implications to a wheelchair user's quality of life. Results from studies indicate that pain is a common problem in this group of individuals, having a reported frequency of always (12%) and everyday (33%). This incidence signifies the need for more applicable and effective pain management clinical tools. As a result, in this paper we present an Android application (PainDroid) that has been enhanced with Virtual Reality (VR) technology for the purpose of improving the management of pain. Our evaluation with a group of wheelchair users revealed that PainDroid demonstrated high usability among this population, and is foreseen that it can make an important contribution in research on the assessment and management of pain.

  15. Development of a System to Assist Automatic Translation of Hand-Drawn Maps into Tactile Graphics and Its Usability Evaluation

    Directory of Open Access Journals (Sweden)

    Jianjun Chen

    2014-01-01

    Full Text Available Tactile graphics are images that use raised surfaces so that a visually impaired person can feel them. Tactile maps are used by blind and partially sighted people when navigating around an environment, and they are also used prior to a visit for orientation purposes. Since the ability to read tactile graphics deeply depends on individuals, providing tactile graphics individually is needed. This implies that producing tactile graphics should be as simple as possible. Based on this background, we are developing a system for automating production of tactile maps from hand-drawn figures. In this paper, we first present a pattern recognition method for hand-drawn maps. The usability of our system is then evaluated by comparing it with the two different methods to produce tactile graphics.

  16. Human factors review of CFMS displays for UCN 3,4 - Development of a usability evaluation method for the CFMS user interface of UCN 3,4

    Energy Technology Data Exchange (ETDEWEB)

    Hang, Sung Ho; Yun, Myung Hwan; Chung, Min Kyun; Kwahk, Ji Young; Hong, Sang Woo; Cho, Jang Hyun; Kim, Bum Soo [Pohang University of Science and Technology, Pohang (Korea, Republic of)

    1996-11-01

    The purpose of study was to perform a usability evaluation of the prototype Critical Function Monitoring System (CFMS) to be used in the Ulchin= 3 and Ulchin 4 nuclear power plant. Collection of existing regulation and literature, design review, design of the evaluation scheme, evaluation list, evaluation procedure, and evaluation method was conducted through literature survey, expert advice, design engineer consulting, interview of operators, and various systems analysis techniques. The main results of the study are as follows. 1) Usability evaluation of the CFMS screen 2) Recommendations for improved design 3) HED evaluations 4) Systematic evaluation procedure, method, and program implementation plan 5) Design of database for managing the evaluation format evaluation result. 47 tabs., 86 figs. (author)

  17. Understanding Usability Work as a Human Activity

    DEFF Research Database (Denmark)

    Nørgaard, Mie

    Three core themes are explored in eight papers: Usability work as a human activity, usability practice and methods, and persuasiveness of evaluation results and feedback. We explore how usability work is much more than methods and work procedures, and argue that maturing our understanding...

  18. A Re-evaluation of Discarded Deceased Donor Kidneys in the UK: Are Usable Organs Still Being Discarded?

    Science.gov (United States)

    Mittal, Shruti; Adamusiak, Anna; Horsfield, Catherine; Loukopoulos, Ioannis; Karydis, Nikolaos; Kessaris, Nicos; Drage, Martin; Olsburgh, Jonathon; Watson, Christopher Je; Callaghan, Chris J

    2017-07-01

    A significant proportion of procured deceased donor kidneys are subsequently discarded. The UK Kidney Fast-Track Scheme (KFTS) was introduced in 2012, enabling kidneys at risk of discard to be simultaneously offered to participating centers. We undertook an analysis of discarded kidneys to determine if unnecessary organ discard was still occurring since the KFTS was introduced. Between April and June 2015, senior surgeons independently inspected 31 consecutive discarded kidneys from throughout the United Kingdom. All kidneys were biopsied. Organs were categorized as usable, possibly usable pending histology, or not usable for implantation. After histology reports were available, final assessments of usability were made. There were 19 donors (6 donations after brain death, 13 donations after circulatory death), with a median (range) donor age of 67 (29-83) years and Kidney Donor Profile Index of 93 (19-100). Reasons for discard were variable. Only 3 discarded kidneys had not entered the KFTS. After initial assessment postdiscard, 11 kidneys were assessed as usable, with 9 kidneys thought to be possibly usable. Consideration of histological data reduced the number of kidneys thought usable to 10 (10/31; 32%). The KFTS scheme is successfully identifying organs at high risk of discard, though potentially transplantable organs are still being discarded. Analyses of discarded organs are essential to identify barriers to organ utilization and develop strategies to reduce unnecessary discard.

  19. How do Usability Professionals Construe Usability?

    DEFF Research Database (Denmark)

    Hertzum, Morten; Clemmensen, Torkil

    2012-01-01

    distinguishing it from user experience. On the basis of repertory-grid interviews with 24 Chinese, Danish, and Indian usability professionals we find that they make use of more utilitarian than experiential, i.e. user-experience related, constructs. This indicates that goal-related performance is central......’ constructs, particularly their experiential constructs, go considerably beyond ISO 9241 usability, indicating a discrepancy between this definition of usability and the thinking of the professionals concerned with delivering usability. Finally, usability is construed rather similarly across the three...

  20. Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation

    Science.gov (United States)

    Hayashi, Miwa; Hoang, Ty; Jung, Yoon C.; Gupta, Gautam; Malik, Waqar; Dulchinos, Victoria

    2013-01-01

    Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.

  1. PERBANDINGAN METODE EVALUASI USABILITY (STUDI KASUS : PENGGUNAAN PERANGKAT SMARTPHONE)

    OpenAIRE

    Hendradewa, Andrie Pasca

    2017-01-01

    Usability is a key factor that determine success of a product or interactive system, like smartphone. The increasing use of smartphone and its rapid technology development, requires usability evaluation method that is more accurate and effective to found usability problem, so it can be used for product improvement in development process. This study suggests a usability evaluation method that is most effective to identify problem in smartphone usage. Three usability evaluation methods that com...

  2. The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications.

    Directory of Open Access Journals (Sweden)

    Andrea Kübler

    Full Text Available Albeit research on brain-computer interfaces (BCI for controlling applications has expanded tremendously, we still face a translational gap when bringing BCI to end-users. To bridge this gap, we adapted the user-centered design (UCD to BCI research and development which implies a shift from focusing on single aspects, such as accuracy and information transfer rate (ITR, to a more holistic user experience. The UCD implements an iterative process between end-users and developers based on a valid evaluation procedure. Within the UCD framework usability of a device can be defined with regard to its effectiveness, efficiency, and satisfaction. We operationalized these aspects to evaluate BCI-controlled applications. Effectiveness was regarded equivalent to accuracy of selections and efficiency to the amount of information transferred per time unit and the effort invested (workload. Satisfaction was assessed with questionnaires and visual-analogue scales. These metrics have been successfully applied to several BCI-controlled applications for communication and entertainment, which were evaluated by end-users with severe motor impairment. Results of four studies, involving a total of N = 19 end-users revealed: effectiveness was moderate to high; efficiency in terms of ITR was low to high and workload low to medium; depending on the match between user and technology, and type of application satisfaction was moderate to high. The here suggested evaluation metrics within the framework of the UCD proved to be an applicable and informative approach to evaluate BCI controlled applications, and end-users with severe impairment and in the locked-in state were able to participate in this process.

  3. The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications.

    Science.gov (United States)

    Kübler, Andrea; Holz, Elisa M; Riccio, Angela; Zickler, Claudia; Kaufmann, Tobias; Kleih, Sonja C; Staiger-Sälzer, Pit; Desideri, Lorenzo; Hoogerwerf, Evert-Jan; Mattia, Donatella

    2014-01-01

    Albeit research on brain-computer interfaces (BCI) for controlling applications has expanded tremendously, we still face a translational gap when bringing BCI to end-users. To bridge this gap, we adapted the user-centered design (UCD) to BCI research and development which implies a shift from focusing on single aspects, such as accuracy and information transfer rate (ITR), to a more holistic user experience. The UCD implements an iterative process between end-users and developers based on a valid evaluation procedure. Within the UCD framework usability of a device can be defined with regard to its effectiveness, efficiency, and satisfaction. We operationalized these aspects to evaluate BCI-controlled applications. Effectiveness was regarded equivalent to accuracy of selections and efficiency to the amount of information transferred per time unit and the effort invested (workload). Satisfaction was assessed with questionnaires and visual-analogue scales. These metrics have been successfully applied to several BCI-controlled applications for communication and entertainment, which were evaluated by end-users with severe motor impairment. Results of four studies, involving a total of N = 19 end-users revealed: effectiveness was moderate to high; efficiency in terms of ITR was low to high and workload low to medium; depending on the match between user and technology, and type of application satisfaction was moderate to high. The here suggested evaluation metrics within the framework of the UCD proved to be an applicable and informative approach to evaluate BCI controlled applications, and end-users with severe impairment and in the locked-in state were able to participate in this process.

  4. Developing an Android-Based Patient Decision Aid Based on Ottawa Standards for Patients After Kidney Transplant and Its Usability Evaluation.

    Science.gov (United States)

    Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh

    2018-01-01

    This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.

  5. Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

    Science.gov (United States)

    Choi, Jeungok; Bakken, Suzanne

    2010-08-01

    Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

  6. Usability Evaluation of an Augmented Reality System for Teaching Euclidean Vectors

    Science.gov (United States)

    Martin-Gonzalez, Anabel; Chi-Poot, Angel; Uc-Cetina, Victor

    2016-01-01

    Augmented reality (AR) is one of the emerging technologies that has demonstrated to be an efficient technological tool to enhance learning techniques. In this paper, we describe the development and evaluation of an AR system for teaching Euclidean vectors in physics and mathematics. The goal of this pedagogical tool is to facilitate user's…

  7. Cultural cognition in the thinking-aloud method for usability evaluation

    DEFF Research Database (Denmark)

    Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper

    2008-01-01

    ) and Easterners (people from China and the countries heavily influenced by its culture). We illustrate the impact of cultural cognition on four central elements of TA: (1) instructions and tasks, (2) the user's verbalizations, (3) the evaluator's reading of the user, and (4) the overall relationship between user...

  8. A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites

    NARCIS (Netherlands)

    Peute, L. W.; Knijnenburg, S. L.; Kremer, L. C.; Jaspers, M. W. M.

    2015-01-01

    The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a

  9. The design and implementation of an android studio plugin to support task analysis annotation for automated usability evaluation

    OpenAIRE

    Durán Saez, Rafael

    2017-01-01

    This master thesis proposal aims to contribute to the overall research objective of how to automatically or semi-automatically analyze the usability of mobile applications in order to inform the decision process of what to pursue in each iteration of an iterative development process, in an integrated manner with IDE tools typically used to develop this kind of applications. And, more specifically, the thesis work will focus on proving the feasibility of extending an IDE with usability anno...

  10. Usability in a cultural context

    DEFF Research Database (Denmark)

    Clemmensen, Torkil; Yammiyavar, Pradeep; Ørngreen, Rikke

    2010-01-01

    This paper focuses on presenting and discussing the aim, context, challenges, results, and impact of the Cultural usability project named as CultUsab. This project was a four year international research effort from 2006 to 2009, which was supported by a grant for the Danish Research Councils...... for Independent Research in Culture and Communication. The project aimed at innovating processes in Information and Communication Technology development through an understanding of culturally sensitive aspects of usability evaluation methods....

  11. Sample size in usability studies

    NARCIS (Netherlands)

    Schmettow, Martin

    2012-01-01

    Usability studies are important for developing usable, enjoyable products, identifying design flaws (usability problems) likely to compromise the user experience. Usability testing is recommended for improving interactive design, but discovery of usability problems depends on the number of users

  12. Evaluation of alternatives for the disposition of surplus weapons-usable plutonium

    International Nuclear Information System (INIS)

    Dyer, J.S.; Butler, J.C.; Edmunds, T.

    1997-01-01

    The Department of Energy Record of Decision (ROD) selected alternatives for disposition of surplus, weapons grade plutonium. A major objective of this decision was to prevent the proliferation of nuclear weapons. Other concerns addressed included economic, technical, institutional, schedule, environmental, and health and safety issues. The analysis reported here was conducted in parallel with technical, environmental, and nonproliferation analyses; it uses multiattribute utility theory to combine these considerations in order to facilitate an integrated evaluation of alternatives. This analysis is intended to provide additional insight regarding alternative evaluation and to assist in understanding the rationale for the choice of alternatives recommended in the ROD. Value functions were developed for objectives of disposition, and used to rank alternatives. Sensitivity analyses indicated that the ranking of alternatives for the base case was relatively insensitive to changes in assumptions over reasonable ranges. The analyses support the recommendation of the ROD to pursue parallel development of the vitrification immobilization alternative and the use of existing light water reactors alternative. 27 refs., 109 figs., 20 tabs

  13. CBP for Field Workers – Results and Insights from Three Usability and Interface Design Evaluations

    Energy Technology Data Exchange (ETDEWEB)

    Oxstrand, Johanna Helene [Idaho National Lab. (INL), Idaho Falls, ID (United States); Le Blanc, Katya Lee [Idaho National Lab. (INL), Idaho Falls, ID (United States); Bly, Aaron Douglas [Idaho National Lab. (INL), Idaho Falls, ID (United States); Medema, Heather Dawne [Idaho National Lab. (INL), Idaho Falls, ID (United States); Hill, Wyatt Orcutt [Idaho National Lab. (INL), Idaho Falls, ID (United States)

    2015-09-01

    Nearly all activities that involve human interaction with the systems in a nuclear power plant are guided by procedures. Even though the paper-based procedures (PBPs) currently used by industry have a demonstrated history of ensuring safety, improving procedure use could yield significant savings in increased efficiency as well as improved nuclear safety through human performance gains. The nuclear industry is constantly trying to find ways to decrease the human error rate, especially the human errors associated with procedure use. As a step toward the goal of improving procedure use and adherence, researchers in the Light-Water Reactor Sustainability (LWRS) Program, together with the nuclear industry, have been investigating the possibility and feasibility of replacing the current paper-based procedure process with a computer-based procedure (CBP) system. This report describes a field evaluation of new design concepts of a prototype computer-based procedure system.

  14. Development of dynamic kidney phantom system and its evaluation of usability of application in nuclear medicine

    International Nuclear Information System (INIS)

    Park, Hoon Hee; Lyu, Kwang Yeul; Lee, Ju Young; Kim, Sang Wook; Jin, Gye Hwan

    2013-01-01

    Currently, commercially available phantom can reproduce and evaluate only a static situation, the study is incomplete research on phantom and system which is can confirmed functional situation in the kidney by time through dynamic phantom and blood flow velocity, various difference according to the amount of radioactive. Therefore, through this study, it has produced the dynamic kidney phantom to reproduce images through the dynamic flow of the kidney, it desires to evaluate the usefulness of nuclear medicine imaging. The production of the kidney phantom was fabricated based on the normal adult kidney, in order to reproduce the dynamic situation based on the fabricated kidney phantom, in this study, it was applied the volume pump that can adjust the speed of blood flow, so it can be integrated continuously radioactive isotopes in the kidney by using 99m Tc-pertechnate. Used the radioactive isotope was supplied through the two pump. It was confirmed the changes according to the infusion rate, radioactive isotopes and the different injection speeds on the left and right, analysis of the acquired images was done by drawn five times ROI in order to check the reproducibility of each on the front and rear of the kidney and bladder. Depending on the speed of injection, radioisotope was a lot of integrated and emissions up when adjusting the pressure of the pump as 30 stroke, it was the least integrated and emissions up when adjusting as 40 stroke. The integration of the left and right kidney was not reached in the amount of the highest when adjusting as 10 stroke. In the changes according to the amount of the radioactive isotope, 0.6 mCi (22.2 MBq), 0.8 mCi (29.6 MBq) was showed up similar tendency but, in the result of the different injection 0.8 mCi, it was showed up counts close to double of 0.6 mCi. In the result of the differently injection speed of the left and right kidney, as a result of different conditions that injection speed was 20 stroke through left kidney

  15. Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

    Science.gov (United States)

    Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

    2017-06-01

    Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

  16. Evaluating Youtube Platform Usability by People with Intellectual Disabilities (A User Experience Case Study Performed in a Six-Month Period)

    OpenAIRE

    Tânia Rocha; José Martins; Frederico Branco; Ramiro Gonçalves

    2017-01-01

    A comparison study of the Web interaction evolution of a group of people with intellectual disabilities, when performing search tasks using the YouTube platform, is presented. For the effect, we compare results in two assessment moments (the second assessment moment was performed, within the 6 months after the first one). We aimed at evaluating the evolution of their digital skills by comparing two assessment moments through the following usability variables: effectiveness, we register the...

  17. Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers.

    Science.gov (United States)

    Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K

    2010-04-01

    To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.

  18. Mobile Applications for Diabetics: A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older

    Science.gov (United States)

    Quade, Mandy; Kirch, Wilhelm

    2014-01-01

    Background A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. Objective We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. Methods We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. Results In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion “comprehensibility” (4.0 out of 5.0), while showing a lack of “fault tolerance” (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of

  19. Mobile applications for diabetics: a systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older.

    Science.gov (United States)

    Arnhold, Madlen; Quade, Mandy; Kirch, Wilhelm

    2014-04-09

    A multitude of mhealth (mobile health) apps have been developed in recent years to support effective self-management of patients with diabetes mellitus type 1 or 2. We carried out a systematic review of all currently available diabetes apps for the operating systems iOS and Android. We considered the number of newly released diabetes apps, range of functions, target user groups, languages, acquisition costs, user ratings, available interfaces, and the connection between acquisition costs and user ratings. Additionally, we examined whether the available applications serve the special needs of diabetes patients aged 50 or older by performing an expert-based usability evaluation. We identified relevant keywords, comparative categories, and their specifications. Subsequently, we performed the app review based on the information given in the Google Play Store, the Apple App Store, and the apps themselves. In addition, we carried out an expert-based usability evaluation based on a representative 10% sample of diabetes apps. In total, we analyzed 656 apps finding that 355 (54.1%) offered just one function and 348 (53.0%) provided a documentation function. The dominating app language was English (85.4%, 560/656), patients represented the main user group (96.0%, 630/656), and the analysis of the costs revealed a trend toward free apps (53.7%, 352/656). The median price of paid apps was €1.90. The average user rating was 3.6 stars (maximum 5). Our analyses indicated no clear differences in the user rating between free and paid apps. Only 30 (4.6%) of the 656 available diabetes apps offered an interface to a measurement device. We evaluated 66 apps within the usability evaluation. On average, apps were rated best regarding the criterion "comprehensibility" (4.0 out of 5.0), while showing a lack of "fault tolerance" (2.8 out of 5.0). Of the 66 apps, 48 (72.7%) offered the ability to read the screen content aloud. The number of functions was significantly negative correlated

  20. Distributed user interfaces usability and collaboration

    CERN Document Server

    Lozano, María D; Tesoriero, Ricardo; Penichet, Victor MR

    2013-01-01

    Written by international researchers in the field of Distributed User Interfaces (DUIs), this book brings together important contributions regarding collaboration and usability in Distributed User Interface settings. Throughout the thirteen chapters authors address key questions concerning how collaboration can be improved by using DUIs, including: in which situations a DUI is suitable to ease the collaboration among users; how usability standards can be used to evaluate the usability of systems based on DUIs; and accurately describe case studies and prototypes implementing these concerns

  1. Marketing through Usability.

    Science.gov (United States)

    Morgan, Eric Lease

    1999-01-01

    Suggests that one of the best ways to get word-of-mouth marketing of library technology is to provide "usable" products and services. Provides an international standards definition on usability and notes that understanding usability combines an understanding of user needs/wants with an understanding of goals, functions, and limitations…

  2. Usability testing for dummies

    CERN Multimedia

    CERN. Geneva

    2017-01-01

    Usability testing seems complicated and time-consuming. Is it though? In fact, it is the best way to understand how real users experience your product. In this interactive session, we will do a live usability test and you will get advice on how to conduct your own usability tests.

  3. Defining Usability of PN Services

    DEFF Research Database (Denmark)

    Nicolajsen, Hanne Westh; Ahola, Titta; Fleury, Alexandre

    In this deliverable usability and user experience are defined in relation to MAGNET Beyond technologies, and it is described how the main MAGNET Beyond concepts can be evaluated through the involvement of users. The concepts include the new "Activity based communication approach" for interacting...... with the MAGNET Beyond system, as well as the core concepts: Personal Network, Personal Network-Federation, Service Discovery, User Profile Management, Personal Network Management, Privacy and Security and Context Awareness. The overall plans for the final usability evaluation are documented based on the present...

  4. An Observational Study to Evaluate the Usability and Intent to Adopt an Artificial Intelligence-Powered Medication Reconciliation Tool.

    Science.gov (United States)

    Long, Ju; Yuan, Michael Juntao; Poonawala, Robina

    2016-05-16

    Medication reconciliation (the process of creating an accurate list of all medications a patient is taking) is a widely practiced procedure to reduce medication errors. It is mandated by the Joint Commission and reimbursed by Medicare. Yet, in practice, medication reconciliation is often not effective owing to knowledge gaps in the team. A promising approach to improve medication reconciliation is to incorporate artificial intelligence (AI) decision support tools into the process to engage patients and bridge the knowledge gap. The aim of this study was to improve the accuracy and efficiency of medication reconciliation by engaging the patient, the nurse, and the physician as a team via an iPad tool. With assistance from the AI agent, the patient will review his or her own medication list from the electronic medical record (EMR) and annotate changes, before reviewing together with the physician and making decisions on the shared iPad screen. In this study, we developed iPad-based software tools, with AI decision support, to engage patients to "self-service" medication reconciliation and then share the annotated reconciled list with the physician. To evaluate the software tool's user interface and workflow, a small number of patients (10) in a primary care clinic were recruited, and they were observed through the whole process during a pilot study. The patients are surveyed for the tool's usability afterward. All patients were able to complete the medication reconciliation process correctly. Every patient found at least one error or other issues with their EMR medication lists. All of them reported that the tool was easy to use, and 8 of 10 patients reported that they will use the tool in the future. However, few patients interacted with the learning modules in the tool. The physician and nurses reported the tool to be easy-to-use, easy to integrate into existing workflow, and potentially time-saving. We have developed a promising tool for a new approach to

  5. Evaluation of the safety and usability of touch gestures in operating in-vehicle information systems with visual occlusion.

    Science.gov (United States)

    Kim, Huhn; Song, Haewon

    2014-05-01

    Nowadays, many automobile manufacturers are interested in applying the touch gestures that are used in smart phones to operate their in-vehicle information systems (IVISs). In this study, an experiment was performed to verify the applicability of touch gestures in the operation of IVISs from the viewpoints of both driving safety and usability. In the experiment, two devices were used: one was the Apple iPad, with which various touch gestures such as flicking, panning, and pinching were enabled; the other was the SK EnNavi, which only allowed tapping touch gestures. The participants performed the touch operations using the two devices under visually occluded situations, which is a well-known technique for estimating load of visual attention while driving. In scrolling through a list, the flicking gestures required more time than the tapping gestures. Interestingly, both the flicking and simple tapping gestures required slightly higher visual attention. In moving a map, the average time taken per operation and the visual attention load required for the panning gestures did not differ from those of the simple tapping gestures that are used in existing car navigation systems. In zooming in/out of a map, the average time taken per pinching gesture was similar to that of the tapping gesture but required higher visual attention. Moreover, pinching gestures at a display angle of 75° required that the participants severely bend their wrists. Because the display angles of many car navigation systems tends to be more than 75°, pinching gestures can cause severe fatigue on users' wrists. Furthermore, contrary to participants' evaluation of other gestures, several participants answered that the pinching gesture was not necessary when operating IVISs. It was found that the panning gesture is the only touch gesture that can be used without negative consequences when operating IVISs while driving. The flicking gesture is likely to be used if the screen moving speed is slower or

  6. Tablet-Based Well-Being Check for the Elderly: Development and Evaluation of Usability and Acceptability.

    Science.gov (United States)

    Ray, Pradeep; Li, Junhua; Ariani, Arni; Kapadia, Vasvi

    2017-05-12

    Many elderly people prefer to live at home independently. One of the major concerns raised by the family members is the safety and well-being of their elderly family members when living independently in a home environment. To address this issue, assistive technology solutions have been available in the market. Despite their availability and proliferation, these types of solutions are not popular with the elderly due to their intrusive nature, privacy-related issues, social stigma, and fear of losing human interaction. This study shares the experience in the development of a digital photo frame system that helps family members to check the well-being of the elderly, exploiting their desire to remain socially connected. The aim of this study was to iteratively design, implement, and assess the usability, user friendliness, and acceptability of a tablet-based system to check the well-being of the elderly. Our study methodology comprises three separate stages: initial system development, contextual assessment, and comparative case study evaluation. In the first stage, requirements were elicited from the elderly to design a well-being check prototype. In the second stage, areas for improvements (eg, privacy features) were identified. Also, additional features (such as medication prompts or food reminders) were suggested to help aged and health care service providers with effective but subtle monitoring of the elderly. These would lower their operating cost by reducing visits by care providers to the homes of the elderly. In the third stage, the results highlighted the difference (between users in India and Australia) in the levels of familiarity of the elderly with this technology. Some elderly participants at the Kalyani Institute for Study, Planning and Action for Rural Change, India latched onto this technology quickly while a few refused to use the system. However, in all cases, the support of family members was crucial for their willingness to use the technology

  7. Methods of Usability Testing in Libraries Web Sites

    Directory of Open Access Journals (Sweden)

    Eman Fawzy

    2006-03-01

    Full Text Available A Study about libraries' web sites evaluation, that is the Usability, the study talking about methods of usability testing and define it, and its important in web sites evaluation, then details the methods of usability: questionnaire, core groups, testing experimental model, cards arrangement, and composed evaluation.

  8. Exploring Multiple Usability Perspectives

    DEFF Research Database (Denmark)

    Uldall-Espersen, Tobias

    2007-01-01

    Industrial usability work often fails to produce the expected impact on software products even though significant resources have been used on uncovering problems and suggesting improvements. So, it seems that feedback from industrial usability work lacks persuasiveness, i.e. it fails to convince...... the key stakeholders that actions need to be taken. This study reports from interviews with 26 stakeholders in software development projects. Our data suggests that the interviewees address usability using different perspectives and based on our observations we describe five such perspectives. Further, we...... discuss how applying different usability perspectives might inform the persuasiveness of usability work....

  9. Evaluating usability of the Halden Reactor Large Screen Display. Is the Information Rich Design concept suitable for real-world installations?

    International Nuclear Information System (INIS)

    Braseth, Alf Ove

    2013-01-01

    Large Screen Displays (LSDs) are beginning to supplement desktop displays in modern control rooms, having the potential to display the big picture of complex processes. Information Rich Design (IRD) is a LSD concept used in many real-life installations in the petroleum domain, and more recently in nuclear research applications. The objectives of IRD are to provide the big picture, avoiding keyhole related problems while supporting fast visual perception of larger data sets. Two LSDs based on the IRD concept have been developed for large-scale nuclear simulators for research purposes; they have however suffered from unsatisfying user experience. The new Halden Reactor LSD, used to monitor a nuclear research reactor, was designed according to recent proposed Design Principles compiled in this paper to mitigate previously experienced problems. This paper evaluates the usability of the Halden Reactor LSD, comparing usability data with the replaced analogue panel, and data for an older IRD large screen display. The results suggest that the IRD concept is suitable for use in real-life applications from a user experience point of view, and that the recently proposed Design Principles have had a positive effect on usability. (author)

  10. Usability and utility evaluation of the web-based "Should I Start Insulin?" patient decision aid for patients with type 2 diabetes among older people.

    Science.gov (United States)

    Lee, Yew Kong; Lee, Ping Yein; Ng, Chirk Jenn; Teo, Chin Hai; Abu Bakar, Ahmad Ihsan; Abdullah, Khatijah Lim; Khoo, Ee Ming; Hanafi, Nik Sherina; Low, Wah Yun; Chiew, Thiam Kian

    2018-01-01

    This study aimed to evaluate the usability (ease of use) and utility (impact on user's decision-making process) of a web-based patient decision aid (PDA) among older-age users. A pragmatic, qualitative research design was used. We recruited patients with type 2 diabetes who were at the point of making a decision about starting insulin from a tertiary teaching hospital in Malaysia in 2014. Computer screen recording software was used to record the website browsing session and in-depth interviews were conducted while playing back the website recording. The interviews were analyzed using the framework approach to identify usability and utility issues. Three cycles of iteration were conducted until no more major issues emerged. Thirteen patients participated: median age 65 years old, 10 men, and nine had secondary education/diploma, four were graduates/had postgraduate degree. Four usability issues were identified (navigation between pages and sections, a layout with open display, simple language, and equipment preferences). For utility, participants commented that the website influenced their decision about insulin in three ways: it had provided information about insulin, it helped them deliberate choices using the option-attribute matrix, and it allowed them to involve others in their decision making by sharing the PDA summary printout.

  11. Tracing Impact in a Usability Improvement Process

    DEFF Research Database (Denmark)

    Uldall-Espersen, Tobias; Frøkjær, Erik; Hornbæk, Kasper Anders Søren

    2008-01-01

    Analyzing usability improvement processes as they take place in real-life organizations is necessary to understand the practice of usability work. This paper describes a case study where the usability of an information system is improved and a relationship between the improvements...... and the evaluation efforts is established. Results show that evaluation techniques complemented each other by suggesting different kinds of usability improvement. Among the techniques applied, a combination of questionnaires and Metaphors of Human Thinking (MOT) showed the largest mean impact and MOT produced...... the largest number of impacts. Logging of real-life use of the system over 6 months indicated six aspects of improved usability, where significant differences among evaluation techniques were found. Concerning five of the six aspects Think Aloud evaluations and the above-mentioned combination of questionnaire...

  12. Merits of usability testing for PACS selection

    NARCIS (Netherlands)

    Jorritsma, Wiard; Cnossen, Fokie; van Ooijen, Peter M. A.

    Objectives: To compare the usability of different Picture Archiving and Communication System (PACS) workstations, determine whether a usability test has added value with respect to the traditional way of comparing PACSs based on functional requirements, and to evaluate the appropriateness of a

  13. Building a Remote Usability Testing Body of Knowledge (RUTBOK)

    DEFF Research Database (Denmark)

    Lizano, Fulvio; Stage, Jan

    2012-01-01

    Remote Usability Testing (RUT) is an alternative method of usability evaluations. The main aim of RUT is the reduction of costs in the usability evaluation process. Since middle of the 90s RUT, has emerged as a technique which seems as is gaining maturity across the time. In general any discipline...

  14. Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach.

    Science.gov (United States)

    Devine, Emily Beth; Lee, Chia-Ju; Overby, Casey L; Abernethy, Neil; McCune, Jeannine; Smith, Joe W; Tarczy-Hornoch, Peter

    2014-07-01

    Pharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption. The study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers. Using a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making. Nine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Usability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and

  15. Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

    Science.gov (United States)

    Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

    2016-07-21

    : 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

  16. Usability of Public Administration Electronic Forms

    Directory of Open Access Journals (Sweden)

    Miloslav Hub

    2015-06-01

    Full Text Available This paper is focused on the testing and evaluating of public administration electronic forms from the usability point of view. Its objective is to design a suitable methodology for usability testing of electronic forms and their description and distribution to public administration information systems professionals. Firstly, methods of usability engineering are summarized and a suitable method for usability testing and evaluation of electronic forms is selected. Farther, the methodology of electronic forms usability testing that uses the selected method is suggested. In the last part of the paper the case study that uses the proposed methodology is suggested and performed. The main benefit of the work is the design of testing methodology and proposition of the set of recommendations for new public administration electronic forms design.

  17. An Intelligent Framework for Website Usability

    Directory of Open Access Journals (Sweden)

    Alexiei Dingli

    2014-01-01

    Full Text Available With the major advances of the Internet throughout the past couple of years, websites have come to play a central role in the modern marketing business program. However, simply owning a website is not enough for a business to prosper on the Web. Indeed, it is the level of usability of a website that determines if a user stays or abandons it for another competing one. It is therefore crucial to understand the importance of usability on the web, and consequently the need for its evaluation. Nonetheless, there exist a number of obstacles preventing software organizations from successfully applying sound website usability evaluation strategies in practice. From this point of view automation of the latter is extremely beneficial, which not only assists designers in creating more usable websites, but also enhances the Internet users’ experience on the Web and increases their level of satisfaction. As a means of addressing this problem, an Intelligent Usability Evaluation (IUE tool is proposed that automates the usability evaluation process by employing a Heuristic Evaluation technique in an intelligent manner through the adoption of several research-based AI methods. Experimental results show there exists a high correlation between the tool and human annotators when identifying the considered usability violations.

  18. Personal Usability Constructs

    DEFF Research Database (Denmark)

    Hertzum, Morten; Clemmensen, Torkil; Hornbæk, Kasper

    2011-01-01

    Whereas the concept of usability is predominantly defined analytically, people relate to systems through personal usability constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected by two factors crucial to the international development...

  19. A Longitudinal Study of Usability in Health Care

    DEFF Research Database (Denmark)

    Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan

    2010-01-01

    We report from a longitudinal laboratory-based usability evaluation of a health care information system. The purpose of the study was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information...... system may or may not disappear over time, as the nurses get more familiar with it-if time heals poor design? As our method for studying this, we conducted a longitudinal study with two key studies. A usability evaluation was conducted with novice users when an electronic patient record system was being......, we discuss implications for evaluating usability in health care....

  20. Exploring the value of usability feedback formats

    DEFF Research Database (Denmark)

    Nørgaard, Mie; Hornbæk, Kasper Anders Søren

    2009-01-01

    The format used to present feedback from usability evaluations to developers affects whether problems are understood, accepted, and fixed. Yet, little research has investigated which formats are the most effective. We describe an explorative study where three developers assess 40 usability findings...... presented using five feedback formats. Our usability findings comprise 35 problems and 5 positive comments. Data suggest that feedback serves multiple purposes. Initially, feedback must convince developers about the relevance of a problem and convey an understanding of this. Feedback must next be easy...... working with the feedback to address the usability problems, there were no significant differences among the developers' ratings of the value of the different formats. This suggests that all of the formats may serve equally well as reminders in later stages of working with usability problems...

  1. Qualitative Marketing Research Through Usability Testing

    Directory of Open Access Journals (Sweden)

    Orzan Mihai

    2008-04-01

    Full Text Available Usability is an attribute of any good product, just as its functionality. It refers mainly to the utility of a product for its indented users, as well as to its ease of use. And whilst a correct functionality is critical for the commercial success of any product, its value comes through the human needs that it fulfills, which is determined through various marketing research techniques. In parallel, the IT&C community has developed in the last two decades its own type of research, called usability testing, used mainly to evaluate interface ease of use and all usability problems associated with.software products. This article aims at finding the right place for usability testing and usability professionals in the marketing community, as well as drawing a wider picture, from a marketing research perspective, on one of the most popular topics in IT&C community for the benefit of marketing scholars and professionals.

  2. The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management.

    Science.gov (United States)

    Househ, Mowafa S; Shubair, Mamdouh M; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

    2015-10-01

    The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers' ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Overall, the consumers' ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients.

  3. The Use of an Adapted Health IT Usability Evaluation Model (Health-ITUEM) for Evaluating Consumer Reported Ratings of Diabetes mHealth Applications: Implications for Diabetes Care and Management

    Science.gov (United States)

    Househ, Mowafa S.; Shubair, Mamdouh M.; Yunus, Faisel; Jamal, Amr; Aldossari, Bakheet

    2015-01-01

    Background: The aim of this paper is to present a usability analysis of the consumer ratings of key diabetes mHealth applications using an adapted Health IT Usability Evaluation Model (Health-ITUEM). Methods: A qualitative content analysis method was used to analyze publicly available consumer reported data posted on the Android Market and Google Play for four leading diabetes mHealth applications. Health-ITUEM concepts including information needs, flexibility/customizability, learnability, performance speed, and competency guided the categorization and analysis of the data. Health impact was an additional category that was included in the study. A total of 405 consumers’ ratings collected from January 9, 2014 to February 17, 2014 were included in the study. Results: Overall, the consumers’ ratings of the leading diabetes mHealth applications for both usability and health impacts were positive. The performance speed of the mHealth application and the information needs of the consumers were the primary usability factors impacting the use of the diabetes mHealth applications. There was also evidence on the positive health impacts of such applications. Conclusions: Consumers are more likely to use diabetes related mHealth applications that perform well and meet their information needs. Furthermore, there is preliminary evidence that diabetes mHealth applications can have positive impact on the health of patients. PMID:26635437

  4. An Evaluation and Support of Usability of Hacettepe University Libraries’ Websites through Training: A Study on Students of Hacettepe University, the Department of Information Management

    Directory of Open Access Journals (Sweden)

    Emine Cengiz

    2016-03-01

    Full Text Available This study has been conducted with the aim of testing the characteristics of usage and evaluating the effects of user education on web site use through assessment of website of Hacettepe University Libraries. In the study conducted on eight volunteer subjects who are users of the website of the University Libraries, qualitative and quantitative research methods were used collectively. During the application of the traditional usability test, six tasks were given to the associations, requiring them to use various sections of the website of the university library. During the responding period of the questions; the data obtained from loud-thinking technique, click counts and response times were recorded. Afterwards, the subjects were provided with a training by a librarian. The quantitative and qualitative data obtained at the end of the study were analyzed and the positive and negative features affecting the use of the website were determined. According to the research results, it was hard for them to answer the questions of the pre-screening of the user catalog, database access, and problems finding the article before the training. Support through training for associations has positively affected the usability of the website. According to the findings, it is suggested that users should be trained on using the website during training programs, catalog section should be more promoted and highlighted, the terminology should be reviewed and a subject search engine should be created in the databases section.

  5. Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

    Science.gov (United States)

    Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

    2014-01-01

    Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

  6. Usability Testing: Too Early? Too Much Talking? Too Many Problems?

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2016-01-01

    Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues that usabil......Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues...... that usability should (also) be evaluated late, that usability professionals should be wary of thinking aloud, and that they should focus more on effects achievement than problem detection....

  7. Active Involvement of Software Developers in Usability Engineering

    DEFF Research Database (Denmark)

    Bornoe, Nis; Stage, Jan

    2017-01-01

    The essence of usability evaluations is to produce feedback that supports the downstream utility so the interaction design can be improved and problems can be fixed. In practice, software development organizations experience several obstacles for conducting usability engineering. One suggested...... approach is to train and involve developers in all phases of usability activities from evaluations, to problem reporting, and making redesign proposals. Only limited work has previously investigated the impact of actively involving developers in usability engineering. In this paper, we present two small......, and problem fixing. At the organizational level, we found that the attitude towards and understanding of the role of usability engineering improved....

  8. Usability in Scientific Databases

    Directory of Open Access Journals (Sweden)

    Ana-Maria Suduc

    2012-07-01

    Full Text Available Usability, most often defined as the ease of use and acceptability of a system, affects the users' performance and their job satisfaction when working with a machine. Therefore, usability is a very important aspect which must be considered in the process of a system development. The paper presents several numerical data related to the history of the scientific research of the usability of information systems, as it is viewed in the information provided by three important scientific databases, Science Direct, ACM Digital Library and IEEE Xplore Digital Library, at different queries related to this field.

  9. 大學圖書館網站使用性評估之探討 The Usability Evaluation Study of University Library Websites

    Directory of Open Access Journals (Sweden)

    Jiann-Cherng Shieh

    2009-12-01

    Full Text Available 圖書館網站是圖書館服務的延伸,因此除了網站內容能否滿足讀者需求外,網站是否易於被使用,是否易於找到資料,亦是影響圖書館網站服務品質的重要指標。本研究利用任務導向之使用性測試、觀察與深度訪談等方法獲取受試者於個案圖書館網站使用性資料,以分析了解不同學科背景使用者於使用圖書館網站之差異,發掘使用者對圖書館網站使用性之問題,改善舊有圖書館網站,並透過圖書館網站使用性之再評估,驗證大學圖書館網站進行使用性評估之成效。另本研究進一步採用系統使用性量表問卷,於使用性測試前後量測使用者對圖書館網站使用性之滿意度,藉由滿意度統計分析以驗證使用者對使用性改善滿意度之提昇。本研究結果顯示不同學科背景使用者對大學圖書館網站使用性有差異,且造成差異的主要原因與其使用圖書館網站頻率有關;另依據使用者於圖書館網站使用性問題,修改重構部分個案圖書館網站並進行後測,結果顯示使用者不僅均能順利完成任務且其平均完成時間亦減少%,同時使用者對修改後圖書館網站之系統使用性滿意度亦明顯高於修改前。本研究證實大學圖書館網站進行使用性評估確能協助提昇使用者對圖書館網站之使用效率及使用性滿意度。Library websites are the platforms that libraries extend their services to. In addition to concerning the contents of library websites, their easy understand- ing and flexible usage are the most important issues that are liable to disregard their critical effects on library web sites design. Library websites of poor us- ability will frustrate users’ aspirations for libraries services. In this research, based on user centered design, we apply various methods of system usability scale, usability testing, think aloud and interview to evaluate the usability of

  10. Design and usability evaluation of user-centered and visual-based aids for dietary food measurement on mobile devices in a randomized controlled trial.

    Science.gov (United States)

    Liu, Ying-Chieh; Chen, Chien-Hung; Lee, Chien-Wei; Lin, Yu-Sheng; Chen, Hsin-Yun; Yeh, Jou-Yin; Chiu, Sherry Yueh-Hsia

    2016-12-01

    We designed and developed two interactive apps interfaces for dietary food measurements on mobile devices. The user-centered designs of both the IPI (interactive photo interface) and the SBI (sketching-based interface) were evaluated. Four types of outcomes were assessed to evaluate the usability of mobile devices for dietary measurements, including accuracy, absolute weight differences, and the response time to determine the efficacy of food measurements. The IPI presented users with images of pre-determined portion sizes of a specific food and allowed users to scan and then select the most representative image matching the food that they were measuring. The SBI required users to relate the food shape to a readily available comparator (e.g., credit card) and scribble to shade in the appropriate area. A randomized controlled trial was conducted to evaluate their usability. A total of 108 participants were randomly assigned into the following three groups: the IPI (n=36) and SBI (n=38) experimental groups and the traditional life-size photo (TLP) group as the control. A total of 18 types of food items with 3-4 different weights were randomly selected for assessment by each type. The independent Chi-square test and t-test were performed for the dichotomous and continuous variable analyses, respectively. The total accuracy rates were 66.98%, 44.15%, and 72.06% for the IPI, SBI, and TLP, respectively. No significant difference was observed between the IPI and TLP, regardless of the accuracy proportion or weight differences. The SBI accuracy rates were significantly lower than the IPI and TLP accuracy rates, especially for several spooned, square cube, and sliced pie food items. The time needed to complete the operation assessment by the user was significantly lower for the IPI than for the SBI. Our study corroborates that the user-centered visual-based design of the IPI on a mobile device is comparable the TLP in terms of the usability for dietary food measurements

  11. Design of a Tablet Computer App for Facilitation of a Molecular Blood Culture Test in Clinical Microbiology and Preliminary Usability Evaluation.

    Science.gov (United States)

    Samson, Lasse L; Pape-Haugaard, Louise; Meltzer, Michelle C; Fuchs, Martin; Schønheyder, Henrik C; Hejlesen, Ole

    2016-03-18

    User mobility is an important aspect of the development of clinical information systems for health care professionals. Mobile phones and tablet computers have obtained widespread use by health care professionals, offering an opportunity for supporting the access to patient information through specialized applications (apps) while supporting the mobility of the users. The use of apps for mobile phones and tablet computers may support workflow of complex tasks, for example, molecular-based diagnostic tests in clinical microbiology. Multiplex Blood Culture Test (MuxBCT) is a molecular-based diagnostic test used for rapid identification of pathogens in positive blood cultures. To facilitate the workflow of the MuxBCT, a specialized tablet computer app was developed as an accessory to the diagnostic test. The app aims to reduce the complexity of the test by step-by-step guidance of microscopy and to assist users in reaching an exact bacterial or fungal diagnosis based on blood specimen observations and controls. Additionally, the app allows for entry of test results, and communication thereof to the laboratory information system (LIS). The objective of the study was to describe the design considerations of the MuxBCT app and the results of a preliminary usability evaluation. The MuxBCT tablet app was developed and set up for use in a clinical microbiology laboratory. A near-live simulation study was conducted in the clinical microbiology laboratory to evaluate the usability of the MuxBCT app. The study was designed to achieve a high degree of realism as participants carried out a scenario representing the context of use for the MuxBCT app. As the MuxBCT was under development, the scenario involved the use of molecular blood culture tests similar to the MuxBCT for identification of microorganisms from positive blood culture samples. The study participants were observed, and their interactions with the app were recorded. After the study, the participants were debriefed to

  12. A usability evaluation of an interactive application for halal products using optical character recognition and augmented reality technologies

    Science.gov (United States)

    Lam, Meng Chun; Nizam, Siti Soleha Muhammad; Arshad, Haslina; A'isyah Ahmad Shukri, Saidatul; Hashim, Nurhazarifah Che; Putra, Haekal Mozzia; Abidin, Rimaniza Zainal

    2017-10-01

    This article discusses the usability of an interactive application for halal products using Optical Character Recognition (OCR) and Augmented Reality (AR) technologies. Among the problems that have been identified in this study is that consumers have little knowledge about the E-Code. Therefore, users often have doubts about the halal status of the product. Nowadays, the integrity of halal status can be doubtful due to the actions of some irresponsible people spreading false information about a product. Therefore, an application that uses OCR and AR technology developed in this study will help the users to identify the information content of a product by scanning the E-Code label and by scanning the product's brand to know the halal status of the product. In this application, E-Code on the label of a product is scanned using OCR technology to display information about the E-Code. The product's brand is scan using augmented reality technology to display halal status of the product. The findings reveal that users are satisfied with this application and it is useful and easy to use.

  13. EVALUATION OF THE USABILITY OF MOBILE COMPUTER SYSTEM FOR EDUCATIVE ADVISING IN THE UNIVERSIDAD AUTÓNOMA INDÍGENA DE MEXICO

    Directory of Open Access Journals (Sweden)

    Erasmo Miranda-Bojórquez

    2011-01-01

    Full Text Available Tests of evaluation and functionality of a system computer denominated FoldMobile in la Universidad Autonoma Indigena de Mexico (UAIM have taken place. This system provides with sufficient information to carry out the pursuit of the learning of student when it takes place the actual interaction of the adviser and the student in any place of the university campus and within an atmosphere totally disconnected of any network of devices used for storage. For it one has settled in a digital personal assistant (PDA. The purpose of the tests is to measure its usability and to carry out a redesign of the system being used for it the methodology based on users. Especially the propose heuristic evaluation by Nielsen through its ten rules. An experiment was carried out to evaluate the usability of the system and graphical interfaces to offer simpler solutions that they approach the mental models of the users and to ensure that the system is accepted and more used. The results gave the approval of the experts to the simplicity of the screens and the information presented/displayed through a consistent and familiar language but also suggested a redesign as far as the obtaining of aid of use of the system. In agreement with the results of the experiment the level of acceptance from the user was high, describing its experience like satisfactory, exciting and easy to use. The benefits are in cost and time of development of the system and more propitious conditions so that he is really used.

  14. Usability and Workflow Evaluation of "RhEumAtic Disease activitY" (READY). A Mobile Application for Rheumatology Patients and Providers.

    Science.gov (United States)

    Yen, Po-Yin; Lara, Barbara; Lopetegui, Marcelo; Bharat, Aseem; Ardoin, Stacy; Johnson, Bernadette; Mathur, Puneet; Embi, Peter J; Curtis, Jeffrey R

    2016-11-02

    RhEumAtic Disease activitY (READY) is a mobile health (mHealth) application that aims to create a shared platform integrating data from both patients and physicians, with a particular emphasis on arthritis disease activity. We made READY available on an iPad and pilot implemented it at a rheumatology outpatient clinic. We conducted 1) a usability evaluation study to explore patients' and physicians' interactions with READY, and 2) a time motion study (TMS) to observe the clinical workflow before and after the implementation. A total of 33 patients and 15 physicians participated in the usability evaluation. We found usability problems in navigation, data entry, pain assessment, documentation, and instructions along with error messages. Despite these issues, 25 (75,76%) patients reported they liked READY. Physicians provided mixed feedback because they were concerned about the impact of READY on clinical workflow. Six physicians participated in the TMS. We observed 47 patient visits (44.72 hours) in the pre-implementation phase, and 42 patient visits (37.82 hours) in the post-implementation phase. We found that patients spent more time on READY than paper (4.39mins vs. 2.26mins), but overall, READY did not delay the workflow (pre = 52.08 mins vs. post = 45.46 mins). This time difference may be compensated with READY eliminating a workflow step for the staff. Patients preferred READY to paper documents. Many found it easier to input information because of the larger font size and the ease of 'tapping' rather than writing-out or circling answers. Even though patients spent more time on READY than using paper documents, the longer usage of READY was mainly due to when troubleshooting was needed. Most patients did not have problems after receiving initial support from the staff. This study not only enabled improvements to the software but also serves as good reference for other researchers or institutional decision makers who are interested in implementing such a

  15. Development and Usability Evaluation of an Art and Narrative-Based Knowledge Translation Tool for Parents With a Child With Pediatric Chronic Pain: Multi-Method Study.

    Science.gov (United States)

    Reid, Kathy; Hartling, Lisa; Ali, Samina; Le, Anne; Norris, Allison; Scott, Shannon D

    2017-12-14

    Chronic pain in childhood is increasingly being recognized as a significant clinical problem for children and their families. Previous research has identified that families want information about the causes of their child's chronic pain, treatment options, and effective strategies to help their child cope with the pain. Unfortunately, parents have reported that finding this information can be challenging. The aim of this study was to actively work together with children attending a pediatric chronic pain clinic and their parents to develop, refine, and evaluate the usability of an art and narrative-based electronic book (e-book) for pediatric chronic pain. A multiphase, multi-method research design employing patient engagement techniques was used to develop, refine, and evaluate the usability of an art and narrative based e-book for pediatric chronic pain management to facilitate knowledge translation for parents with a child with chronic pain. The multiple phases included the following: (1) qualitative interviews to compile parents' narratives using qualitative interviews; (2) qualitative data analysis; (3) development of an e-book prototype; (4) expert clinician feedback; (5) parent usability evaluation, knowledge change, and confidence in knowledge responses using an electronic survey; (6) e-book refinement; and (7) dissemination of the e-book. A 48-page e-book was developed to characterize the experiences of a family living with a child with chronic pain. The e-book was a composite narrative of the parent interviews and encompassed descriptions of the effects the condition has on each member of the family. This was merged with the best available research evidence on the day-to-day management of pediatric chronic pain. The e-book was vetted for clinical accuracy by expert pediatric pain clinicians. All parents that participated in the usability evaluation (N=14) agreed or strongly agreed the content of the e-book was easy to understand and stated that they would

  16. A usability test is not an interview

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2016-01-01

    Usability tests are conducted to gauge users’ experience with a system, preferably before it is released for real use, and thereby find any problems that prevent users from completing their tasks, slow them down, or otherwise degrade their user experience. Such tests are important to successful...... systems development, yet test procedures vary and the quality of test results is sometimes contested. While there is no single accepted procedure for usability specialists to follow when conducting usability tests, these tests normally involve users who think out loud while using a system and an evaluator...... who observes the users’ behavior and listens in on their thoughts. This common core of usability tests is illustrated in Figure 1. The possible variations include, for example, whether the users work individually or in pairs, whether the evaluator is in the room with the user or in an adjoining room...

  17. Palliative Care Planner: A Pilot Study to Evaluate Acceptability and Usability of an Electronic Health Records System-integrated, Needs-targeted App Platform.

    Science.gov (United States)

    Cox, Christopher E; Jones, Derek M; Reagan, Wen; Key, Mary D; Chow, Vinca; McFarlin, Jessica; Casarett, David; Creutzfeldt, Claire J; Docherty, Sharron L

    2018-01-01

    The quality and patient-centeredness of intensive care unit (ICU)-based palliative care delivery is highly variable. To develop and pilot an app platform for clinicians and ICU patients and their family members that enhances the delivery of needs-targeted palliative care. In the development phase of the study, we developed an electronic health record (EHR) system-integrated mobile web app system prototype, PCplanner (Palliative Care Planner). PCplanner screens the EHR for ICU patients meeting any of five prompts (triggers) for palliative care consultation, allows families to report their unmet palliative care needs, and alerts clinicians to these needs. The evaluation phase included a prospective before/after study conducted at a large academic medical center. Two control populations were enrolled in the before period to serve as context for the intervention. First, 25 ICU patients who received palliative care consults served as patient-level controls. Second, 49 family members of ICU patients who received mechanical ventilation for at least 48 hours served as family-level controls. Afterward, 14 patients, 18 family members, and 10 clinicians participated in the intervention evaluation period. Family member outcomes measured at baseline and 4 days later included acceptability (Client Satisfaction Questionnaire [CSQ]), usability (Systems Usability Scale [SUS]), and palliative care needs, assessed with the adapted needs of social nature, existential concerns, symptoms, and therapeutic interaction (NEST) scale; the Patient-Centeredness of Care Scale (PCCS); and the Perceived Stress Scale (PSS). Patient outcomes included frequency of goal concordant treatment, hospital length of stay, and discharge disposition. Family members reported high PCplanner acceptability (mean CSQ, 14.1 [SD, 1.4]) and usability (mean SUS, 21.1 [SD, 1.7]). PCplanner family member recipients experienced a 12.7-unit reduction in NEST score compared with a 3.4-unit increase among controls (P

  18. Adapting the Wii Fit Balance Board to Enable Active Video Game Play by Wheelchair Users: User-Centered Design and Usability Evaluation.

    Science.gov (United States)

    Thirumalai, Mohanraj; Kirkland, William B; Misko, Samuel R; Padalabalanarayanan, Sangeetha; Malone, Laurie A

    2018-03-06

    Active video game (AVG) playing, also known as "exergaming," is increasingly employed to promote physical activity across all age groups. The Wii Fit Balance Board is a popular gaming controller for AVGs and is used in a variety of settings. However, the commercial off-the-shelf (OTS) design poses several limitations. It is inaccessible to wheelchair users, does not support the use of stabilization assistive devices, and requires the ability to shift the center of balance (COB) in all directions to fully engage in game play. The aim of this study was to design an adapted version of the Wii Fit Balance Board to overcome the identified limitations and to evaluate the usability of the newly designed adapted Wii Fit Balance Board in persons with mobility impairments. In a previous study, 16 participants tried the OTS version of the Wii Fit Balance Board. On the basis of observed limitations, a team of engineers developed and adapted the design of the Wii Fit Balance Board, which was then subjected to multiple iterations of user feedback and design tweaks. On design completion, we recruited a new pool of participants with mobility impairments for a larger study. During their first visit, we assessed lower-extremity function using selected mobility tasks from the International Classification of Functioning, Disability and Health. During a subsequent session, participants played 2 sets of games on both the OTS and adapted versions of the Wii Fit Balance Board. Order of controller version played first was randomized. After participants played each version, we administered the System Usability Scale (SUS) to examine the participants' perceived usability. The adapted version of the Wii Fit Balance Board resulting from the user-centered design approach met the needs of a variety of users. The adapted controller (1) allowed manual wheelchair users to engage in game play, which was previously not possible; (2) included Americans with Disabilities Act-compliant handrails as part

  19. Working together to improve usability

    DEFF Research Database (Denmark)

    Nørgaard, Mie; Hornbæk, Kasper

    2010-01-01

    In theory, usability work is an important and well-integrated activity in developing software. In practice, collaboration on improving usability is ridden with challenges relating to conflicting professional goals, tight project schedules, and unclear usability findings. The authors study those...... challenges through 16 interviews with software developers, usability experts, and project managers. Four themes that are key challenges to successful interaction between stakeholders are identified: poor timing when delivering usability results, results lacking relevance, little respect for other disciplines...

  20. MUUX-E, a framework of criteria for evaluating the usability, user experience and educational features of m-learning environments

    Directory of Open Access Journals (Sweden)

    Patricia-Ann Harpur

    2015-07-01

    Full Text Available Higher education students use mobile phones, equipped for Internet access. Mobile technologies can offer effective, satisfying and accessible m-learning experiences. A contribution has been made to knowledge on evaluating m-learning environments and to mobile human-computer interaction (MHCI, with the innovative synthesis of the MUUX-E Framework, which fills a gap in the domain of m-learning. MUUX-E is a single comprehensive, multi-faceted instrument for evaluating m-learning environments, emphasising usability and user experience in mobile educational contexts. It was developed by extensive literature studies on each aspect, and has five categories, 31 criteria and numerous sub-criteria. Using a design-based research paradigm, MUUX-E was applied iteratively to evaluate and enhance successive versions of m-LR, a mobile application created for a Software Engineering module. Participants were students and expert evaluators. MUUX-E served well to identify problems and strengths. The students were more positive than the experts regarding the benefits of m-LR, yet insightfully reported more system problems.

  1. Templates for Cross-Cultural and Culturally Specific Usability Testing

    DEFF Research Database (Denmark)

    Clemmensen, Torkil

    2011-01-01

    The cultural diversity of users of technology challenges our methods for usability testing. This article suggests templates for cross-culturally and culturally specific usability testing, based on studies of usability testing in companies in Mumbai, Beijing, and Copenhagen. Study 1 was a cross...... tests. The result was the construction of templates for usability testing. The culturally specific templates were in Mumbai “user-centered evaluation,” Copenhagen “client-centered evaluation,” and Beijing “evaluator-centered evaluation.” The findings are compared with related research...

  2. The Usability Evaluation of Fakih Method Based on Technology for Students with Hearing Difficulties: The User's Retrospective

    Science.gov (United States)

    Sabdan, Muhammad Sayuti Bin; Alias, Norlidah; Jomhari, Nazean; Jamaludin, Khairul Azhar; DeWitt, Dorothy

    2014-01-01

    The study is aimed at evaluating the FAKIH method based on technology in teaching al-Quran, based on the user's retrospective. The participants of this study were five students selected based on hearing difficulties. The study employed the user evaluation framework. Teacher's journals were used to determine the frequency and percentage of…

  3. Usability evaluation of an experimental text summarization system and three search engines: implications for the reengineering of health care interfaces.

    Science.gov (United States)

    Kushniruk, Andre W; Kan, Min-Yem; McKeown, Kathleen; Klavans, Judith; Jordan, Desmond; LaFlamme, Mark; Patel, Vimia L

    2002-01-01

    This paper describes the comparative evaluation of an experimental automated text summarization system, Centrifuser and three conventional search engines - Google, Yahoo and About.com. Centrifuser provides information to patients and families relevant to their questions about specific health conditions. It then produces a multidocument summary of articles retrieved by a standard search engine, tailored to the user's question. Subjects, consisting of friends or family of hospitalized patients, were asked to "think aloud" as they interacted with the four systems. The evaluation involved audio- and video recording of subject interactions with the interfaces in situ at a hospital. Results of the evaluation show that subjects found Centrifuser's summarization capability useful and easy to understand. In comparing Centrifuser to the three search engines, subjects' ratings varied; however, specific interface features were deemed useful across interfaces. We conclude with a discussion of the implications for engineering Web-based retrieval systems.

  4. Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

    Science.gov (United States)

    Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

    2015-07-24

    The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

  5. Mobile Usability Testing in Healthcare: Methodological Approaches.

    Science.gov (United States)

    Borycki, Elizabeth M; Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

    2015-01-01

    The use of mobile devices and healthcare applications is increasing exponentially worldwide. This has lead to the need for the healthcare industry to develop a better understanding of the impact of the usability of mobile software and hardware upon consumer and health professional adoption and use of these technologies. There are many methodological approaches that can be employed in conducting usability evaluation of mobile technologies. More obtrusive approaches to collecting study data may lead to changes in study participant behaviour, leading to study results that are less consistent with how the technologies will be used in the real-world. Alternatively, less obstrusive methods used in evaluating the usability of mobile software and hardware in-situ and laboratory settings can lead to less detailed information being collected about how an individual interacts with both the software and hardware. In this paper we review and discuss several innovative mobile usability evaluation methods on a contiuum from least to most obtrusive and their effects on the quality of the usability data collected. The strengths and limitations of methods are also discussed.

  6. Usability Plans and Schemes for Low Fidelity Prototypes

    DEFF Research Database (Denmark)

    Schultz, Nette; Kirk Sørensen, Jannick; Sørensen, Lene

    2006-01-01

    Internal report of WP1 task 4 activities from August 2006 to December 2006. This report describes the setup of a usability evaluation framework for evaluating core MAGNET concepts in terms of usability. Initially, these core concepts are identified and modes of operation involving...

  7. Usability at the CELSTEC Medialab

    NARCIS (Netherlands)

    Storm, Jeroen; Kostons, Danny

    2009-01-01

    Storm, J., & Kostons, D. (2009). Usability at the CELSTEC MediaLab. Presentation about the usability testing, usability research and User Centered Design conducted at the CELSTEC MediaLab. July, 7, 2009, Heerlen, The Netherlands: Open University of the Netherlands.

  8. Software architecture analysis of usability

    NARCIS (Netherlands)

    Folmer, Eelke

    2005-01-01

    One of the qualities that has received increased attention in recent decades is usability. A software product with poor usability is likely to fail in a highly competitive market; therefore software developing organizations are paying more and more attention to ensuring the usability of their

  9. The influence of prototype fidelity and aesthetics of design in usability tests: effects on user behaviour, subjective evaluation and emotion.

    Science.gov (United States)

    Sauer, Juergen; Sonderegger, Andreas

    2009-07-01

    An empirical study examined the impact of prototype fidelity on user behaviour, subjective user evaluation and emotion. The independent factors of prototype fidelity (paper prototype, computer prototype, fully operational appliance) and aesthetics of design (high vs. moderate) were varied in a between-subjects design. The 60 participants of the experiment were asked to complete two typical tasks of mobile phone usage: sending a text message and suppressing a phone number. Both performance data and a number of subjective measures were recorded. The results suggested that task completion time may be overestimated when a computer prototype is being used. Furthermore, users appeared to compensate for deficiencies in aesthetic design by overrating the aesthetic qualities of reduced fidelity prototypes. Finally, user emotions were more positively affected by the operation of the more attractive mobile phone than by the less appealing one.

  10. HIV testing in Europe: Evaluating the impact, added value, relevance and usability of the European Centre for Disease Prevention and Control (ECDC)'s 2010 HIV testing guidance.

    Science.gov (United States)

    Sullivan, Ann K; Sperle, Ida; Raben, Dorthe; Amato-Gauci, Andrew J; Lundgren, Jens Dilling; Yazdanpanah, Yazdan; Jakobsen, Stine Finne; Tavoschi, Lara

    2017-11-01

    An evaluation of the 2010 ECDC guidance on HIV testing, conducted in October 2015-January 2016, assessed its impact, added value, relevance and usability and the need for updated guidance. Data sources were two surveys: one for the primary target audience (health policymakers and decision makers, national programme managers and ECDC official contact points in the European Union/European Economic Area (EU/EEA) countries and one for a broader target audience (clinicians, civil society organisations and international public health agencies); two moderated focus group discussions  (17 participants each); webpage access data; a literature citation review; and an expert consultation (18 participants) to discuss the evaluation findings. Twenty-three of 28 primary target audience and 31 of 51 broader target audience respondents indicated the guidance was the most relevant when compared with other international guidance. Primary target audience respondents in 11 of 23 countries reported that they had used the guidance in development, monitoring and/or evaluation of their national HIV testing policy, guidelines, programme and/or strategy, and 29 of 51 of the broader target audience respondents reported having used the guidance in their work. Both the primary and broader target audience considered it important or very important to have an EU/EEA-level HIV testing guidance (23/28 and 46/51, respectively). The guidance has been widely used to develop policies, guidelines, programmes and strategies in the EU/EEA and should be regularly updated due to continuous developments in the field in order to continue to serve as an important reference guidance in the region.

  11. Toward a More Usable Home-Based Video Telemedicine System: A Heuristic Evaluation of the Clinician User Interfaces of Home-Based Video Telemedicine Systems.

    Science.gov (United States)

    Agnisarman, Sruthy; Narasimha, Shraddhaa; Chalil Madathil, Kapil; Welch, Brandon; Brinda, Fnu; Ashok, Aparna; McElligott, James

    2017-04-24

    Telemedicine is the use of technology to provide and support health care when distance separates the clinical service and the patient. Home-based telemedicine systems involve the use of such technology for medical support and care connecting the patient from the comfort of their homes with the clinician. In order for such a system to be used extensively, it is necessary to understand not only the issues faced by the patients in using them but also the clinician. The aim of this study was to conduct a heuristic evaluation of 4 telemedicine software platforms-Doxy.me, Polycom, Vidyo, and VSee-to assess possible problems and limitations that could affect the usability of the system from the clinician's perspective. It was found that 5 experts individually evaluated all four systems using Nielsen's list of heuristics, classifying the issues based on a severity rating scale. A total of 46 unique problems were identified by the experts. The heuristics most frequently violated were visibility of system status and Error prevention amounting to 24% (11/46 issues) each. Esthetic and minimalist design was second contributing to 13% (6/46 issues) of the total errors. Heuristic evaluation coupled with a severity rating scale was found to be an effective method for identifying problems with the systems. Prioritization of these problems based on the rating provides a good starting point for resolving the issues affecting these platforms. There is a need for better transparency and a more streamlined approach for how physicians use telemedicine systems. Visibility of the system status and speaking the users' language are keys for achieving this. ©Sruthy Agnisarman, Shraddhaa Narasimha, Kapil Chalil Madathil, Brandon Welch, FNU Brinda, Aparna Ashok, James McElligott. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 24.04.2017.

  12. Applying usability heuristics to radiotherapy systems

    International Nuclear Information System (INIS)

    Chan, Alvita J.; Islam, Mohammad K.; Rosewall, Tara; Jaffray, David A.; Easty, Anthony C.; Cafazzo, Joseph A.

    2012-01-01

    Background and purpose: Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. Material and methods: A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. Results: The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Conclusions: Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems.

  13. Fuelwood In Europe. Evaluation of the usable potential for 2020, effect on global environment and socioeconomic conditions of its mobilization

    International Nuclear Information System (INIS)

    1998-01-01

    In this 2020 prospective study, we have developed a methodology for analysis of the possibilities of increasing the use of fuelwood, and the socioeconomic and environmental implications of the kind of mobilization which would result therefrom. We have made such an evaluation in five countries within the European Community: Austria, Finland, France, Portugal and Sweden. The methodology is described in detail in the report. The fuelwood share of the energy supply in these five countries could be increased to 9% by the year 2020 if a scenario with a interventionist policy of fuelwood use is assumed in potential user sectors. This could be compared to the present fuelwood share of 5%. There are, however, large differences amongst the five countries. The increased fuelwood use could reduce carbon dioxide emissions by 7% for the year 2020, compared to the present level. The study shows that fuelwood is an economically competitive fuel for energy production in many user sectors. There are, however, a number of non-technical-economic factors (institutional, sociological, political...) which may stand in the way of increased fuelwood use. The method of analysing the possibilities for - and consequences of - an increased use of biomass which has been developed in this project could be used for similar analyses of other groups of countries in the European Union. (authors)

  14. Usability of Discovery Portals

    OpenAIRE

    Bulens, J.D.; Vullings, L.A.E.; Houtkamp, J.M.; Vanmeulebrouk, B.

    2013-01-01

    As INSPIRE progresses to be implemented in the EU, many new discovery portals are built to facilitate finding spatial data. Currently the structure of the discovery portals is determined by the way spatial data experts like to work. However, we argue that the main target group for discovery portals are not spatial data experts but professionals with limited spatial knowledge, and a focus outside the spatial domain. An exploratory usability experiment was carried out in which three discovery p...

  15. Evaluation of usability of the shielding effect for thyroid shield for peripheral dose during whole brain radiation therapy

    Energy Technology Data Exchange (ETDEWEB)

    Yang, Myung Sic; Park, Ju Kyeong; Lee, Seung Hun; Kim, Yang Su; Lee, Sun Young; Cha, Seok Yong [Dept. of Radiation Oncology, Chonbuk National University Hospital, Jeonju (Korea, Republic of)

    2014-12-15

    To reduce the radiation dose to the thyroid that is affected to scattered radiation, the shield was used. And we evaluated the shielding effect for the thyroid during whole brain radiation therapy. To measure the dose of the thyroid, 300cGy were delivered to the phantom using a linear accelerator(Clinac iX VARIAN, USA.)in the way of the 6MV X-ray in bilateral. To measure the entrance surface dose of the thyroid, five glass dosimeters were placed in the 10th slice's surface of the phantom with a 1.5 cm interval. The average values were calculated by measured values in five times each, using bismuth shield, 0.5 mmPb shield, self-made 1.0 mmPb shield and unshield. In the same location, to measure the depth dose of the thyroid, five glass dosimeters were placed in the 10th slice by 2.5 cm depth of the phantom with a 1.5 cm interval. The average values were calculated by measured values in five times each, using bismuth shield, 0.5 mmPb shield, self-made 1.0 mmPb shield and unshield. Entrance surface dose of the thyroid were respectively 44.89 mGy at the unshield, 36.03 mGy at the bismuth shield, 31.03 mGy at the 0.5 mmPb shield and 23.21 mGy at a self-made 1.0 mmPb shield. In addition, the depth dose of the thyroid were respectively 36.10 mGy at the unshield, 34.52 mGy at the bismuth shield, 32.28 mGy at the 0.5 mmPb shield and 25.50 mGy at a self-made 1.0 mmPb shield. The thyroid was affected by the secondary scattering dose and leakage dose outside of the radiation field during whole brain radiation therapy. When using a shield in the thyroid, the depth dose of thyroid showed 11-30% reduction effect and the surface dose of thyroid showed 20-48% reduction effect. Therefore, by using the thyroid shield, it is considered to effectively protect the thyroid and can perform the treatment.

  16. Usability: Human Research Program - Space Human Factors and Habitability

    Science.gov (United States)

    Sandor, Aniko; Holden, Kritina L.

    2009-01-01

    The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

  17. Assessment of Usability Benchmarks: Combining Standardized Scales with Specific Questions

    Directory of Open Access Journals (Sweden)

    Stephanie Bettina Linek

    2011-12-01

    Full Text Available The usability of Web sites and online services is of rising importance. When creating a completely new Web site, qualitative data are adequate for identifying the most usability problems. However, changes of an existing Web site should be evaluated by a quantitative benchmarking process. The proposed paper describes the creation of a questionnaire that allows a quantitative usability benchmarking, i.e. a direct comparison of the different versions of a Web site and an orientation on general standards of usability. The questionnaire is also open for qualitative data. The methodology will be explained by the digital library services of the ZBW.

  18. Evaluating interactive digital television applications through usability heuristics Evaluando aplicaciones de televisión digital interactiva a través de heurísticas de usabilidad

    Directory of Open Access Journals (Sweden)

    Andrés Solano

    2013-04-01

    Full Text Available Interactive Digital Television (iDT is considered as the convergence of television and computer technologies. Usability evaluation for applications based on emerging information technology brings new challenges. The main iDT feature is that the user may interact with the application; therefore usability should be a main concern when designing iDT applications. Current research usually focuses on iDT applications from a technical point of view, rather than a user-centered approach. There is a need for new usability evaluation methods or at least for the use of traditional evaluations in novel ways. A set of specific usability heuristics was defined and validated, in order to help the usability evaluations of iDT applications. A usability checklist to be used when applying iDT heuristics is also proposed.La Televisión Digital Interactiva (TDi es considerada como la convergencia de la televisión y las tecnologías de la computación. La evaluación de usabilidad para aplicaciones basadas en tecnologías emergentes trae nuevos retos. La principal característica de la TDi es que los usuarios pueden interactuar con las aplicaciones; de esta manera la usabilidad es el principal aspecto a considerar cuando se diseñan aplicaciones de TDi. Las investigaciones actuales normalmente están enfocadas sobre las aplicaciones de TDi desde un punto de vista técnico, y no desde un enfoque centrado en el usuario. Hay una necesidad de nuevos métodos de evaluación de usabilidad o, por lo menos, utilizar de nuevas formas los métodos de evaluación existentes. Un conjunto de heurísticas de usabilidad específicas ha sido definido y validado, con el objetivo de ayudar en la evaluación de usabilidad de aplicaciones de TDi. También se ha propuesto una lista de verificación para ser usada al momento de aplicar las heurísticas de usabilidad.

  19. Reusable Software Usability Specifications for mHealth Applications.

    Science.gov (United States)

    Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali

    2018-01-25

    One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.

  20. Educational software usability: Artifact or Design?

    Science.gov (United States)

    Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A

    2017-03-01

    Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

  1. Evaluating Youtube Platform Usability by People with Intellectual Disabilities (A User Experience Case Study Performed in a Six-Month Period

    Directory of Open Access Journals (Sweden)

    Tânia Rocha

    2017-01-01

    Full Text Available A comparison study of the Web interaction evolution of a group of people with intellectual disabilities, when performing search tasks using the YouTube platform, is presented. For the effect, we compare results in two assessment moments (the second assessment moment was performed, within the 6 months after the first one. We aimed at evaluating the evolution of their digital skills by comparing two assessment moments through the following usability variables: effectiveness, we register the rate of successful complete conclusion of Web search activities using the YouTube; efficiency, where it was register: time of task conclusion, number and type of difficulties found and errors made; satisfaction, the rate of acceptance and comfort when performing the tasks; and, autonomy indicators. The results revealed that participants depicted more learning skills when performing the second assessment moment, which is indicated by the number of participants who were able to conclude the activities and it's also confirmed by the prominent results of the second assessment moment. When it comes to errors, they made more errors in the first assessment moment in general. While handling the input devices the participants had a better performance with the mouse than the keyboard however in the second assessment moment they improved their skills with the mouse and keyboard input device. However, we believed that the keyboard will never be a device that they can be autonomous with due to their reading/ writing difficulties, which itself represents a didactic challenge when it comes to the very presentation of appropriate methodologies and techniques that may help them overcome such problem. Overall, users with intellectual disabilities had a good experience with the YouTube interface because they were motivated and satisfied during the execution of the tasks, however they were not autonomy with the search option.

  2. Usability Problem Identification in Culturally Diverse Settings

    DEFF Research Database (Denmark)

    Clemmensen, Torkil

    2012-01-01

    There are indications that established methods for evaluating information system usability that have been developed for use in, e.g. Europe or the USA, fail to give reliable results in countries such as India, China or Malaysia. This paper presents the theoretical background, related work...... and a definition of culture that should be useful for studies of multiple-country usability testing. This includes a discussion of cultural fit and the consequences of cultural (in)consistencies between stakeholders in system development and use. As an illustrative example of the kind of academic research...... that needs to be done, a pilot study is described. The pilot study exemplifies themes to explore, who should be participants and where should the study be done, how to find examples of multiple-country usability testing, how to collect data and how to analyse that data and what kind of results and discussion...

  3. Discovering the User: A Practical Glance at Usability Testing.

    Science.gov (United States)

    Campbell, Nicole; Walbridge, Sharon; Chisman, Janet; Diller, Karen R.

    1999-01-01

    This interview focuses on usability testing, one method for evaluating whether library Web sites are useful for users. Discussion includes: benefits and drawbacks of usability testing; why it is important; lessons learned from testing; advice for someone interested in doing a study; and recommendations. (AEF)

  4. Usability Testing of Two Ambulatory EHR Navigators.

    Science.gov (United States)

    Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

    2016-01-01

    Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

  5. Software architecture analysis of usability

    NARCIS (Netherlands)

    Folmer, E; van Gurp, J; Bosch, J; Bastide, R; Palanque, P; Roth, J

    2005-01-01

    Studies of software engineering projects show that a large number of usability related change requests are made after its deployment. Fixing usability problems during the later stages of development often proves to be costly, since many of the necessary changes require changes to the system that

  6. Usability engineering: domain analysis activities for augmented-reality systems

    Science.gov (United States)

    Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

    2002-05-01

    This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

  7. A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence

    NARCIS (Netherlands)

    Jaspers, Monique W. M.

    2009-01-01

    OBJECTIVE: Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the

  8. Usability laboratories at Philips : supporting research, development, and design for consumer and professional products

    NARCIS (Netherlands)

    Vries, de G.; Gelderen, van T.; Brigham, F.

    1994-01-01

    This paper describes two of the usability laboratories at Philips, discusses practical issues arising from our experience using the facilities, gives an example of a typical usability evaluation, and briefly outlines our vision for the future of the laboratories. Usability tests at Philips can

  9. Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

    Science.gov (United States)

    Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

    2014-01-01

    The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

  10. Usability Testing of an Academic Library Web Site: A Case Study.

    Science.gov (United States)

    Battleson, Brenda; Booth, Austin; Weintrop, Jane

    2001-01-01

    Discusses usability testing as a tool for evaluating the effectiveness and ease of use of academic library Web sites; considers human-computer interaction; reviews major usability principles; and explores the application of formal usability testing to an existing site at the University at Buffalo (NY) libraries. (Author/LRW)

  11. Integration of MSFC Usability Lab with Usability Testing

    Science.gov (United States)

    Cheng, Yiwei; Richardson, Sally

    2010-01-01

    As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

  12. Integrating discount usability in scrum development process in Ethiopia

    DEFF Research Database (Denmark)

    Teka, Degif; Dittrich, Y.; Kifle, Mesfin

    2017-01-01

    be adapted and integrated into the Scrum-agile development with especial emphasis on the Ethiopian context. The research aims at adapting software engineering and ICT development methods to the specific situation and integrating user-centered design (UCD) and lightweight usability methods into agile...... end users and developers. Culturally adapted user pair testing and heuristic evaluation supported usability testing and supported developers in getting early feedback. Integrated approach of discount usability with the Scrum process has been developed and evaluated first with the involved...

  13. Agents and wearables : usability in the COMRIS system

    NARCIS (Netherlands)

    Haan, de G.; Terken, J.M.B.

    2001-01-01

    This paper discusses usability research concerning a wearable system for spoken advice: a field experiment to investigate key concepts, a laboratory experiment to investigate interaction design, and field trials to evaluate the system. Conclusions are drawn about designing wearable appliances.

  14. Enabling the Usability of Earth Science Data Products and Services by Evaluating, Describing, and Improving Data Quality throughout the Data Lifecycle

    Science.gov (United States)

    Downs, R. R.; Peng, G.; Wei, Y.; Ramapriyan, H.; Moroni, D. F.

    2015-12-01

    Earth science data products and services are being used by representatives of various science and social science disciplines, by planning and decision-making professionals, by educators and learners ranging from primary through graduate and informal education, and by the general public. The diversity of users and uses of Earth science data is gratifying and offers new challenges for enabling the usability of these data by audiences with various purposes and levels of expertise. Users and other stakeholders need capabilities to efficiently find, explore, select, and determine the applicability and suitability of data products and services to meet their objectives and information needs. Similarly, they need to be able to understand the limitations of Earth science data, which can be complex, especially when considering combined or simultaneous use of multiple data products and services. Quality control efforts of stakeholders, throughout the data lifecycle, can contribute to the usability of Earth science data to meet the needs of diverse users. Such stakeholders include study design teams, data producers, data managers and curators, archives, systems professionals, data distributors, end-users, intermediaries, sponsoring organizations, hosting institutions, and others. Opportunities for engaging stakeholders to review, describe, and improve the quality of Earth science data products and services throughout the data lifecycle are identified and discussed. Insight is shared from the development of guidelines for implementing the Group on Earth Observations (GEO) Data Management Principles, the recommendations from the Earth Science Data System Working Group (ESDSWG) on Data Quality, and the efforts of the Information Quality Cluster of the Federation of Earth Science Information Partners (ESIP). Examples and outcomes from quality control efforts of data facilities, such as scientific data centers, that contribute to the usability of Earth science data also are offered.

  15. Long-term usability

    International Nuclear Information System (INIS)

    Holmgren, M.

    1998-01-01

    Longitudinal studies of the usability of a computer based system for process control has been performed. The whole life-cycle of one system has been of interest, as the problems are varying over time. Repeated measurements of the operators' experiences of this system have been made during 15 years. Of main interest have been the advantages/ disadvantages of computer based system for process control compared with conventional instrumentation. The results showed among other things that (1) computer based systems made it easier to control the process and increased security (2) age differences could be explained by other factors (3 ) expectations before the installation may influence the attitudes and use of equipment for quite some time In some questions the attitudes changed over time while in others they were quite stable, for example, in questions concerning preference for type of equipment. What do operators appreciate in a computer based system for process control? About 300 operators were asked about that. The main factor seems to include a reliable system with valid information that functions during disturbances. Hopefully new systems are designed with that in mind. (author)

  16. New usable technical specifications

    International Nuclear Information System (INIS)

    Webster, S.A.; Tomasi, L.T.; Bernier, R.A.

    1989-01-01

    After 2 yr of preparation, 1988 finally saw the nuclear industry writing operator-oriented technical specifications. This effort is a continuation of previous efforts to develop improved and usable standard technical specifications (STSs), and is being conducted by the four nuclear steam supply system vendor owners' groups under the auspices of the Nuclear Management Resources Council. Each participant is currently preparing a set of improved STSs based on a writer's guide that was developed through a combined industry effort. In May of 1987, a Human Factors Improvements to Technical Specifications (HFITS) task group was formed to prepare a writer's guide for improved, industrywide STSs. This task group was composed of two representatives from each owners' group, one with a human factors background and one with some operations background. Two documents were prepared in 6 months, a human factors report laying the groundwork for the considerations to go into technical specifications and a writer's guide for their preparation. This paper reports on the application of this writer's guide to the writing of improved STS

  17. Evaluation of different fracture-mechanical J-integral initiation values with regard to their usability in the safety assessment of components

    International Nuclear Information System (INIS)

    Eisele, U.; Roos, E.

    1991-01-01

    Determining fracture-mechanical material characteristic values on the basis of the J-integral is described and stipulated in a variety of standards and guidelines. The individual specifications differ in terms of procedure when determining the characteristic values and, therefore, also in terms of the meaningfulness of the results. This paper presents the different procedures, suggested in the course of the development of test methods in the field of elastic-plastic fracture mechanics, used to characterize crack initiation behaviour with regard to their features as material characteristic values and their usability in the safety assessment of components. (orig.)

  18. Usability testing a practical guide for librarians

    CERN Document Server

    Blakiston, Rebecca

    2014-01-01

    Do you want to improve the usability of your library website, but feel that it is too difficult, time-consuming, or expensive? Usability Testing: A Practical Guide for Librarians will teach you how to make the case for usability testing, define your audience and their goals, select a usability testing method appropriate for your particular context, plan for an in-house usability test, conduct an effective in-house usability test, analyze usability test results, and create and implement a plan for ongoing, systematic usability testing. Step-by-step instructions, along with a myriad of examples,

  19. Ten factors to consider when developing usability scenarios and tasks for health information technology.

    Science.gov (United States)

    Russ, Alissa L; Saleem, Jason J

    2018-02-01

    The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

  20. On the Concepts of Usability and Reusability of Learning Objects

    Directory of Open Access Journals (Sweden)

    Miguel-Angel Sicilia

    2003-10-01

    Full Text Available “Reusable learning objects” oriented towards increasing their potential reusability are required to satisfy concerns about their granularity and their independence of concrete contexts of use. Such requirements also entail that the definition of learning object “usability,” and the techniques required to carry out their “usability evaluation” must be substantially different from those commonly used to characterize and evaluate the usability of conventional educational applications. In this article, a specific characterization of the concept of learning object usability is discussed, which places emphasis on “reusability,” the key property of learning objects residing in repositories. The concept of learning object reusability is described as the possibility and adequacy for the object to be usable in prospective educational settings, so that usability and reusability are considered two interrelated – and in many cases conflicting – properties of learning objects. Following the proposed characterization of two characteristics or properties of learning objects, a method to evaluate usability of specific learning objects will be presented.

  1. Training Software Developers in Usability Engineering: A Literature Review

    DEFF Research Database (Denmark)

    Bruun, Anders

    2010-01-01

    . This paper presents a comprehensive literature study of research conducted in this area, where 129 papers are analyzed in terms of research focus, empirical basis, types of training participants and training costs. Findings show a need for further empirical research regarding long term effects of training...... to fund usability specialists or comprehensive consultancy. Training of non-usability personnel in critical usability engineering methods has the potential of easing these challenges. It is, however, unknown how much and what kind of research that has been committed to novice training in UE methods......, training costs and training in user based evaluation methods....

  2. Neuroanatomical correlates of perceived usability

    DEFF Research Database (Denmark)

    Vi, Chi Thanh; Hornbæk, Kasper; Subramanian, Sriram

    2017-01-01

    Usability has a distinct subjective component, yet surprisingly little is known about its neural basis and relation to the neuroanatomy of aesthetics. To begin closing this gap, we conducted two functional magnetic resonance imaging studies in which participants were shown static webpages (in...... the first study) and videos of interaction with webpages (in the second study). The webpages were controlled so as to exhibit high and low levels of perceived usability and perceived aesthetics. Our results show unique links between perceived usability and brain areas involved in functions such as emotional...... processing (left fusiform gyrus, superior frontal gyrus), anticipation of physical interaction (precentral gyrus), task intention (anterior cingulate cortex), and linguistic processing (medial and bilateral superior frontal gyri). We use these findings to discuss the brain correlates of perceived usability...

  3. Enhancing usability using Near Field Communication for mobile application

    Directory of Open Access Journals (Sweden)

    Wihidayat Endar

    2018-01-01

    Full Text Available Near Field Communication (NFC as relatively new wireless communication technology pushes new challenges to application developers to make their applications easier to use and simpler to operate. This point of view known as usability element. Usability is one of the elements for creating good quality applications. This study aims to analyse the usability of mobile-based application embeds with NFC. We also try to evaluate usability in applications used by children. We developed an application called Receptionist which has a primary function as a communication tool between students, teachers and parents at a middle school. To know the impact of the NFC, the Receptionist input system is designed with two methods, via conventional navigation (using buttons and via NFC. To understand the usability of each method, we do user testing and questioners on students. The results show, using the NFC there is a significant increase in usability attributes: efficiency, effectiveness, and learnability. On the other hand, there is decreases of user satisfaction comparing to conventional method. In general, this study demonstrates the potential of new input device technologies that can improve the usability of mobile-based applications.

  4. Usability: managing facilities for social outcomes

    DEFF Research Database (Denmark)

    Alexander, Keith; Blakstad, Siri; Hansen, Geir

    2013-01-01

    The paper argues for the development of usability concepts, methodologies and tools, in considering the effects of the built environment from a user, organisational and community perspective, in order to have a positive influence on social outcomes. Since it was formed over ten years ago, the CIB W......111 on Usability has been exploring concepts, methods and tools, developed in the evaluation of all kinds of consumer products, applied to the built environment. In the most recent phase of this work, conducted over the past three years, an international network of partners has collaborated to focus...... properties of a workplace, they could better manage and design the facilities for improved social outcomes. Interpretation and analysis of the built environment (and support services) based on how it is socially constructed will enable integration of organisational use and the facilities provided to arrive...

  5. Intra- and Inter-Cultural Usability in Computer-Supported Collaboration

    DEFF Research Database (Denmark)

    Vatrapu, Ravi; Suthers, Dan

    2010-01-01

    In this paper, we argue for an increased scope of universal design to encompass usability and accessibility for not only users with physical disabilities but also for users from different cultures. Towards this end, we present an empirical evaluation of cultural usability in computer......-Chinese, and Chinese-Chinese) appropriated affordances and produced technological intersubjectivity. Cultural usability was analyzed through the use of performance and satisfaction measures. The results show a systemic variation in efficiency, effectiveness, and satisfaction between the two cultural groups....... Implications of these findings for the research and practice of usability, in general, and cultural usability, in particular, are discussed in this paper....

  6. Online user tracking and usability tools - a mapping study

    OpenAIRE

    Nyström, Niklas

    2014-01-01

    Tracking user activities online can be done in order to improve systems usability, understand user behaviour or to increase monetary prot, to mention a few things. The software tools for this purpose can vary, for example in terms of usability of the tool itself, features, security, price, accessibility and support options. In this study I have developed a methodology to evaluate a selection of modern tools and map them depending on various properties. I have also analysed learning theories t...

  7. Hello World! - Experiencing Usability Methods without Usability Expertise

    Science.gov (United States)

    Eriksson, Elina; Cajander, Åsa; Gulliksen, Jan

    How do you do usability work when no usability expertise is available? What happens in an organization when system developers, with no previous HCI knowledge, after a 3-day course, start applying usability methods, and particularly field studies? In order to answer these questions qualitative data were gathered through participatory observations, a feed back survey, field study documentation and interviews from 47 system developers from a public authority. Our results suggest that field studies enhance the developer’s understanding of the user perspective, and provide a more holistic overview of the use situation, but that some developers were unable to interpret their observations and see solutions to the users’ problems. The field study method was very much appreciated and has now become standard operating procedure within the organization. However, although field studies may be useful, it does not replace the need for usability pro fes sion als, as their knowledge is essential for more complex observations, analysis and for keeping the focus on usability.

  8. Responsibilities in the Usability Requirements Elicitation Process

    Directory of Open Access Journals (Sweden)

    Marianella Aveledo

    2008-12-01

    Full Text Available Like any other software system quality attribute, usability places requirements on software components. In particular, it has been demonstrated that certain usability features have a direct impact throughout the software process. This paper details an approach that looks at how to deal with certain usability features in the early software development stages. In particular, we consider usability features as functional usability requirements using patterns that have been termed usability patterns to elicit requirements. Additionally, we clearly establish the responsibilities of all the players at the usability requirements elicitation stage.

  9. Usability and feasibility of health IT interventions to enhance Self-Care for Lymphedema Symptom Management in breast cancer survivors

    Directory of Open Access Journals (Sweden)

    Mei R. Fu, PhD, RN, FAAN

    2016-09-01

    Conclusions: This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.

  10. Web usability testing with a Hispanic medically underserved population.

    Science.gov (United States)

    Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

    2009-04-01

    Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

  11. Qualitative review of usability problems in health information systems for radiology.

    Science.gov (United States)

    Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

    2017-12-01

    Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

  12. Accessibility and usability OCW data: The UTPL OCW

    Directory of Open Access Journals (Sweden)

    Germania Rodríguez

    2017-08-01

    Full Text Available This data article provides a data description on article entitled “A framework for improving web accessibility and usability of Open Course Ware sites” [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

  13. Integrated System Validation Usability Questionnaire: Computerized Procedures

    International Nuclear Information System (INIS)

    Garcés, Ma. I.; Torralba, B.

    2015-01-01

    The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to operating procedures, both computer and paper-based, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed, the models used by the nuclear industry and their technical support organizations, mainly, the Electric Power Research Institute, EPRI, are analyzed, and scientist advances are also explored. In the remaining stages, general and specific guidelines for computerized and paper-based procedures are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMLAB.

  14. OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

    Science.gov (United States)

    Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

    2018-01-01

    Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

  15. A Longitudinal Study of Usability in Health Care - Does Time Heal?

    DEFF Research Database (Denmark)

    Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan

    2007-01-01

    for 15 months, we repeated the evaluation. Our aim was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information system may or may not disappear over time, as the nurses get more familiar......We report from a longitudinal laboratory-based usability evaluation of a health care information system. A usability evaluation was conducted with novice users when an electronic patient record system was being deployed in a large hospital. After the nurses had used the system in their daily work...... with it – if time heals poor design. On the basis of our study, we present findings on the usability of the electronic patient system as experienced by the nurses at these two different points in time and discuss implications for evaluating usability in health care....

  16. Usability of PostgreSQL

    OpenAIRE

    Zeng, Xi

    2011-01-01

    My topic of the thesis is usability of PostgreSQL. It presents basic information aboutPostgreSQL, such as its history, function, and comparison with one of the most popular databases - MySQL. PostgreSQL has been tested in different environments and with different programming languages. The research is based on the documents from PostgreSQL official website.The thesis introduces and proves the usability and the compatibility of PostgreSQL. PostgreSQL has been installed on Windows workstation a...

  17. Is usability compositional?

    NARCIS (Netherlands)

    Brinkman, W.P.

    2003-01-01

    Everyday, people are confronted with devices they have to control for all kinds of reasons. Designers hope that their creations can be controlled easily. For that purpose, they can turn to user-system interaction theories to guide them in design and evaluation. However, so far, no empirical methods

  18. Usability Testing: A Case Study.

    Science.gov (United States)

    Chisman, Janet; Walbridge, Sharon; Diller, Karen

    1999-01-01

    Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)

  19. Improving Usability of Passphrase Authentication

    DEFF Research Database (Denmark)

    Nielsen, Glen; Vedel, Michael; Jensen, Christian D.

    2014-01-01

    . This is done to ensure an appropriate degree of security, but instead, it makes it difficult for users to remember their password, which results in passwords that are either insecure, but easy to remember, or written down on paper. In this paper we address the problem of usability in user authentication...

  20. Development of a Methodology to Conduct Usability Evaluation for Hand Tools that May Reduce the Amount of Small Parts that are Dropped During Installation while Processing Space Flight Hardware

    Science.gov (United States)

    Miller, Darcy

    2000-01-01

    Foreign object debris (FOD) is an important concern while processing space flight hardware. FOD can be defined as "The debris that is left in or around flight hardware, where it could cause damage to that flight hardware," (United Space Alliance, 2000). Just one small screw left unintentionally in the wrong place could delay a launch schedule while it is retrieved, increase the cost of processing, or cause a potentially fatal accident. At this time, there is not a single solution to help reduce the number of dropped parts such as screws, bolts, nuts, and washers during installation. Most of the effort is currently focused on training employees and on capturing the parts once they are dropped. Advances in ergonomics and hand tool design suggest that a solution may be possible, in the form of specialty hand tools, which secure the small parts while they are being handled. To assist in the development of these new advances, a test methodology was developed to conduct a usability evaluation of hand tools, while performing tasks with risk of creating FOD. The methodology also includes hardware in the form of a testing board and the small parts that can be installed onto the board during a test. The usability of new hand tools was determined based on efficiency and the number of dropped parts. To validate the methodology, participants were tested while performing a task that is representative of the type of work that may be done when processing space flight hardware. Test participants installed small parts using their hands and two commercially available tools. The participants were from three groups: (1) students, (2) engineers / managers and (3) technicians. The test was conducted to evaluate the differences in performance when using the three installation methods, as well as the difference in performance of the three participant groups.

  1. Usability Testing Of Web Mapping Portals

    Directory of Open Access Journals (Sweden)

    Petr Voldán

    2011-05-01

    Full Text Available This study presents a usability testing as method, which can be used to improve controlling of web map sites. Study refers to the basic principles of this method and describes particular usability tests of mapping sites. In this paper are identified potential usability problems of web sites: Amapy.cz, Google maps and Mapy.cz. The usability testing was focused on problems related with user interfaces, addresses searching and route planning of the map sites.

  2. Course management systems from a usability perspective

    CSIR Research Space (South Africa)

    Padayachee, I

    2011-01-01

    Full Text Available (with knowledge of usability engineering and system domain knowledge) who inspect the Indira Padayachee, Paula Kotz? and Alta van der Merwe 302 interface and determine its compliance with recognized usability principles (the ?heuristics... presents a summary of the results of the severity rating. Table 2: Severity Rating Scale for Usability Problems (Nielsen 2007b) 0 I don?t agree that this is a usability problem at all 1 Cosmetic problem only: need not be fixed unless there is extra...

  3. Usability Assessment of E-Café Operational Management Simulation Game

    Science.gov (United States)

    Chang, Chiung-sui; Huang, Ya-Ping

    2013-01-01

    To ensure the quality of digital simulation game, we utilized the usability evaluation heuristic in the design and development processes of e-café operational management game-based learning material for students. The application of usability evaluations during this study is described. Additionally, participant selection, data collection and…

  4. A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

    Science.gov (United States)

    Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

    2008-01-01

    This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

  5. Determining Reliability and Validity of the Persian Version of Software Usability Measurements Inventory (SUMI) Questionnaire

    OpenAIRE

    seyed abolfazl zakerian; Roya Azizi; Mehdi Rahgozar

    2013-01-01

    The term usability refers to a special index for success of an operating system. This study aimed to determine the reliability and validity of the Software Usability Measurements Inventory (SUMI) questionnaire as one of the valid and common questionnaires about usability evaluation. The back translation method was used to translate the questionnaire from English to Persian back to English. Moreover, repeatability or test-retest reliability was practically used to determine the reliability of ...

  6. Towards Evidence Based Usability in Health Informatics?

    NARCIS (Netherlands)

    Marcilly, Romaric; Peute, Linda W.; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W.

    2015-01-01

    In a Health Information Technology (HIT) regulatory context in which the usability of this technology is more and more a critical issue, there is an increasing need for evidence based usability practice. However, a clear definition of evidence based usability practice and how to achieve it is still

  7. Library Website Usability Test Project

    KAUST Repository

    Ramli, Rindra M.; Bukhari, Duaa

    2013-01-01

    This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.

  8. Library Website Usability Test Project

    KAUST Repository

    Ramli, Rindra M.

    2013-06-01

    This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.

  9. Increasing the impact of usability work in software development

    DEFF Research Database (Denmark)

    Uldall-Espersen, Tobias; Frøkjær, Erik

    2006-01-01

    Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop......Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop...

  10. Commentary: Usability – A Sensitizing Concept

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2018-01-01

    In his article “The Usability Construct: A Dead End?”, Tractinsky (in Human-Computer Interaction) contends that for scientific research on usability to progress, the usability construct should be unbundled and replaced by well-defined constructs. This contention is presented as the conclusion...... that follows naturally from taking a scientist’s viewpoint on usability. Similar calls for definitive concepts – constructs in Tractinsky’s terminology – have been made in other scientific fields with concepts as ambiguous as that of usability. But counterarguments have also been presented....

  11. Usability Metrics for Gamified E-learning Course: A Multilevel Approach

    Directory of Open Access Journals (Sweden)

    Aleksandra Sobodić

    2018-04-01

    Full Text Available This paper discusses the effect of a gamified learning system for students of the master course on Web Design and Programming performed at the Faculty of Organization and Informatics. A new set of usability metrics was derived from web-based learning usability, user experience and instructional design literature and incorporated into the questionnaire which consists of three main categories: Usability, Educational Usability and User Experience. The main contribution of this paper is the development and validation of a questionnaire for measuring the usability of a gamified e-learning course from students’ perspective. Usability practitioners can use the developed metrics with confidence when evaluating the design of a gamified e-learning course in order to improve students’ engagement and motivation.

  12. Methods uncovering usability issues in medication-related alerting functions: results from a systematic review.

    Science.gov (United States)

    Marcilly, Romaric; Vasseur, Francis; Ammenwerth, Elske; Beuscart-Zephir, Marie-Catherine

    2014-01-01

    This paper aims at listing the methods used to evaluate the usability of medication-related alerting functions and at knowing what type of usability issues those methods allow to detect. A sub-analysis of data from this systematic review has been performed. Methods applied in the included papers were collected. Then, included papers were sorted in four types of evaluation: "expert evaluation", "user- testing/simulation", "on site observation" and "impact studies". The types of usability issues (usability flaws, usage problems and negative outcomes) uncovered by those evaluations were analyzed. Results show that a large set of methods are used. The largest proportion of papers uses "on site observation" evaluation. This is the only evaluation type for which every kind of usability flaws, usage problems and outcomes are detected. It is somehow surprising that, in a usability systematic review, most of the papers included use a method that is not often presented as a usability method. Results are discussed about the opportunity to provide usability information collected after the implementation of the technology during their design process, i.e. before their implementation.

  13. Examining the Use of Usability Results in a Software Development Company

    DEFF Research Database (Denmark)

    Høegh, Rune Thaarup; Stage, Jan

    2004-01-01

    This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...... from the company found that the traditional usability report plays a very little role for the development team. Initial results suggest that textual feedback proves more valuable when accompanied with video and oral feedback.......This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...

  14. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence.

    Science.gov (United States)

    Jaspers, Monique W M

    2009-05-01

    Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the human-computer interaction field, we provide an overview of the methodological and empirical research available on the three usability inspection and testing methods most often used. We describe two 'expert-based' and one 'user-based' usability method: (1) the heuristic evaluation, (2) the cognitive walkthrough, and (3) the think aloud. All three usability evaluation methods are applied in laboratory settings. Heuristic evaluation is a relatively efficient usability evaluation method with a high benefit-cost ratio, but requires high skills and usability experience of the evaluators to produce reliable results. The cognitive walkthrough is a more structured approach than the heuristic evaluation with a stronger focus on the learnability of a computer application. Major drawbacks of the cognitive walkthrough are the required level of detail of task and user background descriptions for an adequate application of the latest version of the technique. The think aloud is a very direct method to gain deep insight in the problems end users encounter in interaction with a system but data analyses is extensive and requires a high level of expertise both in the cognitive ergonomics and in computer system application domain. Each of the three usability evaluation methods has shown its usefulness, has its own advantages and disadvantages; no single method has revealed any significant results indicating that it is singularly effective in all circumstances. A combination of different techniques that compliment one another should preferably be used as their collective application will be more powerful than applied in isolation. Innovative mobile and automated solutions to support end-user testing have

  15. Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

    Science.gov (United States)

    Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

    2016-03-01

    The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

  16. Dimensions for hearing-impaired mobile application usability model

    Science.gov (United States)

    Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan

    2017-10-01

    This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.

  17. Usability Briefing - a process model for healthcare facilities

    DEFF Research Database (Denmark)

    Fronczek-Munter, Aneta

    2014-01-01

    Background: In complex buildings with many types of users it can be difficult to satisfy the numerous, often contradictory requirements. Research in usability mostly focuses on evaluating products or facilities with users, after they were built. This paper is part of a PhD project “Usability...... with various users/stakeholders, using creative boundary objects at workshops.  Practical Implications: The research results have relevance to researchers, client organisations, facility managers and architects planning new complex facilities.  Research limitations: The proposed model is theoretical and needs...... briefing for hospitals”, where methods for capturing user needs and experiences at hospital facilities are investigated in order to feed into design processes and satisfy the users’ needs and maximise the effectiveness of facilities. Purpose: This paper introduces the concept of usability briefing...

  18. Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

    Science.gov (United States)

    Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

    2013-01-01

    Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

  19. Towards an empirical method of usability testing of system parts : a methodological study

    NARCIS (Netherlands)

    Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.

    2007-01-01

    Current usability evaluation methods are essentially holistic in nature. However, engineers that apply a component-based software engineering approach might also be interested in understanding the usability of individual parts of an interactive system. This paper examines the efficiency dimension of

  20. An extended protocol for usability validation of medical devices : Research design and reference model

    NARCIS (Netherlands)

    Schmettow, M.; Schnittker, R.; Schraagen, J.M.

    2017-01-01

    This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences

  1. Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud

    NARCIS (Netherlands)

    van Velsen, Lex Stefan; van der Geest, Thea; Klaassen, R.F.

    2007-01-01

    Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of

  2. Usability of consumer-related information sources for design improvement

    NARCIS (Netherlands)

    Thiruvenkadam, G.; Brombacher, A.C.; Lu, Y.; Ouden, den P.H.

    2008-01-01

    In this paper we report the findings of a study intended to assess the usability of consumer related information sources in order to improve the design processes of innovative electronic products. Specifically, an evaluation is done of the quality and content of information that would help product

  3. Usability of Commercial mHealth Toolkits From a Developer Perspective - An Empirical Evaluation of Google Fit, Apple HealthKit and Samsung Digital Health

    OpenAIRE

    Astrup, Petter; Jansen, Erik Gunnar; Aksic, Nemanja

    2016-01-01

    Self-monitoring and sharing of data to enhance personal fitness and health has rapidly increased in popularity, and as a result, there has emerged a market for delivering tools supporting development and usage of technology that can contribute to this emerging trend. This thesis aims to describe and evaluate the leading development platforms in this field from the perspective of a developer developing mobile health applications. The conducted research consisted of a case study where data was ...

  4. Usability and Interaction Design in West Africa

    DEFF Research Database (Denmark)

    Sørensen, Jannick Kirk

    Good usability is important in all ICT solutions. To achieve good usability, a good praxis for interaction design is needed. Usability and interaction design have however emerged and established itself in a North European and US context. The ICT industry in Africa do not have the same resources...... for user-involvement and participatory design be directly transferred? How can interaction design and usability be cared for in African ICT development context, given the resources available? This paper aims to initiate a discussion of the conditions for interaction design and usability in West Africa...... in the field of interaction design as in the developed world. While good usability and good user experiences are important to all users of ICT, the question is whether the methods and techniques that were mainly developed in Scandinavia, Europe and US are suitable for ICT development in Africa? Can ideals...

  5. Usability Testing for Developing Effective Interactive Multimedia Software: Concepts, Dimensions, and Procedures

    Directory of Open Access Journals (Sweden)

    Sung Heum Lee

    1999-04-01

    Full Text Available Usability testing is a dynamic process that can be used throughout the process of developing interactive multimedia software. The purpose of usability testing is to find problems and make recommendations to improve the utility of a product during its design and development. For developing effective interactive multimedia software, dimensions of usability testing were classified into the general categories of: learnability; performance effectiveness; flexibility; error tolerance and system integrity; and user satisfaction. In the process of usability testing, evaluation experts consider the nature of users and tasks, tradeoffs supported by the iterative design paradigm, and real world constraints to effectively evaluate and improve interactive multimedia software. Different methods address different purposes and involve a combination of user and usability testing, however, usability practitioners follow the seven general procedures of usability testing for effective multimedia development. As the knowledge about usability testing grows, evaluation experts will be able to choose more effective and efficient methods and techniques that are appropriate to their goals.

  6. Usable security history, themes, and challenges

    CERN Document Server

    Garfinkel, Simson

    2014-01-01

    There has been roughly 15 years of research into approaches for aligning research in Human Computer Interaction with computer Security, more colloquially known as ``usable security.'' Although usability and security were once thought to be inherently antagonistic, today there is wide consensus that systems that are not usable will inevitably suffer security failures when they are deployed into the real world. Only by simultaneously addressing both usability and security concerns will we be able to build systems that are truly secure. This book presents the historical context of the work to dat

  7. Usability and User Experience Information in Reviews

    DEFF Research Database (Denmark)

    Hedegaard, Steffen

    future versions of the prod- uct? The results show that users write about product use in terms related to standard and popularly researched aspects of usability and user experience, e.g. effiiency, effectiveness, enjoyment, frustration. The frequency with which different aspects are depicted in reviews...... differs significantly between product domains. We also find that reviews contain descriptions of more persistent usability issues. I devise automatic methods for classifying sentences with regard to dimensions of both usability and user experience and usability problems and perform a linguistic analysis...

  8. Evaluating the usability of a single UK community acquired brain injury (ABI) rehabilitation service website: implications for research methodology and website design.

    Science.gov (United States)

    Newby, Gavin; Groom, Christina

    2010-04-01

    Information provision is an important resource for those living with acquired brain injury (ABI) and their families. Web-based health information services are now common additions to health service provision. Ideally, they should be easy to use and provide useful, relevant and accurate information. ABI injuries do not affect individuals in the same way, and survivors can have a wide range of abilities and impairments. Therefore, any informational resource intended for this group should take account of their needs and help to compensate for their limitations. This pilot study recruited a group of individuals with ABI (of a median Extended Glasgow Outcome Scale rating of "lower moderate disability") who were clients of a UK National Health Service rehabilitation service and asked them to assess a specialised website provided by that service and hosted by their employing Primary Care Trust organisation. Participants completed a practical task and then gave their opinions on various aspects of website design, and content. They were also asked to suggest improvements and recommend additions. Overall the results were favourable. However, improvements in the legibility, layout and writing style were identified. There were also requests to add more information on the existing topics and add additional topics. The discussion also evaluates the utility of the methodology and the implications of the results for others considering constructing their own website.

  9. Evaluation and assessment of social accountability in medical schools.

    Science.gov (United States)

    Leinster, Sam

    2011-01-01

    Social accountability as an outcome must be measured at institutional (evaluation) and individual (assessment) level. The definitions used in the measurement will be dependent on the social setting of the medical school being scrutinised. A formal framework is needed so that comparisons can be made and progress measured. The World Health Organisation suggests that there are four principles that delineate social accountability--relevance, quality, cost-effectiveness and equity. Medical schools are evaluated according to their planning, doing and impact in relation to these principles. Boelen and Woollard have clarified the ideas of planning, doing and impact into Conceptualisation, Production and Usability. THEnet group of medical schools use a shortened version of Boelen and Woollard's framework with 20 criteria to evaluate their programmes. At the individual level, there is considerable overlap between the concepts of 'social accountability' and 'professionalism'. Attempts are being made to define and measure professionalism, however, if the behaviour and attitudes of individual graduates is a significant component in defining social responsibility new methods of assessment need to be developed. Factors such as the available resources and the structure of the health services have a very large effect on doctors' attitudes and behaviour. As a result, the task of evaluating and assessing the extent to which medical schools are socially accountable is complex. Judgments on how well a school is meeting the standards will have to make allowance for the local political and economic environment.

  10. Usable Interface Design for Everyone

    Science.gov (United States)

    de Castro Lozano, Carlos; Salcines, Enrique García; Sainz de Abajo, Beatriz; Burón Fernández, F. Javier; Ramírez, José Miguel; Recellado, José Gabriel Zato; Montoya, Rafael Sanchez; Bell, John; Marin, Francisco Alcantud

    When designing "interfaces for everyone" for interactive systems, it is important to consider factors such as cost, the intended market, the state of the environment, etc. User interfaces are fundamental for the developmental process in any application, and its design must be contemplated from the start. Of the distinct parts of a system (hardware and software), it is the interface that permits the user access to computer resources. The seven principles of "Universal Design" or "Design for Everyone" focus on a universal usable design, but at the same time acknowledge the influences of internal and external factors. Structural changes in social and health services could provide an increase in the well-being of a country's citizens through the use of self-care programming and proactive management/prevention of disease. Automated home platforms can act as an accessibility instrument which permits users to avoid, compensate, mitigate, or neutralize the deficiencies and dependencies caused by living alone.

  11. Metaphors of Human Thinking: A New Tool in User Interface Design and Evaluation

    DEFF Research Database (Denmark)

    Frøkjær, Erik; Hornbæk, Kasper

    2003-01-01

    human thinking, inspection technique, usability evaluation, heuristic evaluation, quantitative study......human thinking, inspection technique, usability evaluation, heuristic evaluation, quantitative study...

  12. Usability of Low-Cost Android Data Collection System for Community-Based Participatory Research.

    Science.gov (United States)

    Salihu, Hamisu M; Salinas-Miranda, Abraham; Turner, DeAnne; King, Lindsey; Paothong, Arnut; Austin, Deborah; Berry, Estrellita Lo

    2016-01-01

    Android tablet computers can be valuable tools for data collection, but their usability has not been evaluated in community-based participatory research (CBPR). This article examines the usability of a low-cost bilingual touchscreen computerized survey system using Android tablets, piloted with a sample of 201 community residents in Tampa, Florida, from November 2013 to March 2014. Needs assessment questions were designed with the droidSURVEY software, and deployed using Android tablet computers. In addition, participants were asked questions about system usability. The mean system usability was 77.57 ± 17.66 (range, 0-100). The mean completion time for taking the 63 survey questions in the needs assessment was 23.11 ± 9.62 minutes. The survey completion rate was optimal (100%), with only 6.34% missingness per variable. We found no sociodemographic differences in usability scores. Our findings indicate that Android tablets could serve as useful tools in CBPR studies.

  13. Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

    Science.gov (United States)

    Tao, Da

    2012-01-01

    Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development

  14. Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

    Science.gov (United States)

    Kushniruk, Andre; Borycki, Elizabeth

    2017-01-01

    In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

  15. Obstacles to usability evaluation in practice

    DEFF Research Database (Denmark)

    Otkjær Bak, Jakob; Nguyen, Kim; Nielsen, Peter Risgaard

    2008-01-01

    The concept of Head-Up Games [18] advocates that pervasive games of the future should be designed to evoke play patterns akin to those of traditional outdoor games. This tenet, while appealing, is ill defined without a clear description of these behaviors. Below we introduce OPOS, an observation ...

  16. Evaluation of business intelligence system usability

    OpenAIRE

    Poropat, Elvis

    2014-01-01

    The reality in businesses nowadays is the easy access to big amount of data that is being transferred into information. Reliable and useful information provide a competitive advantage in turbulent waters on all fields of business activities. Information is the foundation for all important business decisions. That means that on the informational foundation entire business structure is based. Information is needed at each stage of business operations, from enterprise’s entrance into the market,...

  17. Comparative usability of modern anaesthesia ventilators: a human factors study.

    Science.gov (United States)

    Spaeth, J; Schweizer, T; Schmutz, A; Buerkle, H; Schumann, S

    2017-11-01

    The anaesthesia ventilator represents the key equipment for intraoperative respiratory care. Improper operation of this device may threaten a patient's health. A self-explanatory interface facilitates handling and decreases the risk of operating errors. This study systematically evaluates the usability of user interfaces in four modern anaesthesia ventilators. Twenty naïve operators were asked to execute 20 tasks on each of four different anaesthesia ventilators (Avance CS2™, GE Healthcare; Flow-i™, Maquet; and Perseus™ and Primus™, Dräger) in a randomized order. The success of task execution, frequency of requests for assistance, and processing times were recorded. During the tasks, the operators' visual focus was measured via eye-tracking. Additionally, subjective assessments of usability were evaluated by a standardized questionnaire. For comparison, six experienced operators undertook the same protocol. The overall rate of falsely executed tasks was low. Naïve operators requested assistance least when using the Perseus (26). Pooled processing times were shortest for the Perseus (222 s), followed by the Primus (223 s), the Avance (238 s), and the Flow-i (353 s). Task-specific processing times differed considerably between the devices. Eye-tracking analyses revealed associated interface issues that impeded the operators' performance. Operators rated usability best for the Perseus [mean (sd): 67 (17) arbitrary units] and worst for the Flow-i [50 (16) arbitrary units]. Results from experienced operators support these findings by trend. The usability of modern anaesthesia ventilators differs considerably. Interface issues of specific tasks impair the operator's efficiency. Eliminating the specific usability issues might improve the operator's performance and, as a consequence, the patient's safety. © The Author 2017. Published by Oxford University Press on behalf of the British Journal of Anaesthesia. All rights reserved. For Permissions, please

  18. The role of usability in e-lexicography

    Directory of Open Access Journals (Sweden)

    André H. du Plessis

    2017-05-01

    Full Text Available In the development of the metalexicography, the primary focus of metalexicographers was on the development of printed dictionaries. As technology advances, the focus now shifts towards online and electronic products. Tarp (2009:23–24 posits that this shift results in metalexicographic shortcomings. This means that the theories used to create and evaluate dictionaries are not sufficient anymore. Bergenholtz and Bothma (2011:54 show that dictionaries as data carriers are now not only limited to the field of lexicography, but also to information technological fields. For current lexicographers to be successful in the digital age, the theories used in designing, developing and critiquing dictionaries must adapt with regards to current information technological trends, norms and practices. One aspect that must be addressed is the usability of dictionaries and other electronic lexicographic tools. By using usability theories and standards, current metalexicographical principles can be adapted for the digital age in a streamlined fashion. This study aims to show how usability theories and standards can be advantageous for metalexicography and that future electronic metalexicographic endeavours should not be undertaken without considering the usability as part of the theoretical framework.

  19. Usability study of youtube websites for Malaysian teenagers

    Science.gov (United States)

    Razak, Mohd Nur Faiz Abd; Hussain, Azham; Hamdi, Mohd Maizan Fishol

    2017-10-01

    Nowadays, YouTube is the 3rd most visited website in the world. It was created for users to search, watch and share video. Statistics show that YouTube run in more than 88 countries and support 76 different languages which covered almost 95% of Internet population globally. Therefore, a usability study is for specific type of users such as based on gender, range of age and country is considered a must for this kind of top website. In this study, we focus on YouTube website usability for Malaysian teenagers that are currently schooling in boarding school with limited access of Internet. It was done in a controlled lab environment with proper devices and software as MacBook, LCD Monitor, and WhatPulse heat map tracker. The evaluation was made based on usability metrics: ease of use, usefulness and satisfaction of users with combination of recording videos, mouse and keyboard heat map and questionnaires. Findings show that most of the respondents just use YouTube for video watching only while ignoring other features in the same time. There are difficulties in using it at the first moment but could catch up in short time. It shows how usable YouTube website especially in the learnability and memorability aspects.

  20. Assessment of the usability of a digital learning technology prototype for monitoring intracranial pressure

    Directory of Open Access Journals (Sweden)

    Lilian Regina de Carvalho

    Full Text Available ABSTRACT Objective: to assess the usability of a digital learning technology prototype as a new method for minimally invasive monitoring of intracranial pressure. Method: descriptive study using a quantitative approach on assessing the usability of a prototype based on Nielsen's ten heuristics. Four experts in the area of Human-Computer interaction participated in the study. Results: the evaluation delivered eight violated heuristics and 31 usability problems in the 32 screens of the prototype. Conclusion: the suggestions of the evaluators were critical for developing an intuitive, user-friendly interface and will be included in the final version of the digital learning technology.

  1. Usability testing of e-learning: an approach incorporating co-discovery and think-aloud

    CSIR Research Space (South Africa)

    Adebesin, TF

    2009-06-01

    Full Text Available Computer applications developed to support learning in the cognitive domains are quite different from commercial transaction processing applications. The unique nature of such applications calls for different methods for evaluating their usability...

  2. Review of Spatial-Database System Usability: Recommendations for the ADDNS Project

    National Research Council Canada - National Science Library

    Abdalla, R. M; Niall, K. K

    2007-01-01

    ...) and three-dimensional (3D) visualizations. This report presents an overview of the basic concepts of GIS and spatial databases, provides an analytical usability evaluation and critically analyses different spatial- database applications...

  3. A Benchmark Usability Study of the Tactical Decision Making Under Stress Decision Support System

    National Research Council Canada - National Science Library

    Schmorrow, Dylan

    1998-01-01

    This study evaluates the usability of a U.S. Navy Decision Support System (DSS). The DSS was developed to enhance the performance of tactical decision makers within a Navy Combat Information Center...

  4. From Playability to a Hierarchical Game Usability Model

    OpenAIRE

    Nacke, Lennart E.

    2010-01-01

    This paper presents a brief review of current game usability models. This leads to the conception of a high-level game development-centered usability model that integrates current usability approaches in game industry and game research.

  5. Improving Public Relations Web Sites through Usability Research.

    Science.gov (United States)

    Hallahan, Kirk

    2001-01-01

    Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)

  6. Usability and Accessibility of Air Force Intranet Web Sites

    National Research Council Canada - National Science Library

    Bentley, Richard S

    2006-01-01

    .... The Technology Acceptance Model suggests that information systems must not only be useful but also be usable and a large body of usability engineering knowledge exists to support usable design. In addition, the U.S...

  7. The Development of a Formative and a Reflective Scale for the Assessment of On-Line Store Usability

    Directory of Open Access Journals (Sweden)

    Timo Christophersen

    2008-10-01

    Full Text Available In usability research, difference between formative and reflective measurement models for the assessment of latent variables has been ignored largely. As a consequence, many usability scales are misspecified. This might result in reduced scale validity because of the elimination of important usability facets within the procedure of scale development. The aim of the current study was to develop a questionnaire for the evaluation of On-line store usability (UFOS-V2 that includes both a formative and a reflective scale. 378 subjects participated in a laboratory experimental study. Each participant visited two out of 35 On-line stores. The usability and intention to buy was assessed for both stores. In addition, actual purchase behaviour was observed by combining the subjects' reward with the decision to buy. In a two-construct PLS structural equation model the formative usability scale was used as a predictor for the reflective usability measure. Results indicate that the formative usability scale UFOS-V2f forms a valid set of items for the user-based assessment of online store usability. The reflective usability scale shows high internal consistency. Positive relationships to intention and decision to buy confirm high scale validity.

  8. Virtual Reality for Architectural or Territorial Representations: Usability Perceptions

    Directory of Open Access Journals (Sweden)

    Atta Idrawani Zaini

    2017-05-01

    Full Text Available Virtual reality (VR is widely being researched within various aspects of real-world applications. As architecture and urban design are very much adhered to evaluating and designing space, physical representations are deemed as incompetent to deliver a full-scale depiction of a space. Similarly, digital models are very much also limited in that sense. VR can deliver a full-scale virtual environment (VE, tricking users to be immersed in the replicated environment. This is an advantage for the aforementioned design disciplines, as more relatable and realistic depiction of a space can be modelled. The notion of its usability has become important to be understood from the perspective of architecture and urban design. This paper measured the respondents’ perceptions of VR’s usability through measuring its quality of use based on several criteria. The criteria established were the ease of use, usefulness, and satisfaction. Different levels of architectural details were decided as a form of control. A total of N=96 randomly selected respondents from various backgrounds participated in the survey as they were divided into four different group of treatments. Each group experienced a different VE with different level of architectural details. The first section of analysis is a one-sample analysis and the second is a group difference analysis. From the first analysis, it was found that the respondents perceived VR as a usable tool for architectural or territorial representation. Using Kruskal-Wallis test, it was found that there was no statistically significant difference between groups, suggesting that the respondents perceived VR as usable regardless of the level of architectural details. As this paper used perception data based on the quality of use alone, the efficiency of VR system was not measured. Thus, this paper recommends further studies to be conducted on the system’s efficiency to reflect its usability in full extent.

  9. The Software Therapist: Usability Problem Diagnosis Through Latent Semantic Analysis

    National Research Council Canada - National Science Library

    Sparks, Randall; Hartson, Rex

    2006-01-01

    The work we report on here addresses the problem of low return on investment in software usability engineering and offers support for usability practitioners in identifying, understanding, documenting...

  10. What makes an automated teller machine usable by blind users?

    Science.gov (United States)

    Manzke, J M; Egan, D H; Felix, D; Krueger, H

    1998-07-01

    Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.

  11. A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

    Science.gov (United States)

    Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

    2015-01-01

    This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

  12. Assessing the usability of Shazam mobile app

    Science.gov (United States)

    Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Almazini, Hassan; Almazini, Hussein

    2017-10-01

    Like searching for a "needle" in a "haystack", suppose that there is a large set of signals (finite sequences of numbers) fs1; s2; s3; g, and a special signal q that may or may not be in the collection. How can the signals be found in the collection that is similar, or identical to q, and how can this be done quickly? A solution to this question is the basis of the Shazam smart phone app, where a listener captures a short excerpt of a recorded song with the smart phone's microphone, and in a matter of moments the app reports the name of the song and the artist. Here, the "needle" is the excerpt, and the "haystack" is a vast corpus of popular music. The Shazam algorithm is powered by Fourier analysis. This paper presents a report on a usability evaluation of Amazon Shazam app. The researchers present the outcome based on a task-based evaluation that involved 15 users of different level of experience who performed 5 tasks using the Shazam mobile app. Post-test questionnaire was used to capture users' perceptions about the app. The results demonstrate that most of the participants were satisfied with services provided by the app.

  13. The Software Therapist: Usability Problem Diagnosis Through Latent Semantic Analysis

    Science.gov (United States)

    2006-06-14

    at a given level is equivalent to removing attributes that don’t apply to a given usability situation, thereby filtering or pruning off irrelevant sub...Each answer prunes the number of stages remaining. Through a process of elimination, the Wizard helps evaluators home in on the correct stage...the diagnosis for one problem report, the user may want to take a break to get a cup of coffee or take a short walk, but when ready to continue with

  14. The effects of protoype medium on usability testing.

    Science.gov (United States)

    Boothe, Chase; Strawderman, Lesley; Hosea, Ethan

    2013-11-01

    Inconsistencies among testing methods and results in previous research prompted this study that builds upon a systematic usability testing research framework to better understand how interface medium influences users' abilities to detect usability flaws in applications. Interface medium was tested to identify its effects on users' perceptions of usability and abilities to detect usability problems and severe usability problems. Results indicated that medium has no effect on users' abilities to detect usability problems or perceptions of usability. However, results did indicate an interaction between the medium and the tested application in which users were able to identify significantly more usability problems on a higher fidelity medium using a particular application. Results also indicated that as users' perceptions of an application's usability increases, the users are less able to detect usability problems in that application. Usability testing should begin early in the design process, even if low fidelity mediums will be used. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

  15. Apathy towards the Integration of Usability Work

    DEFF Research Database (Denmark)

    Wale-Kolade, Adeola; Nielsen, Peter Axel

    2016-01-01

    In this article we report from a case study of a software development organization and we study in particular the developers’ and product managers’ attitudes towards integrating usability work into software development. We offer explanations based on system justification theory illuminating what...... would-be integrators might be up against. The analysis shows how the developers only pay lip service to usability work and how they treat users superficially. It further shows how that leads to stereotyping of usability designers and users in order to preserve status quo, and how internalization...... of inequality between the developers and usability designers rationalizes the preservation of status quo. These findings will have significant implications for managers of software development....

  16. Managing Product Usability: How companies deal with usability in the development of electronic consumer products

    OpenAIRE

    Van Kuijk, J.I.

    2010-01-01

    Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. That the usability of electronic consumer products is under pressure is attributed to an incre...

  17. An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

    Science.gov (United States)

    Schaarup, Clara; Hejlesen, Ole Kristian

    2016-01-01

    Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

  18. Usability study of a novel, self-lighted, disposable speculum: military applications.

    Science.gov (United States)

    Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

    2013-04-01

    Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

  19. Usability and user driven innovation - unity or clash?

    DEFF Research Database (Denmark)

    Fronczek-Munter, Aneta

    2011-01-01

    Aim: To present different understandings of the concepts ‗usability‘ and ‗user driven innovation‘ and discuss if and how the built environment can benefit from these concepts and the unity of them. Approach and methodology: The paper is based on literature reviews of scientific journals and other...... influential publications within the academic fields of Facilities Management, Architecture and Engineering, Participatory Design and Software design. Outline: The paper will discuss different understandings of the concept ‗usability‘ and its relation to ‗user driven innovation‘, which depends on the academic...... field and area of professional application. The concept of usability has its roots in evaluations of consumer products and user interfaces of computer software. During the last 5-10 years there has been a new development of research in usability of buildings and workplaces. Recently researchers have...

  20. Usability assessment of ASIBOT: a portable robot to aid patients with spinal cord injury

    OpenAIRE

    Jardón Huete, Alberto; Gil, Ángel M.; Peña, Ana I. de la; Monje Micharet, Concepción Alicia; Balaguer Bernaldo de Quirós, Carlos

    2011-01-01

    The usability concept refers to aspects related to the use of products that are closely linked to the user's degree of satisfaction. Our goal is to present a functional evaluation methodology for assessing the usability of sophisticated technical aids, such as a portable robot for helping disabled patients with severe spinal cord injuries. The specific manipulator used for this task is ASIBOT, a personal assistance robot totally developed by RoboticsLab at the University Carlos III of Madrid....

  1. Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

    Science.gov (United States)

    Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

    2017-01-01

    Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no

  2. Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies.

    Science.gov (United States)

    Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James

    2017-06-01

    One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine

  3. Quality and Usability of Arthritic Pain Self-Management Apps for Older Adults: A Systematic Review.

    Science.gov (United States)

    Bhattarai, Priyanka; Newton-John, T R O; Phillips, Jane L

    2018-03-01

    To appraise the quality and usability of currently available pain applications that could be used by community-dwelling older adults to self-manage their arthritic pain. A systematic review. Searches were conducted in App Store and Google Play to identify pain self-management apps relevant to arthritic pain management. English language pain management apps providing pain assessment and documentation function and pain management education were considered for inclusion. A quality evaluation audit tool based on the Stanford Arthritis Self-Management Program was developed a priori to evaluate app content quality. The usability of included apps was assessed using an established usability evaluation tool. Out of the 373 apps that were identified, four met the inclusion criteria. The included apps all included a pain assessment and documentation function and instructions on medication use, communication with health professionals, cognitive behavioral therapy-based pain management, and physical exercise. Management of mood, depression, anxiety, and sleep were featured in most apps (N = 3). Three-quarters (N = 3) of the apps fell below the acceptable moderate usability score (≥3), while one app obtained a moderate score (3.2). Few of the currently available pain apps offer a comprehensive pain self-management approach incorporating evidence-based strategies in accordance with the Stanford Arthritis Self-Management Program. The moderate-level usability across the included apps indicates a need to consider the usability needs of the older population in future pain self-management app development endeavors.

  4. The STEP database through the end-users eyes--USABILITY STUDY.

    Science.gov (United States)

    Salunke, Smita; Tuleu, Catherine

    2015-08-15

    The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

  5. Key Design Characteristics for Developing Usable E-Commerce Websites in the Arab World

    Directory of Open Access Journals (Sweden)

    Layla Hasan

    2016-09-01

    Full Text Available This research aims to suggest key design characteristics that are necessary for developing usable e-commerce websites in the Arab world. A comprehensive usability evaluation of four leading Arab e-commerce websites was conducted using the heuristic evaluation method. The results identified major and minor usability problems and major and minor good design characteristics on the selected websites. Based on the results, 51 key design characteristics were suggested. The recommended key design characteristics comprised two levels according to their priority: level one which includes mandatory key design characteristics and level two which includes supplementary design characteristics. The key design characteristics in each level were categorized under specific pages and areas that can be found on any e-commerce website. Such categorizations could direct website evaluators and designers to important pages and areas that should be considered to improve the overall usability of e-commerce websites. The results of this research are particularly important to developing countries which are still facing challenges that may affect the design and accessibility of usable and useful websites. These relate to low speed of accessing the Internet and a lack of website designers who have experience in customers’ needs and websites’ usable design characteristics.

  6. Empirical usability testing in a component-based environment : improving test efficiency with component-specific usability measures

    NARCIS (Netherlands)

    Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Bastide, R.; Palanque, P.; Roth, J.

    2005-01-01

    This paper addresses the issue of usability testing in a component-based software engineering environment, specifically measuring the usability of different versions of a component in a more powerful manner than other, more holistic, usability methods. Three component-specific usability measures are

  7. Managing Product Usability : How companies deal with usability in the development of electronic consumer products

    NARCIS (Netherlands)

    Van Kuijk, J.I.

    2010-01-01

    Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to

  8. From Usability Engineering to Evidence-based Usability in Health IT

    NARCIS (Netherlands)

    Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

    2016-01-01

    Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve

  9. Health Websites: Accessibility and Usability for American Sign Language Users

    Science.gov (United States)

    Kushalnagar, Poorna; Naturale, Joan; Paludneviciene, Raylene; Smith, Scott R.; Werfel, Emily; Doolittle, Richard; Jacobs, Stephen; DeCaro, James

    2015-01-01

    To date, there have been efforts towards creating better health information access for Deaf American Sign Language (ASL) users. However, the usability of websites with access to health information in ASL has not been evaluated. Our paper focuses on the usability of four health websites that include ASL videos. We seek to obtain ASL users’ perspectives on the navigation of these ASL-accessible websites, finding the health information that they needed, and perceived ease of understanding ASL video content. ASL users (N=32) were instructed to find specific information on four ASL-accessible websites, and answered questions related to: 1) navigation to find the task, 2) website usability, and 3) ease of understanding ASL video content for each of the four websites. Participants also gave feedback on what they would like to see in an ASL health library website, including the benefit of added captioning and/or signer model to medical illustration of health videos. Participants who had lower health literacy had greater difficulty in finding information on ASL-accessible health websites. This paper also describes the participants’ preferences for an ideal ASL-accessible health website, and concludes with a discussion on the role of accessible websites in promoting health literacy in ASL users. PMID:24901350

  10. Usability in the lifecycle of medical software development

    Directory of Open Access Journals (Sweden)

    Trauzettel Franziska

    2016-09-01

    Full Text Available A close cooperation with users is necessary to ensure that interactive systems are robust, easy to use and accepted. Therefore, in medical technology, standards for usability are of fundamental importance. We investigated with the presented study how the concept of usability is currently understood and implemented in medical software companies. Interviews were conducted with 21 employees of German enterprises. Furthermore we extended an already existing quantitative online survey where 53 companies (including 24 from the health industry sector participated in. Results show that the importance of usability is recognized by most of the respondents. Moreover, a wide variety of methods and approaches is known and implemented for exploring user needs and evaluating system prototypes. However, it was observed that human-centered design activities mainly focus on functionality, risk prevention and accessibility. Hedonic user needs and subjective perceptions (“user experience” still play a minor role. Based on the results, practical requirements are derived and a “best case” for methodological approach is introduced.

  11. Health literacy and usability of clinical trial search engines.

    Science.gov (United States)

    Utami, Dina; Bickmore, Timothy W; Barry, Barbara; Paasche-Orlow, Michael K

    2014-01-01

    Several web-based search engines have been developed to assist individuals to find clinical trials for which they may be interested in volunteering. However, these search engines may be difficult for individuals with low health and computer literacy to navigate. The authors present findings from a usability evaluation of clinical trial search tools with 41 participants across the health and computer literacy spectrum. The study consisted of 3 parts: (a) a usability study of an existing web-based clinical trial search tool; (b) a usability study of a keyword-based clinical trial search tool; and (c) an exploratory study investigating users' information needs when deciding among 2 or more candidate clinical trials. From the first 2 studies, the authors found that users with low health literacy have difficulty forming queries using keywords and have significantly more difficulty using a standard web-based clinical trial search tool compared with users with adequate health literacy. From the third study, the authors identified the search factors most important to individuals searching for clinical trials and how these varied by health literacy level.

  12. Involving the users remotely: an exploratory study using asynchronous usability testing

    Directory of Open Access Journals (Sweden)

    Beth Filar Williams

    2015-02-01

    Full Text Available Open Educational Resources (OER are increasingly used in the higher education landscape as a solution for a variety of copyright, publishing and cost-prohibiting issues. While OERs are becoming more common, reports of usability tests that evaluate how well learners can use them to accomplish their learning tasks have lagged behind. Because both the researchers and the learners in this study use resources and tools remotely, asynchronous usability testing of a prototype OER and MOOC online guide was conducted with an exploratory group of users to determine the guide’s ease of use for two distinct groups of users: Educators and Learners. In this article, we share the background and context of this usability project, suggest best methods for asynchronous remote usability testing, and share challenges and insights of the process and results of the testing

  13. Usability of Commercially Available Mobile Applications for Diverse Patients.

    Science.gov (United States)

    Sarkar, Urmimala; Gourley, Gato I; Lyles, Courtney R; Tieu, Lina; Clarity, Cassidy; Newmark, Lisa; Singh, Karandeep; Bates, David W

    2016-12-01

    Mobile applications or 'apps' intended to help people manage their health and chronic conditions are widespread and gaining in popularity. However, little is known about their acceptability and usability for low-income, racially/ethnically diverse populations who experience a disproportionate burden of chronic disease and its complications. The objective of this study was to investigate the usability of existing mobile health applications ("apps") for diabetes, depression, and caregiving, in order to facilitate development and tailoring of patient-facing apps for diverse populations. Usability testing, a mixed-methods approach that includes interviewing and direct observation of participant technology use, was conducted with participants (n = 9 caregivers; n = 10 patients with depression; and n = 10 patients with diabetes) on a total of 11 of the most popular health apps (four diabetes apps, four depression apps, and three caregiver apps) on both iPad and Android tablets. The participants were diverse: 15 (58 %) African Americans, seven (27 %) Whites, two (8 %) Asians, two (8 %) Latinos with either diabetes, depression, or who were caregivers. Participants were given condition-specific tasks, such as entering a blood glucose value into a diabetes app. Participant interviews were video recorded and were coded using standard methods to evaluate attempts and completions of tasks. We performed inductive coding of participant comments to identify emergent themes. Participants completed 79 of 185 (43 %) tasks across 11 apps without assistance. Three themes emerged from participant comments: lack of confidence with technology, frustration with design features and navigation, and interest in having technology to support their self-management. App developers should employ participatory design strategies in order to have an impact on chronic conditions such as diabetes and depression that disproportionately affect vulnerable populations. While patients

  14. Integrated System Validation Usability Questionnaire: Information Display Element

    International Nuclear Information System (INIS)

    Garcés, Ma. I.; Torralba, B.

    2015-01-01

    The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to information displays, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed and the models proposed by the nuclear energy industry and their technical support organizations, mainly, the United States Electric Power Research Institute, EPRI, are analyzed. In the remaining stages, general and specific guidelines for information displays, in particular, display pages, formats, elements and data quality and update rate recommendations are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMMLAB.

  15. Enhanced Cognitive Walkthrough: Development of the Cognitive Walkthrough Method to Better Predict, Identify, and Present Usability Problems

    Directory of Open Access Journals (Sweden)

    Lars-Ola Bligård

    2013-01-01

    Full Text Available To avoid use errors when handling medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. A commonly used method is cognitive walkthrough (CW, but this method shows three weaknesses: poor high-level perspective, insufficient categorisation of detected usability problems, and difficulties in overviewing the analytical results. This paper presents a further development of CW with the aim of overcoming its weaknesses. The new method is called enhanced cognitive walkthrough (ECW. ECW is a proactive analytical method for analysis of potential usability problems. The ECW method has been employed to evaluate user interface designs of medical equipment such as home-care ventilators, infusion pumps, dialysis machines, and insulin pumps. The method has proved capable of identifying several potential use problems in designs.

  16. UX Professionals’ Definitions of Usability and UX

    DEFF Research Database (Denmark)

    Rajanen, Dorina; Clemmensen, Torkil; Iivari, Netta

    2017-01-01

    This paper examines the views of user experience (UX) professionals on the definitions of usability and UX, and compares the findings between countries and within different socio-cultural groups. A mixed-method analysis was employed on data gathered on 422 professionals through a survey in Turkey......, Finland, Denmark, France, and Malaysia. Usability appears to be an established concept, respondents across all countries agreeing on the importance of the ISO 9241-11 definition. There is also a tendency that UX professionals attach organizational perspective to usability. UX professionals diverge when...... defining UX, and there are systematic differences related to socio-cultural conditions. UX professionals in Finland and France incline more towards the definition highlighting the experiential qualities, when compared to Turkey and Malaysia that incline towards the definition reflecting the ease of use...

  17. Effect of improving the usability of an e-learning resource: a randomized trial.

    Science.gov (United States)

    Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

    2014-06-01

    Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

  18. Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

    Science.gov (United States)

    Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

    2015-01-01

    A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

  19. Game usability advancing the player experience

    CERN Document Server

    Isbister, Katherine

    2008-01-01

    I. What is usability and why should I care?A. Overview chapter Isbister and Schaffer (Editors)Introduces key concepts and positions book for primary audiences: game developers andstudents aspiring to work in game development. Addresses key concerns that developersmay have about adopting usability, and sets a broad road map of what is to come in thebook.B. Interview with Tobi Saulnier of 1st PlayableA discussion with the CEO of a small game studio about why and how she uses usabilitytechniques in her development.C. Interview with Don Norman of Nielsen Norman groupA discussion with one of the pr

  20. On the Usability of Spoken Dialogue Systems

    DEFF Research Database (Denmark)

    Larsen, Lars Bo

     This work is centred on the methods and problems associated with defining and measuring the usability of Spoken Dialogue Systems (SDS). The starting point is the fact that speech based interfaces has several times during the last 20 years fallen short of the high expectations and predictions held...... by industry, researchers and analysts. Several studies in the literature of SDS indicate that this can be ascribed to a lack of attention from the speech technology community towards the usability of such systems. The experimental results presented in this work are based on a field trial with the OVID home...

  1. PROPUESTA PARA INCORPORAR EVALUACIÓN Y PRUEBAS DE USABILIDAD DENTRO DE UN PROCESO DE DESARROLLO DE SOFTWARE PROPOSTA PARA INCORPORAR A AVALIAÇÃO E PROVAS DE USABILIDADE DENTRO DE UM PROCESSO DE DESENVOLVIMENTO DE SOFTWARE PROPOSAL FOR INTRODUCING USABILITY EVALUATION AND TESTING WITHIN A SOFTWARE DEVELOPMENT PROCESS

    Directory of Open Access Journals (Sweden)

    Beatriz E Florián

    2010-07-01

    melhoria das listas de revisão utilizadas para avaliação heurística, acrescentandolhes aspectos quantitativos e qualitativos.Usability is critical to consider an interactive software system successful. Usability testing and evaluation during product development have gained wide acceptance as a strategy to improve product quality. Early introduction of usability perspectives in a product is very important in order to provide a clear visibility of the quality aspects not only for the developers, but also for the testing users as well. However, usability evaluation and testing are not commonly taken into consideration as an essential element of the software development process. Then, this paper exposes a proposal to introduce usability evaluation and testing within a software development through reuse of software artifacts. Additionally, it suggests the introduction of an auditor within the classification of actors for usability tests. It also proposes an improvement of checklists used for heuristics evaluation, adding quantitative and qualitative aspects to them.

  2. The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

    Science.gov (United States)

    Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

    2015-06-01

    To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (pusability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA

  3. E-commerce usability: do we need guidelines for emerging economies?

    CSIR Research Space (South Africa)

    Chelule, E

    2010-07-01

    Full Text Available This paper presents the results of a usability study conducted on South African B2C bricks-and-clicks retailers' e-commerce websites. The study employed two evaluation techniques namely; user evaluation and heuristic evaluation (HE). The results...

  4. The Usability Expert’s Fear of Agility

    DEFF Research Database (Denmark)

    Nielsen, Lene; Madsen, Sabine

    2012-01-01

    This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12...... different countries. The findings show that the usability professionals share a forced development and innovation in their practice that stem from their clients’ adoption and use of ASD methods. The ASD methods challenge the way usability testing is performed, the abilities of the usability expert......, the usability deliverables, and the experts’ assumptions about the importance of validity....

  5. A Cross-Cultural Study of How Usability Professionals Experience the Usability of Everyday Systems

    DEFF Research Database (Denmark)

    Jiang, Y.; Sun, X.; Li, H.

    2009-01-01

    in the study, their understanding of fun systems differs across cultural backgrounds. Also, easy-to-use and useful systems are perceived as being similar or different depending on the usability professional’s cultural background. Most other cross-cultural differences relate to categories of construct......Culture influences many aspects of the design and use of computer systems; understanding better this influence on their own thinking may benefit usability professionals who do cross-cultural usability work. Using Kelly’s notion of personal constructs, we focus on one mediator of culture: how...

  6. A Comparison of What Is Part of Usability Testing in Three Countries

    Science.gov (United States)

    Clemmensen, Torkil

    The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

  7. The AutoProof Verifier: Usability by Non-Experts and on Standard Code

    Directory of Open Access Journals (Sweden)

    Carlo A. Furia

    2015-08-01

    Full Text Available Formal verification tools are often developed by experts for experts; as a result, their usability by programmers with little formal methods experience may be severely limited. In this paper, we discuss this general phenomenon with reference to AutoProof: a tool that can verify the full functional correctness of object-oriented software. In particular, we present our experiences of using AutoProof in two contrasting contexts representative of non-expert usage. First, we discuss its usability by students in a graduate course on software verification, who were tasked with verifying implementations of various sorting algorithms. Second, we evaluate its usability in verifying code developed for programming assignments of an undergraduate course. The first scenario represents usability by serious non-experts; the second represents usability on "standard code", developed without full functional verification in mind. We report our experiences and lessons learnt, from which we derive some general suggestions for furthering the development of verification tools with respect to improving their usability.

  8. Factors Affecting Faculty Web Portal Usability

    Science.gov (United States)

    Bringula, Rex P.; Basa, Roselle S.

    2011-01-01

    The study investigated the factors that might significantly affect web portal usability. Results of the study were intended to serve as inputs for faculty web portal development of the University of the East-Manila. Descriptive statistics utilized questionnaire data from 82 faculty members. The data showed that most of the respondents were…

  9. Usability: A Teaching and School Service Project

    Science.gov (United States)

    Snyder, Johnny

    2009-01-01

    Your next usability project could be waiting for you in the college library, registration office, or online admissions process that your college or university utilizes in their daily transactions. As an added bonus, these exercises supplement the IS2002 curriculum model, benefit the instructor's institution, build inter-departmental collaboration,…

  10. Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

    Science.gov (United States)

    Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

    2013-01-01

    Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

  11. Supporting Usability Engineering in Small Software Development Organizations

    DEFF Research Database (Denmark)

    Bornoe, Nis; Stage, Jan

    2013-01-01

    Despite an interest and use of different usability engineering methods small software development organizations find it challenging to implement usability engineering into the software development process. We present the results from a study about usability engineering in practice. Through a series...... of semistructured interviews we want to get an understanding of how usability is implemented into the organizations and how it’s practiced in reality. We found that the developers found it problematic to combine agile software development methods with classic usability engineering methods. A lack of solid usability...... engineering expertise and not least experience seems to be a main obstacle for a successful implementation of usability engineering into current software development practices. They are requesting methods and procedures that fit better with their current practices and strategies to implement usability...

  12. On the assessment of usability testing methods for children

    NARCIS (Netherlands)

    Markopoulos, P.; Bekker, M.M.

    2003-01-01

    The paper motivates the need to acquire methodological knowledge for involving children as test users in usability testing. It introduces a methodological framework for delineating comparative assessments of usability testing methods for children participants. This framework consists in three

  13. Does Usability Matter? An Analysis of the Impact of Usability on Technology Acceptance in ERP Settings

    Directory of Open Access Journals (Sweden)

    Brenda M Scholtz

    2016-11-01

    Full Text Available Though the field of management information systems, as a sector and a discipline, is the inventor of many guidelines and models, it appears to be a slow runner on practical implications of interface usability. This usability can influence end users’ attitude and behavior to use IT. The purpose of this paper was to examine the interface usability of a popular Enterprise Resource Planning (ERP software system, SAP, and to identify related issues and implications to the Technology Acceptance Model (TAM. A survey was conducted of 112 SAP ERP users from an organization in the heavy metal industry in Bangladesh. The partial least squares technique was used to analyze the survey data. The survey findings empirically confirmed that interface usability has a significant impact on users’ perceptions of usefulness and ease of use which ultimately affects attitudes and intention to use the ERP software. The research model extends the TAM by incorporating three criteria of interface usability. It is the first known study to investigate usability criteria as an extension of TAM.

  14. Toward more usable electronic voting: testing the usability of a smartphone voting system.

    Science.gov (United States)

    Campbell, Bryan A; Tossell, Chad C; Byrne, Michael D; Kortum, Philip

    2014-08-01

    The goal of this research was to assess the usability of a voting system designed for smart-phones. Smartphones offer remote participation in elections through the use of pervasive technology. Voting on these devices could, among other benefits, increase voter participation while allowing voters to use familiar technology. However, the usability of these systems has not been assessed. A mobile voting system optimized for use on a smartphone was designed and tested against traditional voting platforms for usability. There were no reliable differences between the smartphone-based system and other voting methods in efficiency and perceived usability. More important, though, smartphone owners committed fewer errors on the mobile voting system than on the traditional voting systems. Even with the known limitations of small mobile platforms in both displays and controls, a carefully designed system can provide a usable voting method. Much of the concern about mobile voting is in the area of security; therefore, although these results are promising, security concerns and usability issues arising from mitigating them must be strongly considered. The results of this experiment may help to inform current and future election and public policy officials about the benefits of allowing voters to vote with familiar hardware.

  15. Usability of clinical decision support system as a facilitator for learning the assistive technology adaptation process.

    Science.gov (United States)

    Danial-Saad, Alexandra; Kuflik, Tsvi; Weiss, Patrice L Tamar; Schreuer, Naomi

    2016-01-01

    The aim of this study was to evaluate the usability of Ontology Supported Computerized Assistive Technology Recommender (OSCAR), a Clinical Decision Support System (CDSS) for the assistive technology adaptation process, its impact on learning the matching process, and to determine the relationship between its usability and learnability. Two groups of expert and novice clinicians (total, n = 26) took part in this study. Each group filled out system usability scale (SUS) to evaluate OSCAR's usability. The novice group completed a learning questionnaire to assess OSCAR's effect on their ability to learn the matching process. Both groups rated OSCAR's usability as "very good", (M [SUS] = 80.7, SD = 11.6, median = 83.7) by the novices, and (M [SUS] = 81.2, SD = 6.8, median = 81.2) by the experts. The Mann-Whitney results indicated that no significant differences were found between the expert and novice groups in terms of OSCAR's usability. A significant positive correlation existed between the usability of OSCAR and the ability to learn the adaptation process (rs = 0.46, p = 0.04). Usability is an important factor in the acceptance of a system. The successful application of user-centered design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically in developing other systems. Implications for Rehabilitation Creating a CDSS with a focus on its usability is an important factor for its acceptance by its users. Successful usability outcomes can impact the learning process of the subject matter in general, and the AT prescription process in particular. The successful application of User-Centered Design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically. The study emphasizes the importance of close collaboration between the developers and

  16. Usability study of a vineyard teleoperated compost spreader.

    Science.gov (United States)

    Ferrari, Ester; Cavallo, Eugenio

    2012-01-01

    Teleoperation has been widely applied in modern industry because of a variety of advantages, such as providing replaceable surrogates for humans in dangerous or difficult working environments over long distances. In this paper, a usability evaluation study of a teleoperation system for a compost spreader robotic machine is presented. The machine has been designed for the application of compost in small and stepping parcels of hilly vineyards. Driving and working tasks can be controlled remotely by a portable piloting unit, reducing the risk for the operator in the event of machine overturning. Participants of the study were asked to perform a series of tasks and sub-tasks and to vocalize their thoughts while working with the machine. The tasks were designed to simulate typical user experience. Once all the tasks were accomplished each participant was asked to fill a questionnaire. The evaluation considered aspects such as learnability, ease of use, understandability, controllability, frustration, mental effort, distraction, clarity of presentation, perceived usefulness, temporal efficiency and machine aesthetic. Results show that usability evaluation helped detecting design deficiencies in the teleoperated compost spreader machine.

  17. Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

    Science.gov (United States)

    Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

    2016-07-08

    Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to

  18. Usability and Gratifications--Towards a Website Analysis Model.

    Science.gov (United States)

    Bunz, Ulla K.

    This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…

  19. Assessing Library Instruction through Web Usability and Vocabulary Studies

    Science.gov (United States)

    Castonguay, Remi

    2008-01-01

    Can we use the methods of Web usability testing to learn about library instruction? This article is among the first in the field trying to establish a link between usability and instruction. The author discusses useful insights that Web usability can bring to our pedagogy as well as to the efficiency of library instruction. The result of a Web…

  20. Development of Usability Criteria for E-Learning Content Development Software

    Science.gov (United States)

    Celik, Serkan

    2012-01-01

    Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

  1. National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

    Science.gov (United States)

    Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka

    2011-10-01

    In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability

  2. Safeguarding nuclear weapon: Usable materials in Russia

    International Nuclear Information System (INIS)

    Cochran, T.

    1998-01-01

    Both the United States and Russia are retaining as strategic reserves more plutonium and HEU for potential reuse as weapons, than is legitimately needed. Both have engaged in discussions and have programs in various stages of development to dispose of excess plutonium and HEU. These fissile material disposition programs will take decades to complete. In the interim there will be, as there is now, hundreds of tons of separated weapon-usable fissile material stored in tens of thousands of transportable canisters, each containing from a few to several tons of kgs of weapon-usable fissile material. This material must be secured against theft and unauthorized use. To have high confidence that the material is secure, one must establish criteria against which the adequacy of the protective systems can be judged. For example, one finds such criteria in US Nuclear Regulatory Commission (USNRC) regulations for the protection of special nuclear materials

  3. Estimating Sample Size for Usability Testing

    Directory of Open Access Journals (Sweden)

    Alex Cazañas

    2017-02-01

    Full Text Available One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.

  4. Bringing content understanding into usability testing in complex application domains—a case study in eHealth

    DEFF Research Database (Denmark)

    Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

    2017-01-01

    A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... of users’ content understanding is sometimes crucial, and thus should be carefully evaluated. Unfortunately, conventional usability evaluation techniques do not address challenges of content understanding. In a case study within eHealth, specifically the setting of a rehabilitation clinic involving...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...

  5. Commercial versus in-situ usability testing of healthcare information systems: towards "public" usability testing in healthcare organizations.

    Science.gov (United States)

    Kushniruk, Andre W; Borycki, Elizabeth M; Kannry, Joseph

    2013-01-01

    The need for improved usability in healthcare IT has been widely recognized. In addition, methods from usability engineering, including usability testing and usability inspection have received greater attention. Many vendors of healthcare software are now employing usability testing methods in the design and development of their products. However, despite this, the usability of healthcare IT is still considered to be problematic and many healthcare organizations that have purchased systems that have been tested at vendor testing sites are still reporting a range of usability and safety issues. In this paper we explore the distinction between commercial usability testing (conducted at centralized vendor usability laboratories and limited beta test sites) and usability testing that is carried out locally within healthcare organizations that have purchased vendor systems and products (i.e. public "in-situ" usability testing). In this paper it will be argued that both types of testing (i.e. commercial vendor-based testing) and in-situ testing are needed to ensure system usability and safety.

  6. Usability Study of a Wireless Monitoring System among Alzheimer’s Disease Elderly Population

    Directory of Open Access Journals (Sweden)

    Stefano Abbate

    2014-01-01

    Full Text Available Healthcare technologies are slowly entering into our daily lives, replacing old devices and techniques with newer intelligent ones. Although they are meant to help people, the reaction and willingness to use such new devices by the people can be unexpected, especially among the elderly. We conducted a usability study of a fall monitoring system in a long-term nursing home. The subjects were the elderly with advanced Alzheimer’s disease. The study presented here highlights some of the challenges faced in the use of wearable devices and the lessons learned. The results gave us useful insights, leading to ergonomics and aesthetics modifications to our wearable systems that significantly improved their usability and acceptance. New evaluating metrics were designed for the performance evaluation of usability and acceptability.

  7. Identifying Usability and Productivity Dimensions for Measuring the Success of Mobile Business Services

    Directory of Open Access Journals (Sweden)

    Maiju Vuolle

    2008-01-01

    Full Text Available This paper reviews existing measures used for evaluating the usability of information systems and those used for evaluating the level of the productivity of a company. We discuss the usefulness of the existing measures in the mobile business context, where both mobility and work-context pose specific demands for the mobile business services. The review showed that the existing measures rarely consider the great contextual variation caused by the mobility of the services and the demands this poses on usability; which, in turn, affects productivity. To build a measurement tool that better meets the requirements of mobile business services, we completed case studies on two mobile business services, one used in passenger transport and the other in construction sites. Based on the understanding gained from the case studies, we propose a list of dimensions and items addressing both usability and productivity aspects that work as the basis for a multidisciplinary measurement tool.

  8. To twist or poke? A method for identifying usability issues with the rotary controller and touch screen for control of in-vehicle information systems.

    Science.gov (United States)

    Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

    2011-07-01

    In-vehicle information systems (IVIS) can be controlled by the user via direct or indirect input devices. In order to develop the next generation of usable IVIS, designers need to be able to evaluate and understand the usability issues associated with these two input types. The aim of this study was to investigate the effectiveness of a set of empirical usability evaluation methods for identifying important usability issues and distinguishing between the IVIS input devices. A number of usability issues were identified and their causal factors have been explored. These were related to the input type, the structure of the menu/tasks and hardware issues. In particular, the translation between inputs and on-screen actions and a lack of visual feedback for menu navigation resulted in lower levels of usability for the indirect device. This information will be useful in informing the design of new IVIS, with improved usability. STATEMENT OF RELEVANCE: This paper examines the use of empirical methods for distinguishing between direct and indirect IVIS input devices and identifying usability issues. Results have shown that the characteristics of indirect input devices produce more serious usability issues, compared with direct devices and can have a negative effect on the driver-vehicle interaction.

  9. A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

    Science.gov (United States)

    Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

    2016-01-11

    Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to

  10. Bringing content understanding into usability testing in complex application domains—a case study in eHealth

    DEFF Research Database (Denmark)

    Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

    2017-01-01

    A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...... domains involving different kinds of users and evaluators are needed before we can tell whether CUT with QU is an effective usability testing technique of wider applicability. Performing CUT with QU is very demanding by drawing heavily on the evaluators’ ability to respond effectively to openings...

  11. The influence of socio-cultural background and product value in usability testing.

    Science.gov (United States)

    Sonderegger, Andreas; Sauer, Juergen

    2013-05-01

    This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

  12. Towards Usable E-Health. A Systematic Review of Usability Questionnaires.

    Science.gov (United States)

    Sousa, Vanessa E C; Dunn Lopez, Karen

    2017-05-10

    The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However

  13. The usability issues of faceted navigation in digital libraries

    Directory of Open Access Journals (Sweden)

    Eliane Blumer

    2014-05-01

    For more than five years, the project ACCEPT, a subproject of a Swiss national project called e-lib.ch, analyzes the usability and usefulness of digital libraries, by using user oriented methods. Experience has shown that filters provided through faceted navigation are considered as positive and very useful by end users. Nevertheless, based on different test results, several returning mistakes have been detected and it turns out that there are some ‘unwritten standards’ concerning e.g. position, labelling or ranking which should be respected to fulfil the aim of a good usability which users do expect of such web services. In this poster we will first give an introduction to faceted navigation, actual design issues and their use in digital libraries and then present testing methods, which can be easily applied in a digital library context. Together with a list of best practices concerning faceted navigation drawn out of different test experiences, the paper should give the reader all important information to evaluate its current faceted navigation and see where improvements could be made.

  14. Transforming data into usable knowledge: the CIRC experience

    Science.gov (United States)

    Mote, P.; Lach, D.; Hartmann, H.; Abatzoglou, J. T.; Stevenson, J.

    2017-12-01

    NOAA's northwest RISA, the Climate Impacts Research Consortium, emphasizes the transformation of data into usable knowledge. This effort involves physical scientists (e.g., Abatzoglou) building web-based tools with climate and hydrologic data and model output, a team performing data mining to link crop loss claims to droughts, social scientists (eg., Lach, Hartmann) evaluating the effectiveness of such tools at communicating with end users, and two-way engagement with a wide variety of audiences who are interested in using and improving the tools. Unusual in this effort is the seamless integration across timescales past, present, and future; data mining; and the level of effort in evaluating the tools. We provide examples of agriculturally relevant climate variables (e.g. growing degree days, day of first fall freeze) and describe the iterative process of incorporating user feedback.

  15. Perancangan Web Interface Institut Teknologi Sepuluh Nopember (ITS Dengan Memperhatikan Aspek Usability

    Directory of Open Access Journals (Sweden)

    Hendry Setyawans Sutedjo

    2012-09-01

    Full Text Available Informasi dalam sebuah website atau web diharapkan dapat sampaikan dan diterima oleh pencari informasi dengan mudah. Di dalam Dunia pendidikan, informasi yang ada di dalam web juga diharapkan mampu diterima oleh para penggunanya dengan tujuan media komunikasi online seperti website dapat membantu para pelajar menerima ilmu yang disampaikan melalui media online. Untuk Mengetahui seberapa mudahnya informasi itu ditangkap ditandai dengan seberapa mudah website itu digunakan (usable. Untuk mengetahui seberapa mudah penggunaan suatu website digunakan analisa usability, banyak metode yang dapat digunakan untuk mengidentifikasi masalah usability terutama dari sisi interface web. Heuristic evaluation merupakan salah satu teknik dalam melakukan hal tersebut yang digunakan dalam penelitian ini guna menilai seberapa mudahnya website Institut Teknologi Sepuluh Nopember dalam menyampaikan informasi yang ada. Dalam penelitian ini digunakan juga Quality Function Deployment (QFD untuk mengidentifikasi keinginan pengguna terhadap tampilan dari web ITS

  16. Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

    Science.gov (United States)

    Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

    2013-12-01

    videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.

  17. Development and usability testing of a web-based smoking cessation treatment for smokers with schizophrenia

    Directory of Open Access Journals (Sweden)

    Mary F. Brunette

    2016-05-01

    Conclusion: The prototype website was usable and satisfactory. With training and support, home use of this cessation website appears to be feasible and promising for cessation among smokers with schizophrenia. Further research is needed to evaluate web-based cessation treatment in people with psychotic disorders.

  18. Equity in Assistance? Usability of a U.S. Government Food Assistance Application

    Science.gov (United States)

    Saal, Leah Katherine

    2016-01-01

    This article focuses on the quantitative phase of a multiphase mixed methods study investigating adults' and families' access to government food assistance. The research evaluates participants' comprehension of, and ability to, adequately complete authentic complex texts--national food assistance application documents. Summative usability testing…

  19. Usability analysis of industrial cooking equipment.

    Science.gov (United States)

    Calado, Alexana Vilar Soares; Soares, Marcelo Márcio

    2012-01-01

    This paper refers to the comparative study of the equipment used for cooking in commercial of kitchens restaurants that use the system of traditional cooking and those ones which use the system called smart cooking (combination oven). The study investigates the usability issues concerning to the two systems, analyzing comparatively the aspects related to anthropometry, dimensional variables, the use of the product and also the product safety, as well as issues of information related to operation of the new concepts of cooking in intelligent systems.

  20. Usability of synchronization for cognitive modeling

    International Nuclear Information System (INIS)

    Diebner, Hans H.; Grond, Florian

    2005-01-01

    We discuss the synchronization features of a previously introduced adaptive system for dynamics recognition in more detail. We investigate the usability of synchronization for modeling and parameter estimations. It is pointed out inhowfar the adaptive system based on synchronization can become a powerful tool in modeling. The adaptive system can store modules of pre-adapted dynamics and is potentially capable of undergoing self-modification. We compare the stored modules with pre-knowledge that a modeler puts into his or her models. In this sense the adaptive system functions like an expert system

  1. Research on the Application of GSR and ECG in the Usability Testing of an Aggregation Reading App

    Directory of Open Access Journals (Sweden)

    Sha Liu

    2016-09-01

    Full Text Available Usability testing is a very important step in improving App design and development. The traditional usability testing methods are based on users'expressions and behaviors, which hardly show users' emotional experience and cognitive load in real time. The introduction of an electrophysiological technique can make up for the deficiency of the traditional usability testing methods. In this study, a usability testing was carried out with the old and the new version of an App software. The behavior and the subjective evaluation of the participants were recorded, and their GSR and ECG signals were collected. Then, 14 physiological characteristics, such as GSR-Mean, LF, HF, LF/HF, etc., were extracted from the GSR and ECG signals. These characteristics were analyzed, and a significance test of difference of the two versions was made. This research indicated that there is a certain application value of GSR and HRV in usability testing and evaluation of an App product. But the meanings of the physiological characteristics must be explained in combination with the behavior and subjective evaluation of users. The result can prove that physiological characteristics have obvious advantages in real-time monitoring users' emotional changes, which can be helpful to find the usability problems of the product.

  2. Usability testing of interaction components: taking the message exchange as a measure of usability

    NARCIS (Netherlands)

    Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Jacob, R.J.K.; Limbourg, Q; Vanderdonckt, J.

    2004-01-01

    Component-based Software Engineering (CBSE) is concerned with the development of systems from reusable parts (components), and the development and maintenance of these parts. This study addresses the issue of usability testing in a CBSE environment, and specifically automatically measuring the

  3. Usability testing of indonesia tourism promotion website

    Science.gov (United States)

    Yunus, U.; Anindito; Tanuar, E.; Maryani

    2018-03-01

    Indonesian tourism has been viewed as one of the source of foreign exchange, therefore visit Indonesia campaign through Wonderful Indonesia should be given attention. This research aims to test the usability of web http://www.indonesia.travel/en, at the end can give input to the Tourism Ministry of the Republic of Indonesia. The concept used based on usabilitygeek.com which mentions the three main categories for usability testing, i. e. explorative, assessment and comparative with the users are three classes of Communication Department students of Bina Nusantara University with a total of 120 students, however finally only 22 students were elected because of the criteria are the students should be like travelling and access to the tourism website more than 12 times. The methodology used is qualitative descriptive and experiments, with data collection techniques through observation and interviews after participants’ access to the web: Due to their one-on-one nature, interviews enable the observer to ask direct questions to the user and the participants posted their opinion in online discussion forum. The results mentioned that the elements web of Wonderful Indonesia has a high learning ability and memorability but less efficiency and satisfaction, as well as several times errors when used. In conclusion, to maximize about the visit of tourism to Indonesia, this web is only able to learn and impress the visitor, but do not give satisfaction to users.

  4. Empirical studies on usability of mHealth apps: a systematic literature review.

    Science.gov (United States)

    Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

    2015-02-01

    The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

  5. Business-Intelligence-Systeme im Spannungsfeld zwischen Usability und Sicherheit

    OpenAIRE

    Hinck, Thorsten

    2010-01-01

    Business-Intelligence-Systeme stehen im Spannungsfeld zwischen Usability und Sicherheit. Die Gefahren und Sicherheitsmaßnahmen für Informationssysteme werden ermittelt und ökonomisch in Bezug zur Gebrauchstauglichkeit gesetzt. Es entsteht ein Sicherheitsprofil für Business-Intelligence-Systeme. Business-Intelligence-Systems are in tension between Usability and IT-Security. Risks and safety measures of informationsystems are defined and set in (economic) regard to Usability. A security prof...

  6. Feasibility and usability of a home monitoring concept based on mobile phones and near field communication (NFC) technology.

    Science.gov (United States)

    Morak, Jürgen; Kollmann, Alexander; Schreier, Günter

    2007-01-01

    Utilization of mobile information and communication technologies in home monitoring applications is becoming more and more common. The mobile phone, acting as a patient terminal for patients suffering from chronic diseases, provides an active link to the caregiver to transmit health status information and receive feedback. In such a concept the usability is still limited by the necessity of entering the values via the mobile phone's small keypad. The near field communication technology (NFC), a touch-based wireless interface that became available recently, may improve the usability level of such applications significantly. The focus of this paper is to describe the development of a prototype application based on this technology embedded in a home monitoring system. The feasibility and usability of this approach are evaluated and compared with concepts used in previous approaches. The high quantifier with respect to overall usability indicates that NFC may be the technology of choice for some tasks in home monitoring applications.

  7. Cost-justifying usability an update for the internet age

    CERN Document Server

    Bias, Randolph G; Bias, Randolph G

    2005-01-01

    You just know that an improvement of the user interface will reap rewards, but how do you justify the expense and the labor and the time-guarantee a robust ROI!-ahead of time? How do you decide how much of an investment should be funded? And what is the best way to sell usability to others? In this completely revised and new edition, Randolph G. Bias (University of Texas at Austin, with 25 years' experience as a usability practitioner and manager) and Deborah J. Mayhew (internationally recognized usability consultant and author of two other seminal books including The Usability Enginee

  8. Development and testing of new upper-limb prosthetic devices: research designs for usability testing.

    Science.gov (United States)

    Resnik, Linda

    2011-01-01

    The purposes of this article are to describe usability testing and introduce designs and methods of usability testing research as it relates to upper-limb prosthetics. This article defines usability, describes usability research, discusses research approaches to and designs for usability testing, and highlights a variety of methodological considerations, including sampling, sample size requirements, and usability metrics. Usability testing is compared with other types of study designs used in prosthetic research.

  9. Getting a technology-based diabetes intervention ready for prime time: a review of usability testing studies.

    Science.gov (United States)

    Lyles, Courtney R; Sarkar, Urmimala; Osborn, Chandra Y

    2014-10-01

    Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009 to 2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n = 11), descriptive quantitative (n = 9), and qualitative methods (n = 3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes and publish usability findings to inform interpretation of why an intervention succeeded or failed and for whom.

  10. Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis.

    Science.gov (United States)

    Ferron, Joelle C; Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

    2017-03-03

    Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly-66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. ©Joelle C Ferron, Mary F Brunette, Pamela Geiger, Lisa A Marsch, Anna M Adachi-Mejia, Stephen J Bartels. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 03.03.2017.

  11. Reducing and Sustaining Duplicate Medical Record Creation by Usability Testing and System Redesign.

    Science.gov (United States)

    Khunlertkit, Adjhaporn; Dorissaint, Leonard; Chen, Allen; Paine, Lori; Pronovost, Peter J

    2017-10-25

    Duplicate medical record creation is a common and consequential health care systems error often caused by poor search system usability and inappropriate user training. We conducted two phases of scenario-based usability testing with patient registrars working in areas at risk of generating duplicate medical records. Phase 1 evaluated the existing search system, which led to system redesigns. Phase 2 tested the redesigned system to mitigate potential errors before health system-wide implementation. To evaluate system effectiveness, we compared the monthly potential duplicate medical record rates for preimplementation and postimplementation months. The existing system could not effectively handle a misspelling, which led to failed search and duplicate medical record creation. Using the existing system, 96% of registrars found commonly spelled patient names whereas only 69% successfully found complicated names. Registrars lacked knowledge and usage of a phonetic matching function to assist in misspelling. The new system consistently captured the correct patient regardless of misspelling, but search returned more potential matches, resulting in, on average, 4 seconds longer to select common names. Potential monthly duplicate medical record rate reduced by 38%, from 4% to 2.3% after implementation of the new system, and has sustained at an average of 2.5% for 2 years. Usability testing was an effective method to reveal problems and aid system redesign to deliver a more user friendly system, hence reducing the potential for medical record duplication. Greater standards for usability would ensure that these improvements can be realized before rather than after exposing patients to risks.

  12. Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

    Science.gov (United States)

    Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

    2016-01-01

    The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

  13. An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

    Science.gov (United States)

    Chalil Madathil, Kapil; Greenstein, Joel S

    2017-11-01

    Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual

  14. "Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

    Science.gov (United States)

    Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

    2017-10-01

    Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets

  15. Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

    Science.gov (United States)

    Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

    2016-02-03

    . Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.

  16. The EPR Paradox: Einstein Scrutinises Quantum Mechanics -28 ...

    Indian Academy of Sciences (India)

    Arvind. Einstein, Podolsky and Rosen (EPR), in their fa- mous paper, argued that the quantum-mechani- cal description of physical reality is incomplete. They showed that one can envisage physical sit- uations whereby 'an element of physical reality' can be located such that it does not have a coun- terpart in quantum ...

  17. Online Biodiversity Resources - Principles for Usability

    Directory of Open Access Journals (Sweden)

    Sophie Neale

    2007-01-01

    Full Text Available Online biodiversity portals and databases enabling access to large volumes of biological information represent a potentially extensive set of resources for a variety of user groups. However, in order for these resources to live up to their promise they need to be both useful and easy to use. We discuss a number of principles for designing systems for usability, examine how these have been applied to the development of online biodiversity resources and compare this with a portal project developed by the Astrophysics community. We highlight a lack of user involvement and formalised requirements analysis by biodiversity projects resulting in a poor understanding of both the users and their tasks. We suggest a change in the way large biodiversity portal projects are structured, that is by providing infrastructure and supporting user groups developing individual interfaces.

  18. Useful and usable alarm systems : recommended properties

    International Nuclear Information System (INIS)

    Veland, Oeystein; Kaarstad, Magnhild; Seim, Lars Aage; Foerdestroemmen, Nils T.

    2001-01-01

    This document describes the result of a study on alarm systems conducted by IFE in Halden. The study was initiated by the Norwegian Petroleum Directorate. The objective was to identify and formulate a set of important properties for useful and usable alarm systems. The study is mainly based on review of the latest international recognised guidelines and standards on alarm systems available at the time of writing, with focus on realistic solutions from research and best practice from different industries. In addition, IFE experiences gathered through specification and design of alarm systems and experimental activities in HAMMLAB and bilateral projects, have been utilized where relevant. The document presents a total of 43 recommendations divided into a number of general recommendations and more detailed recommendations on alarm generation, structuring, prioritisation, presentation and handling. (Author)

  19. Methods and Tools for Ethical Usability

    Science.gov (United States)

    Kavathatzopoulos, Iordanis; Kostrzewa, Agata; Laaksoharju, Mikael

    The objectives of the tutorial are to provide knowledge of basic ethical, psychological and organizational theories that are relevant to consider ethical aspects during design and use of IT systems; knowledge and skills about handling and solving ethical problems in connection with design and use of IT-systems; and skills in using questionnaires, surveys, interviews and the like in connection with software development and IT-use. It contains lectures, workshop and exercises; use of special tools to identify and consider IT ethical issues during planning, construction, installation and use of IT systems; and group exercises where the participants train their ethical skills on IT ethical conflicts and problems. Intended participants are system developers, purchasers, usability experts, academics, HCI teachers.

  20. Enhancing the Usability of Telecare Devices

    Directory of Open Access Journals (Sweden)

    José Manuel Ojel-Jaramillo

    2006-01-01

    Full Text Available Demographic and sociological changes in the last 50 years have forced Western societies to create services to attend to elderly people in their homes, where they can live within familiar environments. Telecare involves a device plugged into a telephonic network that provides access to teams of professionals who can attend to the needs of the elderly in their homes. These devices have been designed according to the principles of universal design, but the great number of erroneous calls to telecare centers point to the necessity of enhancing the usability of the devices. One analysis of the cognitive functioning of elderly people showed that a possible cause of these errors could be the difficulty elderly people have when processing language. In our experiment, we tested the hypothesis that the numbers of errors could be reduced by using icons instead of words in the device interface. The results support this hypothesis.

  1. Expanding Interaction Potentials within Virtual Environments: Investigating the Usability of Speech and Manual Input Modes for Decoupled Interaction

    Directory of Open Access Journals (Sweden)

    Alex Stedmon

    2011-01-01

    Full Text Available Distributed technologies and ubiquitous computing now support users who may be detached or decoupled from traditional interactions. In order to investigate the potential usability of speech and manual input devices, an evaluation of speech input across different user groups and a usability assessment of independent-user and collaborative-user interactions was conducted. Whilst the primary focus was on a formative usability evaluation, the user group evaluation provided a formal basis to underpin the academic rigor of the exercise. The results illustrate that using a speech interface is important in understanding user acceptance of such technologies. From the usability assessment it was possible to translate interactions and make them compatible with innovative input devices. This approach to interaction is still at an early stage of development, and the potential or validity of this interfacing concept is still under evaluation; however, as a concept demonstrator, the results of these initial evaluations demonstrate the potential usability issues of both input devices as well as highlighting their suitability for advanced virtual applications.

  2. Perceived usability and use of custom-made footwear in diabetic patients at high risk for foot ulceration.

    Science.gov (United States)

    Arts, Mark L J; de Haart, Mirjam; Bus, Sicco A; Bakker, Jan P J; Hacking, Hub G A; Nollet, Frans

    2014-04-01

    To assess the perceived usability and use of custom- made footwear in diabetic patients who are at high-risk for foot ulceration, and to elucidate the determinants of usability and use. Survey. A total of 153 patients with diabetes, peripheral neuropathy, prior plantar foot ulceration and newly prescribed custom-made footwear, recruited from 10 Dutch multidisciplinary foot clinics. The Questionnaire of Usability Evaluation was used to assess the patients' perception of weight, appearance, comfort, durability, donning/doffing, stability, benefit and overall appreciation of their prescription footwear (all expressed as visual analogue scores). Data on priorities for usability and footwear use (in h/day) were obtained from patient reports. Multivariate logistic regression analysis was used to assess determinants of usability and use. Median (interquartile range) score for overall appreciation was 8.3 (7.1-9.1). Scores ranged from 6.5 (4.5-8.6) for weight to 9.6 (6.3-9.9) for donning/doffing. Footwear comfort was listed most often (33.3%) as the highest priority. Footwear use was benefit of the footwear (p = 0.045). Perceived usability of footwear was mostly positive, although individual scores and priorities varied considerably. Footwear use was low to moderate and dependent only on the perceived benefit of the footwear. Therefore, practitioners should focus on enhancing the patient's ap-preciation of the therapeutic benefit of custom-made footwear.

  3. Usability Studies and User-Centered Design in Digital Libraries

    Science.gov (United States)

    Comeaux, David J.

    2008-01-01

    Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…

  4. Users Views about the Usability of Digital Libraries

    Science.gov (United States)

    Koohang, Alex; Ondracek, James

    2005-01-01

    This study examined users' views about the usability of digital libraries' current and perceived importance. Age, gender, prior experience with the Internet, college status, and digital library proficiency are the independent variables. Users' current views about the usability of digital libraries and users perceived importance of digital library…

  5. IT investment decision making : Usability of a normative model

    NARCIS (Netherlands)

    Wijnhoven, Alphonsus B.J.M.; Heerkens, Johannes M.G.

    This article analyzes the usability of a multi-criteria decision analysis based on a real options AHP (ROAHP) method for IT-investment decisions. The study presents ROAHP to Chief Information Officers (CIO’s) and collects their opinions on prerequisites for usability, strengths and weaknesses. To

  6. Earning the Stamp of Approval: How To Achieve Optimal Usability.

    Science.gov (United States)

    Makar, Susan

    2003-01-01

    Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)

  7. New Options for Usability Testing Projects in Business Communication Courses

    Science.gov (United States)

    Jameson, Daphne A.

    2013-01-01

    The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…

  8. The Usability Expert’s Fear of Agility

    DEFF Research Database (Denmark)

    Nielsen, Lene; Madsen, Sabine

    2012-01-01

    This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12 differ...

  9. Information users and usability in the digital age

    CERN Document Server

    Chowdhury, G G

    2013-01-01

    Gives an overview of the necessary issues relating to information users and the usability of information services in the digital world, including user-centred design, and the characteristics and behaviour of information users. This book helps readers understand why information users and the usability of information services are important.

  10. Revealing unawareness in usability related decision-making

    NARCIS (Netherlands)

    Harkema, C.L.E.

    2012-01-01

    Nowadays, many users experience usability issues with their electronic products. It does not work as they expect or otherwise irritates the user, so he becomes dissatisfied about the product and may even complain about it. Th ese numbers of complaints to companies and usability issues are high and

  11. Mapping Disease Data: A Usability Test of an Internet-Based System of Disease Status Disclosure

    Directory of Open Access Journals (Sweden)

    Gareth Enticott

    2018-01-01

    Full Text Available Disease maps are important tools in the management of disease. By communicating risk, disease maps can help raise awareness of disease and encourage farmers and veterinarians to employ best practice to eliminate the spread of disease. However, despite the importance of disease maps in communicating risk and the existence of various online disease maps, there are few studies that explicitly examine their usability. Where disease maps are complicated to use, it seems that they are unlikely to be used effectively. The paper outlines an attempt to create an open access, online, searchable map of incidents of bovine tuberculosis in England and Wales, and analyzes its usability among veterinarians. The paper describes the process of creating the map before describing the results of a series of usability trials. Results show the map to score highly on different measures of usability. However, the trials also revealed a number of social and technical limitations and challenges facing the use of online disease maps, including reputational dangers, role confusion, data accuracy, and data representation. The paper considers the challenges facing disease maps and their potential role in designing new methodologies to evaluate the effectiveness of disease prevention initiatives.

  12. Naive (commonsense) geography and geobrowser usability after ten years of Google Earth

    Science.gov (United States)

    Hamerlinck, J. D.

    2016-04-01

    In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.

  13. Usability: a critical success factor for managing change in the clinical info-structure.

    Science.gov (United States)

    Kay, S

    2005-06-01

    There can be no doubt that the clinical info-structure is being significantly enriched with the deployment of new systems throughout the health sector. From a technological perspective, the initial emphasis has been mainly on functionality and only latterly on the usability of these clinical information systems. However, the large scale and rapid pace of the changes being wrought in the health sector will have a major impact on clinicians and patients, not least in how they interact with the technology. Therefore, it is not only hardware and software but people-ware, too, that needs to be actively managed; not simply a one-off functional specification but an ongoing, complex relationship. Usability is the human factor that encompasses the ethical, educational, and evaluative aspects of design. There is also a strong case for regarding usability of clinical information systems as a key critical success factor for the management of change within the health-care domain. In particular, the relationship between usability, and education and training is examined.

  14. Performance and Usability of Various Robotic Arm Control Modes from Human Force Signals

    Directory of Open Access Journals (Sweden)

    Sébastien Mick

    2017-10-01

    Full Text Available Elaborating an efficient and usable mapping between input commands and output movements is still a key challenge for the design of robotic arm prostheses. In order to address this issue, we present and compare three different control modes, by assessing them in terms of performance as well as general usability. Using an isometric force transducer as the command device, these modes convert the force input signal into either a position or a velocity vector, whose magnitude is linearly or quadratically related to force input magnitude. With the robotic arm from the open source 3D-printed Poppy Humanoid platform simulating a mobile prosthesis, an experiment was carried out with eighteen able-bodied subjects performing a 3-D target-reaching task using each of the three modes. The subjects were given questionnaires to evaluate the quality of their experience with each mode, providing an assessment of their global usability in the context of the task. According to performance metrics and questionnaire results, velocity control modes were found to perform better than position control mode in terms of accuracy and quality of control as well as user satisfaction and comfort. Subjects also seemed to favor quadratic velocity control over linear (proportional velocity control, even if these two modes did not clearly distinguish from one another when it comes to performance and usability assessment. These results highlight the need to take into account user experience as one of the key criteria for the design of control modes intended to operate limb prostheses.

  15. An extended protocol for usability validation of medical devices: Research design and reference model.

    Science.gov (United States)

    Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten

    2017-05-01

    This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.

  16. A proposal for a repertory-grid study of differences in Chinese, Danish, and Indian conceptions of usability: Cultural usability?

    DEFF Research Database (Denmark)

    Hertzum, Morten

    2006-01-01

    This is an unrefined proposal for a study that could form part of the exploratory phase of the Cultural Usability project. The proposed study compares three cultures (Chinese, Danish, and Indian) and two stakeholder groups (users and developers) with respect to their conceptions of usability....

  17. DEVELOPMENT OF USABILITY CRITERIA FOR E-LEARNING CONTENT DEVELOPMENT SOFTWARE

    Directory of Open Access Journals (Sweden)

    Serkan ÇELIK

    2012-04-01

    Full Text Available Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step towards the definition of criteria for evaluating e-learning tools. A preliminary user study involving a group of pre-service instructional designers, observed during their interaction with e-learning tools, is reported. Throughout the study, specific usability attributes of these e-learning tools were identified. Participants were assigned to rate the importance of functional and pedagogical competences proposed during the criteria development phase. The findings of the study revealed 31 evaluation criteria under the headings of technical, media, and assessment competences. Among the groups of benchmarks proposed and rated by the users, assessment was considered as the most important one while technical and media features were even.The following step was actual implemention of the usability criteria into evaluation of fifteen leading software used in e-learning across the world. Mostly, tools were observed as having limitations in terms of capabilities. Comparing to the other software, Captivate, Softchalk, and Lectora were regarded as outstanding tools by the participants. Following the discussion on the limitations of the study, some implications for further research were proposed.

  18. Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

    Science.gov (United States)

    Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

    2015-09-10

    As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on

  19. Brief Report: Web-based Management of Adolescent Chronic Pain: Development and Usability Testing of an Online Family Cognitive Behavioral Therapy Program

    OpenAIRE

    Long, Anna C.; Palermo, Tonya M.

    2008-01-01

    Objectives This study evaluates the usability and feasibility of a Web-based intervention (Web-MAP) to deliver cognitive behavioral therapy (CBT) to adolescents with chronic pain and their parents. Methods The Web site was evaluated in two stages. In stage one, recovered adolescents and parents (n = 5 dyads), who had completed office-based CBT through a pediatric pain management clinic, completed ratings of Web site content, usability, appearance, and theme. In stage two, treatment-seeking ad...

  20. Measurement properties and usability of non-contact scanners for measuring transtibial residual limb volume.

    Science.gov (United States)

    Kofman, Rianne; Beekman, Anna M; Emmelot, Cornelis H; Geertzen, Jan H B; Dijkstra, Pieter U

    2018-06-01

    Non-contact scanners may have potential for measurement of residual limb volume. Different non-contact scanners have been introduced during the last decades. Reliability and usability (practicality and user friendliness) should be assessed before introducing these systems in clinical practice. The aim of this study was to analyze the measurement properties and usability of four non-contact scanners (TT Design, Omega Scanner, BioSculptor Bioscanner, and Rodin4D Scanner). Quasi experimental. Nine (geometric and residual limb) models were measured on two occasions, each consisting of two sessions, thus in total 4 sessions. In each session, four observers used the four systems for volume measurement. Mean for each model, repeatability coefficients for each system, variance components, and their two-way interactions of measurement conditions were calculated. User satisfaction was evaluated with the Post-Study System Usability Questionnaire. Systematic differences between the systems were found in volume measurements. Most of the variances were explained by the model (97%), while error variance was 3%. Measurement system and the interaction between system and model explained 44% of the error variance. Repeatability coefficient of the systems ranged from 0.101 (Omega Scanner) to 0.131 L (Rodin4D). Differences in Post-Study System Usability Questionnaire scores between the systems were small and not significant. The systems were reliable in determining residual limb volume. Measurement systems and the interaction between system and residual limb model explained most of the error variances. The differences in repeatability coefficient and usability between the four CAD/CAM systems were small. Clinical relevance If accurate measurements of residual limb volume are required (in case of research), modern non-contact scanners should be taken in consideration nowadays.