Web usability testing with a Hispanic medically underserved population.

Science.gov (United States)

Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

2009-04-01

Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

Merits of usability testing for PACS selection

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; van Ooijen, Peter M. A.

Objectives: To compare the usability of different Picture Archiving and Communication System (PACS) workstations, determine whether a usability test has added value with respect to the traditional way of comparing PACSs based on functional requirements, and to evaluate the appropriateness of a

On the assessment of usability testing methods for children

NARCIS (Netherlands)

Markopoulos, P.; Bekker, M.M.

2003-01-01

The paper motivates the need to acquire methodological knowledge for involving children as test users in usability testing. It introduces a methodological framework for delineating comparative assessments of usability testing methods for children participants. This framework consists in three

Discovering the User: A Practical Glance at Usability Testing.

Science.gov (United States)

Campbell, Nicole; Walbridge, Sharon; Chisman, Janet; Diller, Karen R.

1999-01-01

This interview focuses on usability testing, one method for evaluating whether library Web sites are useful for users. Discussion includes: benefits and drawbacks of usability testing; why it is important; lessons learned from testing; advice for someone interested in doing a study; and recommendations. (AEF)

Usability Testing for Developing Effective Interactive Multimedia Software: Concepts, Dimensions, and Procedures

Directory of Open Access Journals (Sweden)

Sung Heum Lee

1999-04-01

Full Text Available Usability testing is a dynamic process that can be used throughout the process of developing interactive multimedia software. The purpose of usability testing is to find problems and make recommendations to improve the utility of a product during its design and development. For developing effective interactive multimedia software, dimensions of usability testing were classified into the general categories of: learnability; performance effectiveness; flexibility; error tolerance and system integrity; and user satisfaction. In the process of usability testing, evaluation experts consider the nature of users and tasks, tradeoffs supported by the iterative design paradigm, and real world constraints to effectively evaluate and improve interactive multimedia software. Different methods address different purposes and involve a combination of user and usability testing, however, usability practitioners follow the seven general procedures of usability testing for effective multimedia development. As the knowledge about usability testing grows, evaluation experts will be able to choose more effective and efficient methods and techniques that are appropriate to their goals.

Privacy Enhancing Keyboard: Design, Implementation, and Usability Testing

Directory of Open Access Journals (Sweden)

Zhen Ling

2017-01-01

Full Text Available To protect users from numerous password inference attacks, we invent a novel context aware privacy enhancing keyboard (PEK for Android touch-based devices. Usually PEK would show a QWERTY keyboard when users input text like an email or a message. Nevertheless, whenever users enter a password in the input box on his or her touch-enabled device, a keyboard will be shown to them with the positions of the characters shuffled at random. PEK has been released on the Google Play since 2014. However, the number of installations has not lived up to our expectation. For the purpose of usable security and privacy, we designed a two-stage usability test and performed two rounds of iterative usability testing in 2016 and 2017 summer with continuous improvements of PEK. The observations from the usability testing are educational: (1 convenience plays a critical role when users select an input method; (2 people think those attacks that PEK prevents are remote from them.

Building a Remote Usability Testing Body of Knowledge (RUTBOK)

DEFF Research Database (Denmark)

Lizano, Fulvio; Stage, Jan

2012-01-01

Remote Usability Testing (RUT) is an alternative method of usability evaluations. The main aim of RUT is the reduction of costs in the usability evaluation process. Since middle of the 90s RUT, has emerged as a technique which seems as is gaining maturity across the time. In general any discipline...

Toward more usable electronic voting: testing the usability of a smartphone voting system.

Science.gov (United States)

Campbell, Bryan A; Tossell, Chad C; Byrne, Michael D; Kortum, Philip

2014-08-01

The goal of this research was to assess the usability of a voting system designed for smart-phones. Smartphones offer remote participation in elections through the use of pervasive technology. Voting on these devices could, among other benefits, increase voter participation while allowing voters to use familiar technology. However, the usability of these systems has not been assessed. A mobile voting system optimized for use on a smartphone was designed and tested against traditional voting platforms for usability. There were no reliable differences between the smartphone-based system and other voting methods in efficiency and perceived usability. More important, though, smartphone owners committed fewer errors on the mobile voting system than on the traditional voting systems. Even with the known limitations of small mobile platforms in both displays and controls, a carefully designed system can provide a usable voting method. Much of the concern about mobile voting is in the area of security; therefore, although these results are promising, security concerns and usability issues arising from mitigating them must be strongly considered. The results of this experiment may help to inform current and future election and public policy officials about the benefits of allowing voters to vote with familiar hardware.

Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

Science.gov (United States)

Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

2018-03-01

At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

Estimating Sample Size for Usability Testing

Directory of Open Access Journals (Sweden)

Alex Cazañas

2017-02-01

Full Text Available One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.

Usability Testing of an Academic Library Web Site: A Case Study.

Science.gov (United States)

Battleson, Brenda; Booth, Austin; Weintrop, Jane

2001-01-01

Discusses usability testing as a tool for evaluating the effectiveness and ease of use of academic library Web sites; considers human-computer interaction; reviews major usability principles; and explores the application of formal usability testing to an existing site at the University at Buffalo (NY) libraries. (Author/LRW)

Usability Testing: A Case Study.

Science.gov (United States)

Chisman, Janet; Walbridge, Sharon; Diller, Karen

1999-01-01

Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)

A Comparison of What Is Part of Usability Testing in Three Countries

Science.gov (United States)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

Usability Testing For Android Based Application “Jogja Smart Tourism”

Science.gov (United States)

Harwati; Djati Widodo, Imam

2017-06-01

The android based application “Jogja Smart Tourism (JST)” is designed to help everyone who visited Yogyakarta to enjoy their travel. As new application, it is need to be tested for its usability before launched. Usability testing will show how easy user interfaces are to used. The objective of this research is to demonstrate the result of usability testing for application JST based on five characteristics: learnability, effectiveness, memorability, errors, and satisfaction. About 30 respondents were involved to test the usability of this application. Learnability and effectiveness is calculated from some task that should be finished by respondents, and the rest aspects are calculated from questionnaires that should be answered after simulation. There are 14 functions bound in this usability testing. The result shows total usability level is in 81.75%. Learnability testing shows that 98.8% of respondent could finish the task successfully with 87.5% in efficiency. The memorability level of respondents is good (84.5%) where their ability to fix the errors is 71.5%. And the last for satisfaction level of application interface is 66.25%. Low level of satisfaction occurred because most of respondent felt uncomfortable with landscape interface of application because they should turn their mobile phone while using JST application and also it happened because the lack of using picture and colour inside the application. Both of these becomes important note for the improvement of further applications where the interface in a portrait version is more comfort the use and also utilization of colour and the image will be the main focus to improve customer satisfaction.

Library Website Usability Test Project

KAUST Repository

Ramli, Rindra M.; Bukhari, Duaa

2013-01-01

This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.

Library Website Usability Test Project

KAUST Repository

Ramli, Rindra M.

2013-06-01

This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.

New Options for Usability Testing Projects in Business Communication Courses

Science.gov (United States)

Jameson, Daphne A.

2013-01-01

The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…

Usability Testing of Two Ambulatory EHR Navigators.

Science.gov (United States)

Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

2016-01-01

Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

Involving the users remotely: an exploratory study using asynchronous usability testing

Directory of Open Access Journals (Sweden)

Beth Filar Williams

2015-02-01

Full Text Available Open Educational Resources (OER are increasingly used in the higher education landscape as a solution for a variety of copyright, publishing and cost-prohibiting issues. While OERs are becoming more common, reports of usability tests that evaluate how well learners can use them to accomplish their learning tasks have lagged behind. Because both the researchers and the learners in this study use resources and tools remotely, asynchronous usability testing of a prototype OER and MOOC online guide was conducted with an exploratory group of users to determine the guide’s ease of use for two distinct groups of users: Educators and Learners. In this article, we share the background and context of this usability project, suggest best methods for asynchronous remote usability testing, and share challenges and insights of the process and results of the testing

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

Science.gov (United States)

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users

DEFF Research Database (Denmark)

Sivaji, Ashok; Clemmensen, Torkil; Nielsen, Søren Feodor

Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences...... in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject...

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

Science.gov (United States)

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

UserTesting.com: A Tool for Usability Testing of Online Resources

Science.gov (United States)

Koundinya, Vikram; Klink, Jenna; Widhalm, Melissa

2017-01-01

Extension educators are increasingly using online resources in their program design and delivery. Usability testing is essential for ensuring that these resources are relevant and useful to learners. On the basis of our experiences with iteratively developing products using a testing service called UserTesting, we promote the use of fee-based…

Usability Testing for Serious Games: Making Informed Design Decisions with User Data

Directory of Open Access Journals (Sweden)

Pablo Moreno-Ger

2012-01-01

Full Text Available Usability testing is a key step in the successful design of new technologies and tools, ensuring that heterogeneous populations will be able to interact easily with innovative applications. While usability testing methods of productivity tools (e.g., text editors, spreadsheets, or management tools are varied, widely available, and valuable, analyzing the usability of games, especially educational “serious” games, presents unique usability challenges. Because games are fundamentally different than general productivity tools, “traditional” usability instruments valid for productivity applications may fall short when used for serious games. In this work we present a methodology especially designed to facilitate usability testing for serious games, taking into account the specific needs of such applications and resulting in a systematically produced list of suggested improvements from large amounts of recorded gameplay data. This methodology was applied to a case study for a medical educational game, MasterMed, intended to improve patients’ medication knowledge. We present the results from this methodology applied to MasterMed and a summary of the central lessons learned that are likely useful for researchers who aim to tune and improve their own serious games before releasing them for the general public.

Usability testing of interaction components: taking the message exchange as a measure of usability

NARCIS (Netherlands)

Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Jacob, R.J.K.; Limbourg, Q; Vanderdonckt, J.

2004-01-01

Component-based Software Engineering (CBSE) is concerned with the development of systems from reusable parts (components), and the development and maintenance of these parts. This study addresses the issue of usability testing in a CBSE environment, and specifically automatically measuring the

The influence of socio-cultural background and product value in usability testing.

Science.gov (United States)

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Testing the Usability of Two Online Research Guides

Directory of Open Access Journals (Sweden)

Luigina Vileno

2011-01-01

Full Text Available This article describes usability testing of two online research guides. One guide was in the area of applied human sciences and the other was geared toward the discipline of psychology. Six undergraduate students were given several tasks to complete by using the guides. The participants also completed two questionnaires. One described the participants’ demographics and how much time they spent on the Internet on a daily basis. On the other questionnaire, filled out after the usability test, the participants rated the online research guides. Overall, the online research guides were found to be difficult to use. By observing how the participants interacted with the online research guides, the author has identified several problem areas that need to be addressed.

Ethical Concerns in Usability Testing Involving Older Adults

DEFF Research Database (Denmark)

Møller, Margrethe Hansen

Based on experience from the research project “User Manuals for Older Adults”, this paper discusses whether there are special ethical concerns with older adults as test persons in a usability test involving the think-aloud method. In this context, older adults are defined as individuals with normal...

Log files for testing usability

NARCIS (Netherlands)

Klein Teeselink, G.; Siepe, A.H.M.; Pijper, de J.R.

1999-01-01

The aim of this study is to gain insight in the usefulness of log file analysis as a method to evaluate the usability of individual interface components and their influence on the usability of the overall user interface. We selected a music player as application, with four different interfaces and

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

Science.gov (United States)

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

Science.gov (United States)

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

Science.gov (United States)

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

What Happened to Remote Usability Testing? An Empirical Study of Three Methods

DEFF Research Database (Denmark)

Stage, Jan; Andreasen, M. S.; Nielsen, H. V.

2007-01-01

The idea of conducting usability tests remotely emerged ten years ago. Since then, it has been studied empirically, and some software organizations employ remote methods. Yet there are still few comparisons involving more than one remote method. This paper presents results from a systematic...... empirical comparison of three methods for remote usability testing and a conventional laboratorybased think-aloud method. The three remote methods are a remote synchronous condition, where testing is conducted in real time but the test monitor is separated spatially from the test subjects, and two remote...

Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.

Science.gov (United States)

Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola

2016-01-01

The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

Science.gov (United States)

Chalil Madathil, Kapil; Greenstein, Joel S

2017-11-01

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

Science.gov (United States)

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to

Considerations and Methods for Usability Testing with Children

DEFF Research Database (Denmark)

Andersen, Malene Hjortboe; Khalid, Md. Saifuddin; Brooks, Eva Irene

2017-01-01

of these methods is that they are designed for adults and are not necessarily appropriate to investigations including children. The guiding questions for this systematic literature review are (1) the motivation for conducting usability tests with children, and (2) the kind of methodological, practical, and ethical...

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

International Nuclear Information System (INIS)

Warkentin, H; Bubric, K; Giovannetti, H; Graham, G; Clay, C

2016-01-01

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment. A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document

SU-F-T-249: Application of Human Factors Methods: Usability Testing in the Radiation Oncology Environment

Energy Technology Data Exchange (ETDEWEB)

Warkentin, H [Cross Cancer Institute, Edmonton, AB (Canada); Bubric, K [Alberta Health Services, Calgary, AB (Canada); Giovannetti, H [Jack Ady Cancer Centre, Lethbridge, AB (Canada); Graham, G [Tom Baker Cancer Centre, Calgary, AB (Canada); Clay, C [Central Alberta Cancer Centre, Red Deer, AB (Canada)

2016-06-15

Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment. A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document

Expected usability is not a valid indicator of experienced usability

Directory of Open Access Journals (Sweden)

Meinald T. Thielsch

2015-09-01

Full Text Available Usability is a core construct of website evaluation and inherently defined as interactive. Yet, when analysing first impressions of websites, expected usability, i.e., before use, is of interest. Here we investigate to what extend ratings of expected usability are related to (a experienced usability, i.e., ratings after use, and (b objective usability measures, i.e., task performance. Furthermore, we try to elucidate how ratings of expected usability are correlated to aesthetic judgments. In an experiment, 57 participants submitted expected usability ratings after the presentation of website screenshots in three viewing-time conditions (50, 500, and 10,000 ms and after an interactive task (experienced usability. Additionally, objective usability measures (task completion and duration and subjective aesthetics evaluations were recorded for each website. The results at both the group and individual level show that expected usability ratings are not significantly related either to experienced usability or objective usability measures. Instead, they are highly correlated with aesthetics ratings. Taken together, our results highlight the need for interaction in empirical website usability testing, even when exploring very early usability impressions. In our study, user ratings of expected usability were no valid proxy neither for objective usability nor for experienced website usability.

Designing Websites for ESL Learners: A Usability Testing Study

Science.gov (United States)

Liu, Min; Traphagan, Tomoko; Huh, Jin; Koh, Young Ihn; Choi, Gilok; McGregor, Allison

2008-01-01

The purpose of this paper is to report on a usability study for ESL websites conducted to gain insights from learners of English as a second language (ESL) as they interacted with specific sites. Five carefully selected ESL sites were tested by 10 different users generating a total of fifty testing sessions. Two major research questions guided the…

A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence

NARCIS (Netherlands)

Jaspers, Monique W. M.

2009-01-01

OBJECTIVE: Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the

Mobile Usability Testing in Healthcare: Methodological Approaches.

Science.gov (United States)

Borycki, Elizabeth M; Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

The use of mobile devices and healthcare applications is increasing exponentially worldwide. This has lead to the need for the healthcare industry to develop a better understanding of the impact of the usability of mobile software and hardware upon consumer and health professional adoption and use of these technologies. There are many methodological approaches that can be employed in conducting usability evaluation of mobile technologies. More obtrusive approaches to collecting study data may lead to changes in study participant behaviour, leading to study results that are less consistent with how the technologies will be used in the real-world. Alternatively, less obstrusive methods used in evaluating the usability of mobile software and hardware in-situ and laboratory settings can lead to less detailed information being collected about how an individual interacts with both the software and hardware. In this paper we review and discuss several innovative mobile usability evaluation methods on a contiuum from least to most obtrusive and their effects on the quality of the usability data collected. The strengths and limitations of methods are also discussed.

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

Science.gov (United States)

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on

Users' performance in lab and non-lab environments through online usability testing:A case of evaluating the usability of digital academic libraries' websites

OpenAIRE

Alharbi, Abeer; Mayhew, Pam

2015-01-01

The factors related to the environment in which users operate may be of a vital importance when trying to understand how they experience a particular system. It is required that we find out how we can get to know those factors to investigate if they affect the users' performance in usability testing. An online usability study has emerged that can be attempted by a large, varied pool of users' anywhere with an Internet connection. Would the usage of an online usability study help to give compr...

Sample size in usability studies

NARCIS (Netherlands)

Schmettow, Martin

2012-01-01

Usability studies are important for developing usable, enjoyable products, identifying design flaws (usability problems) likely to compromise the user experience. Usability testing is recommended for improving interactive design, but discovery of usability problems depends on the number of users

Usability testing of a monitoring and feedback tool to stimulate physical activity

Directory of Open Access Journals (Sweden)

van der Weegen S

2014-03-01

Full Text Available Sanne van der Weegen,1 Renée Verwey,1,2 Huibert J Tange,3 Marieke D Spreeuwenberg,1 Luc P de Witte1,2 1Department of Health Services Research, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands; 2Research Centre Technology in Care, Zuyd University of Applied Sciences, Heerlen, the Netherlands; 3Department of General Practice, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands Introduction: A monitoring and feedback tool to stimulate physical activity, consisting of an activity sensor, smartphone application (app, and website for patients and their practice nurses, has been developed: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40–70 years, to improve the user interfaces and content of the tool. Patients and methods: The study had four phases: 1 a heuristic evaluation with six technology experts; 2 a usability test in a laboratory by five patients; 3 a pilot in real life wherein 20 patients used the tool for 3 months; and 4 a final lab test by five patients. In both lab tests (phases 2 and 4 qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ was completed for the app and the website. In the pilot test (phase 3, all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI was completed. Results: After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server

Research on the Application of GSR and ECG in the Usability Testing of an Aggregation Reading App

Directory of Open Access Journals (Sweden)

Sha Liu

2016-09-01

Full Text Available Usability testing is a very important step in improving App design and development. The traditional usability testing methods are based on users'expressions and behaviors, which hardly show users' emotional experience and cognitive load in real time. The introduction of an electrophysiological technique can make up for the deficiency of the traditional usability testing methods. In this study, a usability testing was carried out with the old and the new version of an App software. The behavior and the subjective evaluation of the participants were recorded, and their GSR and ECG signals were collected. Then, 14 physiological characteristics, such as GSR-Mean, LF, HF, LF/HF, etc., were extracted from the GSR and ECG signals. These characteristics were analyzed, and a significance test of difference of the two versions was made. This research indicated that there is a certain application value of GSR and HRV in usability testing and evaluation of an App product. But the meanings of the physiological characteristics must be explained in combination with the behavior and subjective evaluation of users. The result can prove that physiological characteristics have obvious advantages in real-time monitoring users' emotional changes, which can be helpful to find the usability problems of the product.

A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence.

Science.gov (United States)

Jaspers, Monique W M

2009-05-01

Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the human-computer interaction field, we provide an overview of the methodological and empirical research available on the three usability inspection and testing methods most often used. We describe two 'expert-based' and one 'user-based' usability method: (1) the heuristic evaluation, (2) the cognitive walkthrough, and (3) the think aloud. All three usability evaluation methods are applied in laboratory settings. Heuristic evaluation is a relatively efficient usability evaluation method with a high benefit-cost ratio, but requires high skills and usability experience of the evaluators to produce reliable results. The cognitive walkthrough is a more structured approach than the heuristic evaluation with a stronger focus on the learnability of a computer application. Major drawbacks of the cognitive walkthrough are the required level of detail of task and user background descriptions for an adequate application of the latest version of the technique. The think aloud is a very direct method to gain deep insight in the problems end users encounter in interaction with a system but data analyses is extensive and requires a high level of expertise both in the cognitive ergonomics and in computer system application domain. Each of the three usability evaluation methods has shown its usefulness, has its own advantages and disadvantages; no single method has revealed any significant results indicating that it is singularly effective in all circumstances. A combination of different techniques that compliment one another should preferably be used as their collective application will be more powerful than applied in isolation. Innovative mobile and automated solutions to support end-user testing have

Getting a technology-based diabetes intervention ready for prime time: a review of usability testing studies.

Science.gov (United States)

Lyles, Courtney R; Sarkar, Urmimala; Osborn, Chandra Y

2014-10-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009 to 2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n = 11), descriptive quantitative (n = 9), and qualitative methods (n = 3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes and publish usability findings to inform interpretation of why an intervention succeeded or failed and for whom.

Usability Testing of an HPV Information Website for Parents and Adolescents

Science.gov (United States)

Starling, Randall; Nodulman, Jessica A.; Kong, Alberta S.; Wheeler, Cosette M.; Buller, David B.; Woodall, W. Gill

2015-01-01

Objective Parents make the decisions regarding their children’s health care. Unfortunately, many parents are misinformed about HPV and HPV vaccines. In order to help parents make an informed decision regarding HPV vaccination for their daughter, the GoHealthyGirls website was created for parents and their adolescent daughters. Usability testing was conducted with members of the target population to refine the website prior to conducting an efficacy trial. Methods Parents with girls (n=9) between the ages of 11-13 and 11-13 year old adolescents (n=10) were recruited for usability testing. The testing consisted of completing twelve scenarios where participants were asked to find specific information on the GoHealthyGirls site. This was followed by a self-administered system usability scale—to determine ease of use and functionality of the website—and a user satisfaction survey. Results Both adult and adolescent participants were able to easily find the requested information and reported an increased positive opinion of HPV vaccines after visiting the website. Both groups of participants reported favorable evaluations of using the website. Conclusion The GoHealthyGirls website has the potential to help parents of adolescent daughters make an informed decision about HPV vaccination. A large scale efficacy trial will determine its usefulness. PMID:26594313

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

Science.gov (United States)

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the

Usability Testing in a Library Web Site Redesign Project.

Science.gov (United States)

McMullen, Susan

2001-01-01

Discusses the need for an intuitive library information gateway to meet users' information needs and describes the process involved in redesigning a library Web site based on experiences at Roger Williams University. Explains usability testing methods that were used to discover how users were interacting with the Web site interface. (Author/LRW)

Bringing content understanding into usability testing in complex application domains—a case study in eHealth

DEFF Research Database (Denmark)

Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

2017-01-01

A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...... domains involving different kinds of users and evaluators are needed before we can tell whether CUT with QU is an effective usability testing technique of wider applicability. Performing CUT with QU is very demanding by drawing heavily on the evaluators’ ability to respond effectively to openings...

Usability testing of indonesia tourism promotion website

Science.gov (United States)

Yunus, U.; Anindito; Tanuar, E.; Maryani

2018-03-01

Indonesian tourism has been viewed as one of the source of foreign exchange, therefore visit Indonesia campaign through Wonderful Indonesia should be given attention. This research aims to test the usability of web http://www.indonesia.travel/en, at the end can give input to the Tourism Ministry of the Republic of Indonesia. The concept used based on usabilitygeek.com which mentions the three main categories for usability testing, i. e. explorative, assessment and comparative with the users are three classes of Communication Department students of Bina Nusantara University with a total of 120 students, however finally only 22 students were elected because of the criteria are the students should be like travelling and access to the tourism website more than 12 times. The methodology used is qualitative descriptive and experiments, with data collection techniques through observation and interviews after participants’ access to the web: Due to their one-on-one nature, interviews enable the observer to ask direct questions to the user and the participants posted their opinion in online discussion forum. The results mentioned that the elements web of Wonderful Indonesia has a high learning ability and memorability but less efficiency and satisfaction, as well as several times errors when used. In conclusion, to maximize about the visit of tourism to Indonesia, this web is only able to learn and impress the visitor, but do not give satisfaction to users.

Computer-facilitated rapid HIV testing in emergency care settings: provider and patient usability and acceptability.

Science.gov (United States)

Spielberg, Freya; Kurth, Ann E; Severynen, Anneleen; Hsieh, Yu-Hsiang; Moring-Parris, Daniel; Mackenzie, Sara; Rothman, Richard

2011-06-01

Providers in emergency care settings (ECSs) often face barriers to expanded HIV testing. We undertook formative research to understand the potential utility of a computer tool, "CARE," to facilitate rapid HIV testing in ECSs. Computer tool usability and acceptability were assessed among 35 adult patients, and provider focus groups were held, in two ECSs in Washington State and Maryland. The computer tool was usable by patients of varying computer literacy. Patients appreciated the tool's privacy and lack of judgment and their ability to reflect on HIV risks and create risk reduction plans. Staff voiced concerns regarding ECS-based HIV testing generally, including resources for follow-up of newly diagnosed people. Computer-delivered HIV testing support was acceptable and usable among low-literacy populations in two ECSs. Such tools may help circumvent some practical barriers associated with routine HIV testing in busy settings though linkages to care will still be needed.

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

Science.gov (United States)

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

Usability of Public Administration Electronic Forms

Directory of Open Access Journals (Sweden)

Miloslav Hub

2015-06-01

Full Text Available This paper is focused on the testing and evaluating of public administration electronic forms from the usability point of view. Its objective is to design a suitable methodology for usability testing of electronic forms and their description and distribution to public administration information systems professionals. Firstly, methods of usability engineering are summarized and a suitable method for usability testing and evaluation of electronic forms is selected. Farther, the methodology of electronic forms usability testing that uses the selected method is suggested. In the last part of the paper the case study that uses the proposed methodology is suggested and performed. The main benefit of the work is the design of testing methodology and proposition of the set of recommendations for new public administration electronic forms design.

Usability testing of two e-learning resources: methods to maximize potential for clinician use.

Science.gov (United States)

Menon, Anita; Korner-Bitensky, Nicol; Chignell, Mark; Straus, Sharon

2012-04-01

Rigorous usability testing of e-learn-ing resources is an important prerequisite to their wide-spread use among clinicians. This study demonstrates the application of an evidence-based approach to usability testing of two stroke-related e-learning resources (StrokEngine). 14 stroke rehabilitation clinicians (occupational therapists and physiotherapists) from Ontario, Canada participated in a 1.5 h in-person testing session. Clinicians navigated StrokEngine in search of information to answer questions on stroke assessment/intervention. Their search patterns were observed and clinicians provided verbal/written feedback about StrokEngine. Content analysis was used to generate themes and categorize them under two broad categories: facilitators and barriers to use. Five key facilitators and three key barriers to Strok-Engine use were identified and related to screen format, layout/organization, ease of navigation, quality of content, likelihood of using StrokEngine in the future, and system dysfunctions. All 14 clinicians were very or extremely satisfied with the layout/organization, quality and clinical relevance of the content, stating that they were likely to use StrokEngine in the future. All identified barriers from this study were addressed with website modifications in order to maximize the usability and navigability of StrokEngine. This rigorous methodology for usability testing can be applied during the design process of any e-learning resource.

Work-domain knowledge in usability evaluation

DEFF Research Database (Denmark)

Følstad, Asbjørn; Hornbæk, Kasper

2010-01-01

Usability evaluation helps to determine whether interactive systems support users in their work tasks. However, knowledge about those tasks and, more generally, about the work-domain is difficult to bring to bear on the processes and outcome of usability evaluation. One way to include such work......-domain knowledge might be Cooperative Usability Testing, an evaluation method that consists of (a) interaction phases, similar to classic usability testing, and (b) interpretation phases, where the test participant and the moderator discuss incidents and experiences from the interaction phases. We have studied...... whether such interpretation phases improve the relevance of usability evaluations in the development of work-domain specific systems. The study included two development cases. We conclude that the interpretation phases generate additional insight and redesign suggestions related to observed usability...

User-centered design and usability testing of an innovative health-related quality of life module.

Science.gov (United States)

Nagykaldi, Z J; Jordan, M; Quitoriano, J; Ciro, C A; Mold, J W

2014-01-01

Various computerized health risk appraisals (HRAs) are available, but few of them assess health-related quality of life (HRQoL) in a goal-directed framework. This study describes the user-centered development and usability testing of an innovative HRQoL module that extends a validated HRA tool in primary care settings. Systematic user-centered design, usability testing, and qualitative methods were used to develop the HRQoL module in primary care practices. Twenty two patients and 5 clinicians participated in two rounds of interactive technology think-out-loud sessions (TOLs) and semi-structured interviews (SSIs) to iteratively develop a four-step, computerized process that collects information on patient goals for meaningful life activities and current level of disability and presents a personalized and prioritized list of preventive recommendations linked to online resources. Analysis of TOLs and SSIs generated 5 categories and 11 sub-categories related to facilitators and barriers to usability and human-technology interaction. The categories included: Understanding the Purpose, Usability, Perceived Value, Literacy, and Participant Motivation. Some categories were inter-connected. The technology was continually and iteratively improved between sessions until saturation of positive feedback was achieved in 4 categories (addressing motivation will require more research). Usability of all screen units of the module was improved substantially. Clinician feedback emphasized the importance of the module's ability to translate the patient-centered HRQoL Report into actionable items for clinicians to facilitate shared decision-making. Complete integration of the HRQoL module into the existing HRA will require further development and testing. Systematic application of user-centered design and human factors principles in technology development and testing may significantly improve the usability and clinical value of health information systems. This more sophisticated

Bringing content understanding into usability testing in complex application domains—a case study in eHealth

DEFF Research Database (Denmark)

Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

2017-01-01

A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... of users’ content understanding is sometimes crucial, and thus should be carefully evaluated. Unfortunately, conventional usability evaluation techniques do not address challenges of content understanding. In a case study within eHealth, specifically the setting of a rehabilitation clinic involving...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...

Implementation of a Computerized Screening Inventory: Improved Usability Through Iterative Testing and Modification.

Science.gov (United States)

Boudreaux, Edwin D; Fischer, Andrew Christopher; Haskins, Brianna Lyn; Saeed Zafar, Zubair; Chen, Guanling; Chinai, Sneha A

2016-03-09

The administration of health screeners in a hospital setting has traditionally required (1) clinicians to ask questions and log answers, which can be time consuming and susceptible to error, or (2) patients to complete paper-and-pencil surveys, which require third-party entry of information into the electronic health record and can be vulnerable to error and misinterpretation. A highly promising method that avoids these limitations and bypasses third-party interpretation is direct entry via a computerized inventory. To (1) computerize medical and behavioral health screening for use in general medical settings, (2) optimize patient acceptability and feasibility through iterative usability testing and modification cycles, and (3) examine how age relates to usability. A computerized version of 15 screeners, including behavioral health screeners recommended by a National Institutes of Health Office of Behavioral and Social Sciences Research collaborative workgroup, was subjected to systematic usability testing and iterative modification. Consecutive adult, English-speaking patients seeking treatment in an urban emergency department were enrolled. Acceptability was defined as (1) the percentage of eligible patients who agreed to take the assessment (initiation rate) and (2) average satisfaction with the assessment (satisfaction rate). Feasibility was defined as the percentage of the screening items completed by those who initiated the assessment (completion rate). Chi-square tests, analyses of variance, and Pearson correlations were used to detect whether improvements in initiation, satisfaction, and completion rates were seen over time and to examine the relation between age and outcomes. Of 2157 eligible patients approached, 1280 agreed to complete the screening (initiation rate=59.34%). Statistically significant increases were observed over time in satisfaction (F3,1061=3.35, P=.019) and completion rates (F3,1276=25.44, PUsability testing revealed several critical

Usability at the CELSTEC Medialab

NARCIS (Netherlands)

Storm, Jeroen; Kostons, Danny

2009-01-01

Storm, J., & Kostons, D. (2009). Usability at the CELSTEC MediaLab. Presentation about the usability testing, usability research and User Centered Design conducted at the CELSTEC MediaLab. July, 7, 2009, Heerlen, The Netherlands: Open University of the Netherlands.

A framework for evaluating electronic health record vendor user-centered design and usability testing processes.

Science.gov (United States)

Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L

2017-04-01

Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Harnessing scientific literature reports for pharmacovigilance. Prototype software analytical tool development and usability testing.

Science.gov (United States)

Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-03-22

We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.

Low Cost vs. High-End Eye Tracking for Usability Testing

DEFF Research Database (Denmark)

Johansen, Sune Alstrup; San Agustin, Javier; Jensen, Henrik Tomra Skovsgaard Hegner

2011-01-01

Accuracy of an open source remote eye tracking system and a state-of-the-art commercial eye tracker was measured 4 times during a usability test. Results from 9 participants showed both devices to be fairly stable over time, but the commercial tracker was more accurate with a mean error of 31 pix...

Card-Sorting Usability Tests of the WMU Libraries' Web Site

Science.gov (United States)

Whang, Michael

2008-01-01

This article describes the card-sorting techniques used by several academic libraries, reports and discusses the results of card-sorting usability tests of the Western Michigan University Libraries' Web site, and reveals how the WMU libraries incorporated the findings into a new Web site redesign, setting the design direction early on. The article…

Comparison of Think-Aloud and Constructive Interaction in Usability Testing with Children

DEFF Research Database (Denmark)

Als, Benedikte Skibsted; Jensen, Janne Jul; Skov, Mikael B.

2005-01-01

Constructive interaction provides natural thinking-aloud as test subjects collaborate to solve tasks. Since children may face difficulties in following instructions for a standard think-aloud test, constructive interaction has been suggested as evaluation method when usability testing with childr......, the acquainted pairs reported that they had to put less effort into the testing than the think-aloud and non-acquainted children....

Reducing and Sustaining Duplicate Medical Record Creation by Usability Testing and System Redesign.

Science.gov (United States)

Khunlertkit, Adjhaporn; Dorissaint, Leonard; Chen, Allen; Paine, Lori; Pronovost, Peter J

2017-10-25

Duplicate medical record creation is a common and consequential health care systems error often caused by poor search system usability and inappropriate user training. We conducted two phases of scenario-based usability testing with patient registrars working in areas at risk of generating duplicate medical records. Phase 1 evaluated the existing search system, which led to system redesigns. Phase 2 tested the redesigned system to mitigate potential errors before health system-wide implementation. To evaluate system effectiveness, we compared the monthly potential duplicate medical record rates for preimplementation and postimplementation months. The existing system could not effectively handle a misspelling, which led to failed search and duplicate medical record creation. Using the existing system, 96% of registrars found commonly spelled patient names whereas only 69% successfully found complicated names. Registrars lacked knowledge and usage of a phonetic matching function to assist in misspelling. The new system consistently captured the correct patient regardless of misspelling, but search returned more potential matches, resulting in, on average, 4 seconds longer to select common names. Potential monthly duplicate medical record rate reduced by 38%, from 4% to 2.3% after implementation of the new system, and has sustained at an average of 2.5% for 2 years. Usability testing was an effective method to reveal problems and aid system redesign to deliver a more user friendly system, hence reducing the potential for medical record duplication. Greater standards for usability would ensure that these improvements can be realized before rather than after exposing patients to risks.

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

Science.gov (United States)

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

Evaluating Web Usability

Science.gov (United States)

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Testing the usability of a personalized system: comparing the use of interviews, questionnaires and thinking -aloud

NARCIS (Netherlands)

van Velsen, Lex Stefan; van der Geest, Thea; Klaassen, R.F.

2007-01-01

Personalized systems present each user with tailored content or output. Testing the usability of such a system must take some specific usability issues and the suitability of the personalized output into account. In this study, we evaluated a personalized search engine to compare the use of

The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”

Science.gov (United States)

2013-01-01

Background As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. Methods A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Results Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Conclusions Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users. PMID:24094082

Usability Test Results for a Discovery Tool in an Academic Library

Directory of Open Access Journals (Sweden)

Jody Condit Fagan

2008-03-01

Full Text Available Discovery tools are emerging in libraries. These tools offer library patrons the ability to concurrently search the library catalog and journal articles. While vendors rush to provide feature-rich interfaces and access to as much content as possible, librarians wonder about the usefulness of these tools to library patrons. In order to learn about both the utility and usability of EBSCO Discovery Service, James Madison University conducted a usability test with eight students and two faculty members. The test consisted of nine tasks focused on common patron requests or related to the utility of specific discovery tool features. Software recorded participants’ actions and time on task, human observers judged the success of each task, and a post-survey questionnaire gathered qualitative feedback and comments from the participants.  Overall, participants were successful at most tasks, but specific usability problems suggested some interface changes for both EBSCO Discovery Service and JMU’s customizations of the tool.  The study also raised several questions for libraries above and beyond any specific discovery tool interface, including the scope and purpose of a discovery tool versus other library systems, working with the large result sets made possible by discovery tools, and navigation between the tool and other library services and resources.  This article will be of interest to those who are investigating discovery tools, selecting products, integrating discovery tools into a library web presence, or performing evaluations of similar systems.

Exploring two methods of usability testing: concurrent versus retrospective think-aloud protocols

NARCIS (Netherlands)

van den Haak, M.J.; de Jong, Menno D.T.

2003-01-01

Think-aloud protocols are commonly used for the usability testing of instructional documents, Web sites and interfaces. This paper addresses the benefits and drawbacks of two think-aloud variations: the traditional concurrent think-aloud method and the less familiar retrospective think-aloud

Exploring Two Methods of Usability Testing : Concurrent versus Retrospective Think-Aloud Protocols

NARCIS (Netherlands)

Van den Haak, Maaike J.; De Jong, Menno D. T.

2003-01-01

Think-aloud protocols are commonly used for the usability testing of instructional documents, web sites and interfaces. This paper addresses the benefits and drawbacks of two think-aloud variations: the traditional concurrent think-aloud method and the less familiar retrospective think-aloud

Towards Usable E-Health. A Systematic Review of Usability Questionnaires.

Science.gov (United States)

Sousa, Vanessa E C; Dunn Lopez, Karen

2017-05-10

The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However

How do Usability Professionals Construe Usability?

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmensen, Torkil

2012-01-01

distinguishing it from user experience. On the basis of repertory-grid interviews with 24 Chinese, Danish, and Indian usability professionals we find that they make use of more utilitarian than experiential, i.e. user-experience related, constructs. This indicates that goal-related performance is central......’ constructs, particularly their experiential constructs, go considerably beyond ISO 9241 usability, indicating a discrepancy between this definition of usability and the thinking of the professionals concerned with delivering usability. Finally, usability is construed rather similarly across the three...

Usability testing of a computerized communication tool in a diverse urban pediatric population.

Science.gov (United States)

Tsimicalis, Argerie; Stone, Patricia W; Bakken, Suzanne; Yoon, Sunmoo; Sands, Stephen; Porter, Rechelle; Ruland, Cornelia

2014-01-01

Developed in Norway, Sisom is an interactive, rigorously tested, computerized, communication tool designed to help children with cancer express their perceived symptoms/problems. Children travel virtually from island to island rating their symptoms/problems. While Sisom has been found to significantly improve communication in patient consultations in Norway, usability testing is warranted with US children prior to further use in research studies. The objective of this study was to determine the usability of Sisom in a sample of English- and Spanish-speaking children in an urban US community. A mixed-methods usability study was conducted with a purposive sample of healthy children and children with cancer. Semistructured interviews were used to assess healthy children's symptom recognition. Children with cancer completed 8 usability tasks captured with Morae 3.3 software. Data were downloaded, transcribed, and analyzed descriptively. Four healthy children and 8 children with cancer participated. Of the 44 symptoms assessed, healthy children recognized 15 (34%) pictorial symptoms immediately or indicated 13 (30%) pictures were good representations of the symptom. Six children with cancer completed all tasks. All children navigated successfully from one island to the next, ranking their symptom/problem severity, clicking the magnifying glass for help, or asking the researcher for assistance. All children were satisfied with the aesthetics and expressed an interest in using Sisom to communicate their symptoms/problems. A few minor suggestions for improvement and adjustment may optimize the use of Sisom for US children. Sisom may help clinicians overcome challenges assessing children's complex symptoms/problems in a child-friendly manner.

NASA Johnson Space Center Usability Testing and Analysis Facility (WAF) Overview

Science.gov (United States)

Whitmore, M.

2004-01-01

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support.

Science.gov (United States)

Li, Alice C; Kannry, Joseph L; Kushniruk, Andre; Chrimes, Dillon; McGinn, Thomas G; Edonyabo, Daniel; Mann, Devin M

2012-11-01

Usability evaluations can improve the usability and workflow integration of clinical decision support (CDS). Traditional usability testing using scripted scenarios with think-aloud protocol analysis provide a useful but incomplete assessment of how new CDS tools interact with users and clinical workflow. "Near-live" clinical simulations are a newer usability evaluation tool that more closely mimics clinical workflow and that allows for a complementary evaluation of CDS usability as well as impact on workflow. This study employed two phases of testing a new CDS tool that embedded clinical prediction rules (an evidence-based medicine tool) into primary care workflow within a commercial electronic health record. Phase I applied usability testing involving "think-aloud" protocol analysis of 8 primary care providers encountering several scripted clinical scenarios. Phase II used "near-live" clinical simulations of 8 providers interacting with video clips of standardized trained patient actors enacting the clinical scenario. In both phases, all sessions were audiotaped and had screen-capture software activated for onscreen recordings. Transcripts were coded using qualitative analysis methods. In Phase I, the impact of the CDS on navigation and workflow were associated with the largest volume of negative comments (accounting for over 90% of user raised issues) while the overall usability and the content of the CDS were associated with the most positive comments. However, usability had a positive-to-negative comment ratio of only 0.93 reflecting mixed perceptions about the usability of the CDS. In Phase II, the duration of encounters with simulated patients was approximately 12 min with 71% of the clinical prediction rules being activated after half of the visit had already elapsed. Upon activation, providers accepted the CDS tool pathway 82% of times offered and completed all of its elements in 53% of all simulation cases. Only 12.2% of encounter time was spent using the

New Tools for New Literacies Research: An Exploration of Usability Testing Software

Science.gov (United States)

Asselin, Marlene; Moayeri, Maryam

2010-01-01

Competency in the new literacies of the Internet is essential for participating in contemporary society. Researchers studying these new literacies are recognizing the limitations of traditional methodological tools and adapting new technologies and new media for use in research. This paper reports our exploration of usability testing software to…

Usability Evaluation of Public Web Mapping Sites

Science.gov (United States)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The

Multimodal Corpus Analysis as a Method for Ensuring Cultural Usability of Embodied Conversational Agents

DEFF Research Database (Denmark)

Nakano, Yukiko; Rehm, Matthias

2009-01-01

In this paper we propose the method of multimodal corpus analysis to collect enough empirical data for modeling the behavior of embodied conversational agents. This is a prerequisite to ensure the usability of such complex interactive systems. So far, the development of embodied agents suffers fr...

NASA Johnson Space Center Usability Testing and Analysis facility (UTAF) Overview

Science.gov (United States)

Whitmore, Mihriban; Holden, Kritina L.

2005-01-01

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility performs research for NASA's HumanSystems Integration Program, under the HumanSystems Research and Technology Division. Specifically, the UTAF provides human factors support for space vehicles, including the International Space Station, the Space Shuttle, and the forthcoming Crew Exploration Vehicle. In addition, there are ongoing collaborative research efforts with external corporations and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes and requirements. This presentation will provide an overview of ongoing activities, and will address how the UTAF projects will evolve to meet new space initiatives.

The Usability Expert’s Fear of Agility

DEFF Research Database (Denmark)

Nielsen, Lene; Madsen, Sabine

2012-01-01

This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12...... different countries. The findings show that the usability professionals share a forced development and innovation in their practice that stem from their clients’ adoption and use of ASD methods. The ASD methods challenge the way usability testing is performed, the abilities of the usability expert......, the usability deliverables, and the experts’ assumptions about the importance of validity....

Enhancing the Usability of an Optical Reader System to Support Point-of-Care Rapid Diagnostic Testing: An Iterative Design Approach.

Science.gov (United States)

Hohenstein, Jess; O'Dell, Dakota; Murnane, Elizabeth L; Lu, Zhengda; Erickson, David; Gay, Geri

2017-11-21

In today's health care environment, increasing costs and inadequate medical resources have created a worldwide need for more affordable diagnostic tools that are also portable, fast, and easy to use. To address this issue, numerous research and commercial efforts have focused on developing rapid diagnostic technologies; however, the efficacy of existing systems has been hindered by usability problems or high production costs, making them infeasible for deployment in at-home, point-of-care (POC), or resource-limited settings. The aim of this study was to create a low-cost optical reader system that integrates with any smart device and accepts any type of rapid diagnostic test strip to provide fast and accurate data collection, sample analysis, and diagnostic result reporting. An iterative design methodology was employed by a multidisciplinary research team to engineer three versions of a portable diagnostic testing device that were evaluated for usability and overall user receptivity. Repeated design critiques and usability studies identified a number of system requirements and considerations (eg, software compatibility, biomatter contamination, and physical footprint) that we worked to incrementally incorporate into successive system variants. Our final design phase culminated in the development of Tidbit, a reader that is compatible with any Wi-Fi-enabled device and test strip format. The Tidbit includes various features that support intuitive operation, including a straightforward test strip insertion point, external indicator lights, concealed electronic components, and an asymmetric shape, which inherently signals correct device orientation. Usability testing of the Tidbit indicates high usability for potential user communities. This study presents the design process, specification, and user reception of the Tidbit, an inexpensive, easy-to-use, portable optical reader for fast, accurate quantification of rapid diagnostic test results. Usability testing suggests

Robot services for elderly with cognitive impairment: testing usability of graphical user interfaces.

Science.gov (United States)

Granata, C; Pino, M; Legouverneur, G; Vidal, J-S; Bidaud, P; Rigaud, A-S

2013-01-01

Socially assistive robotics for elderly care is a growing field. However, although robotics has the potential to support elderly in daily tasks by offering specific services, the development of usable interfaces is still a challenge. Since several factors such as age or disease-related changes in perceptual or cognitive abilities and familiarity with computer technologies influence technology use they must be considered when designing interfaces for these users. This paper presents findings from usability testing of two different services provided by a social assistive robot intended for elderly with cognitive impairment: a grocery shopping list and an agenda application. The main goal of this study is to identify the usability problems of the robot interface for target end-users as well as to isolate the human factors that affect the use of the technology by elderly. Socio-demographic characteristics and computer experience were examined as factors that could have an influence on task performance. A group of 11 elderly persons with Mild Cognitive Impairment and a group of 11 cognitively healthy elderly individuals took part in this study. Performance measures (task completion time and number of errors) were collected. Cognitive profile, age and computer experience were found to impact task performance. Participants with cognitive impairment achieved the tasks committing more errors than cognitively healthy elderly. Instead younger participants and those with previous computer experience were faster at completing the tasks confirming previous findings in the literature. The overall results suggested that interfaces and contents of the services assessed were usable by older adults with cognitive impairment. However, some usability problems were identified and should be addressed to better meet the needs and capacities of target end-users.

Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.

Science.gov (United States)

Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana

2018-04-01

The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.

Integrating Usability Evaluations into the Software Development Process

DEFF Research Database (Denmark)

Lizano, Fulvio

as relevant and strategic human–computer interaction (HCI) activities in the software development process, there are obstacles that limit the complete, effective and efficient integration of this kind of testing into the software development process. Two main obstacles are the cost of usability evaluations...... and the software developers' resistance to accepting users’ opinions regarding the lack of usability in their software systems. The ‘cost obstacle’ refers to the constraint of conducting usability evaluations in the software process due to the significant amount of resources required by this type of testing. Some......This thesis addresses the integration of usability evaluations into the software development process. The integration here is contextualized in terms of how to include usability evaluation as an activity in the software development lifecycle. Even though usability evaluations are considered...

Usability Testing as a Method to Refine a Health Sciences Library Website.

Science.gov (United States)

Denton, Andrea H; Moody, David A; Bennett, Jason C

2016-01-01

User testing, a method of assessing website usability, can be a cost-effective and easily administered process to collect information about a website's effectiveness. A user experience (UX) team at an academic health sciences library has employed user testing for over three years to help refine the library's home page. Test methodology used in-person testers using the "think aloud" method to complete tasks on the home page. Review of test results revealed problem areas of the design and redesign; further testing was effective in refining the page. User testing has proved to be a valuable method to engage users and provide feedback to continually improve the library's home page.

Images of Usability

DEFF Research Database (Denmark)

Hertzum, Morten

2010-01-01

unless confronted with alternative images. This study delineates six images of usability: universal usability, situational usability, perceived usability, hedonic usability, organizational usability, and cultural usability. The different foci of the images provide opportunities for becoming sensitized...... assume different images of usability and a need for supplementary methods addressing the collaborative and long-term aspects of usability. Moreover, the images call for extending the scope of practical usability work to include the effects achieved by users during their use of systems for real work....

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

Science.gov (United States)

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Card Sorting in an Online Environment: Key to Involving Online-Only Student Population in Usability Testing of an Academic Library Web Site?

Science.gov (United States)

Paladino, Emily B.; Klentzin, Jacqueline C.; Mills, Chloe P.

2017-01-01

Based on in-person, task-based usability testing and interviews, the authors' library Web site was recently overhauled in order to improve user experience. This led to the authors' interest in additional usability testing methods and test environments that would most closely fit their library's goals and situation. The appeal of card sorting…

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

Science.gov (United States)

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (pusability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA

A Clinical Decision Support System for Chronic Pain Management in Primary Care: Usability testing and its relevance.

Science.gov (United States)

Nair, Kalpana Maria; Malaeekeh, Raheleh; Schabort, Inge; Taenzer, Paul; Radhakrishnan, Arun; Guenter, Dale

2015-08-13

Clinical decision support systems (CDSSs) that are integrated into electronic medical records may be useful for encouraging practice change compliant with clinical practice guidelines. To engage end users to inform early phase CDSS development through a process of usability testing. A sequential exploratory mixed method approach was used. Interprofessional clinician participants (seven in iteration 1 and six in iteration 2) were asked to 'think aloud' while performing various tasks on the CDSS and then complete the System Usability Scale (SUS). Changes were made to the CDSS after each iteration.Results Barriers and facilitators were identified: systemic; user interface (most numerous barriers); content (most numerous facilitators) and technical. The mean SUS score was 81.1 (SD = 12.02) in iteration 1 and 70.40 (SD = 6.78) in iteration 2 (p > 0.05). Qualitative data from usability testing were valuable in the CDSS development process. SUS scores were of limited value at this development stage.

Usability Testing Analysis on The Bana Game as Education Game Design References on Junior High School

Directory of Open Access Journals (Sweden)

F. Adnan

2017-04-01

Full Text Available Learning media is one of the important elements in the learning process. Technological development support makes learning media more varied. The approach of using digital technology as a learning media has a better and more effective impact than other approaches. In order to increase the students’ learning interest, it requires the support of an interesting learning media. The use of gaming applications as learning media can improve learning outcomes. The benefits of using the maximum application cannot be separated from the determination of application design. The Bana game aims to increase the ability of critical thinking of the junior high school students. The usability-testing analysis on the Bana game application is used in order to get the design reference as an educational game development. The game is used as an object of the analysis because it has the same characteristics and goals with the game application to be developed. Usability Testing is a method used to measure the ease of use of an application by users. The Usability Testing consists of learnability, efficiency, memorability, errors, and satisfaction. The results of the analysis obtained will be used as a reference for educational game applications that will be developed.

A usability evaluation of the prototype Afrikaanse idiome-woordeboek

African Journals Online (AJOL)

When digital tools are developed it is important to consider the usability of the tool. Usability evaluation was done on the Afrikaanse idiome-woordeboek to determine with what success it can be used. Discount usability methods, viz. heuristic evaluation and usability testing were used. This article reports on the findings from ...

Usability testing of a prototype Phone Oximeter with healthcare providers in high- and low-medical resource environments.

Science.gov (United States)

Hudson, J; Nguku, S M; Sleiman, J; Karlen, W; Dumont, G A; Petersen, C L; Warriner, C B; Ansermino, J M

2012-09-01

To increase the use of pulse oximetry by capitalise on the wide availability of mobile phones, we have designed, developed and evaluated a prototype pulse oximeter interfaced to a mobile phone. Usability of this Phone Oximeter was tested as part of a rapid prototyping process. Phase 1 of the study (20 subjects) was performed in Canada. Users performed 23 tasks, while thinking aloud. Time for completion of tasks and analysis of user response to a mobile phone usability questionnaire were used to evaluate usability. Five interface improvements were made to the prototype before evaluation in Phase 2 (15 subjects) in Uganda. The lack of previous pulse oximetry experience and mobile phone use increased median (IQR [range]) time taken to perform tasks from 219 (160-247 [118-274]) s in Phase 1 to 228 (151-501 [111-2661]) s in Phase 2. User feedback was positive and overall usability high (Phase 1--82%, Phase 2--78%). Anaesthesia © 2012 The Association of Anaesthetists of Great Britain and Ireland.

Testing Usability and Acceptability of a Web Application to Promote Physical Activity (iCanFit) Among Older Adults

Science.gov (United States)

Goldberg, Daniel; Dahlke, Deborah Vollmer; Ory, Marcia G; Cargill, Jessica S; Coughlin, Rachel; Hernandez, Edgar; Kellstedt, Debra K; Peres, S Camille

2014-01-01

Background Most older Americans do not exercise regularly and many have chronic conditions. Among an increasing number of fitness mobile and Web apps, few are designed for older adults with chronic conditions despite high ownership rates of mobile tools and Internet access in this population. We designed a mobile-enabled Web app, iCanFit, to promote physical activity in this population. Objective This study aimed to test the usability and acceptability of iCanFit among older adults in a community setting. Methods A total of 33 older adults (aged 60 to 82 years) were recruited from communities to test iCanFit. Of these 33, 10 participants completed the usability testing in a computer room of a senior community center. A research assistant timed each Web application task and observed user navigation behavior using usability metrics. The other 23 participants used the website on their own devices at home and provided feedback after 2-3 weeks by completing a user-experience survey assessing ease of use, helpfulness, and satisfaction with iCanFit. Results Participants completed all 15 tasks on the iCanFit site in an average of 31 (SD 6.9) minutes; some tasks required more time or needed assistance. Participants’ comments were addressed to improve the site’s senior friendliness and ease of use. In the user-experience survey, participants reported high levels of usefulness and satisfaction. More than 56% (13/23) of participants indicated they would continue using the program and recommend it to their families or friends. Conclusions Testing usability and acceptability is a very important step in developing age-appropriate and user-friendly Web apps, especially for older adults. Testing usability and acceptability in a community setting can help reveal users’ experiences and feedback in a real-life setting. Our study suggested that older adults had a high degree of acceptance of iCanFit and could use it easily. The efficacy trial of iCanFit is currently underway

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

Science.gov (United States)

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

76 FR 50881 - Required Scale Tests

Science.gov (United States)

2011-08-17

... RIN 0580-AB10 Required Scale Tests AGENCY: Grain Inspection, Packers and Stockyards Administration... required scale tests. Those documents defined ``limited seasonal basis'' incorrectly. This document... 20, 2011 (76 FR 3485) and on April 4, 2011 (76 FR 18348), concerning required scale tests. Those...

A continuous usability evaluation of an electronic medication administration record application.

Science.gov (United States)

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Usability Testing, User-Centered Design, and LibGuides Subject Guides: A Case Study

Science.gov (United States)

Sonsteby, Alec; DeJonghe, Jennifer

2013-01-01

Usability testing has become a routine way for many libraries to ensure that their Web presence is user-friendly and accessible. At the same time, popular subject guide creation systems, such as LibGuides, decentralize Web content creation and put authorship into the hands of librarians who may not be trained in user-centered design principles. At…

Adding SPICE to a Library Internet Site: A Recipe to Enhance Usability

Directory of Open Access Journals (Sweden)

Ingrid Tonnison

2006-03-01

Full Text Available Objective - To produce a highly- usable intranet site, use the project to explore the practical application of evidence-based librarianship (EBL, and refine the library's project management methodology. Methods - Evidence was gathered via a literature review, an online survey, scenario-based usability testing, and the completion of a usability checlist. Usability issues were then addressed, guided by the Research-Based Web Design and Usability Guidelines. Results - After a preliminary revision, the site achieved a usability index of 79% after application of the "Raward Library Usability Analysis Tool". Finding the information and supporting user tasks were identified as areas of weakness. Usability testing and cleint feedback supported these findings. After these issues were addressed by a major site redeveloment, the usability index increased to 98%. Conclusions - Raward's checklist is an easy and effective tool for measuring and identifying usability issues. Its value was enhanced by scenario-based usability testing, which yielded rich, client specific information. The application of EBL and project management princples ehnanced the outcomes of the project, and the professional development of the project team.

Usability of PostgreSQL

OpenAIRE

Zeng, Xi

2011-01-01

My topic of the thesis is usability of PostgreSQL. It presents basic information aboutPostgreSQL, such as its history, function, and comparison with one of the most popular databases - MySQL. PostgreSQL has been tested in different environments and with different programming languages. The research is based on the documents from PostgreSQL official website.The thesis introduces and proves the usability and the compatibility of PostgreSQL. PostgreSQL has been installed on Windows workstation a...

Educational software usability: Artifact or Design?

Science.gov (United States)

Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A

2017-03-01

Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

Usability: Human Research Program - Space Human Factors and Habitability

Science.gov (United States)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Development and usability testing of a web-based cancer symptom and quality-of-life support intervention.

Science.gov (United States)

Wolpin, S E; Halpenny, B; Whitman, G; McReynolds, J; Stewart, M; Lober, W B; Berry, D L

2015-03-01

The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using "patient-tailored" methods and supporting "patient-control" of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer-II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies

DEFF Research Database (Denmark)

Kushniruk, Andre; Nøhr, Christian; Jensen, Sanne

2013-01-01

of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Results: Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under...... such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. Conclusion: In order to bring context of use...

Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

Science.gov (United States)

Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

2017-06-01

Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

Ten factors to consider when developing usability scenarios and tasks for health information technology.

Science.gov (United States)

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

Usability evaluation techniques in mobile commerce applications: A systematic review

Science.gov (United States)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Integrating discount usability in scrum development process in Ethiopia

DEFF Research Database (Denmark)

Teka, Degif; Dittrich, Y.; Kifle, Mesfin

2017-01-01

be adapted and integrated into the Scrum-agile development with especial emphasis on the Ethiopian context. The research aims at adapting software engineering and ICT development methods to the specific situation and integrating user-centered design (UCD) and lightweight usability methods into agile...... end users and developers. Culturally adapted user pair testing and heuristic evaluation supported usability testing and supported developers in getting early feedback. Integrated approach of discount usability with the Scrum process has been developed and evaluated first with the involved...

Evaluating Usability

DEFF Research Database (Denmark)

Nørgaard, Mie; Høegh, Rune T.

2008-01-01

Usability evaluation is widely accepted as a valuable activity in software development. However, how results effectively are fed back to developers is still a relatively unexplored area. We argue that usability feedback can be understood as an argument for a series of usability problems......, and that basic concepts from argumentation theory can help us understand how to create persuasive feedback. We revisit two field studies on usability feedback to study if concepts from Toulmin's model for argumentation and Aristotle's modes of persuasion can explain why some feedback formats outperform others....... We recommend that evaluators specifically back up the warrants behind their usability claims, that their arguments use several modes of persuasion, and that they present feedback in browsable amounts not to overwhelm developers with information. For complex and controversial problems, we advise...

Hello World! - Experiencing Usability Methods without Usability Expertise

Science.gov (United States)

Eriksson, Elina; Cajander, Åsa; Gulliksen, Jan

How do you do usability work when no usability expertise is available? What happens in an organization when system developers, with no previous HCI knowledge, after a 3-day course, start applying usability methods, and particularly field studies? In order to answer these questions qualitative data were gathered through participatory observations, a feed back survey, field study documentation and interviews from 47 system developers from a public authority. Our results suggest that field studies enhance the developer’s understanding of the user perspective, and provide a more holistic overview of the use situation, but that some developers were unable to interpret their observations and see solutions to the users’ problems. The field study method was very much appreciated and has now become standard operating procedure within the organization. However, although field studies may be useful, it does not replace the need for usability pro fes sion als, as their knowledge is essential for more complex observations, analysis and for keeping the focus on usability.

Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders

Science.gov (United States)

Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.

2014-01-01

The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…

Wireless application guidelines for usability design and evaluation for developing countries

International Nuclear Information System (INIS)

Khoja, S.A.; Ursani, A.A.; Ali, A.

2009-01-01

The aim of this paper is to provide guidelines for designing wireless applications. These guidelines are developed with the help of Human Computer Interaction based Usability Evaluation surveys and tests results. These guidelines will help in making wireless applications more usable and attractive for users and will help designers to plan effective interactive applications. The guidelines presented in the paper have been derived from the results of surveys, usability tests and SET (Summative Evaluation Tests) carried out over 200 people of Karachi, Pakistan, from different walks of life with different academic and professional backgrounds, making imperative suggestions not only to improve the usability of exciting features given in wireless and mobile products, but also provide suggestions to improve usability of basic components such as, text, navigation, interactivity, multimedia, control and behavior. (author)

Global usability

CERN Document Server

Douglas, Ian

2011-01-01

The concept of usability has become an increasingly important consideration in the design of all kinds of technology. As more products are aimed at global markets and developed through internationally distributed teams, usability design needs to be addressed in global terms. Interest in usability as a design issue and specialist area of research and education has developed steadily in North America and Europe since the 1980's. However, it is only over the last ten years that it has emerged as a global concern. Global Usability provides an introduction to the important issues in globalizing des

Assessing Library Instruction through Web Usability and Vocabulary Studies

Science.gov (United States)

Castonguay, Remi

2008-01-01

Can we use the methods of Web usability testing to learn about library instruction? This article is among the first in the field trying to establish a link between usability and instruction. The author discusses useful insights that Web usability can bring to our pedagogy as well as to the efficiency of library instruction. The result of a Web…

Usability Constructs

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmesen, Torkil; Hornbæk, Kasper Anders Søren

2007-01-01

Whereas research on usability predominantly employs universal definitions of the aspects that comprise usability, people experience their use of information systems through personal constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected...... use of constructs traditionally associated with usability (e.g., easy-to-use, intuitive, and liked). Further analysis of the data is ongoing...

77 FR 8217 - Evaluating the Usability of Electronic Health Record (EHR) Systems

Science.gov (United States)

2012-02-14

... usability of health information technology (HIT) systems, EHRs in particular, and performance-oriented user... the usability of health information technology (HIT) systems. NIST research is designed to: (1... DEPARTMENT OF COMMERCE National Institute of Standards and Technology [Docket No. 120123059-2058...

Usability evaluation of a locomotor therapy device considering different strategies

Directory of Open Access Journals (Sweden)

Langthaler Sonja

2016-09-01

Full Text Available Usability of medical devices is one of the main determining factors in preventing use errors in treatment and strongly correlates to patient safety and quality of treatment. This thesis demonstrates the usability testing and evaluation of a prototype for locomotor therapy of infants. Therefore, based on the normative requirements of the EN 62366, a concept combined of evaluation procedures and assessing methods was created to enable extensive testing and analysis of the different aspects of usability. On the basis of gathered information weak points were identified and appropriate measures were presented to increase the usability and operating safety of the locomotor prototype. The overall outcome showed an usability value of 77.4% and an evaluation score of 6.99, which can be interpreted as “satisfactory”.

Beyond the Usability Lab Conducting Large-scale Online User Experience Studies

CERN Document Server

Albert, William; Tullis, Thomas

2010-01-01

Usability testing and user experience research typically take place in a controlled lab with small groups. While this type of testing is essential to user experience design, more companies are also looking to test large sample sizes to be able compare data according to specific user populations and see how their experiences differ across user groups. But few usability professionals have experience in setting up these studies, analyzing the data, and presenting it in effective ways.  Online usability testing offers the solution by allowing testers to elicit feedback simultaneously from 1,0

Usability Evaluation Method for Agile Software Development

Directory of Open Access Journals (Sweden)

Saad Masood Butt

2015-02-01

Full Text Available Agile methods are the best fit for tremendously growing software industry due to its flexible and dynamic nature. But the software developed using agile methods do meet the usability standards? To answer this question we can see that majority of agile software development projects currently involve interactive user interface designs, which can only be possible by following User Centered Design (UCD in agile methods. The question here is, how to integrate UCD with agile models. Both Agile models and UCD are iterative in nature but agile models focus on coding and development of software; whereas, UCD focuses on user interface of the software. Similarly, both of them have testing features where the agile model involves automated tested code while UCD involves an expert or a user to test the user interface. In this paper, a new agile usability model is proposed and the evaluation is of the proposed model is presented by practically implementing it in three real life projects. . Key results from these projects clearly show: the proposed agile model incorporates usability evaluation methods, improves the relationship between usability experts to work with agile software experts; in addition, allows agile developers to incorporate the result from UCD into subsequent interactions.

Towards an empirical method of usability testing of system parts : a methodological study

NARCIS (Netherlands)

Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.

2007-01-01

Current usability evaluation methods are essentially holistic in nature. However, engineers that apply a component-based software engineering approach might also be interested in understanding the usability of individual parts of an interactive system. This paper examines the efficiency dimension of

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

Science.gov (United States)

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

Acceptability and usability of self-collected sampling for HPV testing among African-American women living in the Mississippi Delta.

Science.gov (United States)

Scarinci, Isabel C; Litton, Allison G; Garcés-Palacio, Isabel C; Partridge, Edward E; Castle, Philip E

2013-01-01

Human papillomavirus (HPV) DNA testing has been shown to be an effective approach to cervical cancer screening, and self-collection sampling for HPV testing could be a potential alternative to Pap test, provided that women who tested positive by any method get timely follow-up and care. This feasibility study examined acceptability and usability of self-collected sampling for HPV testing among African-American (AA) women in the Mississippi Delta to inform the development of interventions to promote cervical cancer screening in this population. The study consisted of two phases. Phase I consisted of eight focus groups (n = 87) with AA women to explore knowledge, attitudes, and beliefs about cervical cancer and HPV infection as well as acceptability of self-collected sampling for HPV testing. In phase II, we examined the usability of this technology through one discussion group (n = 9). The Health Belief Model guided data collection and analysis. Although participants perceived themselves as susceptible to cervical cancer and acknowledged its severity, there was a lack of knowledge of the link between HPV and cervical cancer, and they expressed a number of misconceptions. The most frequent barriers to screening included embarrassment, discomfort, and fear of the results. Women in both phases were receptive to self-collected sampling for HPV testing. All participants in the usability phase expressed that self-collection was easy and they did not experience any difficulties. Self-collection for HPV testing is an acceptable and feasible method among AA women in the Mississippi Delta to complement current cytology cervical cancer screening programs. Copyright © 2013 Jacobs Institute of Women's Health. Published by Elsevier Inc. All rights reserved.

Marketing through Usability.

Science.gov (United States)

Morgan, Eric Lease

1999-01-01

Suggests that one of the best ways to get word-of-mouth marketing of library technology is to provide "usable" products and services. Provides an international standards definition on usability and notes that understanding usability combines an understanding of user needs/wants with an understanding of goals, functions, and limitations…

Evaluation Methods on Usability of M-Learning Environments

Directory of Open Access Journals (Sweden)

Teresa Magal-Royo

2007-10-01

Full Text Available Nowadays there are different evaluation methods focused in the assessment of the usability of telematic methods. The assessment of 3rd generation web environments evaluates the effectiveness and usability of application with regard to the user needs. Wireless usability and, specifically in mobile phones, is concentrated in the validation of the features and tools management using conventional interactive environments. There is not a specific and suitable criterion to evaluate created environments and m-learning platforms, where the restricted and sequential representation is a fundamental aspect to be considered.The present paper exposes the importance of the conventional usability methods to verify both: the employed contents in wireless formats, and the possible interfaces from the conception phases, to the validations of the platform with such characteristics.The development of usability adapted inspection could be complemented with the Remote’s techniques of usability testing, which are being carried out these days in the mobile devices field and which pointed out the need to apply common criteria in the validation of non-located learning scenarios.

Usability Problem Identification in Culturally Diverse Settings

DEFF Research Database (Denmark)

Clemmensen, Torkil

2012-01-01

There are indications that established methods for evaluating information system usability that have been developed for use in, e.g. Europe or the USA, fail to give reliable results in countries such as India, China or Malaysia. This paper presents the theoretical background, related work...... and a definition of culture that should be useful for studies of multiple-country usability testing. This includes a discussion of cultural fit and the consequences of cultural (in)consistencies between stakeholders in system development and use. As an illustrative example of the kind of academic research...... that needs to be done, a pilot study is described. The pilot study exemplifies themes to explore, who should be participants and where should the study be done, how to find examples of multiple-country usability testing, how to collect data and how to analyse that data and what kind of results and discussion...

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

Science.gov (United States)

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no

Cultural Usability

DEFF Research Database (Denmark)

Shi, Qingxin

2007-01-01

Culture has already played an important role in the global market. It not only affects products, but also impacts on usability evaluation methods. This project aims to examine in the established thinking aloud usability evaluation method (TA UEM), how does the evaluator build a supportive...

Exploring Multiple Usability Perspectives

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias

2007-01-01

Industrial usability work often fails to produce the expected impact on software products even though significant resources have been used on uncovering problems and suggesting improvements. So, it seems that feedback from industrial usability work lacks persuasiveness, i.e. it fails to convince...... the key stakeholders that actions need to be taken. This study reports from interviews with 26 stakeholders in software development projects. Our data suggests that the interviewees address usability using different perspectives and based on our observations we describe five such perspectives. Further, we...... discuss how applying different usability perspectives might inform the persuasiveness of usability work....

Validation and Verification (V and V) Testing on Midscale Flame Resistant (FR) Test Method

Science.gov (United States)

2016-12-16

materials . The results demonstrated that the Midscale test is a quick and cost-effective method for evaluation of FR performance of design features...standard and novel FR materials and design configurations during fire engulfment. Details of the test method and its development can be found in the...employed in the FRACU is a ripstop fabric blend of 65% FR rayon, 25% para- aramid and 10% nylon. The iCVC material is Nylon/Cotton/Nomex. All three

Usability Briefing for hospital design

DEFF Research Database (Denmark)

Fronczek-Munter, Aneta

This PhD thesis is a contribution to an ongoing debate in Denmark about improving the building design processes of complex buildings, especially in relation to the current hospital developments. It provides knowledge about capturing user needs and defines the process model for usability briefing...... and evaluations, can be fed into briefing and design processes. This PhD thesis proposes methods for usability briefing.Usability is a concept similar to functionality, but usability depends on: subjective view of users, context, culture, situation and experience. Understanding usability is achieved by involving...... users. This PhD thesis extends the research in usability of buildings to include all building design phases, therefore not only proposes usability evaluations, but also defines usability briefing. Briefing, also called architectural programming, is usually understood as one of the first phases...

Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: A methodological comparison

NARCIS (Netherlands)

Van Den Haak, M. J.; De Jong, M. D T; Schellens, P. J.

2004-01-01

This paper describes a comparative study of three usability test approaches: concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction. These three methods were compared by means of an evaluation of an online library catalogue, which involved four points of

Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison.

NARCIS (Netherlands)

van den Haak, M.J.; de Jong, Menno D.T.; Schellens, P.J.

2004-01-01

This paper describes a comparative study of three usability test approaches: concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction. These three methods were compared by means of an evaluation of an online library catalogue, which involved four points of

Workshop on cultural usability and human work interaction design

DEFF Research Database (Denmark)

Clemmensen, Torkil; Ørngreen, Rikke; Roese, Kerstin

2008-01-01

it into interaction design. The workshop will present current research into cultural usability and human work interaction design. Cultural usability is a comprehensive concept, which adheres to all kinds of contexts in which humans are involved (private family, work, public and private organizations, nature......, Workplace observation, Think-Aloud Usability Test, etc. These techniques often give - seemingly - similar results when applied in diverse cultural settings, but experience shows that we need a deep understanding of the cultural, social and organizational context to interpret the results, and to transform...

Enhancing usability using Near Field Communication for mobile application

Directory of Open Access Journals (Sweden)

Wihidayat Endar

2018-01-01

Full Text Available Near Field Communication (NFC as relatively new wireless communication technology pushes new challenges to application developers to make their applications easier to use and simpler to operate. This point of view known as usability element. Usability is one of the elements for creating good quality applications. This study aims to analyse the usability of mobile-based application embeds with NFC. We also try to evaluate usability in applications used by children. We developed an application called Receptionist which has a primary function as a communication tool between students, teachers and parents at a middle school. To know the impact of the NFC, the Receptionist input system is designed with two methods, via conventional navigation (using buttons and via NFC. To understand the usability of each method, we do user testing and questioners on students. The results show, using the NFC there is a significant increase in usability attributes: efficiency, effectiveness, and learnability. On the other hand, there is decreases of user satisfaction comparing to conventional method. In general, this study demonstrates the potential of new input device technologies that can improve the usability of mobile-based applications.

Usability testing of the human-machine interface for the Light Duty Utility Arm System

International Nuclear Information System (INIS)

Kiebel, G.R.; Ellis, J.E.; Masliah, M.R.

1994-01-01

This report describes the usability testing that has been done for the control and data acquisition system for the Light Duty Utility Arm (LDUA) System. A program of usability testing has been established as a part of a process for making the LDUA as easy to use as possible. The LDUA System is being designed to deploy a family of tools, called End Effectors, into underground storage tanks by means of a robotic arm on the end of a telescoping mast, and to collect and manage the data that they generate. The LDUA System uses a vertical positioning mast, to lower the arm into a tank through an existing 30.5 cm access riser. A Mobile Deployment Subsystem is used to position the mast and arm over a tank riser for deployment, and to transport them from tank to tank. The LDUA System has many ancillary subsystems including the Operations Control Trailer, the Tank Riser Interface and Confinement Subsystem, the Decontamination Subsystem, and the End Effector Exchange Subsystem. This work resulted in the identification of several important improvements to the LDUA control and data acquisition system before the design was frozen. The most important of these were color coding of joints in motion, simultaneous operator control of multiple joints, and changes to the field-of-views of the camera lenses for the robot and other camera systems

Augmented Reality Cubes for Cognitive Gaming: Preliminary Usability and Game Experience Testing

Directory of Open Access Journals (Sweden)

Costas Boletsis

2016-03-01

Full Text Available Early detection is important in dementia care; however, cognitive impairment is still under-recognised and under-diagnosed. Cognitive screening and training are two important preventative treatments, which can lead to early detection of cognitive decline. In this work, the “Cognitive Augmented Reality Cubes” (CogARC system is presented, i.e. a serious game for cognitive training and screening, utilising an interaction technique based on Augmented Reality and the manipulation of tangible, physical objects (cubes. The game is a collection of cognitive mini-games of preventative nature and is, primarily, targeting elderly players (≥60 years old. A preliminary testing was conducted focusing on the game experience that CogARC offers (utilising the In-Game Experience Questionnaire, the usability of the system (using the System Usability Scale, and the specific user observations and remarks, as documented by open, semi-structured interviews.  Overall, CogARC demonstrated satisfying positive responses, however, the negative reactions indicated that there are specific problems with aspects of the interaction technique and a number of mini-games. The open interview shed more light on the specific issues of each mini-game and further interpretation of user interactions. The current study managed to provide interesting insights into the game design elements, integration of Augmented Reality, tangible interaction of the system, and on how elderly players perceive and use those interaction components. 

A global, incremental development method for a web-based prostate cancer treatment decision aid and usability testing in a Dutch clinical setting.

Science.gov (United States)

Cuypers, Maarten; Lamers, Romy Ed; Kil, Paul Jm; The, Regina; Karssen, Klemens; van de Poll-Franse, Lonneke V; de Vries, Marieke

2017-07-01

Many new decision aids are developed while aspects of existing decision aids could also be useful, leading to a sub-optimal use of resources. To support treatment decision-making in prostate cancer patients, a pre-existing evidence-based Canadian decision aid was adjusted to Dutch clinical setting. After analyses of the original decision aid and routines in Dutch prostate cancer care, adjustments to the decision aid structure and content were made. Subsequent usability testing (N = 11) resulted in 212 comments. Care providers mainly provided feedback on medical content, and patients commented most on usability and summary layout. All participants reported that the decision aid was comprehensible and well-structured and would recommend decision aid use. After usability testing, final adjustments to the decision aid were made. The presented methods could be useful for cultural adaptation of pre-existing tools into other languages and settings, ensuring optimal usage of previous scientific and practical efforts and allowing for a global, incremental decision aid development process.

Usability Studies and User-Centered Design in Digital Libraries

Science.gov (United States)

Comeaux, David J.

2008-01-01

Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…

Usability Testing of a Large, Multidisciplinary Library Database: Basic Search and Visual Search

Directory of Open Access Journals (Sweden)

Jody Condit Fagan

2006-09-01

Full Text Available Visual search interfaces have been shown by researchers to assist users with information search and retrieval. Recently, several major library vendors have added visual search interfaces or functions to their products. For public service librarians, perhaps the most critical area of interest is the extent to which visual search interfaces and text-based search interfaces support research. This study presents the results of eight full-scale usability tests of both the EBSCOhost Basic Search and Visual Search in the context of a large liberal arts university.

Working together to improve usability

DEFF Research Database (Denmark)

Nørgaard, Mie; Hornbæk, Kasper

2010-01-01

In theory, usability work is an important and well-integrated activity in developing software. In practice, collaboration on improving usability is ridden with challenges relating to conflicting professional goals, tight project schedules, and unclear usability findings. The authors study those...... challenges through 16 interviews with software developers, usability experts, and project managers. Four themes that are key challenges to successful interaction between stakeholders are identified: poor timing when delivering usability results, results lacking relevance, little respect for other disciplines...

C-TOC (Cognitive Testing on Computer): investigating the usability and validity of a novel self-administered cognitive assessment tool in aging and early dementia.

Science.gov (United States)

Jacova, Claudia; McGrenere, Joanna; Lee, Hyunsoo S; Wang, William W; Le Huray, Sarah; Corenblith, Emily F; Brehmer, Matthew; Tang, Charlotte; Hayden, Sherri; Beattie, B Lynn; Hsiung, Ging-Yuek R

2015-01-01

Cognitive Testing on Computer (C-TOC) is a novel computer-based test battery developed to improve both usability and validity in the computerized assessment of cognitive function in older adults. C-TOC's usability was evaluated concurrently with its iterative development to version 4 in subjects with and without cognitive impairment, and health professional advisors representing different ethnocultural groups. C-TOC version 4 was then validated against neuropsychological tests (NPTs), and by comparing performance scores of subjects with normal cognition, Cognitive Impairment Not Dementia (CIND) and Alzheimer disease. C-TOC's language tests were validated in subjects with aphasic disorders. The most important usability issue that emerged from consultations with 27 older adults and with 8 cultural advisors was the test-takers' understanding of the task, particularly executive function tasks. User interface features did not pose significant problems. C-TOC version 4 tests correlated with comparator NPT (r=0.4 to 0.7). C-TOC test scores were normal (n=16)>CIND (n=16)>Alzheimer disease (n=6). All normal/CIND NPT performance differences were detected on C-TOC. Low computer knowledge adversely affected test performance, particularly in CIND. C-TOC detected impairments in aphasic disorders (n=11). In general, C-TOC had good validity in detecting cognitive impairment. Ensuring test-takers' understanding of the tasks, and considering their computer knowledge appear important steps towards C-TOC's implementation.

A Fuzzy method for the usability evaluation of nuclear medical equipment

Energy Technology Data Exchange (ETDEWEB)

Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V., E-mail: grecco@ien.gov.br, E-mail: luquetti@ien.gov.br, E-mail: msantana@ien.gov.br, E-mail: larissapfarias@ymail.com, E-mail: marques@ien.gov.br [Instituto de Engenharia Nuclear (DENN/IEN/CNEN/RJ), Rio de Janeiro, RJ (Brazil). Departamento de Engenharia Nuclear

2017-11-01

To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

A Fuzzy method for the usability evaluation of nuclear medical equipment

International Nuclear Information System (INIS)

Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V.

2017-01-01

To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

Distributed usability evaluation

DEFF Research Database (Denmark)

Christensen, Lars; Frøkjær, Erik

2010-01-01

We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary......, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server......, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented...

Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing.

Science.gov (United States)

Choi, Jeungok; Bakken, Suzanne

2010-08-01

Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.

From Usability Engineering to Evidence-based Usability in Health IT

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

2016-01-01

Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve

Earning the Stamp of Approval: How To Achieve Optimal Usability.

Science.gov (United States)

Makar, Susan

2003-01-01

Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

Science.gov (United States)

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

Personal Usability Constructs

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmensen, Torkil; Hornbæk, Kasper

2011-01-01

Whereas the concept of usability is predominantly defined analytically, people relate to systems through personal usability constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected by two factors crucial to the international development...

Usability Testing of the BRANCH Smartphone App Designed to Reduce Harmful Drinking in Young Adults.

Science.gov (United States)

Milward, Joanna; Deluca, Paolo; Drummond, Colin; Watson, Rod; Dunne, Jacklyn; Kimergård, Andreas

2017-08-08

Electronic screening and brief intervention (eSBI) apps demonstrate potential to reduce harmful drinking. However, low user engagement rates with eSBI reduce overall effectiveness of interventions. As "Digital Natives," young adults have high expectations of app quality. Ensuring that the design, content, and functionality of an eSBI app are acceptable to young adults is an integral stage to the development process. The objective of this study was to identify usability barriers and enablers for an app, BRANCH, targeting harmful drinking in young adults. The BRANCH app contains a drinking diary, alcohol reduction goal setting functions, normative drinking feedback, and information on risks and advice for cutting down. The app includes a social feature personalized to motivate cutting down and to promote engagement with a point-based system for usage. Three focus groups were conducted with 20 users who had tested the app for 1 week. A detailed thematic analysis was undertaken. The first theme, "Functionality" referred to how users wanted an easy-to-use interface, with minimum required user-input. Poor functionality was considered a major usability barrier. The second theme, "Design" described how an aesthetic with minimum text, clearly distinguishable tabs and buttons and appealing infographics was integral to the level of usability. The final theme, "Content" described how participants wanted all aspects of the app to be automatically personalized to them, as well as providing them with opportunities to personalize the app themselves, with increased options for social connectivity. There are high demands for apps such as BRANCH that target skilled technology users including young adults. Key areas to optimize eSBI app development that emerged from testing BRANCH with representative users include high-quality functionality, appealing aesthetics, and improved personalization. ©Joanna Milward, Paolo Deluca, Colin Drummond, Rod Watson, Jacklyn Dunne, Andreas Kimerg

Assessment of diet and physical activity of brazilian schoolchildren: usability testing of a web-based questionnaire.

Science.gov (United States)

da Costa, Filipe Ferreira; Schmoelz, Camilie Pacheco; Davies, Vanessa Fernandes; Di Pietro, Patrícia Faria; Kupek, Emil; de Assis, Maria Alice Altenburg

2013-08-19

Information and communication technology (ICT) has been used with increasing frequency for the assessment of diet and physical activity in health surveys. A number of Web-based questionnaires have been developed for children and adolescents. However, their usability characteristics have scarcely been reported, despite their potential importance for improving the feasibility and validity of ICT-based methods. The objective of this study was to describe the usability evaluation of the Consumo Alimentar e Atividade Física de Escolares (CAAFE) questionnaire (Food Consumption and Physical Activity Questionnaire for schoolchildren), a new Web-based survey tool for the self-assessment of diet and physical activity by schoolchildren. A total of 114 schoolchildren aged 6 to 12 years took part in questionnaire usability testing carried out in computer classrooms at five elementary schools in the city of Florianopolis, Brazil. Schoolchildren used a personal computer (PC) equipped with software for recording what is on the computer screen and the children's speech during usability testing. Quantitative and qualitative analyses took into account objective usability metrics such as error counts and time to complete a task. Data on the main difficulties in accomplishing the task and the level of satisfaction expressed by the children were assessed by the observers using a standardized form and interviews with the children. Descriptive statistics and content analysis were used to summarize both the quantitative and the qualitative aspects of the data obtained. The mean time for completing the questionnaire was 13.7 minutes (SD 3.68). Compared to the children in 2nd or 3rd grades, those in 4th or 5th grades spent less time completing the questionnaire (median 12.4 vs 13.3 minutes, P=.022), asked for help less frequently (median 0 vs 1.0 count, P=.005), had a lower error count (median 2.0 vs 8.0 count, Pperformance score (median 73.0 vs 68.0, P=.005). Children with a PC at home

Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR.

Science.gov (United States)

Walji, Muhammad F; Kalenderian, Elsbeth; Piotrowski, Mark; Tran, Duong; Kookal, Krishna K; Tokede, Oluwabunmi; White, Joel M; Vaderhobli, Ram; Ramoni, Rachel; Stark, Paul C; Kimmes, Nicole S; Lagerweij, Maxim; Patel, Vimla L

2014-05-01

To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35). The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Health system guidance appraisal--concept evaluation and usability testing.

Science.gov (United States)

Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K

2016-01-05

Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final

The significance of a usability evaluation of an emerging laboratory order entry system

NARCIS (Netherlands)

Peute, Linda W. P.; Jaspers, Monique W. M.

2007-01-01

OBJECTIVES: To assess the usability of an emerging POE system, OM/Lab, for the computer-supported ordering of laboratory tests. We were more specifically interested in the relation of the usability problems detected in the user testing sessions with the order behaviour in terms of efficiency and

Usability laboratories at Philips : supporting research, development, and design for consumer and professional products

NARCIS (Netherlands)

Vries, de G.; Gelderen, van T.; Brigham, F.

1994-01-01

This paper describes two of the usability laboratories at Philips, discusses practical issues arising from our experience using the facilities, gives an example of a typical usability evaluation, and briefly outlines our vision for the future of the laboratories. Usability tests at Philips can

Direct Integration: Training Software Developers to Conduct Usability Evaluations

DEFF Research Database (Denmark)

Skov, Mikael B.; Stage, Jan

2008-01-01

is based on an empirical study where 36 teams with a total of 234 first-year university students on software development and design educations were trained in a simple approach for user-based website usability testing that was taught in a 40 hour course. This approach supported them in planning, conducting......Many improvements of the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both approaches involve...... a complete division of work between developers and evaluators, which is an undesirable complexity for many software development projects. This paper takes a different approach by exploring to what extent software developers and designers can be trained to carry out their own usability evaluations. The paper...

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

Science.gov (United States)

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability

Development and usability testing of a web-based decision support for users and health professionals in psychiatric services.

Science.gov (United States)

Grim, Katarina; Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin

2017-09-01

Shared decision making (SMD) related to treatment and rehabilitation is considered a central component in recovery-oriented practice. Although decision aids are regarded as an essential component for successfully implementing SDM, these aids are often lacking within psychiatric services. The aim of this study was to use a participatory design to facilitate the development of a user-generated, web-based decision aid for individuals receiving psychiatric services. The results of this effort as well as the lessons learned during the development and usability processes are reported. The participatory design included 4 iterative cycles of development. Various qualitative methods for data collection were used with potential end users participating as informants in focus group and individual interviews and as usability and pilot testers. Interviewing and testing identified usability problems that then led to refinements and making the subsequent prototypes increasingly user-friendly and relevant. In each phase of the process, feedback from potential end-users provided guidance in developing the formation of the web-based decision aid that strengthens the position of users by integrating access to information regarding alternative supports, interactivity between staff and users, and user preferences as a continual focus in the tool. This web-based decision aid has the potential to strengthen service users' experience of self-efficacy and control as well as provide staff access to user knowledge and preferences. Studies employing participatory models focusing on usability have potential to significantly contribute to the development and implementation of tools that reflect user perspectives. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Evaluating Distributed Usability: the role of user interfaces in an activity system

Directory of Open Access Journals (Sweden)

Lejla Vrazalic

2003-11-01

Full Text Available Traditional definitions of usability localise this fundamental Human Computer Interaction (HCI concept in the user interface and reduce it to a variety of qualitative and quantitative attributes of the computer system. This simplistic view of usability has been used as the basis for developing design and evaluation methods in the discipline. This paper argues that, as a result, HCI methods are ineffective and suffer from various shortcomings. It is proposed that the notion of usability must be extended to include contextual factors, and viewed as being distributed across an activity system. Adopting this notion of distributed usability then requires a review of existing HCI methods. Usability testing, as a complete and self-contained HCI method, was chosen for this purpose, and the result, a distributed usability evaluation method (DUEM, is presented in this paper.

Digital Resource Exchange About Music (DREAM): Phase 2 Usability Testing

Science.gov (United States)

Upitis, Rena; Boese, Karen; Abrami, Philip C.; Anwar, Zaeem

2015-01-01

The Digital Resource Exchange About Music (DREAM) is a virtual space for exchanging information about digital learning tools. The purpose of the present study was to determine how users responded to DREAM in the first four months after its public release. This study is the second phase of usability research on DREAM, and was conducted to guide…

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

Science.gov (United States)

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Seeing Double at Memorial University: Two WorldCat Local Usability Studies

Directory of Open Access Journals (Sweden)

Sue Fahey

2011-11-01

Full Text Available Obtaining user feedback is valuable yet often overlooked, so when Memorial University Libraries launched OCLC’s WorldCat Local discovery tool for Fall 2010, usability testing was a logical next step. Two branches, each with distinct user groups, the Ferriss Hodgett Library in Corner Brook, and the Health Sciences Library in St. John’s, conducted unique usability studies to gain evidence into how WorldCat Local performed common research tasks. The Health Sciences Library was inspired by the information seeking habits of Memorial University’s Faculty of Medicine, School of Nursing, and School of Pharmacy. This demographic’s heavy reliance on journal literature, and known item searching made these users an interesting test group. The Ferriss Hodgett Library, serving an undergraduate Liberal Arts and Sciences population, was interested in the information seeking behavior of new students with little to no experience using library resources. At the local level, evidence obtained as a result of this usability testing will provide guidance into future use of WCL at Memorial University Libraries. On a broader scale, the usability findings are relevant to any library considering the shift to a new discovery tool.

Software architecture analysis of usability

NARCIS (Netherlands)

Folmer, Eelke

2005-01-01

One of the qualities that has received increased attention in recent decades is usability. A software product with poor usability is likely to fail in a highly competitive market; therefore software developing organizations are paying more and more attention to ensuring the usability of their

The evaluator effect in usability studies: Problem detection and severity judgments

DEFF Research Database (Denmark)

Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

1998-01-01

Usability studies are commonly used in industry and applied in research as a yardstick for other usability evaluation methods. Though usability studies have been studied extensively, one potential threat to their reliability has been left virtually untouched: the evaluator effect. In this study......, four evaluators individually analyzed four videotaped usability test sessions. Only 20% of the 93 detected problems were detected by all evaluators, and 46% were detected by only a single evaluator. From the total set of 93 problems the evaluators individually selected the ten problems they considered...... most severe. None of the selected severe problems appeared on all four evaluators’ top-10 lists, and 4 of the 11 problems that were considered severe by more than one evaluator were only detected by one or two evaluators. Thus, both detection of usability problems and selection of the most severe...

76 FR 18348 - Required Scale Tests

Science.gov (United States)

2011-04-04

... RIN 0580-AB10 Required Scale Tests AGENCY: Grain Inspection, Packers and Stockyards Administration... published a document in the Federal Register on January 20, 2011 (76 FR 3485), defining required scale tests... the last sentence of paragraph (a) to read as follows: Sec. 201.72 Scales; testing of. (a...

Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users

DEFF Research Database (Denmark)

Rømen, Dagfinn; Svanæs, Dag

2012-01-01

) and a control group (N = 6), it was found that only 27% of the identified website accessibility problems could have been identified through the use of WCAG 1.0. A similar analysis of conformance to WCAG 2.0 showed a marginal 5% improvement concerning identified website accessibility problems. Compensating...... accessibility evaluations and guidelines in many countries. WCAG version 2.0 was released in 2008. This paper reports on a study that empirically validated the usefulness of using WCAG as a heuristic for website accessibility. Through controlled usability tests of two websites with disabled users (N = 7...... for the low number of test subjects with confidence tests gave results that were still low (42% for WCAG 1.0 and 49% for WCAG 2.0, with 95% confidence). It is concluded from this that the application of WAI accessibility guidelines is not sufficient to guarantee website accessibility. It is recommended...

Brief Report: Web-based Management of Adolescent Chronic Pain: Development and Usability Testing of an Online Family Cognitive Behavioral Therapy Program

Science.gov (United States)

Palermo, Tonya M.

2009-01-01

Objectives This study evaluates the usability and feasibility of a Web-based intervention (Web-MAP) to deliver cognitive behavioral therapy (CBT) to adolescents with chronic pain and their parents. Methods The Web site was evaluated in two stages. In stage one, recovered adolescents and parents (n = 5 dyads), who had completed office-based CBT through a pediatric pain management clinic, completed ratings of Web site content, usability, appearance, and theme. In stage two, treatment-seeking adolescents and their parents (n = 6 dyads) completed the full-length Web program. Program usage data were obtained to assess interaction with the Web site. Results Participants rated moderate to strong acceptability of the program. Usage data indicated that participants interacted with the site and used communication features. Conclusions Feedback from usability testing provided important information in the process of designing a feasible Web-based treatment for adolescents with chronic pain for use in a randomized controlled trial. PMID:18669578

Responsibilities in the Usability Requirements Elicitation Process

Directory of Open Access Journals (Sweden)

Marianella Aveledo

2008-12-01

Full Text Available Like any other software system quality attribute, usability places requirements on software components. In particular, it has been demonstrated that certain usability features have a direct impact throughout the software process. This paper details an approach that looks at how to deal with certain usability features in the early software development stages. In particular, we consider usability features as functional usability requirements using patterns that have been termed usability patterns to elicit requirements. Additionally, we clearly establish the responsibilities of all the players at the usability requirements elicitation stage.

Mapping Disease Data: A Usability Test of an Internet-Based System of Disease Status Disclosure

Directory of Open Access Journals (Sweden)

Gareth Enticott

2018-01-01

Full Text Available Disease maps are important tools in the management of disease. By communicating risk, disease maps can help raise awareness of disease and encourage farmers and veterinarians to employ best practice to eliminate the spread of disease. However, despite the importance of disease maps in communicating risk and the existence of various online disease maps, there are few studies that explicitly examine their usability. Where disease maps are complicated to use, it seems that they are unlikely to be used effectively. The paper outlines an attempt to create an open access, online, searchable map of incidents of bovine tuberculosis in England and Wales, and analyzes its usability among veterinarians. The paper describes the process of creating the map before describing the results of a series of usability trials. Results show the map to score highly on different measures of usability. However, the trials also revealed a number of social and technical limitations and challenges facing the use of online disease maps, including reputational dangers, role confusion, data accuracy, and data representation. The paper considers the challenges facing disease maps and their potential role in designing new methodologies to evaluate the effectiveness of disease prevention initiatives.

Commentary: Usability – A Sensitizing Concept

DEFF Research Database (Denmark)

Hertzum, Morten

2018-01-01

In his article “The Usability Construct: A Dead End?”, Tractinsky (in Human-Computer Interaction) contends that for scientific research on usability to progress, the usability construct should be unbundled and replaced by well-defined constructs. This contention is presented as the conclusion...... that follows naturally from taking a scientist’s viewpoint on usability. Similar calls for definitive concepts – constructs in Tractinsky’s terminology – have been made in other scientific fields with concepts as ambiguous as that of usability. But counterarguments have also been presented....

The Usability Analysis of An E-Learning Environment

Directory of Open Access Journals (Sweden)

Fulya TORUN

2015-10-01

Full Text Available In this research, an E-learning environment is developed for the teacher candidates taking the course on Scientific Research Methods. The course contents were adapted to one of the constructivist approach models referred to as 5E, and an expert opinion was received for the compliance of this model. An usability analysis was also performed to determine the usability of the e-learning environment. The participants of the research comprised 42 teacher candidates. The mixed method was used in the research. 3 different data collection tools were used in order to measure the three basic concepts of usability analyses, which are the dimensions of effectiveness, efficiency and satisfaction. Two of the data collection tools were the scales developed by different researchers and were applied with the approval received from the researchers involved. On the other hand, the usability test as another data tool was prepared by the researchers who conducted this study for the purpose of determining the participants’ success in handling the twelve tasks assigned to them with respect to the use of elearning environment, the seconds they spent on that environment and the number of clicks they performed. Considering the results of the analyses performed within the data obtained, the usability of the developed e-learning environment proved to be at a higher rate.

Analysis in usability evaluations

DEFF Research Database (Denmark)

Følstad, Asbjørn; Lai-Chong Law, Effie; Hornbæk, Kasper

2010-01-01

While the planning and implementation of usability evaluations are well described in the literature, the analysis of the evaluation data is not. We present interviews with 11 usability professionals on how they conduct analysis, describing the resources, collaboration, creation of recommendations......, and prioritization involved. The interviews indicate a lack of structure in the analysis process and suggest activities, such as generating recommendations, that are unsupported by existing methods. We discuss how to better support analysis, and propose four themes for future research on analysis in usability...

Finding online health-related information: usability issues of health portals.

Science.gov (United States)

Gurel Koybasi, Nergis A; Cagiltay, Kursat

2012-01-01

As Internet and computers become widespread, health portals offering online health-related information become more popular. The most important point for health portals is presenting reliable and valid information. Besides, portal needs to be usable to be able to serve information to users effectively. This study aims to determine usability issues emerging when health-related information is searched on a health portal. User-based usability tests are conducted and eye movement analyses are used in addition to traditional performance measures. Results revealed that users prefer systematic, simple and consistent designs offering interactive tools. Moreover, content and partitions needs to be shaped according to the medical knowledge of target users.

Mobile Usability

DEFF Research Database (Denmark)

Aryana, Bijan; Clemmensen, Torkil

2013-01-01

In this article, a country specific comparative mobile usability study is presented, using Iran and Turkey as the two chosen emerging/emergent nation exemplars of smartphone usage and adoption. In a focus group study, three mobile applications were selected by first-time users of smartphones...... personal contacts. The results and analysis establish the existence of country specific issues and concerns, as well as reveal generic usability issues. The article concludes that the source of these issues is most likely due to a combination of certain contextual features endemic to both Iran and Turkey...

The STEP database through the end-users eyes--USABILITY STUDY.

Science.gov (United States)

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

A Usability Evaluation Model for Academic Library Websites: Efficiency, Effectiveness and Learnability

Directory of Open Access Journals (Sweden)

Soohyung Joo

2011-12-01

Full Text Available Purpose – This paper aimed to develop a usability evaluation model and associated survey tool in the context of academic libraries. This study not only proposed a usability evaluation model but also a practical survey tool tailored to academic library websites. Design/methodology – A usability evaluation model has been developed for academic library websites based on literature review and expert consultation. Then, the authors verified the reliability and validity of the usability evaluation model empirically using the survey data from actual users. Statistical analysis, such as descriptive statistics, internal consistency test, and a factor analysis, were applied to ensure both the reliability and validity of the usability evaluation tool. Findings – From the document analysis and expert consultation, this study identified eighteen measurement items to survey the three constructs of the usability, effectiveness, efficiency, and learnability, in academic library websites. The evaluation tool was then validated with regard to data distribution, reliability, and validity. The empirical examination based on 147 actual user responses proved the survey evaluation tool suggested herein is acceptable in assessing academic library website usability. Originality/Value – This research is one of the few studies to engender a practical survey tool in evaluating library website usability. The usability model and corresponding survey tool would be useful for librarians and library administrators in academic libraries who plan to conduct a usability evaluation involving large sample.

Establishing best practices to improve usability of web interfaces providing atmospheric data

Science.gov (United States)

Oakley, N.; Daudert, B.

2014-12-01

Accessing scientific data through an online portal can be a frustrating task. The concept of making web interfaces easy to use known as "usability" has been thoroughly researched in the field of e-commerce but has not been explicitly addressed in the atmospheric sciences. As more observation stations are installed, satellite missions flown, models run, and field campaigns performed, large amounts of data are produced. Portals on the Internet have become the favored mechanisms to share this information and are ever increasing in number. Portals are often created without being tested for usability with the target audience though the expenses of testing are low and the returns high. To remain competitive and relevant in the provision of atmospheric data, it is imperative that developers understand design elements of a successful portal to make their product stand out among others. This presentation informs the audience of the benefits and basic principles of usability for web pages presenting atmospheric data. We will also share some of the best practices and recommendations we have formulated from the results of usability testing performed on two data provision web sites hosted by the Western Regional Climate Center.

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

Science.gov (United States)

Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J

2013-01-01

Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

Science.gov (United States)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

NA48/2 final results on charged semileptonic kaon decays and $|V_{(us)}|$, NA48 measurements of the $K\\mu3$ form factors from $K_{L}$ decays

CERN Document Server

Dabrowski , A

2007-01-01

Measured ratios of decay rates for $\\Re_{Ke3/K2π}, \\Re_{K\\mu3/K2\\pi}$ and $\\Re_{K\\mu 3/Ke3}$ are presented, based on $K^{\\pm}$ decays collected in a dedicated run in 2003 by the NA48/2 experiment at CERN. The results obtained are $\\Re_{Ke3/K2\\pi} = 0.2470 \\pm 0.0009_{stat} \\pm 0.0004_{syst}$ and $\\Re_{K\\mu3/K2\\pi} = 0.1637 \\pm 0.0006_{stat} \\pm 0.0003_{syst}$. Using the PDG average for the $K^{\\pm} \\rightarrow \\pi^{\\pm}\\pi^{0}$ normalisation mode, both values are found to be larger than the current values given by the Particle Data Book [1] and lead to a larger magnitude of the $|V_{us}|$ element in the CabibboKobayashi-Maskawa (CKM) matrix than previously accepted. When combined with the latest Particle Data Book value of $|V_{ud}|$[1], the result is in agreement with unitarity of the CKM matrix. In addition, a new measured value of $Re_{K\\mu3/K2\\pi} = 0.663 \\pm 0.003_{stat} \\pm 0.001_{syst}$ is compared to the semi-empirical predictions based on the latest form factor measurements. The $K\\mu 3$ form factor...

Usability principles to design mobile workplace learning content

Directory of Open Access Journals (Sweden)

Alessia Messuti

2015-04-01

Full Text Available The article describes the design of a mobile workplace learning tool for trainers of the International Training Centre of the International Labour Organization. The motivation behind is to provide trainers with a practical tool that will enable them to recall information at the moment of need and continue to learn in context. On this purpose a set of visual augmented reality cards was created, taking into consideration the fundamental mobile learning and usability principles. The nature of the article is empirical as it reports an experiment carried out with trainers which aimed at testing cards usability and learnability. Results show that the integration of both online and offline strategies was perceived as an added value as trainers could choose to retrieve information as they mostly like; finally, it also resulted in high usability scores, an aspect that contributes to their effectiveness at the workplace.

Usability in Scientific Databases

Directory of Open Access Journals (Sweden)

Ana-Maria Suduc

2012-07-01

Full Text Available Usability, most often defined as the ease of use and acceptability of a system, affects the users' performance and their job satisfaction when working with a machine. Therefore, usability is a very important aspect which must be considered in the process of a system development. The paper presents several numerical data related to the history of the scientific research of the usability of information systems, as it is viewed in the information provided by three important scientific databases, Science Direct, ACM Digital Library and IEEE Xplore Digital Library, at different queries related to this field.

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

Science.gov (United States)

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

Usability evaluation of mobile applications; where do we stand?

Science.gov (United States)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

Science.gov (United States)

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Einleitung

Science.gov (United States)

Herrmann, Christoph

Veränderungen unserer Umwelt, wie z.B. die Globalisierung und Dynamisierung der Absatz- und Beschaffungsmärkte, führen zu einer steigenden Komplexität in unternehmerischen Entscheidungssituationen. Die Dynamik der Veränderungen erfordert eine immer schnellere Anpassung der Unternehmen an ihre Umwelt (Malik 2006). Die aktive Gestaltung dieser notwendigen Anpassungen in Form des unternehmerischen Wandels wird damit zu einer entscheidenden Fähigkeit von Unternehmen (Westkämper 2002). Insbesondere für kleine und mittlere Unternehmen (KMU) stellen die rasant steigenden Anforderungen an die Anpassungsfähigkeit - auch aufgrund vielschichtiger KMU-spezifischer Faktoren (wie z.B. eine fehlende oder nur lückenhaft formulierte Unternehmensstrategie, fehlende Methodenkompetenz, etc.) - die zentrale Herausforderung für die Zukunft dar. Da KMU in der Regel in die Zulieferketten größerer Unternehmen eingebunden sind, werden zudem die Anpassungsanforderungen der großen Unternehmen an die kleinen und mittleren Unternehmen weitergegeben. Erfolgt die Anpassung von KMU an die zeitlichen, qualitativen oder kostenbezogenen Anforderungen ihrer Kunden nur langsam oder in unzureichendem Maße, verlieren KMU im Verlaufe der Zeit ihre Wettbewerbs- und damit ihre Überlebensfähigkeit (Gomez u. Hahn 1994).

Software Development and Feedback from Usability Evaluations

DEFF Research Database (Denmark)

Høegh, Rune Thaarup

2008-01-01

This paper presents a study of the strengths and weaknesses of written, multimedia and oral feedback from usability evaluations to developers. The strengths and weaknesses are related to how well the feedback supports the developers in addressing usability problems in a software system. The study...... concludes that using the traditional written usability report, as the only form of feedback from usability evaluations is associated with problems related to the report not supporting the process of addressing the usability problems. The report is criticized for representing an overwhelming amount...... of information, while still not offering the required information to address usability problems. Other forms of feedback, such as oral or multimedia feedback helps the developer in understanding the usability problems better, but are on the other hand less cost-effective than a written description....

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

Science.gov (United States)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Methods uncovering usability issues in medication-related alerting functions: results from a systematic review.

Science.gov (United States)

Marcilly, Romaric; Vasseur, Francis; Ammenwerth, Elske; Beuscart-Zephir, Marie-Catherine

2014-01-01

This paper aims at listing the methods used to evaluate the usability of medication-related alerting functions and at knowing what type of usability issues those methods allow to detect. A sub-analysis of data from this systematic review has been performed. Methods applied in the included papers were collected. Then, included papers were sorted in four types of evaluation: "expert evaluation", "user- testing/simulation", "on site observation" and "impact studies". The types of usability issues (usability flaws, usage problems and negative outcomes) uncovered by those evaluations were analyzed. Results show that a large set of methods are used. The largest proportion of papers uses "on site observation" evaluation. This is the only evaluation type for which every kind of usability flaws, usage problems and outcomes are detected. It is somehow surprising that, in a usability systematic review, most of the papers included use a method that is not often presented as a usability method. Results are discussed about the opportunity to provide usability information collected after the implementation of the technology during their design process, i.e. before their implementation.

Does Usability Matter? An Analysis of the Impact of Usability on Technology Acceptance in ERP Settings

Directory of Open Access Journals (Sweden)

Brenda M Scholtz

2016-11-01

Full Text Available Though the field of management information systems, as a sector and a discipline, is the inventor of many guidelines and models, it appears to be a slow runner on practical implications of interface usability. This usability can influence end users’ attitude and behavior to use IT. The purpose of this paper was to examine the interface usability of a popular Enterprise Resource Planning (ERP software system, SAP, and to identify related issues and implications to the Technology Acceptance Model (TAM. A survey was conducted of 112 SAP ERP users from an organization in the heavy metal industry in Bangladesh. The partial least squares technique was used to analyze the survey data. The survey findings empirically confirmed that interface usability has a significant impact on users’ perceptions of usefulness and ease of use which ultimately affects attitudes and intention to use the ERP software. The research model extends the TAM by incorporating three criteria of interface usability. It is the first known study to investigate usability criteria as an extension of TAM.

Developer Driven and User Driven Usability Evaluations

DEFF Research Database (Denmark)

Bruun, Anders

2013-01-01

Usability evaluation provide software development teams with insights on the degree to which a software application enables a user to achieve his/her goals, how fast these goals can be achieved, how easy it is to learn and how satisfactory it is in use Although usability evaluations are crucial...... in the process of developing software systems with a high level of usability, its use is still limited in the context of small software development companies. Several approaches have been proposed to support software development practitioners (SWPs) in conducting usability evaluations, and my thesis explores two...... of these: 1) The first approach is to support SWPs by training them to drive usability evaluations. 2) The second approach to support SWPs involves minimalist training of end users to drive usability evaluations. In related work, a set of five quality criteria for usability evaluations is applied...

A Cross-Cultural Study of How Usability Professionals Experience the Usability of Everyday Systems

DEFF Research Database (Denmark)

Jiang, Y.; Sun, X.; Li, H.

2009-01-01

in the study, their understanding of fun systems differs across cultural backgrounds. Also, easy-to-use and useful systems are perceived as being similar or different depending on the usability professional’s cultural background. Most other cross-cultural differences relate to categories of construct......Culture influences many aspects of the design and use of computer systems; understanding better this influence on their own thinking may benefit usability professionals who do cross-cultural usability work. Using Kelly’s notion of personal constructs, we focus on one mediator of culture: how...

Usable security history, themes, and challenges

CERN Document Server

Garfinkel, Simson

2014-01-01

There has been roughly 15 years of research into approaches for aligning research in Human Computer Interaction with computer Security, more colloquially known as ``usable security.'' Although usability and security were once thought to be inherently antagonistic, today there is wide consensus that systems that are not usable will inevitably suffer security failures when they are deployed into the real world. Only by simultaneously addressing both usability and security concerns will we be able to build systems that are truly secure. This book presents the historical context of the work to dat

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

Science.gov (United States)

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

An Intelligent Framework for Website Usability

Directory of Open Access Journals (Sweden)

Alexiei Dingli

2014-01-01

Full Text Available With the major advances of the Internet throughout the past couple of years, websites have come to play a central role in the modern marketing business program. However, simply owning a website is not enough for a business to prosper on the Web. Indeed, it is the level of usability of a website that determines if a user stays or abandons it for another competing one. It is therefore crucial to understand the importance of usability on the web, and consequently the need for its evaluation. Nonetheless, there exist a number of obstacles preventing software organizations from successfully applying sound website usability evaluation strategies in practice. From this point of view automation of the latter is extremely beneficial, which not only assists designers in creating more usable websites, but also enhances the Internet users’ experience on the Web and increases their level of satisfaction. As a means of addressing this problem, an Intelligent Usability Evaluation (IUE tool is proposed that automates the usability evaluation process by employing a Heuristic Evaluation technique in an intelligent manner through the adoption of several research-based AI methods. Experimental results show there exists a high correlation between the tool and human annotators when identifying the considered usability violations.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

Science.gov (United States)

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development

Managing Product Usability: How companies deal with usability in the development of electronic consumer products

OpenAIRE

Van Kuijk, J.I.

2010-01-01

Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. That the usability of electronic consumer products is under pressure is attributed to an incre...

An extended protocol for usability validation of medical devices : Research design and reference model

NARCIS (Netherlands)

Schmettow, M.; Schnittker, R.; Schraagen, J.M.

2017-01-01

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences

Problem Prioritization in Usability Evaluation:

DEFF Research Database (Denmark)

Hertzum, Morten

2006-01-01

Severity assessments enable prioritization of problems encountered during usability evaluations and thereby provide a device for guiding the utilization of design resources. However, designers' response to usability evaluations is also influenced by other factors, which may overshadow severity....... With the purpose of enhancing the impact of severity assessments, this study combines a field study of factors that influence the impact of evaluations with an experimental study of severity assessments made during usability inspections. The results show that even in a project receptive to input from evaluations...... their impact was highly dependent on conducting evaluations early. This accorded with an informal method that blended elements of usability evaluation and participatory design and could be extended with user-made severity assessments. The major cost associated with the evaluations was not finding but fixing...

Neuroanatomical correlates of perceived usability

DEFF Research Database (Denmark)

Vi, Chi Thanh; Hornbæk, Kasper; Subramanian, Sriram

2017-01-01

Usability has a distinct subjective component, yet surprisingly little is known about its neural basis and relation to the neuroanatomy of aesthetics. To begin closing this gap, we conducted two functional magnetic resonance imaging studies in which participants were shown static webpages (in...... the first study) and videos of interaction with webpages (in the second study). The webpages were controlled so as to exhibit high and low levels of perceived usability and perceived aesthetics. Our results show unique links between perceived usability and brain areas involved in functions such as emotional...... processing (left fusiform gyrus, superior frontal gyrus), anticipation of physical interaction (precentral gyrus), task intention (anterior cingulate cortex), and linguistic processing (medial and bilateral superior frontal gyri). We use these findings to discuss the brain correlates of perceived usability...

Usability evaluation of healthcare information systems: comparison of methods and classification of usability problems

NARCIS (Netherlands)

Khajouei, R.

2011-01-01

In ziekenhuizen wordt steeds meer gebruik gemaakt van informatiesystemen, maar de usability laat vaak te wensen over. Reza Khajouei testte twee methodes om de usability te beoordelen. Hij constateert dat beide methoden ongeveer evenveel, maar verschillende problemen aan het licht brengen. Uit een

Supporting Usability Engineering in Small Software Development Organizations

DEFF Research Database (Denmark)

Bornoe, Nis; Stage, Jan

2013-01-01

Despite an interest and use of different usability engineering methods small software development organizations find it challenging to implement usability engineering into the software development process. We present the results from a study about usability engineering in practice. Through a series...... of semistructured interviews we want to get an understanding of how usability is implemented into the organizations and how it’s practiced in reality. We found that the developers found it problematic to combine agile software development methods with classic usability engineering methods. A lack of solid usability...... engineering expertise and not least experience seems to be a main obstacle for a successful implementation of usability engineering into current software development practices. They are requesting methods and procedures that fit better with their current practices and strategies to implement usability...

Usability testing of e-learning: an approach incorporating co-discovery and think-aloud

CSIR Research Space (South Africa)

Adebesin, TF

2009-06-01

Full Text Available Computer applications developed to support learning in the cognitive domains are quite different from commercial transaction processing applications. The unique nature of such applications calls for different methods for evaluating their usability...

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

Science.gov (United States)

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

Advancing Usability Evaluation through Human Reliability Analysis

International Nuclear Information System (INIS)

Ronald L. Boring; David I. Gertman

2005-01-01

This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probability of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues

Usability of Optical Mark Reader Sheet as an Answering Tool in Testing.

Science.gov (United States)

Booka, Masayuki; Oku, Hidehisa; Scheller, Andreas; Yamaoka, Shintaro

2017-01-01

The research result on usability of Optical Mark Reader Sheet (OMRS) being used as the standard answering tool is reported. The use of OMRS significantly requires more answer time than the answer time without OMRS, and the use of assistive devices for OMRS has the possibility to reduce the answer time.

Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis.

Science.gov (United States)

Ferron, Joelle C; Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J

2017-03-03

Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly-66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. ©Joelle C Ferron, Mary F Brunette, Pamela Geiger, Lisa A Marsch, Anna M Adachi-Mejia, Stephen J Bartels. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 03.03.2017.

Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record.

Science.gov (United States)

Chrimes, Dillon; Kitos, Nicole R; Kushniruk, Andre; Mann, Devin M

2014-09-01

Usability testing can be used to evaluate human-computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a way to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in "live" clinical workflow or whether a tool is successful. Therefore, "Near-live" clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved "think-aloud" protocol analysis of eight primary care providers interacting with several scripted clinical scenarios. Phase II used "near-live" clinical simulations of five providers interacting with standardized

Integrated System Validation Usability Questionnaire: Computerized Procedures

International Nuclear Information System (INIS)

Garcés, Ma. I.; Torralba, B.

2015-01-01

The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to operating procedures, both computer and paper-based, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed, the models used by the nuclear industry and their technical support organizations, mainly, the Electric Power Research Institute, EPRI, are analyzed, and scientist advances are also explored. In the remaining stages, general and specific guidelines for computerized and paper-based procedures are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMLAB.

Assessment of the Usability of the Workbench Faraday Cage Method

DEFF Research Database (Denmark)

Sørensen, Morten; Franek, Ondrej; Christensen, Søren K.

2011-01-01

The workbench Faraday Cage method (WBFC) is a time efficient module pre-compliance test regarding radiated emission. This work investigates the method’s usability and credibility and concludes that for this particular case the WBFC perform a tolerable compliance test for frequencies below 360 MHz...

Determining Reliability and Validity of the Persian Version of Software Usability Measurements Inventory (SUMI) Questionnaire

OpenAIRE

seyed abolfazl zakerian; Roya Azizi; Mehdi Rahgozar

2013-01-01

The term usability refers to a special index for success of an operating system. This study aimed to determine the reliability and validity of the Software Usability Measurements Inventory (SUMI) questionnaire as one of the valid and common questionnaires about usability evaluation. The back translation method was used to translate the questionnaire from English to Persian back to English. Moreover, repeatability or test-retest reliability was practically used to determine the reliability of ...

Usability and Interaction Design in West Africa

DEFF Research Database (Denmark)

Sørensen, Jannick Kirk

Good usability is important in all ICT solutions. To achieve good usability, a good praxis for interaction design is needed. Usability and interaction design have however emerged and established itself in a North European and US context. The ICT industry in Africa do not have the same resources...... for user-involvement and participatory design be directly transferred? How can interaction design and usability be cared for in African ICT development context, given the resources available? This paper aims to initiate a discussion of the conditions for interaction design and usability in West Africa...... in the field of interaction design as in the developed world. While good usability and good user experiences are important to all users of ICT, the question is whether the methods and techniques that were mainly developed in Scandinavia, Europe and US are suitable for ICT development in Africa? Can ideals...

Performance, usability and comparison of two versions of a new macular vision test: the handheld Radial Shape Discrimination test

Directory of Open Access Journals (Sweden)

Jae Y. Ku

2016-11-01

Full Text Available Background Central vision, critical for everyday tasks such as reading and driving, is impacted by age-related changes in the eye and by diseases such as age-related macular degeneration. The detection of changes in macular function is therefore important. The Radial Shape Discrimination (RSD test measures the threshold at which distortions in a radial frequency pattern can be detected and there is evidence that it is more sensitive to macular pathology than visual acuity (VA. It also provides a more quantitative measure of macular function than the commonly available Amsler grid. Recently, handheld versions of the test (hRSD in which stimuli are presented on mobile devices (e.g., Apple iPod Touch, iPhone have been developed. We investigated the characteristics of the hRSD test in healthy participants. Methods Data were collected using both three-alternative forced choice (3AFC and 4AFC versions of the hRSD test, presented on an Apple iPod Touch. For the 3AFC version, data from a single test session were available for 186 (72 male; mean ± SD age 42 ± 17y; range 16–90y healthy participants. Test-retest data were available for subgroups of participants (intra-session: N = 74; tests approximately 2 months apart: N = 30; tests 39 months apart: N = 15. The 3AFC and 4AFC versions were directly compared in 106 participants who also completed a usability questionnaire. Distance and near VA and Pelli Robson Contrast Sensitivity (CS data were collected and undilated fundoscopy performed on the majority of participants. Results Mean (±SD 3AFC hRSD threshold was −0.77 ± 0.14 logMAR, and was statistically significantly correlated with age (Pearson r = 0.35; p < 0.001. The linear regression of hRSD threshold on age had a slope of +0.0026 compared to +0.0051 for near VA (which also correlated with age: r = 0.51; p < 0.001. There were no statistically significant differences in hRSD thresholds for any of the test-retest subgroups. We

Understanding Usability Work as a Human Activity

DEFF Research Database (Denmark)

Nørgaard, Mie

Three core themes are explored in eight papers: Usability work as a human activity, usability practice and methods, and persuasiveness of evaluation results and feedback. We explore how usability work is much more than methods and work procedures, and argue that maturing our understanding...

Course management systems from a usability perspective

CSIR Research Space (South Africa)

Padayachee, I

2011-01-01

Full Text Available (with knowledge of usability engineering and system domain knowledge) who inspect the Indira Padayachee, Paula Kotz? and Alta van der Merwe 302 interface and determine its compliance with recognized usability principles (the ?heuristics... presents a summary of the results of the severity rating. Table 2: Severity Rating Scale for Usability Problems (Nielsen 2007b) 0 I don?t agree that this is a usability problem at all 1 Cosmetic problem only: need not be fixed unless there is extra...

Usability Problems in a Home Telemedicine System

DEFF Research Database (Denmark)

Bruun, Anders; Stage, Jan

2010-01-01

a high level of usability in order to enable their users to employ the required functionality, especially if the target user group is elderly people. This paper reports from a usability evaluation of a home telemedicine system. Five elderly persons carried out specified tasks with the system, and based...... on that we identified usability problems with the system. The problems are presented, analysed in relation to 12 different usability themes and related to results from other evaluations of similar systems....

Software architecture analysis of usability

NARCIS (Netherlands)

Folmer, E; van Gurp, J; Bosch, J; Bastide, R; Palanque, P; Roth, J

2005-01-01

Studies of software engineering projects show that a large number of usability related change requests are made after its deployment. Fixing usability problems during the later stages of development often proves to be costly, since many of the necessary changes require changes to the system that

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

Science.gov (United States)

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Increasing the impact of usability work in software development

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias; Frøkjær, Erik

2006-01-01

Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop......Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop...

Towards Evidence Based Usability in Health Informatics?

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda W.; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W.

2015-01-01

In a Health Information Technology (HIT) regulatory context in which the usability of this technology is more and more a critical issue, there is an increasing need for evidence based usability practice. However, a clear definition of evidence based usability practice and how to achieve it is still

Usability and User Experience Information in Reviews

DEFF Research Database (Denmark)

Hedegaard, Steffen

future versions of the prod- uct? The results show that users write about product use in terms related to standard and popularly researched aspects of usability and user experience, e.g. effiiency, effectiveness, enjoyment, frustration. The frequency with which different aspects are depicted in reviews...... differs significantly between product domains. We also find that reviews contain descriptions of more persistent usability issues. I devise automatic methods for classifying sentences with regard to dimensions of both usability and user experience and usability problems and perform a linguistic analysis...

Usability Evaluation in a Digitally Emerging Country

DEFF Research Database (Denmark)

Lizano, Fulvio; Sandoval, Maria Marta; Bruun, Anders

2013-01-01

Several emerging countries experience increasing software development activities. With the purpose of provide useful feedback on possible courses of action for increasing application of usability evaluation in such countries, this paper explores the status of usability evaluation in a digitally...... emerging country. Our aim is to identifying common characteristics or behavioral patterns that could be compared with digitally advanced countries. We used an online survey answered by 26 software development organizations, which gave a snapshot of the application of usability evaluation...... in these organizations. We found many similarities with advanced countries, several completely new obstacles more connected with software development matters and a relatively positive improvement in the lack of “usability culture”. These findings suggest good conditions to improve conduction of usability evaluations...

Managing Product Usability : How companies deal with usability in the development of electronic consumer products

NARCIS (Netherlands)

Van Kuijk, J.I.

2010-01-01

Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to

A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments.

Science.gov (United States)

Shin, Joon-Ho; Ryu, Hokyoung; Jang, Seong Ho

2014-03-06

Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy. A participatory design and usability tests were carried out for development of RehabMaster with representative user groups. Two clinical trials were then performed. The first was an observational study in which seven patients with chronic stroke received 30 minutes of RehabMaster intervention per day for two weeks. The second was a randomised controlled trial of 16 patients with acute or subacute stroke who received 10 sessions of conventional occupational therapy only (OT-only group) or conventional occupational therapy plus 20 minutes of RehabMaster intervention (RehabMaster + OT group). The Fugl-Meyer Assessment score (FMA), modified Barthel Index (MBI), adverse effects, and drop-out rate were recorded. The requirements of a VR system for stroke rehabilitation were established and incorporated into RehabMaster. The reported advantages from the usability tests were improved attention, the immersive flow experience, and individualised intervention. The first clinical trial showed that the RehabMaster intervention improved the FMA (P = .03) and MBI (P = .04) across evaluation times. The second trial revealed that the addition of RehabMaster intervention tended to enhance the improvement in the FMA (P = .07) but did not affect the improvement in the MBI. One patient with chronic stroke left the trial, and no adverse effects were reported. The RehabMaster is a feasible and safe VR system for enhancing upper extremity function in patients with stroke.

Exploring the value of usability feedback formats

DEFF Research Database (Denmark)

Nørgaard, Mie; Hornbæk, Kasper Anders Søren

2009-01-01

The format used to present feedback from usability evaluations to developers affects whether problems are understood, accepted, and fixed. Yet, little research has investigated which formats are the most effective. We describe an explorative study where three developers assess 40 usability findings...... presented using five feedback formats. Our usability findings comprise 35 problems and 5 positive comments. Data suggest that feedback serves multiple purposes. Initially, feedback must convince developers about the relevance of a problem and convey an understanding of this. Feedback must next be easy...... working with the feedback to address the usability problems, there were no significant differences among the developers' ratings of the value of the different formats. This suggests that all of the formats may serve equally well as reminders in later stages of working with usability problems...

Tracing Impact in a Usability Improvement Process

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias; Frøkjær, Erik; Hornbæk, Kasper Anders Søren

2008-01-01

Analyzing usability improvement processes as they take place in real-life organizations is necessary to understand the practice of usability work. This paper describes a case study where the usability of an information system is improved and a relationship between the improvements...... and the evaluation efforts is established. Results show that evaluation techniques complemented each other by suggesting different kinds of usability improvement. Among the techniques applied, a combination of questionnaires and Metaphors of Human Thinking (MOT) showed the largest mean impact and MOT produced...... the largest number of impacts. Logging of real-life use of the system over 6 months indicated six aspects of improved usability, where significant differences among evaluation techniques were found. Concerning five of the six aspects Think Aloud evaluations and the above-mentioned combination of questionnaire...

A study in usability: redesigning a health sciences library's mobile site.

Science.gov (United States)

Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J

2012-01-01

A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC

Web Usability Policies/Standards/Guidelines Do Not Influence Practices at ARL Academic Libraries. A Review of: Chen, Yu‐Hui, Carol Anne Germain and Huahai Yang. “An Exploration into the Practices of Library Web Usability in ARL Academic Libraries.” Journal of the American Society for Information Science and Technology 60.5 (2009: 953‐68.

Directory of Open Access Journals (Sweden)

Shandra Protzko

2009-12-01

Full Text Available Objective – To survey the current status of Web usability Policies/Standards/Guidelines (PSGs found in academic libraries of the Association of Research Libraries (ARL. Researchers sought to investigate whether PSGs are in place, the levels of difficulty surrounding implementation, the impact of PSGs on design, testing, and resource allocation, and the relationship between ARL ranking and usability practice or PSGs.Design – Survey.Setting – North America.Subjects – Academic libraries of the ARL.Methods – An 18‐question survey consisting of multiple choice, Likert scale, and open‐ended questions was sent to all 113 ARL libraries in November 2007. Survey recipients were selected as the person in charge of Web site usability by visiting library Web sites and phone inquiry. The survey was concluded in January 2008 with a response rate of 74% (84 institutions. The researchers used t‐test to detect any difference in ARL library ranking between libraries with and without PSGs. Pair‐wise t‐tests were conducted to identify gaps in difficulty implementing PSGs. In addition, they used Pearson’s Correlation to investigate any significant correlations between variables such as ARL rank and resource allocation.Main Results – Of the 84 respondents, 34 (40% have general library Web PSGs and 25 (30% have specific usability PSGs; 41 (49% have at least one type of in‐library PSG. Of the 43 (51% libraries that do not have PSGs, 30 (36% are at universities with institutional Web usability PSGs; 26 (87% follow those guidelines. There was no statistically significant relationship between ARL ranking and PSG status (see Table 1. The authors asked about difficulty in implementing PSGs. Of the 32 libraries responding to a question about general library Web PSGs, most had slight or moderate difficulty. Twenty‐three libraries with specific usability PSGs identified difficulty levels; some had no difficulty, but a majority had moderate difficulty

Improving Public Relations Web Sites through Usability Research.

Science.gov (United States)

Hallahan, Kirk

2001-01-01

Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)

Distributed user interfaces usability and collaboration

CERN Document Server

Lozano, María D; Tesoriero, Ricardo; Penichet, Victor MR

2013-01-01

Written by international researchers in the field of Distributed User Interfaces (DUIs), this book brings together important contributions regarding collaboration and usability in Distributed User Interface settings. Throughout the thirteen chapters authors address key questions concerning how collaboration can be improved by using DUIs, including: in which situations a DUI is suitable to ease the collaboration among users; how usability standards can be used to evaluate the usability of systems based on DUIs; and accurately describe case studies and prototypes implementing these concerns

Evaluation of the Digital Alzheimer Center: Testing Usability and Usefulness of an Online Portal for Patients with Dementia and Their Carers.

Science.gov (United States)

Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W

2016-07-21

: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.

Start with an Hour a Week: Enhancing Usability at Wayne State University Libraries

Directory of Open Access Journals (Sweden)

Maria Nuccilli

2018-01-01

Full Text Available Instead of pursuing traditional testing methods, Discovery and Innovation at Wayne State University Libraries settled on an alternate path to user-centered design when redesigning our library website: running hour-long “guerrilla” usability tests each week for two semesters. The team found immediate successes with this simple, cost-effective method of usability testing, leading to similar redesign projects for other online resources. Emphasizing the importance of iterative design and continuous improvement, this article will detail the authors’ experience conducting short weekly tests, suggestions for institutions looking to begin similar testing programs, and low-stakes testing as a pathway to improved design for the library as a whole. In spring 2016, the Discovery and Innovation web team at Wayne State University Libraries began a redesign of our main library homepage, making the first major updates to the site since 2013. After launching the initial design, we wanted to improve the new website with feedback from real users, following Jakob Nielsen’s decades-old assertion that redesigning websites based on user feedback “can substantially improve usability” (Nielsen, 1993. Instead of using remote and large-scale testing options, we chose a lean, iterative approach, and committed to two semesters of brief, weekly “guerrilla” usability sessions with student users. Not only did this method produce powerful results, but its attainable, iterative approach ultimately led to an increased user focus beyond the library homepage. If you have an hour a week, a laptop, and at least one other colleague willing to help, you can start usability testing, guerrilla-style. Though we found success with this method, using such a stripped-down approach wasn’t immediately obvious. At the beginning of this project, we didn’t know a whole lot about conducting user testing, having relied mostly on survey responses, search logs, and Piwik website

Nurses' perceptions and problems in the usability of a medication safety app.

Science.gov (United States)

Ankem, Kalyani; Cho, Sookyung; Simpson, Diana

2017-10-16

The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.

Usability testing of a respiratory interface using computer screen and facial expressions videos.

Science.gov (United States)

Oliveira, Ana; Pinho, Cátia; Monteiro, Sandra; Marcos, Ana; Marques, Alda

2013-12-01

Computer screen videos (CSVs) and users' facial expressions videos (FEVs) are recommended to evaluate systems performance. However, software combining both methods is often non-accessible in clinical research fields. The Observer-XT software is commonly used for clinical research to assess human behaviours. Thus, this study reports on the combination of CSVs and FEVs, to evaluate a graphical user interface (GUI). Eight physiotherapists entered clinical information in the GUI while CSVs and FEVs were collected. The frequency and duration of a list of behaviours found in FEVs were analysed using the Observer-XT-10.5. Simultaneously, the frequency and duration of usability problems of CSVs were manually registered. CSVs and FEVs timelines were also matched to verify combinations. The analysis of FEVs revealed that the category most frequently observed in users behaviour was the eye contact with the screen (ECS, 32±9) whilst verbal communication achieved the highest duration (14.8±6.9min). Regarding the CSVs, 64 problems, related with the interface (73%) and the user (27%), were found. In total, 135 usability problems were identified by combining both methods. The majority were reported through verbal communication (45.8%) and ECS (40.8%). "False alarms" and "misses" did not cause quantifiable reactions and the facial expressions problems were mainly related with the lack of familiarity (55.4%) felt by users when interacting with the interface. These findings encourage the use of Observer-XT-10.5 to conduct small usability sessions, as it identifies emergent groups of problems by combining methods. However, to validate final versions of systems further validation should be conducted using specialized software. © 2013 Published by Elsevier Ltd.

From Playability to a Hierarchical Game Usability Model

OpenAIRE

Nacke, Lennart E.

2010-01-01

This paper presents a brief review of current game usability models. This leads to the conception of a high-level game development-centered usability model that integrates current usability approaches in game industry and game research.

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

Science.gov (United States)

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

Assessment of the Usability of the Workbench Faraday Cage Method

OpenAIRE

Sørensen, Morten; Franek, Ondrej; Christensen, Søren K.; Pedersen, Gert Frølund; Ebert, Hans

2011-01-01

The workbench Faraday Cage method (WBFC) is a time efficient module pre-compliance test regarding radiated emission. This work investigates the method’s usability and credibility and concludes that for this particular case the WBFC perform a tolerable compliance test for frequencies below 360 MHz while it is essentially useless for higher frequencies.

A Longitudinal Study of Usability in Health Care

DEFF Research Database (Denmark)

Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan

2010-01-01

We report from a longitudinal laboratory-based usability evaluation of a health care information system. The purpose of the study was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information...... system may or may not disappear over time, as the nurses get more familiar with it-if time heals poor design? As our method for studying this, we conducted a longitudinal study with two key studies. A usability evaluation was conducted with novice users when an electronic patient record system was being......, we discuss implications for evaluating usability in health care....

Active Involvement of Software Developers in Usability Engineering

DEFF Research Database (Denmark)

Bornoe, Nis; Stage, Jan

2017-01-01

The essence of usability evaluations is to produce feedback that supports the downstream utility so the interaction design can be improved and problems can be fixed. In practice, software development organizations experience several obstacles for conducting usability engineering. One suggested...... approach is to train and involve developers in all phases of usability activities from evaluations, to problem reporting, and making redesign proposals. Only limited work has previously investigated the impact of actively involving developers in usability engineering. In this paper, we present two small......, and problem fixing. At the organizational level, we found that the attitude towards and understanding of the role of usability engineering improved....

PERBANDINGAN METODE EVALUASI USABILITY (STUDI KASUS : PENGGUNAAN PERANGKAT SMARTPHONE)

OpenAIRE

Hendradewa, Andrie Pasca

2017-01-01

Usability is a key factor that determine success of a product or interactive system, like smartphone. The increasing use of smartphone and its rapid technology development, requires usability evaluation method that is more accurate and effective to found usability problem, so it can be used for product improvement in development process. This study suggests a usability evaluation method that is most effective to identify problem in smartphone usage. Three usability evaluation methods that com...

Checking an integrated model of web accessibility and usability evaluation for disabled people.

Science.gov (United States)

Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta

2005-07-08

A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.

The usability issues of faceted navigation in digital libraries

Directory of Open Access Journals (Sweden)

Eliane Blumer

2014-05-01

For more than five years, the project ACCEPT, a subproject of a Swiss national project called e-lib.ch, analyzes the usability and usefulness of digital libraries, by using user oriented methods. Experience has shown that filters provided through faceted navigation are considered as positive and very useful by end users. Nevertheless, based on different test results, several returning mistakes have been detected and it turns out that there are some ‘unwritten standards’ concerning e.g. position, labelling or ranking which should be respected to fulfil the aim of a good usability which users do expect of such web services. In this poster we will first give an introduction to faceted navigation, actual design issues and their use in digital libraries and then present testing methods, which can be easily applied in a digital library context. Together with a list of best practices concerning faceted navigation drawn out of different test experiences, the paper should give the reader all important information to evaluate its current faceted navigation and see where improvements could be made.

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

Science.gov (United States)

Siarto, Jeff; Reese, Mark; Shum, Dana; Baynes, Katie

2016-01-01

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

Design of a Tablet Computer App for Facilitation of a Molecular Blood Culture Test in Clinical Microbiology and Preliminary Usability Evaluation.

Science.gov (United States)

Samson, Lasse L; Pape-Haugaard, Louise; Meltzer, Michelle C; Fuchs, Martin; Schønheyder, Henrik C; Hejlesen, Ole

2016-03-18

User mobility is an important aspect of the development of clinical information systems for health care professionals. Mobile phones and tablet computers have obtained widespread use by health care professionals, offering an opportunity for supporting the access to patient information through specialized applications (apps) while supporting the mobility of the users. The use of apps for mobile phones and tablet computers may support workflow of complex tasks, for example, molecular-based diagnostic tests in clinical microbiology. Multiplex Blood Culture Test (MuxBCT) is a molecular-based diagnostic test used for rapid identification of pathogens in positive blood cultures. To facilitate the workflow of the MuxBCT, a specialized tablet computer app was developed as an accessory to the diagnostic test. The app aims to reduce the complexity of the test by step-by-step guidance of microscopy and to assist users in reaching an exact bacterial or fungal diagnosis based on blood specimen observations and controls. Additionally, the app allows for entry of test results, and communication thereof to the laboratory information system (LIS). The objective of the study was to describe the design considerations of the MuxBCT app and the results of a preliminary usability evaluation. The MuxBCT tablet app was developed and set up for use in a clinical microbiology laboratory. A near-live simulation study was conducted in the clinical microbiology laboratory to evaluate the usability of the MuxBCT app. The study was designed to achieve a high degree of realism as participants carried out a scenario representing the context of use for the MuxBCT app. As the MuxBCT was under development, the scenario involved the use of molecular blood culture tests similar to the MuxBCT for identification of microorganisms from positive blood culture samples. The study participants were observed, and their interactions with the app were recorded. After the study, the participants were debriefed to

Three Contexts for Evaluating Organizational Usability

DEFF Research Database (Denmark)

Hertzum, Morten

2018-01-01

Organizational usability is about the match between the user and the system, between the organization and the system, and between the environment and the system. While the first of these matches can, to a large extent, be evaluated in the lab, the two others cannot. Organizational usability must......, provide a brief example, and discuss the challenges it presents. To strengthen the focus on evaluation in the three contexts we propose the measurement of specified effects, combined with a sensitivity toward emergent effects. Incorporating effects in the evaluation of organizational usability makes...

MATHEMATICAL MODEL FOR SOFTWARE USABILITY AUTOMATED EVALUATION AND ASSURANCE

Directory of Open Access Journals (Sweden)

І. Гученко

2011-04-01

Full Text Available The subject of the research is software usability and the aim is construction of mathematicalmodel of estimation and providing of the set level of usability. Methodology of structural analysis,methods of multicriterion optimization and theory of making decision, method of convolution,scientific methods of analysis and analogies is used in the research. The result of executed work isthe model for software usability automated evaluation and assurance that allows not only toestimate the current level of usability during every iteration of agile development but also tomanage the usability of created software products. Results can be used for the construction ofautomated support systems of management the software usability.

Integrated System Validation Usability Questionnaire: Information Display Element

International Nuclear Information System (INIS)

Garcés, Ma. I.; Torralba, B.

2015-01-01

The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to information displays, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed and the models proposed by the nuclear energy industry and their technical support organizations, mainly, the United States Electric Power Research Institute, EPRI, are analyzed. In the remaining stages, general and specific guidelines for information displays, in particular, display pages, formats, elements and data quality and update rate recommendations are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMMLAB.

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

Science.gov (United States)

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

A New Electronic Monitoring Device to Measure Medication Adherence: Usability of the Helping Hand™

Directory of Open Access Journals (Sweden)

Sabina De Geest

2010-03-01

Full Text Available The aim of this study was to test the user performance, satisfaction and acceptability of the Helping Hand™ (B&O Medicom electronic medication adherence monitor. Using a mixed-method design, we studied 11 kidney transplant patients and 10 healthy volunteers during three weeks. Although testing showed positive usability aspects, several areas requiring technical improvement were identified: the most important obstacles to usability and acceptability were the weak sound signal, problems loading the medication, and the fact that only one medication could be used at a time.

Usability Evaluation of www.budget.com

DEFF Research Database (Denmark)

Bruun, Anders; Jensen, Janne Jul; Skov, Mikael B.

This report presents the results of a usability evaluation of the budget.com website. The evaluation was carried out by a team of 4 HCI experts, and it involved 10 potential users. The evaluation is based on measurement of (1) task completion time, (2) task completion, (3) user satisfaction and (4......) perceived workload. We have also analyzed the user interaction with the website for (5) usability problems. Through the evaluation, we have found the following weaknesses of the website:   Reservation takes considerably more time than promised. The website indicates that a reservation can be made in 60...... is not useful for specific purposes. The user satisfaction is generally low. Except one high and two low scores, the user satisfaction was in the middle range. There are too many severe usability problems. The evaluation identified a considerable number of usability problems. 5 of them were critical which means...

A study of usability principles and interface design for mobile e-books.

Science.gov (United States)

Wang, Chao-Ming; Huang, Ching-Hua

2015-01-01

This study examined usability principles and interface designs in order to understand the relationship between the intentions of mobile e-book interface designs and users' perceptions. First, this study summarised 4 usability principles and 16 interface attributes, in order to conduct usability testing and questionnaire survey by referring to Nielsen (1993), Norman (2002), and Yeh (2010), who proposed the usability principles. Second, this study used the interviews to explore the perceptions and behaviours of user operations through senior users of multi-touch prototype devices. The results of this study are as follows: (1) users' behaviour of operating an interactive interface is related to user prior experience; (2) users' rating of the visibility principle is related to users' subjective perception but not related to user prior experience; however, users' ratings of the ease, efficiency, and enjoyment principles are related to user prior experience; (3) the interview survey reveals that the key attributes affecting users' behaviour of operating an interface include aesthetics, achievement, and friendliness. This study conducts experiments to explore the effects of users’ prior multi-touch experience on users’ behaviour of operating a mobile e-book interface and users’ rating of usability principles. Both qualitative and quantitative data analyses were performed. By applying protocol analysis, key attributes affecting users’ behaviour of operation were determined.

Evaluating the parent-adolescent communication toolkit: Usability and preliminary content effectiveness of an online intervention.

Science.gov (United States)

Toombs, Elaine; Unruh, Anita; McGrath, Patrick

2018-01-01

This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N  =   18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p  Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

Science.gov (United States)

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to

Apathy towards the Integration of Usability Work

DEFF Research Database (Denmark)

Wale-Kolade, Adeola; Nielsen, Peter Axel

2016-01-01

In this article we report from a case study of a software development organization and we study in particular the developers’ and product managers’ attitudes towards integrating usability work into software development. We offer explanations based on system justification theory illuminating what...... would-be integrators might be up against. The analysis shows how the developers only pay lip service to usability work and how they treat users superficially. It further shows how that leads to stereotyping of usability designers and users in order to preserve status quo, and how internalization...... of inequality between the developers and usability designers rationalizes the preservation of status quo. These findings will have significant implications for managers of software development....

Usability evaluations in user-centred design

NARCIS (Netherlands)

Ruyter, de B.E.R.; Vet, de J.H.M.

1997-01-01

Improving usability of consumer applications has been the focus of much research. Estimating the advantage of these efforts, however, still is very cumbersome since evaluating product improvements in terms of their usability requires good measuring methods and tools. In this paper activities in the

Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

Science.gov (United States)

Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

2015-01-01

A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

Science.gov (United States)

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be

Innovative design of ironing board based on Kansei Engineering and usability test

Directory of Open Access Journals (Sweden)

Zhafira Nadia

2018-01-01

Full Text Available Laundry business is popular service business in Indonesia that mostly involve muscle activity for lifting and ironing activity. It causes the worker get muscular fatigue and injury especially for ironing activity that is included in the static and monotonous activity. moreover, existed ironing board design in the market is not easy to be adjusted to standing or sitting position of workers. Hence, this paper aimed to design the innovative and adjustable ironing board to minimize the musculoskeletal complaint. The preliminary study is conducted by NBM questionnaires found that fatigue experienced mostly in the back, right upper arm, and calves. The product designed by Kansei engineering to satisfy consumer's feeling and assessed by USE questionnaire to fulfil consumer's usability. Orthogonal array and conjoint analysis were conducted to incorporate all attribute potentials in developing a new single concept design. Statistical analysis was also done to test the hypothesis. 80 respondents have participated in this study. The result of this study is an innovative design of ironing board which is valid to meet consumers' needs such as comfort, secure, attractive, sturdy, durable and multifunction and practical at 5% of the significant level.

Virtual Reality for Architectural or Territorial Representations: Usability Perceptions

Directory of Open Access Journals (Sweden)

Atta Idrawani Zaini

2017-05-01

Full Text Available Virtual reality (VR is widely being researched within various aspects of real-world applications. As architecture and urban design are very much adhered to evaluating and designing space, physical representations are deemed as incompetent to deliver a full-scale depiction of a space. Similarly, digital models are very much also limited in that sense. VR can deliver a full-scale virtual environment (VE, tricking users to be immersed in the replicated environment. This is an advantage for the aforementioned design disciplines, as more relatable and realistic depiction of a space can be modelled. The notion of its usability has become important to be understood from the perspective of architecture and urban design. This paper measured the respondents’ perceptions of VR’s usability through measuring its quality of use based on several criteria. The criteria established were the ease of use, usefulness, and satisfaction. Different levels of architectural details were decided as a form of control. A total of N=96 randomly selected respondents from various backgrounds participated in the survey as they were divided into four different group of treatments. Each group experienced a different VE with different level of architectural details. The first section of analysis is a one-sample analysis and the second is a group difference analysis. From the first analysis, it was found that the respondents perceived VR as a usable tool for architectural or territorial representation. Using Kruskal-Wallis test, it was found that there was no statistically significant difference between groups, suggesting that the respondents perceived VR as usable regardless of the level of architectural details. As this paper used perception data based on the quality of use alone, the efficiency of VR system was not measured. Thus, this paper recommends further studies to be conducted on the system’s efficiency to reflect its usability in full extent.

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

Science.gov (United States)

Fay, Nicolas; Ellison, T Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient's and Physical Therapist's Perspective.

Science.gov (United States)

van Lieshout, Remko; Pisters, Martijn F; Vanwanseele, Benedicte; de Bie, Rob A; Wouters, Eveline J; Stukstette, Mirelle J

2016-01-01

Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient's compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user's perspective. To describe the usability from the physical therapists' and a patients' perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. This study gives insight in the usability of two biofeedback devices from the patient's and physical therapist's perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient's perspective. The study findings could help

Reusable Software Usability Specifications for mHealth Applications.

Science.gov (United States)

Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali

2018-01-25

One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.

Models of f(R) cosmic acceleration that evade solar system tests

International Nuclear Information System (INIS)

Hu, Wayne; Sawicki, Ignacy

2007-01-01

We study a class of metric-variation f(R) models that accelerates the expansion without a cosmological constant and satisfies both cosmological and solar-system tests in the small-field limit of the parameter space. Solar-system tests alone place only weak bounds on these models, since the additional scalar degree of freedom is locked to the high-curvature general-relativistic prediction across more than 25 orders of magnitude in density, out through the solar corona. This agreement requires that the galactic halo be of sufficient extent to maintain the galaxy at high curvature in the presence of the low-curvature cosmological background. If the galactic halo and local environment in f(R) models do not have substantially deeper potentials than expected in ΛCDM, then cosmological field amplitudes |f R | > or approx.10 -6 will cause the galactic interior to evolve to low curvature during the acceleration epoch. Viability of large-deviation models therefore rests on the structure and evolution of the galactic halo, requiring cosmological simulations of f(R) models, and not directly on solar-system tests. Even small deviations that conservatively satisfy both galactic and solar-system constraints can still be tested by future, percent-level measurements of the linear power spectrum, while they remain undetectable to cosmological-distance measures. Although we illustrate these effects in a specific class of models, the requirements on f(R) are phrased in a nearly model-independent manner

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

Science.gov (United States)

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Usability Evaluation of a Web-Based Learning System

Science.gov (United States)

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Effect of improving the usability of an e-learning resource: a randomized trial.

Science.gov (United States)

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Usability and Gratifications--Towards a Website Analysis Model.

Science.gov (United States)

Bunz, Ulla K.

This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…

Usability and Accessibility of Air Force Intranet Web Sites

National Research Council Canada - National Science Library

Bentley, Richard S

2006-01-01

.... The Technology Acceptance Model suggests that information systems must not only be useful but also be usable and a large body of usability engineering knowledge exists to support usable design. In addition, the U.S...

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

Science.gov (United States)

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Forensic botany: usability of bryophyte material in forensic studies.

Science.gov (United States)

Virtanen, Viivi; Korpelainen, Helena; Kostamo, Kirsi

2007-10-25

Two experiments were performed to test the relevance of bryophyte (Plantae, Bryophyta) material for forensic studies. The first experiment was conducted to reveal if, and how well, plant fragments attach to footwear in general. In the test, 16 persons walked outdoors wearing rubber boots or hiking boots. After 24h of use outdoors the boots were carefully cleaned, and all plant fragments were collected. Afterwards, all plant material was examined to identify the species. In the second experiment, fresh material of nine bryophyte species was kept in a shed in adverse conditions for 18 months, after which DNA was extracted and subjected to genotyping to test the quality of the material. Both experiments give support for the usability of bryophyte material in forensic studies. The bryophyte fragments become attached to shoes, where they remain even after the wearer walks on a dry road for several hours. Bryophyte DNA stays intact, allowing DNA profiling after lengthy periods following detachment from the original plant source. Based on these experiments, and considering the fact that many bryophytes are clonal plants, we propose that bryophytes are among the most usable plants to provide botanical evidence for forensic investigations.

A Framework for Usability Evaluation in EHR Procurement.

Science.gov (United States)

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

Meta-Analysis of Correlations Among Usability Measures

DEFF Research Database (Denmark)

Hornbæk, Kasper Anders Søren; Effie Lai Chong, Law

2007-01-01

are generally low: effectiveness measures (e.g., errors) and efficiency measures (e.g., time) has a correlation of .247 ± .059 (Pearson's product-moment correlation with 95% confidence interval), efficiency and satisfaction (e.g., preference) one of .196 ± .064, and effectiveness and satisfaction one of .164......Understanding the relation between usability measures seems crucial to deepen our conception of usability and to select the right measures for usability studies. We present a meta-analysis of correlations among usability measures calculated from the raw data of 73 studies. Correlations...... ± .062. Changes in task complexity do not influence these correlations, but use of more complex measures attenuates them. Standard questionnaires for measuring satisfaction appear more reliable than homegrown ones. Measures of users' perceptions of phenomena are generally not correlated with objective...

Intra- and Inter-Cultural Usability in Computer-Supported Collaboration

DEFF Research Database (Denmark)

Vatrapu, Ravi; Suthers, Dan

2010-01-01

In this paper, we argue for an increased scope of universal design to encompass usability and accessibility for not only users with physical disabilities but also for users from different cultures. Towards this end, we present an empirical evaluation of cultural usability in computer......-Chinese, and Chinese-Chinese) appropriated affordances and produced technological intersubjectivity. Cultural usability was analyzed through the use of performance and satisfaction measures. The results show a systemic variation in efficiency, effectiveness, and satisfaction between the two cultural groups....... Implications of these findings for the research and practice of usability, in general, and cultural usability, in particular, are discussed in this paper....

An extended protocol for usability validation of medical devices: Research design and reference model.

Science.gov (United States)

Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten

2017-05-01

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.

Quickscan QTI addendum #1 - Usability study of QTI for De Digitale Universiteit

NARCIS (Netherlands)

dr. Pierre Gorissen

2003-01-01

De Digitale Universiteit (DU) performed a quickscan to determine the usability of the IMS Question and TestInteroperability (QTI) specification as a format to store questions and tests developed for and by the consortium. The original report is available in Dutch from the website of De Digitale

Evaluation of Usability Utilizing Markov Models

Science.gov (United States)

Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane

2012-01-01

Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…

Usability in a cultural context

DEFF Research Database (Denmark)

Clemmensen, Torkil; Yammiyavar, Pradeep; Ørngreen, Rikke

2010-01-01

This paper focuses on presenting and discussing the aim, context, challenges, results, and impact of the Cultural usability project named as CultUsab. This project was a four year international research effort from 2006 to 2009, which was supported by a grant for the Danish Research Councils...... for Independent Research in Culture and Communication. The project aimed at innovating processes in Information and Communication Technology development through an understanding of culturally sensitive aspects of usability evaluation methods....

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

Directory of Open Access Journals (Sweden)

Nicolas Fay

Full Text Available This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both, and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity, but harder to learn (identification accuracy for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

Directory of Open Access Journals (Sweden)

Chrisna Jooste

2014-08-01

Full Text Available Business Intelligence (BI applications provide business information to drive decision support. Usability is one of the factors determining the optimal use and eventual benefit derived from BI applications. The documented need for more BI usability research together with the practical necessity for BI evaluation guidelines in the mining industry provides the rationale for this study. The purpose of the study was to investigate the usability evaluation of BI applications in the context of a coal mining organization. The research is guided by the question: How can existing usability criteria be customized to evaluate the usability of BI applications. The research design included user observation, heuristic evaluation and a survey. Based on observations made during user support on a BI application used at a coal mining organization a log of usability issues was compiled. The usability issues extracted from this log was compared and contrasted with general usability criteria from literature to synthesize an initial set of BI usability evaluation criteria. These criteria were used as the basis for a heuristic evaluation of the BI application used at the coal mining organization. The same BI application was also evaluated using the Software Usability Measurement Inventory (SUMI standardized questionnaire. The results from the two evaluations were triangulated and then compared with the BI user issues again to contextualize the findings and synthesize a validated and refined set of criteria. The main contribution of the study is the usability evaluation criteria for BI applications presented as guidelines. These guidelines deviate from existing evaluation guidelines in the emphasis on information architecture, learnability and operability.

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps.

Science.gov (United States)

Mohamad Marzuki, Muhamad Fadhil; Yaacob, Nor Azwany; Yaacob, Najib Majdi

2018-05-14

A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. The Malay System Usability Scale questionnaire is a

A Survey of Usability Practices in Free/Libre/Open Source Software

Science.gov (United States)

Paul, Celeste Lyn

A review of case studies about usability in eight Free/Libre/Open Source Software (FLOSS) projects showed that an important issue regarding a usability initiative in the project was the lack of user research. User research is a key component in the user-centered design (UCD) process and a necessary step for creating usable products. Reasons why FLOSS projects suffered from a lack of user research included poor or unclear project leadership, cultural differences between developer and designers, and a lack of usability engineers. By identifying these critical issues, the FLOSS usability community can begin addressing problems in the efficacy of usability activities and work towards creating more usable FLOSS products.

Development and usability testing of a web-based self-management intervention for oral cancer survivors and their family caregivers.

Science.gov (United States)

Badr, H; Lipnick, D; Diefenbach, M A; Posner, M; Kotz, T; Miles, B; Genden, E

2016-09-01

Oral cancer (OC) survivors experience debilitating side effects that affect their quality of life (QOL) and that of their caregivers. This study aimed to develop and evaluate a dyadic, web-based intervention to improve survivor self-management and survivor/caregiver QOL. A qualitative needs assessment (semi-structured interviews) with 13 OC survivors and 12 caregivers was conducted to discern information and support needs as well as preferences regarding website features and tools. Results using Grounded Theory analysis showed that OC survivors and caregivers: (1) want and need practical advice about managing side effects; (2) want to reach out to other survivors/caregivers for information and support; and (3) have both overlapping and unique needs and preferences regarding website features. Usability testing (N = 6 survivors; 5 caregivers) uncovered problems with the intuitiveness, navigation and design of the website that were subsequently addressed. Users rated the website favourably on the dimensions of attractiveness, controllability, efficiency, intuitiveness and learnability, and gave it a total usability score of 80/100. Overall, this study demonstrates that OC survivors and caregivers are interested in using an online programme to improve QOL, and that providing tailored website content and features based on the person's role as survivor or caregiver is important in this population. © 2015 John Wiley & Sons Ltd.

Usability/Sentiment for the Enterprise and ENTERPRISE

Science.gov (United States)

Meza, David; Berndt, Sarah

2014-01-01

The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or

USABILITY TESTING OF JAPANESE CAPTIONS SEGMENTATION SYSTEM TO SCAFFOLD BEGINNERS TO COMPREHEND JAPANESE VIDEOS

Directory of Open Access Journals (Sweden)

Ya-Fei Yang

2013-06-01

Full Text Available A major learning difficulty of Japanese foreign language (JFL learners is the complex composition of two syllabaries, hiragana and katakana, and kanji characters adopted from logographic Chinese ones. As the number of Japanese language learners increases, computer-assisted Japanese language education gradually gains more attention. This study aimed to adopt a Japanese word segmentation system to help JFL learners overcome literacy problems. This study adopted MeCab, a Japanese morphological analyzer and part-of-speech (POS tagger, to segment Japanese texts into separate morphemes by adding spaces and to attach POS tags to each morpheme for beginners. The participants were asked to participate in three experimental activities involvingwatching two Japanese videos with general or segmented Japanese captions and complete the Nielsen’s Attributes of Usability (NAU survey and the After Scenario Questionnaire (ASQ to evaluate the usability of the learning activities. The results of the system evaluation showed that the videos with the segmented captions could increase the participants’ learning motivation and willingness to adopt the word segmentation system to learn Japanese.

Usability Metrics for Gamified E-learning Course: A Multilevel Approach

Directory of Open Access Journals (Sweden)

Aleksandra Sobodić

2018-04-01

Full Text Available This paper discusses the effect of a gamified learning system for students of the master course on Web Design and Programming performed at the Faculty of Organization and Informatics. A new set of usability metrics was derived from web-based learning usability, user experience and instructional design literature and incorporated into the questionnaire which consists of three main categories: Usability, Educational Usability and User Experience. The main contribution of this paper is the development and validation of a questionnaire for measuring the usability of a gamified e-learning course from students’ perspective. Usability practitioners can use the developed metrics with confidence when evaluating the design of a gamified e-learning course in order to improve students’ engagement and motivation.

Cultural Cognition in Usability Evaluation

DEFF Research Database (Denmark)

Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

2009-01-01

We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences' helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users' cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

Cultural Cognition in Usability Evaluation

DEFF Research Database (Denmark)

Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

2009-01-01

We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences’ helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users’ cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

The Usability Expert’s Fear of Agility

DEFF Research Database (Denmark)

Nielsen, Lene; Madsen, Sabine

2012-01-01

This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12 differ...

Development and usability testing of a web-based smoking cessation treatment for smokers with schizophrenia

Directory of Open Access Journals (Sweden)

Mary F. Brunette

2016-05-01

Conclusion: The prototype website was usable and satisfactory. With training and support, home use of this cessation website appears to be feasible and promising for cessation among smokers with schizophrenia. Further research is needed to evaluate web-based cessation treatment in people with psychotic disorders.

Get out of Fines Free: Recruiting Student Usability Testers via Fine Waivers

Science.gov (United States)

Hockenberry, Benjamin; Blackburn, Kourtney

2016-01-01

St. John Fisher College's Lavery Library's Access Services and Systems departments began a pilot project in which students with overdue fines tested usability of library Web sites in exchange for fine waivers. Circulation staff promoted the program and redeemed fine waiver vouchers at the Checkout Desk, while Systems staff administered testing and…

Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient’s and Physical Therapist’s Perspective

Science.gov (United States)

van Lieshout, Remko; Pisters, Martijn F.; Vanwanseele, Benedicte; de Bie, Rob A.; Wouters, Eveline J.; Stukstette, Mirelle J.

2016-01-01

Background Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient’s compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user’s perspective. Aim To describe the usability from the physical therapists’ and a patients’ perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. Methods In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Results Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. Conclusion This study gives insight in the usability of two biofeedback devices from the patient’s and physical therapist’s perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the

Enabling Data Discovery and Reuse by Improving Software Usability:Data Science Experiences, Lessons, and Gaps

Science.gov (United States)

Rosati, A.; Yarmey, L.

2014-12-01

It is well understood that a good data scientist needs domain science, analysis, programming, and communication skills to create finished data products, visualizations, and reports. Articles and blogs tout the need for "expert" skill levels in domain knowledge, statistics, storytelling, graphic design, technology…and the list goes on. Since it seems impossible that one person would encompass all these skills, it is often suggested that data science be done by a team instead of an individual. This research into, and experience with, data product design offers an augmented definition - one that elevates relationships and engagement with the final user of a product. Essentially, no matter how fantastic or technically advanced a product appears, the intended audience of that product must be able to understand, use, and find value in the product in order for it to be considered a success. Usability is often misunderstood and seen as common sense or common knowledge, but it is actually an important and challenging piece of product development. This paper describes the National Snow and Ice Data Center's process to usability test the Arctic Data Explorer (ADE). The ADE is a federated data search tool for interdisciplinary Arctic science data that has been improved in features, appearance, functionality, and quality through a series of strategic and targeted usability testing and assessments. Based on the results, it is recommended that usability testing be incorporated into the skill set of each data science team.

A proposal for a repertory-grid study of differences in Chinese, Danish, and Indian conceptions of usability: Cultural usability?

DEFF Research Database (Denmark)

Hertzum, Morten

2006-01-01

This is an unrefined proposal for a study that could form part of the exploratory phase of the Cultural Usability project. The proposed study compares three cultures (Chinese, Danish, and Indian) and two stakeholder groups (users and developers) with respect to their conceptions of usability....

A Comparison of Quantitative and Qualitative Data from a Formative Usability Evaluation of an Augmented Reality Learning Scenario

Directory of Open Access Journals (Sweden)

Dragos Daniel IORDACHE

2009-01-01

Full Text Available The proliferation of augmented reality (AR technologies creates opportunities for the devel-opment of new learning scenarios. More recently, the advances in the design and implementation of desktop AR systems make it possible the deployment of such scenarios in primary and secondary schools. Usability evaluation is a precondition for the pedagogical effectiveness of these new technologies and requires a systematic approach for finding and fixing usability problems. In this paper we present an approach to a formative usability evaluation based on heuristic evaluation and user testing. The basic idea is to compare and integrate quantitative and qualitative measures in order to increase confidence in results and enhance the descriptive power of the usability evaluation report.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

Science.gov (United States)

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Defining Usability of PN Services

DEFF Research Database (Denmark)

Nicolajsen, Hanne Westh; Ahola, Titta; Fleury, Alexandre

In this deliverable usability and user experience are defined in relation to MAGNET Beyond technologies, and it is described how the main MAGNET Beyond concepts can be evaluated through the involvement of users. The concepts include the new "Activity based communication approach" for interacting...... with the MAGNET Beyond system, as well as the core concepts: Personal Network, Personal Network-Federation, Service Discovery, User Profile Management, Personal Network Management, Privacy and Security and Context Awareness. The overall plans for the final usability evaluation are documented based on the present...

Usability analysis of indoor map application in a shopping centre

Science.gov (United States)

Dewi, R. S.; Hadi, R. K.

2018-04-01

Although indoor navigation is still new in Indonesia, its future development is very promising. Similar to the outdoor one, the indoor navigation technology provides several important functions to support route and landmark findings. Furthermore, there is also a need that indoor navigation can support the public safety especially during disaster evacuation process in a building. It is a common that the indoor navigation technologies are built as applications where users can access this technology using their smartphones, tablets, or personal computers. Therefore, a usability analysis is important to ensure the indoor navigation applications can be operated by users with highest functionality. Among several indoor map applications which were available in the market, this study chose to analyse indoor Google Maps due to its availability and popularity in Indonesia. The experiments to test indoor Google Maps was conducted in one of the biggest shopping centre building in Surabaya, Indonesia. The usability was measured by employing System Usability Scale (SUS) questionnaire. The result showed that the SUS score of indoor Google Maps was below the average score of other cellular applications to indicate the users still had high difficulty in operating and learning the features of indoor Google Maps.

Mobile PHRs compliance with Android and iOS usability guidelines.

Science.gov (United States)

Cruz Zapata, Belén; Hernández Niñirola, Antonio; Idri, Ali; Fernández-Alemán, José Luis; Toval, Ambrosio

2014-08-01

Mobile Personal Health Records (PHRs) have achieved a particularly strong market share since the appearance of more powerful mobile devices and popular worldwide mobile application markets such as Apple's App Store and Android's Google Play. However, Android and Apple have a set of recommendations on design and usability targeted towards developers who wish to publish apps in their stores: Android Design Guidelines and iOS Human Interface Guidelines. This paper aims to evaluate compliance with these guidelines by assessing the usability recommendations of a set of 24 selected mobile PHR applications. An analysis process based on a well-known Systematic Literature Review (SLR) protocol was used. The results show that the 24 mobile PHR applications studied are not suitably structured. 46 % of these applications do not use any of the recommended patterns, using instead lists or springboards, which are deprecated patterns for top-level menus. 70 % of the PHRs require a registration to be able to test the application when these interactions should be delayed. Our study will help both PHR users to select user-friendly mobile PHRs and PHR providers and developers to identify the good usability practices implemented by the applications with the highest scores.

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Spatial Awareness

Science.gov (United States)

2017-08-08

created. For the test, the space created was a virtual factory space and a machine shop . Into this space the test administrators were able to inject...Using Competitive Usability Analysis”, Transactions of the ASME, Journal of Computing and Information Science in Engineering, June 2012, Vol, 12. 5

Revealing unawareness in usability related decision-making

NARCIS (Netherlands)

Harkema, C.L.E.

2012-01-01

Nowadays, many users experience usability issues with their electronic products. It does not work as they expect or otherwise irritates the user, so he becomes dissatisfied about the product and may even complain about it. Th ese numbers of complaints to companies and usability issues are high and

Dimensions for hearing-impaired mobile application usability model

Science.gov (United States)

Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan

2017-10-01

This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.

Barefooted Usability Evaluation: Addressing the Mindset, Resources and Competences

OpenAIRE

Bruun , Anders

2011-01-01

Part 1: Long and Short Papers; International audience; Lack of usability specialists, high resource requirements and developer mindsets are three considerable barriers for introducing usability engineering into software companies. This Ph.D. project explores the effect of letting software developers and end users apply usability engineering methods instead of a specialist, a solution which may reduce the barriers.

Naive (commonsense) geography and geobrowser usability after ten years of Google Earth

Science.gov (United States)

Hamerlinck, J. D.

2016-04-01

In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.

Cost-justifying usability an update for the internet age

CERN Document Server

Bias, Randolph G; Bias, Randolph G

2005-01-01

You just know that an improvement of the user interface will reap rewards, but how do you justify the expense and the labor and the time-guarantee a robust ROI!-ahead of time? How do you decide how much of an investment should be funded? And what is the best way to sell usability to others? In this completely revised and new edition, Randolph G. Bias (University of Texas at Austin, with 25 years' experience as a usability practitioner and manager) and Deborah J. Mayhew (internationally recognized usability consultant and author of two other seminal books including The Usability Enginee

On the Concepts of Usability and Reusability of Learning Objects

Directory of Open Access Journals (Sweden)

Miguel-Angel Sicilia

2003-10-01

Full Text Available “Reusable learning objects” oriented towards increasing their potential reusability are required to satisfy concerns about their granularity and their independence of concrete contexts of use. Such requirements also entail that the definition of learning object “usability,” and the techniques required to carry out their “usability evaluation” must be substantially different from those commonly used to characterize and evaluate the usability of conventional educational applications. In this article, a specific characterization of the concept of learning object usability is discussed, which places emphasis on “reusability,” the key property of learning objects residing in repositories. The concept of learning object reusability is described as the possibility and adequacy for the object to be usable in prospective educational settings, so that usability and reusability are considered two interrelated – and in many cases conflicting – properties of learning objects. Following the proposed characterization of two characteristics or properties of learning objects, a method to evaluate usability of specific learning objects will be presented.

Usability evaluation with mental health professionals and young people to develop an Internet-based cognitive-behaviour therapy program for adolescents with anxiety disorders.

Science.gov (United States)

Wozney, Lori; Baxter, Pamela; Newton, Amanda S

2015-12-16

Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for

Applying usability heuristics to radiotherapy systems

International Nuclear Information System (INIS)

Chan, Alvita J.; Islam, Mohammad K.; Rosewall, Tara; Jaffray, David A.; Easty, Anthony C.; Cafazzo, Joseph A.

2012-01-01

Background and purpose: Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. Material and methods: A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. Results: The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Conclusions: Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems.

eLEARNING - EINE CHANCE FÜR KLEINE UND MITTLERE UNTERNEHMEN

Directory of Open Access Journals (Sweden)

Ileana Hamburg

2005-12-01

Full Text Available eLearning wird durch seine Flexibilität und Zugänglichkeit als bedeutendes Instrument für die Implementierung lebenslangen Lernens (LLL angesehen. Es kann für kleine und mittelgroße Unternehmen (KMU einen Katalysator des Wandels sein und bietet damit die Chance zur Verbesserung der wirtschaftlichen Leistungsfähigkeit. Darüber hinaus kann eLearning dazu dienen, die Integration von KMU in den europäischen Markt zu fördern. Bis jetzt wird eLearning im Rahmen der beruflichen Aus- und Weiterbildung jedoch nahezu ausschließlich in Großunternehmen genutzt, während es in KMU allenfalls eine marginale Rolle spielt. Im ersten Kapitel dieses Artikels wird auf den Perspektivenwechsel in der beruflichen Aus- und Weiterbildung eingegangen. Im Anschluss daran werden die zentralen Elemente von eLearning vorgestellt (Kap. 2. Die mit eLearning verbundenen Chancen und Herausforderungen für KMU diskutiert (Kap. 3. Abschließend wird auf Erfahrungen mit eLearning in der Praxis am Beispiel von drei EU-finanzierten Projekten eingegangen. Das Hauptaugenmerk liegt dabei auf dem laufenden Projekt ARIEL -Analysing and Reporting the Implementation of Electronic Learning in Europe -, das vom Institut Arbeit und Technik, Gelsenkirchen, (IAT koordiniert wird.

Usability Study Identifies Vocabulary, Facets, and Education as Primary Primo Discovery System Interface Problems

Directory of Open Access Journals (Sweden)

Ruby Muriel Lavallee Warren

2017-09-01

Full Text Available A Review of: Brett, K. R., Lierman, A., & Turner, C. (2016. Lessons learned: A Primo usability study. Information Technology and Libraries, 35(1, 7-25. https://doi.org/10.6017/ital.v35i1.8965 Abstract Objective – To discover whether users can effectively complete common research tasks in a modified Primo Discovery System interface. Design – Usability testing. Setting – University of Houston Libraries. Subjects – Users of the University of Houston Libraries Ex Libris Primo Discovery System interface. Methods – The researchers used a think aloud usability test methodology, with participants asked to verbalize their thought processes as they completed a set of tasks. Four tasks were developed and divided into two task sets (Test 1 and Test 2, with session facilitators alternating sets for each participant. Tasks were as follows: locating a known article, finding a peer reviewed article on a requested subject, locating a book, and finding a newspaper article on a topic. Tests were conducted in front of the library entrance using a laptop equipped with Morae (screen and audio recording software, and participants were recruited via an assigned “caller” at the table offering library merchandise and food as a research incentive. Users could opt out of having their session recorded, resulting in a total of fifteen sessions completed with fourteen recorded. Thirteen of the fifteen participants were undergraduate students, one was a graduate student, one was a post-baccalaureate student, and there were no faculty participants. Facilitators completed notes on a standard rubric, coding participant responses into successes or failures and noting participant feedback. Main Results – All eight participants assigned Test 1 successfully completed Test 1, Task 1: locating a known article. Participants expressed a need for an author limiter in advanced search, and had difficulty using the citation formatted information to locate materials

Qualitative review of usability problems in health information systems for radiology.

Science.gov (United States)

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK

Science.gov (United States)

Sukardjo, Moch.; Sugiyanta, Lipur

2018-04-01

implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.

Adolescents' experience of a rapid HIV self-testing device in youth-friendly clinic settings in Cape Town South Africa: a cross-sectional community based usability study.

Science.gov (United States)

Smith, Philip; Wallace, Melissa; Bekker, Linda-Gail

2016-12-23

Introduction : Since HIV testing in South African adolescents and young adults is sub-optimal, the objective of the current study was to investigate the feasibility and acceptability of an HIV rapid self-testing device in adolescents and young people at the Desmond Tutu HIV Foundation Youth Centre and Mobile Clinic. Methods : Self-presenting adolescents and young adults were invited to participate in a study investigating the fidelity, usability and acceptability of the AtomoRapid HIV Rapid self-testing device. Trained healthcare workers trained participants to use the device before the participant conducted the HIV self-test with device usage instructions. The healthcare worker then conducted a questionnaire-based survey to assess outcomes. Results : Of the 224 enrolled participants between 16 and 24 years of age, 155 (69,2%) were female. Overall, fidelity was high; 216 (96,4%) participants correctly completed the test and correctly read and interpreted the HIV test result. There were eight (3,6%) user errors overall; six participants failed to prick their finger even though the lancet fired correctly. There were two user errors where participants failed to use the capillary tube correctly. Participants rated acceptability and usability highly, with debut testers giving significantly higher ratings for both. Younger participants gave significantly higher ratings of acceptability. Conclusions : Adolescents and young adults found HIV self-testing highly acceptable with the AtomoRapid and they used the device accurately. Further research should investigate how, where and when to deploy HIV self-testing as a means to accompany existing strategies in reaching the UNAIDS goal to test 90% of all individuals worldwide.

Feedback from Usability Evaluation to User Interface Design

DEFF Research Database (Denmark)

Nielsen, C. M.; Overgaard, M.; Pedersen, M. B.

2005-01-01

This paper reports from an exploratory study of means for providing feedback from a usability evaluation to the user interface designers. In this study, we conducted a usability evaluation of a mobile system that is used by craftsmen to register use of time and materials. The results...... and weaknesses of the system. The findings indicate that detailed descriptions of problems and log descriptions of the user's interaction with the system and of system interaction are useful for the designers when trying to understand the usability problems that the users have encountered....

Usability of Commercially Available Mobile Applications for Diverse Patients.

Science.gov (United States)

Sarkar, Urmimala; Gourley, Gato I; Lyles, Courtney R; Tieu, Lina; Clarity, Cassidy; Newmark, Lisa; Singh, Karandeep; Bates, David W

2016-12-01

Mobile applications or 'apps' intended to help people manage their health and chronic conditions are widespread and gaining in popularity. However, little is known about their acceptability and usability for low-income, racially/ethnically diverse populations who experience a disproportionate burden of chronic disease and its complications. The objective of this study was to investigate the usability of existing mobile health applications ("apps") for diabetes, depression, and caregiving, in order to facilitate development and tailoring of patient-facing apps for diverse populations. Usability testing, a mixed-methods approach that includes interviewing and direct observation of participant technology use, was conducted with participants (n = 9 caregivers; n = 10 patients with depression; and n = 10 patients with diabetes) on a total of 11 of the most popular health apps (four diabetes apps, four depression apps, and three caregiver apps) on both iPad and Android tablets. The participants were diverse: 15 (58 %) African Americans, seven (27 %) Whites, two (8 %) Asians, two (8 %) Latinos with either diabetes, depression, or who were caregivers. Participants were given condition-specific tasks, such as entering a blood glucose value into a diabetes app. Participant interviews were video recorded and were coded using standard methods to evaluate attempts and completions of tasks. We performed inductive coding of participant comments to identify emergent themes. Participants completed 79 of 185 (43 %) tasks across 11 apps without assistance. Three themes emerged from participant comments: lack of confidence with technology, frustration with design features and navigation, and interest in having technology to support their self-management. App developers should employ participatory design strategies in order to have an impact on chronic conditions such as diabetes and depression that disproportionately affect vulnerable populations. While patients

Usability engineering: domain analysis activities for augmented-reality systems

Science.gov (United States)

Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

2002-05-01

This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

Business-Intelligence-Systeme im Spannungsfeld zwischen Usability und Sicherheit

OpenAIRE

Hinck, Thorsten

2010-01-01

Business-Intelligence-Systeme stehen im Spannungsfeld zwischen Usability und Sicherheit. Die Gefahren und Sicherheitsmaßnahmen für Informationssysteme werden ermittelt und ökonomisch in Bezug zur Gebrauchstauglichkeit gesetzt. Es entsteht ein Sicherheitsprofil für Business-Intelligence-Systeme. Business-Intelligence-Systems are in tension between Usability and IT-Security. Risks and safety measures of informationsystems are defined and set in (economic) regard to Usability. A security prof...

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

Science.gov (United States)

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology

Can eye tracking boost usability evaluation of computer games?

DEFF Research Database (Denmark)

Johansen, Sune Alstrup; Noergaard, Mie; Soerensen, Janus Rau

2008-01-01

Good computer games need to be challenging while at the same time being easy to use. Accordingly, besides struggling with well known challenges for usability work, such as persuasiveness, the computer game industry also faces system-specific challenges, such as identifying methods that can provide...... data on players' attention during a game. This position paper discusses how eye tracking may address three core challenges faced by computer game producer IO Interactive in their on-going work to ensure games that are fun, usable, and challenging. These challenges are: (1) Persuading game designers...... about the relevance of usability results, (2) involving game designers in usability work, and (3) identifying methods that provide new data about user behaviour and experience....

Post-deployment usability evaluation of a radiology workstation

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A.; Oudkerk, Matthijs; Van Ooijen, Peter M. A.

Objectives: To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical

How to Reach Evidence-Based Usability Evaluation Methods

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda

2017-01-01

This paper discusses how and why to build evidence-based knowledge on usability evaluation methods. At each step of building evidence, requisites and difficulties to achieve it are highlighted. Specifically, the paper presents how usability evaluation studies should be designed to allow capitalizing

Usability Assessment of International Office Website of Diponegoro University With Scenario Based Usability Evaluation Method and Wammi Method

OpenAIRE

Ratna Purwaningsih; Ikhsan Yenifi

2015-01-01

Website development needs to pay attention to usability aspect which consist of four factors: efficiency, effectiveness, satisfactions and error rate. The website of International Office of Diponegoro University provides academic information for Indonesian students and foreign students. The website still has some problem, especially on searching certain information. This research aims to evaluate the design of the existing website and measures the usability. A well-designed website will help ...

Evaluation of the Usability of Different Virtual Lab Software Used in Physics Courses

Directory of Open Access Journals (Sweden)

O. Karagoz

2010-11-01

Full Text Available In recent years the use of virtual lab software has become ubiquitous in education settings. The purpose of the current study is to de¬velop an Evaluation Scale to allow the easy and fast assessment of virtual lab software. During the development of the Evaluation Scale, theoretical and experimental studies investigating the effects of different software on learn¬ing, particularly in terms of usability, were utilized. The Evaluation Scale was created by adding new attributes to pre-existing scales, and comprises three sections – attributes related to the interface of the software; attributes related to its use as a material in education; and attributes related to product and ser¬vice support – and 79 items. Testing of the Evaluation Scale was carried out using two different virtual lab programmes, with the help of a checklist. The evaluation was carried out by physics teachers and academics that had previ¬ously used similar software, and consistency between the results was consid¬ered to represent inter-rater reliability. At the end of the study, the usability of the Evaluation Scale was tested, and the instructor evaluations regarding the usability characteristics considered sufficient and that require improvement in virtual lab software were also investigated.

Post-deployment usability evaluation of a radiology workstation

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi; Oudkerk, Matthijs; van Ooijen, Peter

2015-01-01

Objective To evaluate the usability of a radiology workstation after deployment in a hospital. Significance In radiology, it is difficult to perform valid pre-deployment usability evaluations due to the heterogeneity of the user group, the complexity of the radiological workflow, and the complexity

Usability Plans and Schemes for Low Fidelity Prototypes

DEFF Research Database (Denmark)

Schultz, Nette; Kirk Sørensen, Jannick; Sørensen, Lene

2006-01-01

Internal report of WP1 task 4 activities from August 2006 to December 2006. This report describes the setup of a usability evaluation framework for evaluating core MAGNET concepts in terms of usability. Initially, these core concepts are identified and modes of operation involving...

Virtual gaming simulation of a mental health assessment: A usability study.

Science.gov (United States)

Verkuyl, Margaret; Romaniuk, Daria; Mastrilli, Paula

2018-05-18

Providing safe and realistic virtual simulations could be an effective way to facilitate the transition from the classroom to clinical practice. As nursing programs begin to include virtual simulations as a learning strategy; it is critical to first assess the technology for ease of use and usefulness. A virtual gaming simulation was developed, and a usability study was conducted to assess its ease of use and usefulness for students and faculty. The Technology Acceptance Model provided the framework for the study, which included expert review and testing by nursing faculty and nursing students. This study highlighted the importance of assessing ease of use and usefulness in a virtual game simulation and provided feedback for the development of an effective virtual gaming simulation. The study participants said the virtual gaming simulation was engaging, realistic and similar to a clinical experience. Participants found the game easy to use and useful. Testing provided the development team with ideas to improve the user interface. The usability methodology provided is a replicable approach to testing virtual experiences before a research study or before implementing virtual experiences into curriculum. Copyright © 2018 Elsevier Ltd. All rights reserved.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

Science.gov (United States)

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

The role of usability in e-lexicography

Directory of Open Access Journals (Sweden)

André H. du Plessis

2017-05-01

Full Text Available In the development of the metalexicography, the primary focus of metalexicographers was on the development of printed dictionaries. As technology advances, the focus now shifts towards online and electronic products. Tarp (2009:23–24 posits that this shift results in metalexicographic shortcomings. This means that the theories used to create and evaluate dictionaries are not sufficient anymore. Bergenholtz and Bothma (2011:54 show that dictionaries as data carriers are now not only limited to the field of lexicography, but also to information technological fields. For current lexicographers to be successful in the digital age, the theories used in designing, developing and critiquing dictionaries must adapt with regards to current information technological trends, norms and practices. One aspect that must be addressed is the usability of dictionaries and other electronic lexicographic tools. By using usability theories and standards, current metalexicographical principles can be adapted for the digital age in a streamlined fashion. This study aims to show how usability theories and standards can be advantageous for metalexicography and that future electronic metalexicographic endeavours should not be undertaken without considering the usability as part of the theoretical framework.

Adolescents’ experience of a rapid HIV self-testing device in youth-friendly clinic settings in Cape Town South Africa: a cross-sectional community based usability study

Science.gov (United States)

Smith, Philip; Wallace, Melissa; Bekker, Linda-Gail

2016-01-01

Abstract Introduction: Since HIV testing in South African adolescents and young adults is sub-optimal, the objective of the current study was to investigate the feasibility and acceptability of an HIV rapid self-testing device in adolescents and young people at the Desmond Tutu HIV Foundation Youth Centre and Mobile Clinic. Methods: Self-presenting adolescents and young adults were invited to participate in a study investigating the fidelity, usability and acceptability of the AtomoRapid HIV Rapid self-testing device. Trained healthcare workers trained participants to use the device before the participant conducted the HIV self-test with device usage instructions. The healthcare worker then conducted a questionnaire-based survey to assess outcomes. Results: Of the 224 enrolled participants between 16 and 24 years of age, 155 (69,2%) were female. Overall, fidelity was high; 216 (96,4%) participants correctly completed the test and correctly read and interpreted the HIV test result. There were eight (3,6%) user errors overall; six participants failed to prick their finger even though the lancet fired correctly. There were two user errors where participants failed to use the capillary tube correctly. Participants rated acceptability and usability highly, with debut testers giving significantly higher ratings for both. Younger participants gave significantly higher ratings of acceptability. Conclusions: Adolescents and young adults found HIV self-testing highly acceptable with the AtomoRapid and they used the device accurately. Further research should investigate how, where and when to deploy HIV self-testing as a means to accompany existing strategies in reaching the UNAIDS goal to test 90% of all individuals worldwide. PMID:28406597

A human reliability based usability evaluation method for safety-critical software

International Nuclear Information System (INIS)

Boring, R. L.; Tran, T. Q.; Gertman, D. I.; Ragsdale, A.

2006-01-01

Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thus allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)

Experimental Platform for Usability Testing of Secure Medical Sensor Network Protocols

DEFF Research Database (Denmark)

Andersen, Jacob; Lo, Benny P.; Yang, Guang-Zhong

2008-01-01

designed security mechanisms are essential. Several experimental sensor network platforms have emerged in recent years targeted for clinical use. However, few of them consider the importance of security issues such as privacy and access control, and how these can impact the usability of the platform, while......Implementing security mechanisms such as access control for clinical use is a challenging research issue in BSN due to its required heterogeneous operating responses ranging from chronic diseases management to emergency care. To ensure the clinical uptake of the BSN technology, appropriately...... others develop BSN security without considering how a prototype implementation would be received by clinicians in real-life situations. The purpose of this paper is to present our initial effort in building a flexible experimental platform for providing a basic infrastructure with symmetric AES...

Users Views about the Usability of Digital Libraries

Science.gov (United States)

Koohang, Alex; Ondracek, James

2005-01-01

This study examined users' views about the usability of digital libraries' current and perceived importance. Age, gender, prior experience with the Internet, college status, and digital library proficiency are the independent variables. Users' current views about the usability of digital libraries and users perceived importance of digital library…

Information users and usability in the digital age

CERN Document Server

Chowdhury, G G

2013-01-01

Gives an overview of the necessary issues relating to information users and the usability of information services in the digital world, including user-centred design, and the characteristics and behaviour of information users. This book helps readers understand why information users and the usability of information services are important.

A Usability Evaluation of Academic Virtual Reference Services

Science.gov (United States)

Chow, Anthony S.; Croxton, Rebecca A.

2014-01-01

This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…

UX Professionals’ Definitions of Usability and UX

DEFF Research Database (Denmark)

Rajanen, Dorina; Clemmensen, Torkil; Iivari, Netta

2017-01-01

This paper examines the views of user experience (UX) professionals on the definitions of usability and UX, and compares the findings between countries and within different socio-cultural groups. A mixed-method analysis was employed on data gathered on 422 professionals through a survey in Turkey......, Finland, Denmark, France, and Malaysia. Usability appears to be an established concept, respondents across all countries agreeing on the importance of the ISO 9241-11 definition. There is also a tendency that UX professionals attach organizational perspective to usability. UX professionals diverge when...... defining UX, and there are systematic differences related to socio-cultural conditions. UX professionals in Finland and France incline more towards the definition highlighting the experiential qualities, when compared to Turkey and Malaysia that incline towards the definition reflecting the ease of use...

A framework for characterizing usability requirements elicitation and analysis methodologies (UREAM)

NARCIS (Netherlands)

Trienekens, J.J.M.; Kusters, R.J.; Mannaert, H.

2012-01-01

Dedicated methodologies for the elicitation and analysis of usability requirements have been proposed in literature, usually developed by usability experts. The usability of these approaches by non-expert software engineers is not obvious. In this paper, the objective is to support developers and

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

Science.gov (United States)

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

A Longitudinal Study of Usability in Health Care - Does Time Heal?

DEFF Research Database (Denmark)

Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan

2007-01-01

for 15 months, we repeated the evaluation. Our aim was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information system may or may not disappear over time, as the nurses get more familiar......We report from a longitudinal laboratory-based usability evaluation of a health care information system. A usability evaluation was conducted with novice users when an electronic patient record system was being deployed in a large hospital. After the nurses had used the system in their daily work...... with it – if time heals poor design. On the basis of our study, we present findings on the usability of the electronic patient system as experienced by the nurses at these two different points in time and discuss implications for evaluating usability in health care....

Earthdata User Interface Patterns: Building Usable Web Interfaces Through a Shared UI Pattern Library

Science.gov (United States)

Siarto, J.

2014-12-01

As more Earth science software tools and services move to the web--the design and usability of those tools become ever more important. A good user interface is becoming expected and users are becoming increasingly intolerant of websites and web applications that work against them. The Earthdata UI Pattern Library attempts to give these scientists and developers the design tools they need to make usable, compelling user interfaces without the associated overhead of using a full design team. Patterns are tested and functional user interface elements targeted specifically at the Earth science community and will include web layouts, buttons, tables, typography, iconography, mapping and visualization/graphing widgets. These UI elements have emerged as the result of extensive user testing, research and software development within the NASA Earthdata team over the past year.

Implementing a collaborative virtual environment — specification for a usability metamodel

Directory of Open Access Journals (Sweden)

Maria L Villegas R

2009-01-01

Full Text Available This research presents the results of the first phase of a macro-project for constructing a collaborative virtual environment. It was aimed at selecting a graphical interface from five proposed for such environment, considering each one’s level of usability. Seve- ral standards of usability and user-centered design patterns were studied for specifying interface measurment criteria for speci- fying a usability metamodel; this defined the variables and rules to be taken into accout when measuring graphic user interface (GUI usability level for collaborative virtual environments. The use of metaphors when specifying graphic user interfaces is also briefly looked at as a source of new usability and satisfaction related to such interface use.

The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence.

Science.gov (United States)

Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y

2016-05-12

Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also

Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

Science.gov (United States)

Guo, J.; Iribarren, S.; Kapsandoy, S.; Perri, S.; Staggers, N.

2011-01-01

Background Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. Objective To conduct a formal usability evaluation of an implemented eMAR. Methods Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. Results Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. Conclusion The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety. PMID:23616871

Human Machine Interface and Usability Issues: Exploring a Preliminary Mission Management System Evaluation Methodology

National Research Council Canada - National Science Library

Kardos, Monique

2001-01-01

...) concept demonstrator test during June 2000. The questionnaire was designed to examine usability and interface issues relating to the design of the systems or tools, and to provide suggestions for future iterations of the system...

What words and where? Applying usability testing techniques to name a new live reference service.

Science.gov (United States)

Duncan, Vicky; Fichter, Darlene M

2004-04-01

A user-focused design approach was taken to develop a new "live reference" service at the Health Sciences Library, University of Saskatchewan. The name of the service, the placement of the links, and the design of a graphical button were seen as key elements in creating service awareness and its subsequent use. To ensure library users recognized and understood the label for the new service, selected library users were given an opportunity to choose a phrase that would best describe the service. The top two preferred phrases were then placed on the library Web pages as text and graphic images for further testing. Some pages had links in multiple locations to determine which placement worked best. Task-based usability testing was carried out with participants who were unaware of the new service. Participants were observed as they completed seven Website tasks arranged in increasing levels of difficulty to see whether they would notice the live reference service and seek assistance. The high level of recognition and use of the service indicate that the label name and link placement were effective with library Website users. Using user-centered design methodology helped ensure that the new live reference service was visible and used and demonstrated the effectiveness of the user-centered design approach for adding new services to an existing Website.

Testing the Usability of a Portable DVD Player and Tailored Photo Instructions with Older Adult Veterans

Science.gov (United States)

Gould, Christine E.; Zapata, Aimee Marie L.; Shinsky, Deanna N.; Goldstein, Mary K.

2018-01-01

DVD-delivered behavioral skills training may help disseminate efficacious treatments to older adults independent of internet access. The present study examined the usability of a portable DVD player alongside iterative revisions of accompanying instructions to be used by older adults in a DVD-delivered behavioral skills treatment study. The sample…

What makes an automated teller machine usable by blind users?

Science.gov (United States)

Manzke, J M; Egan, D H; Felix, D; Krueger, H

1998-07-01

Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.

Assessment of Usability Benchmarks: Combining Standardized Scales with Specific Questions

Directory of Open Access Journals (Sweden)

Stephanie Bettina Linek

2011-12-01

Full Text Available The usability of Web sites and online services is of rising importance. When creating a completely new Web site, qualitative data are adequate for identifying the most usability problems. However, changes of an existing Web site should be evaluated by a quantitative benchmarking process. The proposed paper describes the creation of a questionnaire that allows a quantitative usability benchmarking, i.e. a direct comparison of the different versions of a Web site and an orientation on general standards of usability. The questionnaire is also open for qualitative data. The methodology will be explained by the digital library services of the ZBW.

Lessons from an Educational Game Usability Evaluation

Directory of Open Access Journals (Sweden)

Gabriela Trindade Perry

2012-04-01

Full Text Available In this paper, we present the results of a usability evaluation for Xenubi, a cell phone game about the periodic table. We describe and discuss the issues that we faced during the evaluation, which took place in a state high school. These issues are related to conflicts between the data that were gathered through video recordings and through a questionnaire. We also point to the poor performance of the game mechanics during the evaluation. This result was unexpected because the game had an excellent performance in the pilot test. Possible causes for these differences are discussed.

75 FR 45494 - Implementation of Section 224 of the Act; a National Broadband Plan for Our Future

Science.gov (United States)

2010-08-03

... Attachment Notice 73 FR 6879, February 6, 2008 in recognition of the importance of pole attachments to the... techniques take advantage of usable physical space on the existing pole. 15. The Eleventh Circuit... deployment of communications technologies, consistent with the broad ``pro competitive'' purposes of the 1996...

Brief Report: Web-based Management of Adolescent Chronic Pain: Development and Usability Testing of an Online Family Cognitive Behavioral Therapy Program

OpenAIRE

Long, Anna C.; Palermo, Tonya M.

2008-01-01

Objectives This study evaluates the usability and feasibility of a Web-based intervention (Web-MAP) to deliver cognitive behavioral therapy (CBT) to adolescents with chronic pain and their parents. Methods The Web site was evaluated in two stages. In stage one, recovered adolescents and parents (n = 5 dyads), who had completed office-based CBT through a pediatric pain management clinic, completed ratings of Web site content, usability, appearance, and theme. In stage two, treatment-seeking ad...

Software Usability: Concepts, Attributes and Associated Health Problems

Directory of Open Access Journals (Sweden)

Grīnberga Sabīne

2016-10-01

Full Text Available Digital technologies have opened a large set of opportunities for new electronic services (e-commerce, e-health, e-studies etc.. There are many considerations that need to be made when programmers are building new application software or system software. The software needs to be attractive enough that people want to look at it. It also needs to contain all necessary information that developers want to share with their readers (customers, users in order to help them achieve the objective for which they came to their website, use their software, or interact with their teaching packages. The oversupply of e-services products has created a need for usability research and development. “Usability means making products and systems easier to use, and matching them more closely to user needs and requirements”. Usability is a key concept of the human-computer interface and is concerned with making computer systems easy to learn and easy to use through a user-centered design process. The in-depth understanding of usability concepts and processes are critical for large-scale acceptance of new e-services and knowledge productivity. Poorly designed software can be extremely annoying to users. Smith and Mayes state that „usability is now recognised as a vital determining factor in the success of any new computer system or computer-based service”. Studies have shown that the main health problems of computer users are repetitive strain injuries, visual discomfort and stress-related disorders. Beside other risk factors, such as poor workstation design, uncomfortable work postures, long hours of computer use every day, stress, etc., also poor design and usability of the computer systems, as well as computer technical problems, add to the pressure felt by the user, which may in turn cause stress-related disorders.

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

Science.gov (United States)

Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

2017-01-01

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

Social Context in Usability Evaluations: Concepts, Processes and Products

DEFF Research Database (Denmark)

Jensen, Janne Jul

social context is considered important, only little research has been done to identify how it influences usability evaluations. In this thesis I explore how social context affects the process and product of a usability evaluation and explain the findings in terms of the theory of behaviour settings...... leader) and non-operatives (members, spectators, neutrals and potentials) from the theory of behaviour settings to usability evaluations generates an understanding and create an awareness of the level of power possessed by each of the participants in the social context. 2. On the operative level...... and a field experiment. Findings from these activities are presented in five published paper contributions. I furthermore introduce the theory of behaviour settings as a tool to help characterise the key concepts of social context which, together with an understanding of usability evaluations, provide...

Dogmas in the assessment of usability evaluation methods

DEFF Research Database (Denmark)

Hornbæk, Kasper

2010-01-01

Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work ...... research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined......Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work...... on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win-lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss...

VoIP Accessibility: A Usability Study of Voice over Internet Protocol (VoIP) Systems and A Survey of VoIP Users with Vision Loss

Science.gov (United States)

Packer, Jaclyn; Reuschel, William

2018-01-01

Introduction: Accessibility of Voice over Internet Protocol (VoIP) systems was tested with a hands-on usability study and an online survey of VoIP users who are visually impaired. The survey examined the importance of common VoIP features, and both methods assessed difficulty in using those features. Methods: The usability test included four paid…

Investigation of the Usability of Computerized Critical Care Information Systems in Germany.

Science.gov (United States)

von Dincklage, Falk; Suchodolski, Klaudiusz; Lichtner, Gregor; Friesdorf, Wolfgang; Podtschaske, Beatrice; Ragaller, Maximilian

2017-01-01

The term "usability" describes how effectively, efficiently, and with what level of user satisfaction an information system can be used to accomplish specific goals. Computerized critical care information systems (CCISs) with high usability increase quality of care and staff satisfaction, while reducing medication errors. Conversely, systems lacking usability can interrupt clinical workflow, facilitate errors, and increase charting time. The aim of this study was to investigate and compare usability across CCIS currently used in Germany. In this study, German intensive care unit (ICU) nurses and physicians completed a specialized, previously validated, web-based questionnaire. The questionnaire assessed CCIS usability based on three rating models: an overall rating of the systems, a model rating technical usability, and a model rating task-specific usability. We analyzed results from 535 survey participants and compared eight different CCIS commonly used in Germany. Our results showed that usability strongly differs across the compared systems. The system ICUData had the best overall rating and technical usability, followed by the platforms ICM and MetaVision. The same three systems performed best in the rating of task-specific usability without significant differences between each other. Across all systems, overall ratings were more dependent on ease-of-use aspects than on aspects of utility/functionality, and the general scope of the functions offered was rated better than how well the functions are realized. Our results suggest that manufacturers should shift some of their effort away from the development of new features and focus more on improving the ease-of-use and quality of existing features.

Evaluation of Virtual Teaching-Learning Environments based on usability standards

Directory of Open Access Journals (Sweden)

Jose I. Cocunubo-Suarez

2018-01-01

Full Text Available The main objective of this review article is to determine the necessary sub-characteristics or aspects for the evaluation of Virtual Teaching-Learning Environments (VTLEs as final or finished products based on ISO 9126, 14598 and 25000-SQuaRE standards. A systematic information search was carried out. A total of 108 documents were retrieved about subjects such as web usability, virtual learning environments, usability, educational software, educational web evaluation, usability evaluation and web usability evaluation. Out of the 108 documents, 70 were selected by inclusion and exclusion analysis. The eight subfeatures of greater statistical frequency were identified among the subset of documents and then integrated as a proposal for standard 25000-SQuaRE.

Game usability advancing the player experience

CERN Document Server

Isbister, Katherine

2008-01-01

I. What is usability and why should I care?A. Overview chapter Isbister and Schaffer (Editors)Introduces key concepts and positions book for primary audiences: game developers andstudents aspiring to work in game development. Addresses key concerns that developersmay have about adopting usability, and sets a broad road map of what is to come in thebook.B. Interview with Tobi Saulnier of 1st PlayableA discussion with the CEO of a small game studio about why and how she uses usabilitytechniques in her development.C. Interview with Don Norman of Nielsen Norman groupA discussion with one of the pr

Let Your Users Do the Testing

DEFF Research Database (Denmark)

Bruun, Anders; Gull, Peter; Hofmeister, Lene

2009-01-01

Remote asynchronous usability testing is characterized by both a spatial and temporal separation of users and evaluators. This has the potential both to reduce practical problems with securing user attendance and to allow direct involvement of users in usability testing. In this paper, we report...... from an empirical study where we systematically compared three methods for remote asynchronous usability testing: user-reported critical incidents, forum-based online reporting and discussion, and diary-based longitudinal user reporting. In addition, conventional laboratory-based think-aloud testing...

Protocol for Usability Testing and Validation of the ISO Draft International Standard 19223 for Lung Ventilators

Science.gov (United States)

2017-01-01

Background Clinicians, such as respiratory therapists and physicians, are often required to set up pieces of medical equipment that use inconsistent terminology. Current lung ventilator terminology that is used by different manufacturers contributes to the risk of usage errors, and in turn the risk of ventilator-associated lung injuries and other conditions. Human factors and communication issues are often associated with ventilator-related sentinel events, and inconsistent ventilator terminology compounds these issues. This paper describes our proposed protocol, which will be implemented at the University of Waterloo, Canada when this project is externally funded. Objective We propose to determine whether a standardized vocabulary improves the ease of use, safety, and utility as it relates to the usability of medical devices, compared to legacy medical devices from multiple manufacturers, which use different terms. Methods We hypothesize that usage errors by clinicians will be lower when standardization is consistently applied by all manufacturers. The proposed study will experimentally examine the impact of standardized nomenclature on performance declines in the use of an unfamiliar ventilator product in clinically relevant scenarios. Participants will be respiratory therapy practitioners and trainees, and we propose studying approximately 60 participants. Results The work reported here is in the proposal phase. Once the protocol is implemented, we will report the results in a follow-up paper. Conclusions The proposed study will help us better understand the effects of standardization on medical device usability. The study will also help identify any terms in the International Organization for Standardization (ISO) Draft International Standard (DIS) 19223 that may be associated with recurrent errors. Amendments to the standard will be proposed if recurrent errors are identified. This report contributes a protocol that can be used to assess the effect of

The Software Therapist: Usability Problem Diagnosis Through Latent Semantic Analysis

National Research Council Canada - National Science Library

Sparks, Randall; Hartson, Rex

2006-01-01

The work we report on here addresses the problem of low return on investment in software usability engineering and offers support for usability practitioners in identifying, understanding, documenting...

Examining the Use of Usability Results in a Software Development Company

DEFF Research Database (Denmark)

Høegh, Rune Thaarup; Stage, Jan

2004-01-01

This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...... from the company found that the traditional usability report plays a very little role for the development team. Initial results suggest that textual feedback proves more valuable when accompanied with video and oral feedback.......This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...

Expanding Usability of Virtual Network Laboratory in IT Engineering Education

Directory of Open Access Journals (Sweden)

Dalibor M Dobrilovic

2013-02-01

Full Text Available This paper deals with importance of virtual network laboratories usage in IT engineering education. It presents the particular virtual network laboratory model developed for usage in Computer Networks course as well. This virtual network laboratory, called VNLab, is based on virtualization technology. It has been successfully tested in educational process of Computer Network course for IT undergraduate students. Its usability for network related courses is analyzed by comparison of recommended curricula’s of world organizations such as IEEE, ACM and AIS. This paper is focused on expanding the usability of this virtual network laboratory to other non-network related courses. The primary expansion field is in domain of IT System Administration, IT Systems and Data Security and Operating Systems as well. The possible learning scenarios, learning tools and concepts for making this system applicable in these three additional fields are presented by the analyses of compatibility with recommended learning topics and outcomes by IEEE, ACM and AIS.

Comparing two anesthesia information management system user interfaces: a usability evaluation.

Science.gov (United States)

Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M

2012-11-01

design problems were identified in the revised user interface. The usability of anesthesia information management systems can be evaluated using a low-fidelity simulated clinical environment. User testing of the revised user interface showed improvement in some usability metrics and highlighted areas for further revision. Vendors of AIMS and those who use them should consider adopting methods to evaluate and improve AIMS usability.

IT investment decision making : Usability of a normative model

NARCIS (Netherlands)

Wijnhoven, Alphonsus B.J.M.; Heerkens, Johannes M.G.

This article analyzes the usability of a multi-criteria decision analysis based on a real options AHP (ROAHP) method for IT-investment decisions. The study presents ROAHP to Chief Information Officers (CIO’s) and collects their opinions on prerequisites for usability, strengths and weaknesses. To

Accessibility and usability OCW data: The UTPL OCW

Directory of Open Access Journals (Sweden)

Germania Rodríguez

2017-08-01

Full Text Available This data article provides a data description on article entitled “A framework for improving web accessibility and usability of Open Course Ware sites” [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

Training Software Developers in Usability Engineering: A Literature Review

DEFF Research Database (Denmark)

Bruun, Anders

2010-01-01

. This paper presents a comprehensive literature study of research conducted in this area, where 129 papers are analyzed in terms of research focus, empirical basis, types of training participants and training costs. Findings show a need for further empirical research regarding long term effects of training...... to fund usability specialists or comprehensive consultancy. Training of non-usability personnel in critical usability engineering methods has the potential of easing these challenges. It is, however, unknown how much and what kind of research that has been committed to novice training in UE methods......, training costs and training in user based evaluation methods....

Electromagnetic compatibility for the control and command equipments in nuclear power plants

International Nuclear Information System (INIS)

Buisson, J.

1985-06-01

Different kinds of electrical interference produce some disturbance on electronic sub-assemblies used to assume the control and the command of nuclear reactors. Following interferences are described: power supply lines perturbations, potential difference between grounding connections, electromagnetic fields. A method is described for testing the EMC of different equipments. The advantages of this method are: no destructive method, usable for testing equipment ''in situ'' in operating conditions on nuclear power plant, usable for testing equipment before operating conditions (acceptance test), level of the testing signals similar to the electrical interference level induced by the electromagnetic environment in normal operating conditions, no particular equipment and installation for test are required [fr

Development and Usability Testing of a Computer-Tailored Decision Support Tool for Lung Cancer Screening: Study Protocol.

Science.gov (United States)

Carter-Harris, Lisa; Comer, Robert Skipworth; Goyal, Anurag; Vode, Emilee Christine; Hanna, Nasser; Ceppa, DuyKhanh; Rawl, Susan M

2017-11-16

Awareness of lung cancer screening remains low in the screening-eligible population, and when patients visit their clinician never having heard of lung cancer screening, engaging in shared decision making to arrive at an informed decision can be a challenge. Therefore, methods to effectively support both patients and clinicians to engage in these important discussions are essential. To facilitate shared decision making about lung cancer screening, effective methods to prepare patients to have these important discussions with their clinician are needed. Our objective is to develop a computer-tailored decision support tool that meets the certification criteria of the International Patient Decision Aid Standards instrument version 4.0 that will support shared decision making in lung cancer screening decisions. Using a 3-phase process, we will develop and test a prototype of a computer-tailored decision support tool in a sample of lung cancer screening-eligible individuals. In phase I, we assembled a community advisory board comprising 10 screening-eligible individuals to develop the prototype. In phase II, we recruited a sample of 13 screening-eligible individuals to test the prototype for usability, acceptability, and satisfaction. In phase III, we are conducting a pilot randomized controlled trial (RCT) with 60 screening-eligible participants who have never been screened for lung cancer. Outcomes tested include lung cancer and screening knowledge, lung cancer screening health beliefs (perceived risk, perceived benefits, perceived barriers, and self-efficacy), perception of being prepared to engage in a patient-clinician discussion about lung cancer screening, occurrence of a patient-clinician discussion about lung cancer screening, and stage of adoption for lung cancer screening. Phases I and II are complete. Phase III is underway. As of July 15, 2017, 60 participants have been enrolled into the study, and have completed the baseline survey, intervention, and first

78 FR 41609 - Energy Conservation Program for Consumer Products: Test Procedures for Refrigerators...

Science.gov (United States)

2013-07-10

... September 14, 1977. 42 FR 46140. Industry representatives viewed these test procedures as too complex and... Freezers'' (HRF-1- 1979). Using this industry-created test procedure, DOE revised its test procedures on... compartment of such a product to be at a level that would effectively exclude the coverage of combination wine...

A methodological approach for designing a usable ontology-based GUI in healthcare.

Science.gov (United States)

Lasierra, N; Kushniruk, A; Alesanco, A; Borycki, E; García, J

2013-01-01

This paper presents a methodological approach to the design and evaluation of an interface for an ontology-based system used for designing care plans for monitoring patients at home. In order to define the care plans, physicians need a tool for creating instances of the ontology and configuring some rules. Our purpose is to develop an interface to allow clinicians to interact with the ontology. Although ontology-driven applications do not necessarily present the ontology in the user interface, it is our hypothesis that showing selected parts of the ontology in a "usable" way could enhance clinician's understanding and make easier the definition of the care plans. Based on prototyping and iterative testing, this methodology combines visualization techniques and usability methods. Preliminary results obtained after a formative evaluation indicate the effectiveness of suggested combination.

Usability in product development practice; an exploratory case study comparing four markets.

Science.gov (United States)

van Kuijk, Jasper; van Driel, Liesbeth; van Eijk, Daan

2015-03-01

This study explored how usability was dealt with in four product development organizations active in different sectors: high-end automotive, professional printers and copiers, office coffee makers and fast moving consumer goods. The primary differentiators of the selected cases were whether they were targeting businesses or consumers and the degree of product complexity. Interviews with 19 product development practitioners were conducted, focussing on three topics: 1) the product development process and the integration of user involvement, 2) multidisciplinary teamwork, and 3) organizational attitude towards usability. Based on the interviews, context descriptions of the companies were created and barriers and enablers for usability were identified. To verify the findings and to discuss remaining issues a feedback workshop was held in which the primary contact from each company participated. The results indicate that differences in product-market combination lead to differences in organizational attitude towards usability. The prioritization of usability in an organization seems to be influenced by the degree of product complexity (complex products are more prone to suffer from usability issues) and whether developers think that usability is a purchase consideration for their clients. The product-market combination a company targets also affects the methods for user-centred design that a company can apply and that are relevant. What methods for user-centred design are used also seems to be influenced by the attitude towards usability: if usability is considered more important, methods that require more resources can be applied. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Sensitivity, reliability and the effects of diurnal variation on a test battery of field usable upper limb fatigue measures.

Science.gov (United States)

Yung, Marcus; Wells, Richard P

2017-07-01

Fatigue has been linked to deficits in production quality and productivity and, if of long duration, work-related musculoskeletal disorders. It may thus be a useful risk indicator and design and evaluation tool. However, there is limited information on the test-retest reliability, the sensitivity and the effects of diurnal fluctuation on field usable fatigue measures. This study reports on an evaluation of 11 measurement tools and their 14 parameters. Eight measures were found to have test-retest ICC values greater than 0.8. Four measures were particularly responsive during an intermittent fatiguing condition. However, two responsive measures demonstrated rhythmic behaviour, with significant time effects from 08:00 to mid-afternoon and early evening. Action tremor, muscle mechanomyography and perceived fatigue were found to be most reliable and most responsive; but additional analytical considerations might be required when interpreting daylong responses of MMG and action tremor. Practitioner Summary: This paper presents findings from test-retest and daylong reliability and responsiveness evaluations of 11 fatigue measures. This paper suggests that action tremor, muscle mechanomyography and perceived fatigue were most reliable and most responsive. However, mechanomyography and action tremor may be susceptible to diurnal changes.

Usability testing of gaming and social media applications for stroke and cerebral palsy upper limb rehabilitation.

Science.gov (United States)

Valdés, Bulmaro A; Hilderman, Courtney G E; Hung, Chai-Ting; Shirzad, Navid; Van der Loos, H F Machiel

2014-01-01

As part of the FEATHERS (Functional Engagement in Assisted Therapy Through Exercise Robotics) project, two motion tracking and one social networking applications were developed for upper limb rehabilitation of stroke survivors and teenagers with cerebral palsy. The project aims to improve the engagement of clients during therapy by using video games and a social media platform. The applications allow users to control a cursor on a personal computer through bimanual motions, and to interact with their peers and therapists through the social media. The tracking applications use either a Microsoft Kinect or a PlayStation Eye camera, and the social media application was developed on Facebook. This paper presents a usability testing of these applications that was conducted with therapists from two rehabilitation clinics. The "Cognitive Walkthrough" and "Think Aloud" methods were used. The objectives of the study were to investigate the ease of use and potential issues or improvements of the applications, as well as the factors that facilitate and impede the adoption of technology in current rehabilitation programs.

Website Usability in Asia “From Within”

DEFF Research Database (Denmark)

Nawaz, Ather; Clemmensen, Torkil

2013-01-01

As the number of website users in Asia grows, there is an increasing need to gain an overview of human–computer interaction (HCI) research about users and websites in that context. This article presents an overview of HCI research on website usability in Asia “from within,” which outlines...... discusses the results and the need for a greater sensitivity to what is “local” and “from within” in HCI research and what this can add to the existing literature on website usability....

What do thinking-aloud participants say? A comparison of moderated and unmoderated usability sessions

DEFF Research Database (Denmark)

Hertzum, Morten; Borlund, Pia; Kristoffersen, Kristina Bonde

2015-01-01

The value of thinking aloud in usability tests depends on the content of the users’ verbalizations. We investigated moderated and unmoderated users’ verbalizations during relaxed thinking aloud (i.e., verbalization at levels 1 through 3). Verbalizations of user experience were frequent and mostly...

Usability challenges in an Ethiopian software development organization

DEFF Research Database (Denmark)

Teka, Degif; Dittrich, Yvonne; Kifle, Mesfin

2016-01-01

Usability and user centered design (UCD) are central to software development. In developing countries, the gap between IT development and the local use situation is larger than in western countries. However, usability is neither well addressed in software practice nor at the policy making level...... in Ethiopia. Software practitioners focus on functional requirements, meeting deadlines and budget. The software development industry in Ethiopia is in its early stage. The article aims at understanding usability practices in an Ethiopian software development company. Developers, system analysts, product...... configuration, their experience, cultural knowledge and common sense regarding the users' situation guided the design. Prototypes and fast delivery of working versions helped in getting user feedback even if early user focus proved to be a challenge as communication between developers and users suffered from...

Usability Briefing - a process model for healthcare facilities

DEFF Research Database (Denmark)

Fronczek-Munter, Aneta

2014-01-01

Background: In complex buildings with many types of users it can be difficult to satisfy the numerous, often contradictory requirements. Research in usability mostly focuses on evaluating products or facilities with users, after they were built. This paper is part of a PhD project “Usability...... with various users/stakeholders, using creative boundary objects at workshops.  Practical Implications: The research results have relevance to researchers, client organisations, facility managers and architects planning new complex facilities.  Research limitations: The proposed model is theoretical and needs...... briefing for hospitals”, where methods for capturing user needs and experiences at hospital facilities are investigated in order to feed into design processes and satisfy the users’ needs and maximise the effectiveness of facilities. Purpose: This paper introduces the concept of usability briefing...

Usability evaluation model for mobile e-book applications

Science.gov (United States)

Matraf, Munya Saleh Ba; Hussain, Azham

2017-10-01

Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.

Usability evaluation of augmented reality user interfaces in games and personal navigation assistants

OpenAIRE

Ivanec, Zorian

2017-01-01

This paper studies heuristic usability evaluation of user interfaces. The literature review distinguishes characteristics of augmented reality and smartphones, presents heuristic evaluation, PACMAD usability model, personal navigation assistants, video games, augmented reality and J. Nielsen usability heuristics. In research part, usability heuristics of related subject fields and design guidelines are combined. Created heuristics and control questionnaire are used for evaluation of augmented...

Investigating the effect of m-commerce design usability on customers' trust

Science.gov (United States)

Hussain, Azham Bin; Mahmood, Alaa Thamer; Naser, Raed Kamil

2017-10-01

User experience may vary from one user to another based on the design characteristics for processing a certain task. Our review of the literature revealed that there is a noticeable lack of studies on the effect of mobile or m-commerce design usability on customers' trust to perform certain activities. We investigated the effect of m-commerce design usability in terms of navigability, supportability, readability, creditability, and content relevant. A close-ended questionnaire was distributed to 20 customers who were asked to perform some tasks. The result showed that majority of the participants found m-commerce design usability to influence their trust of the app. The mentioned usability elements were found to positively influence customers' trust except for supportability. Our findings provide some insights to the m-commerce designers and developers and extend the current understanding about the potential of design usability in explaining users' usage behavior.

The AutoProof Verifier: Usability by Non-Experts and on Standard Code

Directory of Open Access Journals (Sweden)

Carlo A. Furia

2015-08-01

Full Text Available Formal verification tools are often developed by experts for experts; as a result, their usability by programmers with little formal methods experience may be severely limited. In this paper, we discuss this general phenomenon with reference to AutoProof: a tool that can verify the full functional correctness of object-oriented software. In particular, we present our experiences of using AutoProof in two contrasting contexts representative of non-expert usage. First, we discuss its usability by students in a graduate course on software verification, who were tasked with verifying implementations of various sorting algorithms. Second, we evaluate its usability in verifying code developed for programming assignments of an undergraduate course. The first scenario represents usability by serious non-experts; the second represents usability on "standard code", developed without full functional verification in mind. We report our experiences and lessons learnt, from which we derive some general suggestions for furthering the development of verification tools with respect to improving their usability.

Training Software Developers and Designers to Conduct Usability Evaluations

Science.gov (United States)

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

Big Data in kleinen und mittleren Unternehmen: Eine empirische Bestandsaufnahme

OpenAIRE

Vossen, Gottfried; Lechtenbörger, Jens; Fekete, David

2015-01-01

Dieser Bericht untersucht das Potential von Big Data in und für kleine und mittlere Unternehmen (KMU). Dafür werden mittels einer Umfrage, Fokus-Interviews und zusätzlichen Recherchen die Potentiale und Herausforderungen bei Big Data untersucht, welche für KMU zu Tragen kommen. Der Begriff Big Data selbst wird genauer betrachtet und es wird erklärt, welche Dimensionen abseits schierer Größe ebenfalls dazu zählen, wie etwa Vielfalt oder Schnelligkeit der Daten. Weiter wird mit eingängigen Prax...

Usability inspection to improve an electronic provincial medication repository.

Science.gov (United States)

Kitson, Nicole A; Price, Morgan; Bowen, Michael; Lau, Francis

2013-01-01

Medication errors are a significant source of actual and potential harm for patients. Community medication records have the potential to reduce medication errors, but they can also introduce unintended consequences when there is low fit to task (low cognitive fit). PharmaNet is a provincially managed electronic repository that contains the records for community-based pharmacy-dispensed medications in British Columbia. This research explores the usability of PharmaNet, as a representative community-based medication repository. We completed usability inspections of PharmaNet through vendor applications. Vendor participants were asked to complete activity-driven scenarios, which highlighted aspects of medication management workflow. Screen recording was later reviewed. Heuristics were applied to explore usability issues and improvement opportunities. Usability inspection was conducted with four PharmaNet applications. Ninety-six usability issues were identified; half of these had potential implications for patient safety. These were primarily related to login and logout procedures; display of patient name; display of medications; update and display of alert information; and the changing or discontinuation of medications. PharmaNet was designed primarily to support medication dispensing and billing activities by community pharmacies, but is also used to support care providers with monitoring and prescribing activities. As such, some of the features do not have a strong fit for other clinical activities. To improve fit, we recommend: having a Current Medications List and Displaying Medication Utilization Charts.

78 FR 30899 - Agency Information Collection Activities; Comment Request; NCES Cognitive, Pilot, and Field Test...

Science.gov (United States)

2013-05-23

... requested data in the desired format. ED is soliciting comments on the proposed information collection... and methodologies. The procedures utilized to this effect include but are not limited to experiments... activities, pilot testing, exploratory interviews, experiments with questionnaire design, and usability...

Present state of radiography and connected techniques

International Nuclear Information System (INIS)

Boutaine, J.L.

1991-01-01

In this paper are developed the different sources employed in non destructive testing using ionizing radiations and the different usable systems of detection. Are also presented few examples showing the compared interests of radiographic or radiometric control methods. 21 refs [fr

Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves

Science.gov (United States)

Hamilton, George S.; Brookman, Stephen; Dumas, Joseph D. II; Tilghman, Neal

2003-01-01

Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

Science.gov (United States)

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool

NARCIS (Netherlands)

Peute, Linda W. P.; de Keizer, Nicolette F.; Jaspers, Monique W. M.

2015-01-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive

Usability study of youtube websites for Malaysian teenagers

Science.gov (United States)

Razak, Mohd Nur Faiz Abd; Hussain, Azham; Hamdi, Mohd Maizan Fishol

2017-10-01

Nowadays, YouTube is the 3rd most visited website in the world. It was created for users to search, watch and share video. Statistics show that YouTube run in more than 88 countries and support 76 different languages which covered almost 95% of Internet population globally. Therefore, a usability study is for specific type of users such as based on gender, range of age and country is considered a must for this kind of top website. In this study, we focus on YouTube website usability for Malaysian teenagers that are currently schooling in boarding school with limited access of Internet. It was done in a controlled lab environment with proper devices and software as MacBook, LCD Monitor, and WhatPulse heat map tracker. The evaluation was made based on usability metrics: ease of use, usefulness and satisfaction of users with combination of recording videos, mouse and keyboard heat map and questionnaires. Findings show that most of the respondents just use YouTube for video watching only while ignoring other features in the same time. There are difficulties in using it at the first moment but could catch up in short time. It shows how usable YouTube website especially in the learnability and memorability aspects.

Web-Based Intervention to Reduce Substance Abuse and Depressive Symptoms in Mexico: Development and Usability Test.

Science.gov (United States)

Tiburcio, Marcela; Lara, Ma Asunción; Aguilar Abrego, Araceli; Fernández, Morise; Martínez Vélez, Nora; Sánchez, Alejandro

2016-09-29

The development of Web-based interventions for substance abuse in Latin America is a new field of interest with great potential for expansion to other Spanish-speaking countries. This paper describes a project aimed to develop and evaluate the usability of the Web-based Help Program for Drug Abuse and Depression (Programa de Ayuda para Abuso de Drogas y Depresión, PAADD, in Spanish) and also to construct a systematic frame of reference for the development of future Web-based programs. The PAADD aims to reduce substance use and depressive symptoms with cognitive behavioral techniques translated into Web applications, aided by the participation of a counselor to provide support and guidance. This Web-based intervention includes 4 steps: (1) My Starting Point, (2) Where Do I Want to Be? (3) Strategies for Change, and (4) Maintaining Change. The development of the program was an interactive multistage process. The first stage defined the core structure and contents, which were validated in stage 2 by a group of 8 experts in addiction treatment. Programming of the applications took place in stage 3, taking into account 3 types of end users: administrators, counselors, and substance users. Stage 4 consisted of functionality testing. In stage 5, a total of 9 health professionals and 20 drug users currently in treatment voluntarily interacted with the program in a usability test, providing feedback about adjustments needed to improve users' experience. The main finding of stage 2 was the consensus of the health professionals about the cognitive behavioral strategies and techniques included in PAADD being appropriate for changing substance use behaviors. In stage 5, the health professionals found the functionalities easy to learn; their suggestions were related to the page layout, inclusion of confirmation messages at the end of activities, avoiding "read more" links, and providing feedback about every activity. On the other hand, the users said the information presented

78 FR 69943 - Anthropomorphic Test Devices; Q3s 3-Year-Old Child Side Impact Test Dummy, Incorporation by...

Science.gov (United States)

2013-11-21

... airbag tests, Stapp Car Crash Journal, V44: 25-50. Since the Q3 had yet to show it was suitable for side... on May 2, 2002, 67 FR 21836. In early 2002, NHTSA tested a prototype version of the Q3s.\\6\\ NHTSA..., durability, and biofidelity. We determined that the thorax of the prototype appeared biofidelic and...

A literature review about usability evaluation methods for e-learning platforms.

Science.gov (United States)

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men.

Science.gov (United States)

Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G

2015-07-24

The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

Evaluating Usability of E-Learning Systems in Universities

OpenAIRE

Nicholas Kipkurui Kiget; Professor G. Wanyembi; Anselemo Ikoha Peters

2014-01-01

The use of e-learning systems has increased significantly in the recent times. E-learning systems are supplementing teaching and learning in universities globally. Kenyan universities have adopted e-learning technologies as means for delivering course content. However despite adoption of these systems, there are considerable challenges facing the usability of the systems. Lecturers and students have different perceptions in regard to the usability of e-learning systems. The aim of this study ...

Pilot implementation Driven by Effects Specifications and Formative Usability Evaluation

DEFF Research Database (Denmark)

Barlach, Anders; Hertzum, Morten; Simonsen, Jesper

2013-01-01

This chapter reports on the usability-engineering work performed throughout the pilot implementation of an Electronic Healthcare Record (EHR). The case describes and analyzes the use of pilot implementations to formatively evaluate whether the usability of the EHR meets the effects specified for ...

Methods in Mapping Usability of Malaysia’s Shopping Centre

Directory of Open Access Journals (Sweden)

Abdul Ghani Aida Affina

2016-01-01

Full Text Available With more than 200 number of shopping centre in Klang Valley itself, we the consumer actually have vast of choices. Instead of the machineries varieties from the lower class product till the posh one, each of those shopping centres eventually offers the typical product same as others. Those shopping centers are competing with each other and in great endeavour to attract more consumers, to visit and spend. As for the visitor, the typical product and boring ambience seems similar in all malls, and is looking something beyond the standard. Something that promising quality embedded in shopping centre which evokes the various emotions of the user along their journey in malls. This quality is known as usability. Usability; as defined generally is a global user’s experience response with product, environment, service or facilities. It is an assessment in extracting the qualities of shopping centre design. In mapping it, there are a few synthesizing methods to implement it. Therefore, this paper purposely to review the method that been used in usability of Malaysia’s shopping centre research with a few references on previous research done in usability assessment by predecessor’s scholars. With the accentuation on three elements that anchoring what the usability is: effectiveness, efficient and satisfaction, it is hope that this overview can lead other researcher in portraying its relationship with the quality and ‘user friendly’ design of shopping centre.

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability

Directory of Open Access Journals (Sweden)

van Dijk Frank JH

2010-10-01

Full Text Available Abstract Background Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. Methods We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction and facilitators and barriers in use. Results Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. Conclusions This network tool is a promising new strategy for offering company workers high quality information

Usability Testing for e-Resource Discovery: How Students Find and Choose e-Resources Using Library Web Sites

Science.gov (United States)

Fry, Amy; Rich, Linda

2011-01-01

In early 2010, library staff at Bowling Green State University (BGSU) in Ohio designed and conducted a usability study of key parts of the library web site, focusing on the web pages generated by the library's electronic resources management system (ERM) that list and describe the library's databases. The goal was to discover how users find and…

78 FR 49287 - Environmental Assessment for Potential Lease Issuance and Marine Hydrokinetic Technology Testing...

Science.gov (United States)

2013-08-13

...; MMAA104000] Environmental Assessment for Potential Lease Issuance and Marine Hydrokinetic Technology Testing... important environmental issues associated with data collection and technology testing activities (76 FR... Availability of a Revised Environmental Assessment and a Finding of No Significant Impact. SUMMARY: BOEM has...

The current status of usability studies of information technologies in China: a systematic study.

Science.gov (United States)

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. More human and material resources need to be invested in China's usability research, particularly in HIT.

Mixed Methods Not Mixed Messages: Improving LibGuides with Student Usability Data

Directory of Open Access Journals (Sweden)

Nora Almeida

2017-12-01

Full Text Available Abstract Objective – This article describes a mixed methods usability study of research guides created using the LibGuides 2.0 platform conducted in 2016 at an urban, public university library. The goal of the study was to translate user design and learning modality preferences into executable design principles, and ultimately to improve the design and usage of LibGuides at the New York City College of Technology Library. Methods – User-centred design demands that stakeholders participate in each stage of an application’s development and that assumptions about user design preferences are validated through testing. Methods used for this usability study include: a task analysis on paper prototypes with a think aloud protocol (TAP, an advanced scribbling technique modeled on the work of Linek and Tochtermann (2015, and semi-structured interviews. The authors introduce specifics of each protocol in addition to data collection and analysis methods. Results – The authors present quantitative and qualitative student feedback on navigation layouts, terminology, and design elements and discuss concrete institutional and technical measures they will take to implement best practices. Additionally, the authors discuss students’ impressions of multimedia, text-based, and interactive instructional content in relation to specific research scenarios defined during the usability test. Conclusion – The authors translate study findings into best practices that can be incorporated into custom user-centric LibGuide templates and assets. The authors also discuss relevant correlations between students’ learning modality preferences and design feedback, and identify several areas that warrant further research. The authors believe this study will spark a larger discussion about relationships between instructional design, learning modalities, and research guide use contexts.

On the Usability of Spoken Dialogue Systems

DEFF Research Database (Denmark)

Larsen, Lars Bo

 This work is centred on the methods and problems associated with defining and measuring the usability of Spoken Dialogue Systems (SDS). The starting point is the fact that speech based interfaces has several times during the last 20 years fallen short of the high expectations and predictions held...... by industry, researchers and analysts. Several studies in the literature of SDS indicate that this can be ascribed to a lack of attention from the speech technology community towards the usability of such systems. The experimental results presented in this work are based on a field trial with the OVID home...

Does Branding Need Web Usability? A Value-Oriented Empirical Study

Science.gov (United States)

Bolchini, Davide; Garzotto, Franca; Sorce, Fabio

Does usability of a web-based communication artifact affect brand, i.e., the set of beliefs, emotions, attitudes, or qualities that people mentally associate to the entity behind that artifact? Intuitively, the answer is “yes”: usability is a fundamental aspect of the quality of the experience with a website, and a “good” experience with a “product” or its reifications tends to translate into “good” brand perception. To date, however, the existence of a connection between web usability and brand perception is shown through anecdotic arguments, and is not supported by published systematic research. This paper discusses a study that empirically investigates this correlation in a more rigorous, analytical, and replicable way. Our main contribution is twofold: on the one hand, we provide empirical evidence to the heuristic principle that web usability influences branding, and we do that through four between subjects controlled experiments that involved 120 subjects. On the other hand, we inform the study with a systematic value-oriented approach to the user experience, and thus provide a conceptual framework that can be reused in other experimental settings, either for replicating our study, or for designing similar studies focusing on the correlation of web branding vs. design factors other than usability.

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

Science.gov (United States)

Thirumalai, Mohanraj; Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-05-24

People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready

Usability of a CKD Educational Website Targeted to Patients and Their Family Members

Science.gov (United States)

Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C.

2012-01-01

Summary Background and objectives Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Design, setting, participants, & measurements Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Results Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10–44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Conclusions Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet. PMID:22798537

Usability evaluation of user interface of thesis title review system

Science.gov (United States)

Tri, Y.; Erna, A.; Gellysa, U.

2018-03-01

Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

Usability Results from Human Performance Feedback and Development (HPFD) and ePerformance System Users: Technical Report #1

National Research Council Canada - National Science Library

Dean, Elizabeth; Aspinwall, Kimberly R; Schwerin, Michael J; Kendrick, Douglas E

2006-01-01

...) and ePerformance system. This second and final iteration of usability testing was designed to verify the functionality of system revisions made as a result of recommendations offered in Schwerin et al. (2004...