Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR.

Science.gov (United States)

Walji, Muhammad F; Kalenderian, Elsbeth; Piotrowski, Mark; Tran, Duong; Kookal, Krishna K; Tokede, Oluwabunmi; White, Joel M; Vaderhobli, Ram; Ramoni, Rachel; Stark, Paul C; Kimmes, Nicole S; Lagerweij, Maxim; Patel, Vimla L

2014-05-01

To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35). The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study.

Science.gov (United States)

Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang

2018-01-05

Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.

The current status of usability studies of information technologies in China: a systematic study.

Science.gov (United States)

Lei, Jianbo; Xu, Lufei; Meng, Qun; Zhang, Jiajie; Gong, Yang

2014-01-01

To systematically review and analyze the current status and characteristics of usability studies in China in the field of information technology in general and in the field of healthcare in particular. We performed a quantitative literature analysis in three major Chinese academic databases and one English language database using Chinese search terms equivalent to the concept of usability. Six hundred forty-seven publications were selected for analysis. We found that in China the literature on usability in the field of information technology began in 1994 and increased thereafter. The usability definitions from ISO 9241-11:1998 and Nielsen (1993) have been widely recognized and cited. Authors who have published several publications are rare. Fourteen journals have a publishing rate over 1%. Only nine publications about HIT were identified. China's usability research started relatively late. There is a lack of organized research teams and dedicated usability journals. High-impact theoretical studies are scarce. On the application side, no original and systematic research frameworks have been developed. The understanding and definition of usability is not well synchronized with international norms. Besides, usability research in HIT is rare. More human and material resources need to be invested in China's usability research, particularly in HIT.

The evaluator effect in usability studies: Problem detection and severity judgments

DEFF Research Database (Denmark)

Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

1998-01-01

Usability studies are commonly used in industry and applied in research as a yardstick for other usability evaluation methods. Though usability studies have been studied extensively, one potential threat to their reliability has been left virtually untouched: the evaluator effect. In this study......, four evaluators individually analyzed four videotaped usability test sessions. Only 20% of the 93 detected problems were detected by all evaluators, and 46% were detected by only a single evaluator. From the total set of 93 problems the evaluators individually selected the ten problems they considered...... most severe. None of the selected severe problems appeared on all four evaluators’ top-10 lists, and 4 of the 11 problems that were considered severe by more than one evaluator were only detected by one or two evaluators. Thus, both detection of usability problems and selection of the most severe...

Usability Constructs

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmesen, Torkil; Hornbæk, Kasper Anders Søren

2007-01-01

Whereas research on usability predominantly employs universal definitions of the aspects that comprise usability, people experience their use of information systems through personal constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected...... use of constructs traditionally associated with usability (e.g., easy-to-use, intuitive, and liked). Further analysis of the data is ongoing...

Improving Accessibility for Seniors in a Life-Long Learning Network: A Usability Study of Learning Websites

Science.gov (United States)

Gu, Xiaoqing; Ding, Rui; Fu, Shirong

2011-01-01

Senior citizens are comparatively vulnerable in accessing learning opportunities offered on the Internet due to usability problems in current web design. In an effort to build a senior-friendly learning web as a part of the Life-long Learning Network in Shanghai, usability studies of two websites currently available to Shanghai senior citizens…

How do Usability Professionals Construe Usability?

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmensen, Torkil

2012-01-01

distinguishing it from user experience. On the basis of repertory-grid interviews with 24 Chinese, Danish, and Indian usability professionals we find that they make use of more utilitarian than experiential, i.e. user-experience related, constructs. This indicates that goal-related performance is central......’ constructs, particularly their experiential constructs, go considerably beyond ISO 9241 usability, indicating a discrepancy between this definition of usability and the thinking of the professionals concerned with delivering usability. Finally, usability is construed rather similarly across the three...

Templates for Cross-Cultural and Culturally Specific Usability Testing

DEFF Research Database (Denmark)

Clemmensen, Torkil

2011-01-01

The cultural diversity of users of technology challenges our methods for usability testing. This article suggests templates for cross-culturally and culturally specific usability testing, based on studies of usability testing in companies in Mumbai, Beijing, and Copenhagen. Study 1 was a cross...... tests. The result was the construction of templates for usability testing. The culturally specific templates were in Mumbai “user-centered evaluation,” Copenhagen “client-centered evaluation,” and Beijing “evaluator-centered evaluation.” The findings are compared with related research...

Usability study of a novel, self-lighted, disposable speculum: military applications.

Science.gov (United States)

Jones, Christina L; Gruber, Daniel D; Warner, William; Buller, Jerome L

2013-04-01

Data collected from a postutilization questionnaire were used to evaluate the usability of the OfficeSPEC disposable vaginal speculum, specifically the effectiveness, efficiency, and acceptability, in clinical, hospital, and austere environments. Usability data analysis showed the OfficeSPEC speculum had an effectiveness rating of 4.6/5, efficiency rating of 4.5/5, and acceptability rating of 4.6/5; overall usability in deployed environments was favorable. The overall rankings were 3.4 for plastic, 4.2 for metal (p disposable speculum as a reasonable alternative with yearly cost of $129,200, compared to traditional metal ($209,100) and plastic ($319,175). By evaluating the OfficeSPEC speculum within a usability framework, it proved to be practical, viable alternative in all environments, particularly in the forward deployed environment. Reprint & Copyright © 2013 Association of Military Surgeons of the U.S.

The STEP database through the end-users eyes--USABILITY STUDY.

Science.gov (United States)

Salunke, Smita; Tuleu, Catherine

2015-08-15

The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.

Usability Evaluation for Business Intelligence Applications: A User Support Perspective

Directory of Open Access Journals (Sweden)

Chrisna Jooste

2014-08-01

Full Text Available Business Intelligence (BI applications provide business information to drive decision support. Usability is one of the factors determining the optimal use and eventual benefit derived from BI applications. The documented need for more BI usability research together with the practical necessity for BI evaluation guidelines in the mining industry provides the rationale for this study. The purpose of the study was to investigate the usability evaluation of BI applications in the context of a coal mining organization. The research is guided by the question: How can existing usability criteria be customized to evaluate the usability of BI applications. The research design included user observation, heuristic evaluation and a survey. Based on observations made during user support on a BI application used at a coal mining organization a log of usability issues was compiled. The usability issues extracted from this log was compared and contrasted with general usability criteria from literature to synthesize an initial set of BI usability evaluation criteria. These criteria were used as the basis for a heuristic evaluation of the BI application used at the coal mining organization. The same BI application was also evaluated using the Software Usability Measurement Inventory (SUMI standardized questionnaire. The results from the two evaluations were triangulated and then compared with the BI user issues again to contextualize the findings and synthesize a validated and refined set of criteria. The main contribution of the study is the usability evaluation criteria for BI applications presented as guidelines. These guidelines deviate from existing evaluation guidelines in the emphasis on information architecture, learnability and operability.

Usability study of youtube websites for Malaysian teenagers

Science.gov (United States)

Razak, Mohd Nur Faiz Abd; Hussain, Azham; Hamdi, Mohd Maizan Fishol

2017-10-01

Nowadays, YouTube is the 3rd most visited website in the world. It was created for users to search, watch and share video. Statistics show that YouTube run in more than 88 countries and support 76 different languages which covered almost 95% of Internet population globally. Therefore, a usability study is for specific type of users such as based on gender, range of age and country is considered a must for this kind of top website. In this study, we focus on YouTube website usability for Malaysian teenagers that are currently schooling in boarding school with limited access of Internet. It was done in a controlled lab environment with proper devices and software as MacBook, LCD Monitor, and WhatPulse heat map tracker. The evaluation was made based on usability metrics: ease of use, usefulness and satisfaction of users with combination of recording videos, mouse and keyboard heat map and questionnaires. Findings show that most of the respondents just use YouTube for video watching only while ignoring other features in the same time. There are difficulties in using it at the first moment but could catch up in short time. It shows how usable YouTube website especially in the learnability and memorability aspects.

Usability Studies and User-Centered Design in Digital Libraries

Science.gov (United States)

Comeaux, David J.

2008-01-01

Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…

Does Branding Need Web Usability? A Value-Oriented Empirical Study

Science.gov (United States)

Bolchini, Davide; Garzotto, Franca; Sorce, Fabio

Does usability of a web-based communication artifact affect brand, i.e., the set of beliefs, emotions, attitudes, or qualities that people mentally associate to the entity behind that artifact? Intuitively, the answer is “yes”: usability is a fundamental aspect of the quality of the experience with a website, and a “good” experience with a “product” or its reifications tends to translate into “good” brand perception. To date, however, the existence of a connection between web usability and brand perception is shown through anecdotic arguments, and is not supported by published systematic research. This paper discusses a study that empirically investigates this correlation in a more rigorous, analytical, and replicable way. Our main contribution is twofold: on the one hand, we provide empirical evidence to the heuristic principle that web usability influences branding, and we do that through four between subjects controlled experiments that involved 120 subjects. On the other hand, we inform the study with a systematic value-oriented approach to the user experience, and thus provide a conceptual framework that can be reused in other experimental settings, either for replicating our study, or for designing similar studies focusing on the correlation of web branding vs. design factors other than usability.

The impact of usability reports and user test observations on developers understanding of usability data

DEFF Research Database (Denmark)

Høegh, Rune Thaarup; Nielsen, Christian Monrad; Pedersen, Michael Bach

2006-01-01

of the system. This article presents results from an exploratory study of 2 ways of providing feedback from a usability evaluation: observation of user tests and reading usability reports. A case study and a field experiment were used to explore how observation and usability reports impact developers......' understanding of usability data. The results indicate that observation of user tests facilitated a rich understanding of usability problems and created empathy with the users and their work. The usability report had a strong impact on the developers' understanding of specific usability problems and supported...

A Longitudinal Study of Usability in Health Care - Does Time Heal?

DEFF Research Database (Denmark)

Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan

2007-01-01

for 15 months, we repeated the evaluation. Our aim was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information system may or may not disappear over time, as the nurses get more familiar......We report from a longitudinal laboratory-based usability evaluation of a health care information system. A usability evaluation was conducted with novice users when an electronic patient record system was being deployed in a large hospital. After the nurses had used the system in their daily work...... with it – if time heals poor design. On the basis of our study, we present findings on the usability of the electronic patient system as experienced by the nurses at these two different points in time and discuss implications for evaluating usability in health care....

Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.

Science.gov (United States)

Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott

2015-01-01

A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

Studying web usability with people with Learning Disabilities: what the literature tells us

Directory of Open Access Journals (Sweden)

Peter Edward Williams

2015-09-01

Full Text Available Introduction: It is well-recognised that the Internet may be an appropriate vehicle to provide information for people with Learning Disabilities. A small but growing body of research has studied the usability of the Internet for this purpose. This review examines the literature relating to this issue. Objectives: The objective of the paper is to examine current research and thinking around the issue of web design for people with Learning Disabilities, including an exploration both of methods used and key findings. Methods: A comprehensive literature review was undertaken encompassing material from the fields of education, computer science and health. Literature was elicited from various appropriate bibliographic databases. In examining the literature, an analytical proforma was used to elicit information, evaluate and compare studies. Results: A large number of methods by which usability has been studied with this cohort were elicited, including using a mainstream website; comparing an especially adapted website against an equivalent ‘’mainstream’ version and comparing various ‘accessible’ website designs. Similarly, studies included those comparing the performance of people with Learning Disabilities with a ‘mainstream’ cohort and on their own. Findings overall suggest that ‘accessible sites’ are easier to use for people with Learning Disabilities. Difficulties encountered include in reading, finding content from a large quantity of text and scrolling. Work examining the efficacy of images or icons has had contradictory findings, from having little or no benefit in terms of access to information, to significantly aiding the understanding of text. Conclusions: Contradictory or inconclusive findings suggest both a need for further research and for greater participation by people with Learning Disabilities themselves in studying the usability of web sites and other IT applications.

Development and testing of new upper-limb prosthetic devices: research designs for usability testing.

Science.gov (United States)

Resnik, Linda

2011-01-01

The purposes of this article are to describe usability testing and introduce designs and methods of usability testing research as it relates to upper-limb prosthetics. This article defines usability, describes usability research, discusses research approaches to and designs for usability testing, and highlights a variety of methodological considerations, including sampling, sample size requirements, and usability metrics. Usability testing is compared with other types of study designs used in prosthetic research.

National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability.

Science.gov (United States)

Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka

2011-10-01

In the health informatics field, usability studies typically focus on evaluating a single information system and involve a rather small group of end-users. However, little is known about the usability of clinical information and communication technology (ICT) environment in which healthcare professionals work daily. This paper aims at contributing to usability research and user-oriented development of healthcare technologies with three objectives: inform researchers and practitioners about the current state of usability of clinical ICT systems, increase the understanding of usability aspects specific for clinical context, and encourage a more holistic approach on studying usability issues in health informatics field. A national web questionnaire study was conducted in Finland in spring 2010 with 3929 physicians actively working in patient care. For the purposes of the study, we described three dimensions of clinical ICT system usability that reflect the physicians' viewpoint on system usage: (1) compatibility between clinical ICT systems and physicians' tasks, (2) ICT support for information exchange, communication and collaboration in clinical work, and (3) interoperability and reliability. The dimensions derive from the definitions of usability and clinical context of use analysis, and reflect the ability of ICT systems to have a positive impact on patient care by supporting physicians in achieving their goals with a pleasant user experience. The research data incorporated 32 statements with a five-point Likert-scale on physicians' experiences on usability of their currently used ICT systems and a summative question about school grade given to electronic health record (EHR) systems. Physicians' estimates of their EHR systems were very critical. With the rating scale from 4 or fail to 10 or excellent, the average of the grades varied from 6.1 to 8.4 dependent on the kind of facility the physician is working. Questionnaire results indicated several usability

Exploring Multiple Usability Perspectives

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias

2007-01-01

Industrial usability work often fails to produce the expected impact on software products even though significant resources have been used on uncovering problems and suggesting improvements. So, it seems that feedback from industrial usability work lacks persuasiveness, i.e. it fails to convince...... the key stakeholders that actions need to be taken. This study reports from interviews with 26 stakeholders in software development projects. Our data suggests that the interviewees address usability using different perspectives and based on our observations we describe five such perspectives. Further, we...... discuss how applying different usability perspectives might inform the persuasiveness of usability work....

An empirical study on website usability elements and how they affect search engine optimisation

Directory of Open Access Journals (Sweden)

Eugene B. Visser

2011-03-01

Full Text Available The primary objective of this research project was to identify and investigate the website usability attributes which are in contradiction with search engine optimisation elements. The secondary objective was to determine if these usability attributes affect conversion. Although the literature review identifies the contradictions, experts disagree about their existence.An experiment was conducted, whereby the conversion and/or traffic ratio results of an existing control website were compared to a usability-designed version of the control website,namely the experimental website. All optimisation elements were ignored, thus implementing only usability. The results clearly show that inclusion of the usability attributes positively affect conversion,indicating that usability is a prerequisite for effective website design. Search engine optimisation is also a prerequisite for the very reason that if a website does not rank on the first page of the search engine result page for a given keyword, then that website might as well not exist. According to this empirical work, usability is in contradiction to search engine optimisation best practices. Therefore the two need to be weighed up in terms of importance towards search engines and visitors.

Investigation of the Usability of Computerized Critical Care Information Systems in Germany.

Science.gov (United States)

von Dincklage, Falk; Suchodolski, Klaudiusz; Lichtner, Gregor; Friesdorf, Wolfgang; Podtschaske, Beatrice; Ragaller, Maximilian

2017-01-01

The term "usability" describes how effectively, efficiently, and with what level of user satisfaction an information system can be used to accomplish specific goals. Computerized critical care information systems (CCISs) with high usability increase quality of care and staff satisfaction, while reducing medication errors. Conversely, systems lacking usability can interrupt clinical workflow, facilitate errors, and increase charting time. The aim of this study was to investigate and compare usability across CCIS currently used in Germany. In this study, German intensive care unit (ICU) nurses and physicians completed a specialized, previously validated, web-based questionnaire. The questionnaire assessed CCIS usability based on three rating models: an overall rating of the systems, a model rating technical usability, and a model rating task-specific usability. We analyzed results from 535 survey participants and compared eight different CCIS commonly used in Germany. Our results showed that usability strongly differs across the compared systems. The system ICUData had the best overall rating and technical usability, followed by the platforms ICM and MetaVision. The same three systems performed best in the rating of task-specific usability without significant differences between each other. Across all systems, overall ratings were more dependent on ease-of-use aspects than on aspects of utility/functionality, and the general scope of the functions offered was rated better than how well the functions are realized. Our results suggest that manufacturers should shift some of their effort away from the development of new features and focus more on improving the ease-of-use and quality of existing features.

Usability studies on e-learning platforms: Preliminary study in USM

Science.gov (United States)

Emang, Devinna Win Anak Boniface; Lukman, Raja Nurul Izzati Raja; Kamarulzaman, Muhammad Izzat Syafiq; Zaaba, Zarul Fitri

2017-10-01

This paper explores the end-users' experienced in regards to the usability issues in E-learning platform. An online survey utilising 116 participants were conducted to investigate the end-users understanding and satisfaction on E-learning platform in the Universiti Sains Malaysia (USM). The results indicates that mainly students still experiencing significant challenges in E-learning platform in regards to accessibility, technical terminologies and functionality. On the other hand, the 10 heuristic guideline is chosen to be a referral point to compare five E-learning platforms in order to assess each performance on regards to the usability criteria. Overall, USM E-learning platform can be considered in a good shape. However, there are more works to be done to improve the delivery system of the E-learning if it would like to sustain for a long period of time. Although the result is at the preliminary stage, it provides useful insights to improve the E-learning platform as one of the most popular education platform in Malaysia.

Towards Usable E-Health. A Systematic Review of Usability Questionnaires.

Science.gov (United States)

Sousa, Vanessa E C; Dunn Lopez, Karen

2017-05-10

The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However

Merits of usability testing for PACS selection

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; van Ooijen, Peter M. A.

Objectives: To compare the usability of different Picture Archiving and Communication System (PACS) workstations, determine whether a usability test has added value with respect to the traditional way of comparing PACSs based on functional requirements, and to evaluate the appropriateness of a

Comparative study of the usability of directional commands for two different conceptions of agricultural machinery

Directory of Open Access Journals (Sweden)

Ricardo Kozoroski Veiga

2015-09-01

Full Text Available Santa Catarina showed a significant increase in its fleet of agricultural machinery in the past 40 years. For the historical origins, the state experienced a strong farm household that grows in small portions of land. This small size of farms boosted the purchase of farm machinery such as small power tillers. It is estimated that in Santa Catarina there are more than 20,000 machines like these. The initial design of this machine its use is intended for operations on foot position for possessing it commands designed for the walking posture. But a large proportion of power tillers is used to transport cargo and personnel, by adapting implement that allows driving in the sitting position. This modification is incomplete because it does not allow the installation of steering wheel. Thus the inadequacy of command increases the difficulty in driving the vehicle and may potentiate human error, leading to the accident. To compare the usability and rate of errors in triggering commands power tiller and tractors, the work used two methods: analysis uses the model Usa-Design (U-D© and usability testing. A panel was positioned in front of the two agricultural machines simulated obstacles appearing on the right or left side of operator, in a position to rise or fall, and observed the reaction to the same stimulus. A sample of 53 volunteers showed that for all groups (experience levels the error was greater for the  power tiller. The tractor had 5.7 % error while the power tiller this value was 49.1 %. The results found by U-D© model was similar with the found in the test and pointed out serious deficiencies in functional and safety aspects of power tiller.

Enhancing usability using Near Field Communication for mobile application

Directory of Open Access Journals (Sweden)

Wihidayat Endar

2018-01-01

Full Text Available Near Field Communication (NFC as relatively new wireless communication technology pushes new challenges to application developers to make their applications easier to use and simpler to operate. This point of view known as usability element. Usability is one of the elements for creating good quality applications. This study aims to analyse the usability of mobile-based application embeds with NFC. We also try to evaluate usability in applications used by children. We developed an application called Receptionist which has a primary function as a communication tool between students, teachers and parents at a middle school. To know the impact of the NFC, the Receptionist input system is designed with two methods, via conventional navigation (using buttons and via NFC. To understand the usability of each method, we do user testing and questioners on students. The results show, using the NFC there is a significant increase in usability attributes: efficiency, effectiveness, and learnability. On the other hand, there is decreases of user satisfaction comparing to conventional method. In general, this study demonstrates the potential of new input device technologies that can improve the usability of mobile-based applications.

Optimizing Usability Studies by Complementary Evaluation Methods

NARCIS (Netherlands)

Schmettow, Martin; Bach, Cedric; Scapin, Dominique

2014-01-01

This paper examines combinations of complementary evaluation methods as a strategy for efficient usability problem discovery. A data set from an earlier study is re-analyzed, involving three evaluation methods applied to two virtual environment applications. Results of a mixed-effects logistic

Cross cultural usability testing

DEFF Research Database (Denmark)

Clemmensen, Torkil; Goyal, Shivam

2005-01-01

In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user....... This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud...... and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively...

Personal Usability Constructs

DEFF Research Database (Denmark)

Hertzum, Morten; Clemmensen, Torkil; Hornbæk, Kasper

2011-01-01

Whereas the concept of usability is predominantly defined analytically, people relate to systems through personal usability constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected by two factors crucial to the international development...

Working together to improve usability

DEFF Research Database (Denmark)

Nørgaard, Mie; Hornbæk, Kasper

2010-01-01

In theory, usability work is an important and well-integrated activity in developing software. In practice, collaboration on improving usability is ridden with challenges relating to conflicting professional goals, tight project schedules, and unclear usability findings. The authors study those...... challenges through 16 interviews with software developers, usability experts, and project managers. Four themes that are key challenges to successful interaction between stakeholders are identified: poor timing when delivering usability results, results lacking relevance, little respect for other disciplines...

Online user tracking and usability tools - a mapping study

OpenAIRE

Nyström, Niklas

2014-01-01

Tracking user activities online can be done in order to improve systems usability, understand user behaviour or to increase monetary prot, to mention a few things. The software tools for this purpose can vary, for example in terms of usability of the tool itself, features, security, price, accessibility and support options. In this study I have developed a methodology to evaluate a selection of modern tools and map them depending on various properties. I have also analysed learning theories t...

Assessing Library Instruction through Web Usability and Vocabulary Studies

Science.gov (United States)

Castonguay, Remi

2008-01-01

Can we use the methods of Web usability testing to learn about library instruction? This article is among the first in the field trying to establish a link between usability and instruction. The author discusses useful insights that Web usability can bring to our pedagogy as well as to the efficiency of library instruction. The result of a Web…

A study of usability principles and interface design for mobile e-books.

Science.gov (United States)

Wang, Chao-Ming; Huang, Ching-Hua

2015-01-01

This study examined usability principles and interface designs in order to understand the relationship between the intentions of mobile e-book interface designs and users' perceptions. First, this study summarised 4 usability principles and 16 interface attributes, in order to conduct usability testing and questionnaire survey by referring to Nielsen (1993), Norman (2002), and Yeh (2010), who proposed the usability principles. Second, this study used the interviews to explore the perceptions and behaviours of user operations through senior users of multi-touch prototype devices. The results of this study are as follows: (1) users' behaviour of operating an interactive interface is related to user prior experience; (2) users' rating of the visibility principle is related to users' subjective perception but not related to user prior experience; however, users' ratings of the ease, efficiency, and enjoyment principles are related to user prior experience; (3) the interview survey reveals that the key attributes affecting users' behaviour of operating an interface include aesthetics, achievement, and friendliness. This study conducts experiments to explore the effects of users’ prior multi-touch experience on users’ behaviour of operating a mobile e-book interface and users’ rating of usability principles. Both qualitative and quantitative data analyses were performed. By applying protocol analysis, key attributes affecting users’ behaviour of operation were determined.

Integration of MSFC Usability Lab with Usability Testing

Science.gov (United States)

Cheng, Yiwei; Richardson, Sally

2010-01-01

As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.

Involving the users remotely: an exploratory study using asynchronous usability testing

Directory of Open Access Journals (Sweden)

Beth Filar Williams

2015-02-01

Full Text Available Open Educational Resources (OER are increasingly used in the higher education landscape as a solution for a variety of copyright, publishing and cost-prohibiting issues. While OERs are becoming more common, reports of usability tests that evaluate how well learners can use them to accomplish their learning tasks have lagged behind. Because both the researchers and the learners in this study use resources and tools remotely, asynchronous usability testing of a prototype OER and MOOC online guide was conducted with an exploratory group of users to determine the guide’s ease of use for two distinct groups of users: Educators and Learners. In this article, we share the background and context of this usability project, suggest best methods for asynchronous remote usability testing, and share challenges and insights of the process and results of the testing

Systematic Review Protocol to Assess the Effectiveness of Usability Questionnaires in mHealth App Studies.

Science.gov (United States)

Zhou, Leming; Bao, Jie; Parmanto, Bambang

2017-08-01

Usability questionnaires have a wide use in mobile health (mHealth) app usability studies. However, no systematic review has been conducted for assessing the effectiveness of these questionnaires. This paper describes a protocol for conducting a systematic review of published questionnaire-based mHealth app usability studies. In this systematic review, we will select recently published (2008-2017) articles from peer-reviewed journals and conferences that describe mHealth app usability studies and implement at least one usability questionnaire. The search strategy will include terms such as "mobile app" and "usability." Multiple databases such as PubMed, CINAHL, IEEE Xplore, ACM Digital Library, and INSPEC will be searched. There will be 2 independent reviewers in charge of screening titles and abstracts as well as determining those articles that should be included for a full-text review. The third reviewer will act as a mediator between the other 2 reviewers. Moreover, a data extraction form will be created and used during the full article data analysis. Notably, the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidelines will be followed in reporting this protocol. A preliminary search produced 1271 articles, 40 of which are duplicate records. The inclusion-exclusion criteria are being strictly followed in performing the ongoing study selection. Usability questionnaires are an important tool in mHealth app usability studies. This review will summarize the usability questionnaires used in published research articles while assessing the efficacy of these questionnaires in determining the usability of mHealth apps. ©Leming Zhou, Jie Bao, Bambang Parmanto. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 01.08.2017.

Usability Prediction & Ranking of SDLC Models Using Fuzzy Hierarchical Usability Model

Science.gov (United States)

Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna

2017-06-01

Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.

Distributed usability evaluation

DEFF Research Database (Denmark)

Christensen, Lars; Frøkjær, Erik

2010-01-01

We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary......, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server......, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented...

Exploring the Role of Usability in the Software Process: A Study of Irish Software SMEs

Science.gov (United States)

O'Connor, Rory V.

This paper explores the software processes and usability techniques used by Small and Medium Enterprises (SMEs) that develop web applications. The significance of this research is that it looks at development processes used by SMEs in order to assess to what degree usability is integrated into the process. This study seeks to gain an understanding into the level of awareness of usability within SMEs today and their commitment to usability in practice. The motivation for this research is to explore the current development processes used by SMEs in developing web applications and to understand how usability is represented in those processes. The background for this research is provided by the growth of the web application industry beyond informational web sites to more sophisticated applications delivering a broad range of functionality. This paper presents an analysis of the practices of several Irish SMEs that develop web applications through a series of case studies. With the focus on SMEs that develop web applications as Management Information Systems and not E-Commerce sites, informational sites, online communities or web portals. This study gathered data about the usability techniques practiced by these companies and their awareness of usability in the context of the software process in those SMEs. The contribution of this study is to further the understanding of the current role of usability within the software development processes of SMEs that develop web applications.

Usability Evaluation in a Digitally Emerging Country

DEFF Research Database (Denmark)

Lizano, Fulvio; Sandoval, Maria Marta; Bruun, Anders

2013-01-01

Several emerging countries experience increasing software development activities. With the purpose of provide useful feedback on possible courses of action for increasing application of usability evaluation in such countries, this paper explores the status of usability evaluation in a digitally...... emerging country. Our aim is to identifying common characteristics or behavioral patterns that could be compared with digitally advanced countries. We used an online survey answered by 26 software development organizations, which gave a snapshot of the application of usability evaluation...... in these organizations. We found many similarities with advanced countries, several completely new obstacles more connected with software development matters and a relatively positive improvement in the lack of “usability culture”. These findings suggest good conditions to improve conduction of usability evaluations...

Usability Testing Of Web Mapping Portals

Directory of Open Access Journals (Sweden)

Petr Voldán

2011-05-01

Full Text Available This study presents a usability testing as method, which can be used to improve controlling of web map sites. Study refers to the basic principles of this method and describes particular usability tests of mapping sites. In this paper are identified potential usability problems of web sites: Amapy.cz, Google maps and Mapy.cz. The usability testing was focused on problems related with user interfaces, addresses searching and route planning of the map sites.

An empirical study on website usability elements and how they affect search engine optimisation

OpenAIRE

Eugene B. Visser; Melius Weideman

2011-01-01

The primary objective of this research project was to identify and investigate the website usability attributes which are in contradiction with search engine optimisation elements. The secondary objective was to determine if these usability attributes affect conversion. Although the literature review identifies the contradictions, experts disagree about their existence.An experiment was conducted, whereby the conversion and/or traffic ratio results of an existing control website were compared...

Work-domain knowledge in usability evaluation

DEFF Research Database (Denmark)

Følstad, Asbjørn; Hornbæk, Kasper

2010-01-01

Usability evaluation helps to determine whether interactive systems support users in their work tasks. However, knowledge about those tasks and, more generally, about the work-domain is difficult to bring to bear on the processes and outcome of usability evaluation. One way to include such work......-domain knowledge might be Cooperative Usability Testing, an evaluation method that consists of (a) interaction phases, similar to classic usability testing, and (b) interpretation phases, where the test participant and the moderator discuss incidents and experiences from the interaction phases. We have studied...... whether such interpretation phases improve the relevance of usability evaluations in the development of work-domain specific systems. The study included two development cases. We conclude that the interpretation phases generate additional insight and redesign suggestions related to observed usability...

Global usability

CERN Document Server

Douglas, Ian

2011-01-01

The concept of usability has become an increasingly important consideration in the design of all kinds of technology. As more products are aimed at global markets and developed through internationally distributed teams, usability design needs to be addressed in global terms. Interest in usability as a design issue and specialist area of research and education has developed steadily in North America and Europe since the 1980's. However, it is only over the last ten years that it has emerged as a global concern. Global Usability provides an introduction to the important issues in globalizing des

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

Science.gov (United States)

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development

Usability Testing: A Case Study.

Science.gov (United States)

Chisman, Janet; Walbridge, Sharon; Diller, Karen

1999-01-01

Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)

Usability Testing of Two Ambulatory EHR Navigators.

Science.gov (United States)

Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B

2016-01-01

Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.

Problem Prioritization in Usability Evaluation:

DEFF Research Database (Denmark)

Hertzum, Morten

2006-01-01

Severity assessments enable prioritization of problems encountered during usability evaluations and thereby provide a device for guiding the utilization of design resources. However, designers' response to usability evaluations is also influenced by other factors, which may overshadow severity....... With the purpose of enhancing the impact of severity assessments, this study combines a field study of factors that influence the impact of evaluations with an experimental study of severity assessments made during usability inspections. The results show that even in a project receptive to input from evaluations...... their impact was highly dependent on conducting evaluations early. This accorded with an informal method that blended elements of usability evaluation and participatory design and could be extended with user-made severity assessments. The major cost associated with the evaluations was not finding but fixing...

Neuroanatomical correlates of perceived usability

DEFF Research Database (Denmark)

Vi, Chi Thanh; Hornbæk, Kasper; Subramanian, Sriram

2017-01-01

Usability has a distinct subjective component, yet surprisingly little is known about its neural basis and relation to the neuroanatomy of aesthetics. To begin closing this gap, we conducted two functional magnetic resonance imaging studies in which participants were shown static webpages (in...... the first study) and videos of interaction with webpages (in the second study). The webpages were controlled so as to exhibit high and low levels of perceived usability and perceived aesthetics. Our results show unique links between perceived usability and brain areas involved in functions such as emotional...... processing (left fusiform gyrus, superior frontal gyrus), anticipation of physical interaction (precentral gyrus), task intention (anterior cingulate cortex), and linguistic processing (medial and bilateral superior frontal gyri). We use these findings to discuss the brain correlates of perceived usability...

A Breastfeed-Promoting Mobile App Intervention: Usability and Usefulness Study.

Science.gov (United States)

Wang, Chih-Jau; Chaovalit, Pimwadee; Pongnumkul, Suporn

2018-01-26

Breastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records. The aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women. Our study was reviewed and approved by Thailand's National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis. The mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement. Our usability and usefulness assessment of MoomMae demonstrated that MoomMae has

Usability requirements for buildings: a case study on primary schools.

Science.gov (United States)

Duca, Gabriella

2012-01-01

This paper concerns an applied research aimed at applying the concept of usability, as derived form the standard ISO 9241/11, in the filed of building design, namely primary schools. Starting from the concept that space characteristics play a very relevant role in learning performances, the study presented here developed an original methodology for the assessment of effectiveness, efficiency and satisfaction of buildings hosting primary schools, in order to create a school environment better supporting users in their tasks. Research core is the framework of usability requirements and their related markers, indicators and technical specification that has been formulated in order to check compliance of urban area, building, rooms and architectural details with users needs. Therefore, a detailed task analysis of pupils and teacher tasks has been carried out and two questionnaires addressed to a significant users panel have been formulated for satisfaction survey. Lastly, a matrix for an overall reading of gathered data has been set-up and criteria for usability assessment based on that data has been defined. The whole study has been developed within the case study of a primary school in the Naples city centre, whose contents and results are discussed.

Software Development and Feedback from Usability Evaluations

DEFF Research Database (Denmark)

Høegh, Rune Thaarup

2008-01-01

This paper presents a study of the strengths and weaknesses of written, multimedia and oral feedback from usability evaluations to developers. The strengths and weaknesses are related to how well the feedback supports the developers in addressing usability problems in a software system. The study...... concludes that using the traditional written usability report, as the only form of feedback from usability evaluations is associated with problems related to the report not supporting the process of addressing the usability problems. The report is criticized for representing an overwhelming amount...... of information, while still not offering the required information to address usability problems. Other forms of feedback, such as oral or multimedia feedback helps the developer in understanding the usability problems better, but are on the other hand less cost-effective than a written description....

Promise Fulfilled? An EBSCO Discovery Service Usability Study

Science.gov (United States)

Williams, Sarah C.; Foster, Anita K.

2011-01-01

Discovery tools are the next phase of library search systems. Illinois State University's Milner Library implemented EBSCO Discovery Service in August 2010. The authors conducted usability studies on the system in the fall of 2010. The aims of the study were twofold: first, to determine how Milner users set about using the system in order to…

The Evaluator Effect in Usability Tests

DEFF Research Database (Denmark)

Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

1998-01-01

Usability tests are applied in industry to evaluate systems and in research as a yardstick for other usability evaluation methods. However, one potential threat to the reliability of usability tests has been left unaddressed: the evaluator effect. In this study, four evaluators analyzed four vide...

Usability Evaluation of Electronic Health Record System around Clinical Notes Usage-An Ethnographic Study.

Science.gov (United States)

Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B

2017-10-01

Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

Science.gov (United States)

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

Usability Testing of an Academic Library Web Site: A Case Study.

Science.gov (United States)

Battleson, Brenda; Booth, Austin; Weintrop, Jane

2001-01-01

Discusses usability testing as a tool for evaluating the effectiveness and ease of use of academic library Web sites; considers human-computer interaction; reviews major usability principles; and explores the application of formal usability testing to an existing site at the University at Buffalo (NY) libraries. (Author/LRW)

Increasing the impact of usability work in software development

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias; Frøkjær, Erik

2006-01-01

Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop......Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop...

Usability Evaluation of Public Web Mapping Sites

Science.gov (United States)

Wang, C.

2014-04-01

Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The

A Usability Study of Interactive Web-Based Modules

Science.gov (United States)

Girard, Tulay; Pinar, Musa

2011-01-01

This research advances the understanding of the usability of marketing case study modules in the area of interactive web-based technologies through the assignment of seven interactive case modules in a Principles of Marketing course. The case modules were provided for marketing students by the publisher, McGraw Hill Irwin, of the…

Empirical studies on usability of mHealth apps: a systematic literature review.

Science.gov (United States)

Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

2015-02-01

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

The Usability Expert’s Fear of Agility

DEFF Research Database (Denmark)

Nielsen, Lene; Madsen, Sabine

2012-01-01

This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12...... different countries. The findings show that the usability professionals share a forced development and innovation in their practice that stem from their clients’ adoption and use of ASD methods. The ASD methods challenge the way usability testing is performed, the abilities of the usability expert......, the usability deliverables, and the experts’ assumptions about the importance of validity....

Seeing Double at Memorial University: Two WorldCat Local Usability Studies

Directory of Open Access Journals (Sweden)

Sue Fahey

2011-11-01

Full Text Available Obtaining user feedback is valuable yet often overlooked, so when Memorial University Libraries launched OCLC’s WorldCat Local discovery tool for Fall 2010, usability testing was a logical next step. Two branches, each with distinct user groups, the Ferriss Hodgett Library in Corner Brook, and the Health Sciences Library in St. John’s, conducted unique usability studies to gain evidence into how WorldCat Local performed common research tasks. The Health Sciences Library was inspired by the information seeking habits of Memorial University’s Faculty of Medicine, School of Nursing, and School of Pharmacy. This demographic’s heavy reliance on journal literature, and known item searching made these users an interesting test group. The Ferriss Hodgett Library, serving an undergraduate Liberal Arts and Sciences population, was interested in the information seeking behavior of new students with little to no experience using library resources. At the local level, evidence obtained as a result of this usability testing will provide guidance into future use of WCL at Memorial University Libraries. On a broader scale, the usability findings are relevant to any library considering the shift to a new discovery tool.

A Comparative Study of Spreadsheet Applications on Mobile Devices

Directory of Open Access Journals (Sweden)

Veera V. S. M. Chintapalli

2016-01-01

Full Text Available Advances in mobile screen sizes and feature enhancement for mobile applications have increased the number of users accessing spreadsheets on mobile devices. This paper reports a comparative usability study on four popular mobile spreadsheet applications: OfficeSuite Viewer 6, Documents To Go, ThinkFree Online, and Google Drive. We compare them against three categories of usability criteria: visibility; navigation, scrolling, and feedback; and interaction, satisfaction, simplicity, and convenience. Measures for each criterion were derived in a survey. Questionnaires were designed to address the measures based on the comparative criteria provided in the analysis.

Marketing through Usability.

Science.gov (United States)

Morgan, Eric Lease

1999-01-01

Suggests that one of the best ways to get word-of-mouth marketing of library technology is to provide "usable" products and services. Provides an international standards definition on usability and notes that understanding usability combines an understanding of user needs/wants with an understanding of goals, functions, and limitations…

Usability study of a vineyard teleoperated compost spreader.

Science.gov (United States)

Ferrari, Ester; Cavallo, Eugenio

2012-01-01

Teleoperation has been widely applied in modern industry because of a variety of advantages, such as providing replaceable surrogates for humans in dangerous or difficult working environments over long distances. In this paper, a usability evaluation study of a teleoperation system for a compost spreader robotic machine is presented. The machine has been designed for the application of compost in small and stepping parcels of hilly vineyards. Driving and working tasks can be controlled remotely by a portable piloting unit, reducing the risk for the operator in the event of machine overturning. Participants of the study were asked to perform a series of tasks and sub-tasks and to vocalize their thoughts while working with the machine. The tasks were designed to simulate typical user experience. Once all the tasks were accomplished each participant was asked to fill a questionnaire. The evaluation considered aspects such as learnability, ease of use, understandability, controllability, frustration, mental effort, distraction, clarity of presentation, perceived usefulness, temporal efficiency and machine aesthetic. Results show that usability evaluation helped detecting design deficiencies in the teleoperated compost spreader machine.

UX Professionals’ Definitions of Usability and UX

DEFF Research Database (Denmark)

Rajanen, Dorina; Clemmensen, Torkil; Iivari, Netta

2017-01-01

This paper examines the views of user experience (UX) professionals on the definitions of usability and UX, and compares the findings between countries and within different socio-cultural groups. A mixed-method analysis was employed on data gathered on 422 professionals through a survey in Turkey......, Finland, Denmark, France, and Malaysia. Usability appears to be an established concept, respondents across all countries agreeing on the importance of the ISO 9241-11 definition. There is also a tendency that UX professionals attach organizational perspective to usability. UX professionals diverge when...... defining UX, and there are systematic differences related to socio-cultural conditions. UX professionals in Finland and France incline more towards the definition highlighting the experiential qualities, when compared to Turkey and Malaysia that incline towards the definition reflecting the ease of use...

Dynamic Tunnel Usability Study: Format Recommendations for Synthetic Vision System Primary Flight Displays

Science.gov (United States)

Arthur, Jarvis J., III; Prinzel, Lawrence J., III; Kramer, Lynda J.; Bailey, Randall E.

2006-01-01

A usability study evaluating dynamic tunnel concepts has been completed under the Aviation Safety and Security Program, Synthetic Vision Systems Project. The usability study was conducted in the Visual Imaging Simulator for Transport Aircraft Systems (VISTAS) III simulator in the form of questionnaires and pilot-in-the-loop simulation sessions. Twelve commercial pilots participated in the study to determine their preferences via paired comparisons and subjective rankings regarding the color, line thickness and sensitivity of the dynamic tunnel. The results of the study showed that color was not significant in pilot preference paired comparisons or in pilot rankings. Line thickness was significant for both pilot preference paired comparisons and in pilot rankings. The preferred line/halo thickness combination was a line width of 3 pixels and a halo of 4 pixels. Finally, pilots were asked their preference for the current dynamic tunnel compared to a less sensitive dynamic tunnel. The current dynamic tunnel constantly gives feedback to the pilot with regard to path error while the less sensitive tunnel only changes as the path error approaches the edges of the tunnel. The tunnel sensitivity comparison results were not statistically significant.

The effects of protoype medium on usability testing.

Science.gov (United States)

Boothe, Chase; Strawderman, Lesley; Hosea, Ethan

2013-11-01

Inconsistencies among testing methods and results in previous research prompted this study that builds upon a systematic usability testing research framework to better understand how interface medium influences users' abilities to detect usability flaws in applications. Interface medium was tested to identify its effects on users' perceptions of usability and abilities to detect usability problems and severe usability problems. Results indicated that medium has no effect on users' abilities to detect usability problems or perceptions of usability. However, results did indicate an interaction between the medium and the tested application in which users were able to identify significantly more usability problems on a higher fidelity medium using a particular application. Results also indicated that as users' perceptions of an application's usability increases, the users are less able to detect usability problems in that application. Usability testing should begin early in the design process, even if low fidelity mediums will be used. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Evaluating the usability of web pages: a case study

NARCIS (Netherlands)

Lautenbach, M.A.E.; Schegget, I.E. ter; Schoute, A.E.; Witteman, C.L.M.

1999-01-01

An evaluation of the Utrecht University website was carried out with 240 students. New criteria were drawn from the literature and operationalized for the study. These criteria are surveyability and findability. Web pages can be said to satisfy a usability criterion if their efficiency and

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

Science.gov (United States)

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

Cultural Usability

DEFF Research Database (Denmark)

Shi, Qingxin

2007-01-01

Culture has already played an important role in the global market. It not only affects products, but also impacts on usability evaluation methods. This project aims to examine in the established thinking aloud usability evaluation method (TA UEM), how does the evaluator build a supportive...

Usability analysis of industrial cooking equipment.

Science.gov (United States)

Calado, Alexana Vilar Soares; Soares, Marcelo Márcio

2012-01-01

This paper refers to the comparative study of the equipment used for cooking in commercial of kitchens restaurants that use the system of traditional cooking and those ones which use the system called smart cooking (combination oven). The study investigates the usability issues concerning to the two systems, analyzing comparatively the aspects related to anthropometry, dimensional variables, the use of the product and also the product safety, as well as issues of information related to operation of the new concepts of cooking in intelligent systems.

On the assessment of usability testing methods for children

NARCIS (Netherlands)

Markopoulos, P.; Bekker, M.M.

2003-01-01

The paper motivates the need to acquire methodological knowledge for involving children as test users in usability testing. It introduces a methodological framework for delineating comparative assessments of usability testing methods for children participants. This framework consists in three

Using a fuzzy comprehensive evaluation method to determine product usability: A test case.

Science.gov (United States)

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.

Software architecture analysis of usability

NARCIS (Netherlands)

Folmer, E; van Gurp, J; Bosch, J; Bastide, R; Palanque, P; Roth, J

2005-01-01

Studies of software engineering projects show that a large number of usability related change requests are made after its deployment. Fixing usability problems during the later stages of development often proves to be costly, since many of the necessary changes require changes to the system that

Usability Study of a Wireless Monitoring System among Alzheimer’s Disease Elderly Population

Directory of Open Access Journals (Sweden)

Stefano Abbate

2014-01-01

Full Text Available Healthcare technologies are slowly entering into our daily lives, replacing old devices and techniques with newer intelligent ones. Although they are meant to help people, the reaction and willingness to use such new devices by the people can be unexpected, especially among the elderly. We conducted a usability study of a fall monitoring system in a long-term nursing home. The subjects were the elderly with advanced Alzheimer’s disease. The study presented here highlights some of the challenges faced in the use of wearable devices and the lessons learned. The results gave us useful insights, leading to ergonomics and aesthetics modifications to our wearable systems that significantly improved their usability and acceptance. New evaluating metrics were designed for the performance evaluation of usability and acceptability.

Health literacy and usability of clinical trial search engines.

Science.gov (United States)

Utami, Dina; Bickmore, Timothy W; Barry, Barbara; Paasche-Orlow, Michael K

2014-01-01

Several web-based search engines have been developed to assist individuals to find clinical trials for which they may be interested in volunteering. However, these search engines may be difficult for individuals with low health and computer literacy to navigate. The authors present findings from a usability evaluation of clinical trial search tools with 41 participants across the health and computer literacy spectrum. The study consisted of 3 parts: (a) a usability study of an existing web-based clinical trial search tool; (b) a usability study of a keyword-based clinical trial search tool; and (c) an exploratory study investigating users' information needs when deciding among 2 or more candidate clinical trials. From the first 2 studies, the authors found that users with low health literacy have difficulty forming queries using keywords and have significantly more difficulty using a standard web-based clinical trial search tool compared with users with adequate health literacy. From the third study, the authors identified the search factors most important to individuals searching for clinical trials and how these varied by health literacy level.

Does Usability Matter? An Analysis of the Impact of Usability on Technology Acceptance in ERP Settings

Directory of Open Access Journals (Sweden)

Brenda M Scholtz

2016-11-01

Full Text Available Though the field of management information systems, as a sector and a discipline, is the inventor of many guidelines and models, it appears to be a slow runner on practical implications of interface usability. This usability can influence end users’ attitude and behavior to use IT. The purpose of this paper was to examine the interface usability of a popular Enterprise Resource Planning (ERP software system, SAP, and to identify related issues and implications to the Technology Acceptance Model (TAM. A survey was conducted of 112 SAP ERP users from an organization in the heavy metal industry in Bangladesh. The partial least squares technique was used to analyze the survey data. The survey findings empirically confirmed that interface usability has a significant impact on users’ perceptions of usefulness and ease of use which ultimately affects attitudes and intention to use the ERP software. The research model extends the TAM by incorporating three criteria of interface usability. It is the first known study to investigate usability criteria as an extension of TAM.

Combining usability evaluations to highlight the chain that leads from usability flaws to usage problems and then negative outcomes.

Science.gov (United States)

Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis

2018-02-01

Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.

Usability of Public Administration Electronic Forms

Directory of Open Access Journals (Sweden)

Miloslav Hub

2015-06-01

Full Text Available This paper is focused on the testing and evaluating of public administration electronic forms from the usability point of view. Its objective is to design a suitable methodology for usability testing of electronic forms and their description and distribution to public administration information systems professionals. Firstly, methods of usability engineering are summarized and a suitable method for usability testing and evaluation of electronic forms is selected. Farther, the methodology of electronic forms usability testing that uses the selected method is suggested. In the last part of the paper the case study that uses the proposed methodology is suggested and performed. The main benefit of the work is the design of testing methodology and proposition of the set of recommendations for new public administration electronic forms design.

Usability Briefing for hospital design

DEFF Research Database (Denmark)

Fronczek-Munter, Aneta

This PhD thesis is a contribution to an ongoing debate in Denmark about improving the building design processes of complex buildings, especially in relation to the current hospital developments. It provides knowledge about capturing user needs and defines the process model for usability briefing...... and evaluations, can be fed into briefing and design processes. This PhD thesis proposes methods for usability briefing.Usability is a concept similar to functionality, but usability depends on: subjective view of users, context, culture, situation and experience. Understanding usability is achieved by involving...... users. This PhD thesis extends the research in usability of buildings to include all building design phases, therefore not only proposes usability evaluations, but also defines usability briefing. Briefing, also called architectural programming, is usually understood as one of the first phases...

Supporting Usability Engineering in Small Software Development Organizations

DEFF Research Database (Denmark)

Bornoe, Nis; Stage, Jan

2013-01-01

Despite an interest and use of different usability engineering methods small software development organizations find it challenging to implement usability engineering into the software development process. We present the results from a study about usability engineering in practice. Through a series...... of semistructured interviews we want to get an understanding of how usability is implemented into the organizations and how it’s practiced in reality. We found that the developers found it problematic to combine agile software development methods with classic usability engineering methods. A lack of solid usability...... engineering expertise and not least experience seems to be a main obstacle for a successful implementation of usability engineering into current software development practices. They are requesting methods and procedures that fit better with their current practices and strategies to implement usability...

Methods of Usability Testing in Libraries Web Sites

Directory of Open Access Journals (Sweden)

Eman Fawzy

2006-03-01

Full Text Available A Study about libraries' web sites evaluation, that is the Usability, the study talking about methods of usability testing and define it, and its important in web sites evaluation, then details the methods of usability: questionnaire, core groups, testing experimental model, cards arrangement, and composed evaluation.

Log files for testing usability

NARCIS (Netherlands)

Klein Teeselink, G.; Siepe, A.H.M.; Pijper, de J.R.

1999-01-01

The aim of this study is to gain insight in the usefulness of log file analysis as a method to evaluate the usability of individual interface components and their influence on the usability of the overall user interface. We selected a music player as application, with four different interfaces and

A Comparison of What Is Part of Usability Testing in Three Countries

Science.gov (United States)

Clemmensen, Torkil

The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.

Commercial versus in-situ usability testing of healthcare information systems: towards "public" usability testing in healthcare organizations.

Science.gov (United States)

Kushniruk, Andre W; Borycki, Elizabeth M; Kannry, Joseph

2013-01-01

The need for improved usability in healthcare IT has been widely recognized. In addition, methods from usability engineering, including usability testing and usability inspection have received greater attention. Many vendors of healthcare software are now employing usability testing methods in the design and development of their products. However, despite this, the usability of healthcare IT is still considered to be problematic and many healthcare organizations that have purchased systems that have been tested at vendor testing sites are still reporting a range of usability and safety issues. In this paper we explore the distinction between commercial usability testing (conducted at centralized vendor usability laboratories and limited beta test sites) and usability testing that is carried out locally within healthcare organizations that have purchased vendor systems and products (i.e. public "in-situ" usability testing). In this paper it will be argued that both types of testing (i.e. commercial vendor-based testing) and in-situ testing are needed to ensure system usability and safety.

Usability testing for dummies

CERN Multimedia

CERN. Geneva

2017-01-01

Usability testing seems complicated and time-consuming. Is it though? In fact, it is the best way to understand how real users experience your product. In this interactive session, we will do a live usability test and you will get advice on how to conduct your own usability tests.

Usability evaluation techniques in mobile commerce applications: A systematic review

Science.gov (United States)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Apathy towards the Integration of Usability Work

DEFF Research Database (Denmark)

Wale-Kolade, Adeola; Nielsen, Peter Axel

2016-01-01

In this article we report from a case study of a software development organization and we study in particular the developers’ and product managers’ attitudes towards integrating usability work into software development. We offer explanations based on system justification theory illuminating what...... would-be integrators might be up against. The analysis shows how the developers only pay lip service to usability work and how they treat users superficially. It further shows how that leads to stereotyping of usability designers and users in order to preserve status quo, and how internalization...... of inequality between the developers and usability designers rationalizes the preservation of status quo. These findings will have significant implications for managers of software development....

A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study.

Science.gov (United States)

Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan

2016-01-11

Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to

Distributed user interfaces usability and collaboration

CERN Document Server

Lozano, María D; Tesoriero, Ricardo; Penichet, Victor MR

2013-01-01

Written by international researchers in the field of Distributed User Interfaces (DUIs), this book brings together important contributions regarding collaboration and usability in Distributed User Interface settings. Throughout the thirteen chapters authors address key questions concerning how collaboration can be improved by using DUIs, including: in which situations a DUI is suitable to ease the collaboration among users; how usability standards can be used to evaluate the usability of systems based on DUIs; and accurately describe case studies and prototypes implementing these concerns

Designing Websites for ESL Learners: A Usability Testing Study

Science.gov (United States)

Liu, Min; Traphagan, Tomoko; Huh, Jin; Koh, Young Ihn; Choi, Gilok; McGregor, Allison

2008-01-01

The purpose of this paper is to report on a usability study for ESL websites conducted to gain insights from learners of English as a second language (ESL) as they interacted with specific sites. Five carefully selected ESL sites were tested by 10 different users generating a total of fifty testing sessions. Two major research questions guided the…

What Happened to Remote Usability Testing? An Empirical Study of Three Methods

DEFF Research Database (Denmark)

Stage, Jan; Andreasen, M. S.; Nielsen, H. V.

2007-01-01

The idea of conducting usability tests remotely emerged ten years ago. Since then, it has been studied empirically, and some software organizations employ remote methods. Yet there are still few comparisons involving more than one remote method. This paper presents results from a systematic...... empirical comparison of three methods for remote usability testing and a conventional laboratorybased think-aloud method. The three remote methods are a remote synchronous condition, where testing is conducted in real time but the test monitor is separated spatially from the test subjects, and two remote...

Mobile Usability Testing in Healthcare: Methodological Approaches.

Science.gov (United States)

Borycki, Elizabeth M; Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

The use of mobile devices and healthcare applications is increasing exponentially worldwide. This has lead to the need for the healthcare industry to develop a better understanding of the impact of the usability of mobile software and hardware upon consumer and health professional adoption and use of these technologies. There are many methodological approaches that can be employed in conducting usability evaluation of mobile technologies. More obtrusive approaches to collecting study data may lead to changes in study participant behaviour, leading to study results that are less consistent with how the technologies will be used in the real-world. Alternatively, less obstrusive methods used in evaluating the usability of mobile software and hardware in-situ and laboratory settings can lead to less detailed information being collected about how an individual interacts with both the software and hardware. In this paper we review and discuss several innovative mobile usability evaluation methods on a contiuum from least to most obtrusive and their effects on the quality of the usability data collected. The strengths and limitations of methods are also discussed.

From Usability Engineering to Evidence-based Usability in Health IT

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine

2016-01-01

Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve

The value of Retrospective and Concurrent Think Aloud in formative usability testing of a physician data query tool.

Science.gov (United States)

Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M

2015-06-01

To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (pusability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA

A Usability Study of Users' Perceptions toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

Science.gov (United States)

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2008-01-01

This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…

Exploring the value of usability feedback formats

DEFF Research Database (Denmark)

Nørgaard, Mie; Hornbæk, Kasper Anders Søren

2009-01-01

The format used to present feedback from usability evaluations to developers affects whether problems are understood, accepted, and fixed. Yet, little research has investigated which formats are the most effective. We describe an explorative study where three developers assess 40 usability findings...... presented using five feedback formats. Our usability findings comprise 35 problems and 5 positive comments. Data suggest that feedback serves multiple purposes. Initially, feedback must convince developers about the relevance of a problem and convey an understanding of this. Feedback must next be easy...... working with the feedback to address the usability problems, there were no significant differences among the developers' ratings of the value of the different formats. This suggests that all of the formats may serve equally well as reminders in later stages of working with usability problems...

Tracing Impact in a Usability Improvement Process

DEFF Research Database (Denmark)

Uldall-Espersen, Tobias; Frøkjær, Erik; Hornbæk, Kasper Anders Søren

2008-01-01

Analyzing usability improvement processes as they take place in real-life organizations is necessary to understand the practice of usability work. This paper describes a case study where the usability of an information system is improved and a relationship between the improvements...... and the evaluation efforts is established. Results show that evaluation techniques complemented each other by suggesting different kinds of usability improvement. Among the techniques applied, a combination of questionnaires and Metaphors of Human Thinking (MOT) showed the largest mean impact and MOT produced...... the largest number of impacts. Logging of real-life use of the system over 6 months indicated six aspects of improved usability, where significant differences among evaluation techniques were found. Concerning five of the six aspects Think Aloud evaluations and the above-mentioned combination of questionnaire...

Empirical usability testing in a component-based environment : improving test efficiency with component-specific usability measures

NARCIS (Netherlands)

Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Bastide, R.; Palanque, P.; Roth, J.

2005-01-01

This paper addresses the issue of usability testing in a component-based software engineering environment, specifically measuring the usability of different versions of a component in a more powerful manner than other, more holistic, usability methods. Three component-specific usability measures are

Meta-Analysis of Correlations Among Usability Measures

DEFF Research Database (Denmark)

Hornbæk, Kasper Anders Søren; Effie Lai Chong, Law

2007-01-01

are generally low: effectiveness measures (e.g., errors) and efficiency measures (e.g., time) has a correlation of .247 ± .059 (Pearson's product-moment correlation with 95% confidence interval), efficiency and satisfaction (e.g., preference) one of .196 ± .064, and effectiveness and satisfaction one of .164......Understanding the relation between usability measures seems crucial to deepen our conception of usability and to select the right measures for usability studies. We present a meta-analysis of correlations among usability measures calculated from the raw data of 73 studies. Correlations...... ± .062. Changes in task complexity do not influence these correlations, but use of more complex measures attenuates them. Standard questionnaires for measuring satisfaction appear more reliable than homegrown ones. Measures of users' perceptions of phenomena are generally not correlated with objective...

Forensic botany: usability of bryophyte material in forensic studies.

Science.gov (United States)

Virtanen, Viivi; Korpelainen, Helena; Kostamo, Kirsi

2007-10-25

Two experiments were performed to test the relevance of bryophyte (Plantae, Bryophyta) material for forensic studies. The first experiment was conducted to reveal if, and how well, plant fragments attach to footwear in general. In the test, 16 persons walked outdoors wearing rubber boots or hiking boots. After 24h of use outdoors the boots were carefully cleaned, and all plant fragments were collected. Afterwards, all plant material was examined to identify the species. In the second experiment, fresh material of nine bryophyte species was kept in a shed in adverse conditions for 18 months, after which DNA was extracted and subjected to genotyping to test the quality of the material. Both experiments give support for the usability of bryophyte material in forensic studies. The bryophyte fragments become attached to shoes, where they remain even after the wearer walks on a dry road for several hours. Bryophyte DNA stays intact, allowing DNA profiling after lengthy periods following detachment from the original plant source. Based on these experiments, and considering the fact that many bryophytes are clonal plants, we propose that bryophytes are among the most usable plants to provide botanical evidence for forensic investigations.

Cookstove options for safety and health: Comparative analysis of technological and usability attributes

International Nuclear Information System (INIS)

Kimemia, David; Van Niekerk, Ashley

2017-01-01

Energy use in low-income households in South Africa is considerably more hazardous than in middle to high-income households. Poverty is a key underlying factor. However, poor quality domestic energy technologies, including stoves, heaters and light sources contribute to this vulnerability. The problem is compounded by behavioural and environmental factors. Since cooking is a key energy-using chore, access to efficient, safe and versatile stoves portend safety improvements. This paper reports on a comparative analysis of eleven technological and usability attributes (CO emissions, firepower, efficiency, fuel toxicity, fuel cost, stove price, controllability, durability, availability, temperature of touchable-parts, and mechanical stability) of commercially available stoves that utilise four energy sources (kerosene, methanol, ethanol gel, and LPG). The ensuing discussion serves as a guide to enable the selection of the best-fit stove-fuel combination for low-income households. The findings indicate that LPG stoves have comparatively better overall rankings for cleanliness, firepower, safety, and durability. This analysis highlights that no combustion technology is risk-proof and there remains a burden on users to exercise diligence. We recommend that South Africa adopts an affirmative policy and strategic actions that discourage the use of kerosene as a household combustion fuel, and promotes the adoption of LPG as a safer and practical alternative. - Highlights: • Inefficient fuel combustion stoves raise risk profile in energy-poor households. • This study uses quantitative methods to compare the attributes of four stove types. • LPG stoves have comparatively better ranking for emissions, safety, and durability. • Transformative policies and strategies are required to promote safe, clean stoves.

Usability and Gratifications--Towards a Website Analysis Model.

Science.gov (United States)

Bunz, Ulla K.

This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…

Usability at the CELSTEC Medialab

NARCIS (Netherlands)

Storm, Jeroen; Kostons, Danny

2009-01-01

Storm, J., & Kostons, D. (2009). Usability at the CELSTEC MediaLab. Presentation about the usability testing, usability research and User Centered Design conducted at the CELSTEC MediaLab. July, 7, 2009, Heerlen, The Netherlands: Open University of the Netherlands.

VA FitHeart, a Mobile App for Cardiac Rehabilitation: Usability Study.

Science.gov (United States)

Beatty, Alexis L; Magnusson, Sara L; Fortney, John C; Sayre, George G; Whooley, Mary A

2018-01-15

Cardiac rehabilitation (CR) improves outcomes for patients with ischemic heart disease or heart failure but is underused. New strategies to improve access to and engagement in CR are needed. There is considerable interest in technology-facilitated home CR. However, little is known about patient acceptance and use of mobile technology for CR. The aim of this study was to develop a mobile app for technology-facilitated home CR and seek to determine its usability. We recruited patients eligible for CR who had access to a mobile phone, tablet, or computer with Internet access. The mobile app includes physical activity goal setting, logs for tracking physical activity and health metrics (eg, weight, blood pressure, and mood), health education, reminders, and feedback. Study staff demonstrated the mobile app to participants in person and then observed participants completing prespecified tasks with the mobile app. Participants completed the System Usability Scale (SUS, 0-100), rated likelihood to use the mobile app (0-100), questionnaires on mobile app use, and participated in a semistructured interview. The Unified Theory of Acceptance and Use of Technology and the Theory of Planned Behavior informed the analysis. On the basis of participant feedback, we made iterative revisions to the mobile app between users. We conducted usability testing in 13 participants. The first version of the mobile app was used by the first 5 participants, and revised versions were used by the final 8 participants. From the first version to revised versions, task completion success rate improved from 44% (11/25 tasks) to 78% (31/40 tasks; P=.05), SUS improved from 54 to 76 (P=.04; scale 0-100, with 100 being the best usability), and self-reported likelihood of use remained high at 76 and 87 (P=.30; scale 0-100, with 100 being the highest likelihood). In interviews, patients expressed interest in tracking health measures ("I think it'll be good to track my exercise and to see what I'm doing

Usability testing a practical guide for librarians

CERN Document Server

Blakiston, Rebecca

2014-01-01

Do you want to improve the usability of your library website, but feel that it is too difficult, time-consuming, or expensive? Usability Testing: A Practical Guide for Librarians will teach you how to make the case for usability testing, define your audience and their goals, select a usability testing method appropriate for your particular context, plan for an in-house usability test, conduct an effective in-house usability test, analyze usability test results, and create and implement a plan for ongoing, systematic usability testing. Step-by-step instructions, along with a myriad of examples,

Multifunctional systems in vehicles:a usability evaluation

OpenAIRE

Rydström, Annie; Bengtsson, Peter; Grane, Camilla; Broström, Robert; Agardh, Johannes; Nilsson, Jennie

2005-01-01

Car Human-Machine Interaction (HMI) is becoming increasingly complex as the extension of functionality necessitates new interface concepts. Various multifunctional systems operated by haptic rotary switches, touch screen, and voice control have been developed. A usability study of multifunctional systems available on the market was carried out to evaluate and compare different manual interaction principles. The systems used in the study were the BMW iDrive and the Audi MMI, both operated by a...

Evaluation of Usability Utilizing Markov Models

Science.gov (United States)

Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane

2012-01-01

Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…

Software architecture analysis of usability

NARCIS (Netherlands)

Folmer, Eelke

2005-01-01

One of the qualities that has received increased attention in recent decades is usability. A software product with poor usability is likely to fail in a highly competitive market; therefore software developing organizations are paying more and more attention to ensuring the usability of their

Evaluating Web Usability

Science.gov (United States)

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Bringing content understanding into usability testing in complex application domains—a case study in eHealth

DEFF Research Database (Denmark)

Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

2017-01-01

A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... of users’ content understanding is sometimes crucial, and thus should be carefully evaluated. Unfortunately, conventional usability evaluation techniques do not address challenges of content understanding. In a case study within eHealth, specifically the setting of a rehabilitation clinic involving...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...

Toward more usable electronic voting: testing the usability of a smartphone voting system.

Science.gov (United States)

Campbell, Bryan A; Tossell, Chad C; Byrne, Michael D; Kortum, Philip

2014-08-01

The goal of this research was to assess the usability of a voting system designed for smart-phones. Smartphones offer remote participation in elections through the use of pervasive technology. Voting on these devices could, among other benefits, increase voter participation while allowing voters to use familiar technology. However, the usability of these systems has not been assessed. A mobile voting system optimized for use on a smartphone was designed and tested against traditional voting platforms for usability. There were no reliable differences between the smartphone-based system and other voting methods in efficiency and perceived usability. More important, though, smartphone owners committed fewer errors on the mobile voting system than on the traditional voting systems. Even with the known limitations of small mobile platforms in both displays and controls, a carefully designed system can provide a usable voting method. Much of the concern about mobile voting is in the area of security; therefore, although these results are promising, security concerns and usability issues arising from mitigating them must be strongly considered. The results of this experiment may help to inform current and future election and public policy officials about the benefits of allowing voters to vote with familiar hardware.

Evaluating the Usability of Authoring Environments for Serious Games.

Science.gov (United States)

Slootmaker, Aad; Hummel, Hans; Koper, Rob

2017-08-01

Background . The EMERGO method and online platform enable the development and delivery of scenario-based serious games that foster students to acquire professional competence. One of the main goals of the platform is to provide a user-friendly authoring environment for creating virtual environments where students can perform authentic tasks. Aim . We present the findings of an in-depth qualitative case study of the platform's authoring environment and compare our findings on usability with those found for comparable environments in literature. Method . We carried out semi-structured interviews, with two experienced game developers who have authored a game for higher education, and a literature review of comparable environments. Findings . The analysis shows that the usability of the authoring environment is problematic, especially regarding understandability and learnability , which is in line with findings of comparable environments. Other findings are that authoring is well integrated with the EMERGO method and that functionality and reliability of the authoring environment are valued. Practical implications . The lessons learned are presented in the form of general guidelines to improve the understandability and learnability of authoring environments for serious games .

Responsibilities in the Usability Requirements Elicitation Process

Directory of Open Access Journals (Sweden)

Marianella Aveledo

2008-12-01

Full Text Available Like any other software system quality attribute, usability places requirements on software components. In particular, it has been demonstrated that certain usability features have a direct impact throughout the software process. This paper details an approach that looks at how to deal with certain usability features in the early software development stages. In particular, we consider usability features as functional usability requirements using patterns that have been termed usability patterns to elicit requirements. Additionally, we clearly establish the responsibilities of all the players at the usability requirements elicitation stage.

The Usability Expert’s Fear of Agility

DEFF Research Database (Denmark)

Nielsen, Lene; Madsen, Sabine

2012-01-01

This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12 differ...

Qualitative review of usability problems in health information systems for radiology.

Science.gov (United States)

Dias, Camila Rodrigues; Pereira, Marluce Rodrigues; Freire, André Pimenta

2017-12-01

Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics. The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively. These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability testing for the rest of us: the application of discount usability principles in the development of an online communications assessment application.

Science.gov (United States)

Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric

2013-01-01

Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.

Commentary: Usability – A Sensitizing Concept

DEFF Research Database (Denmark)

Hertzum, Morten

2018-01-01

In his article “The Usability Construct: A Dead End?”, Tractinsky (in Human-Computer Interaction) contends that for scientific research on usability to progress, the usability construct should be unbundled and replaced by well-defined constructs. This contention is presented as the conclusion...... that follows naturally from taking a scientist’s viewpoint on usability. Similar calls for definitive concepts – constructs in Tractinsky’s terminology – have been made in other scientific fields with concepts as ambiguous as that of usability. But counterarguments have also been presented....

Usability of Videogame-Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study.

Science.gov (United States)

Vanbellingen, Tim; Filius, Suzanne J; Nyffeler, Thomas; van Wegen, Erwin E H

2017-01-01

Approximately 70-80% of stroke survivors have limited activities of daily living, mainly due to dexterous problems. Videogame-based training (VBT) along with virtual reality seems to be beneficial to train upper limb function. To evaluate the usability of VBT using the Leap Motion Controller (LMC) to train fine manual dexterity in the early rehabilitation phase of stroke patients as an add-on to conventional therapy. Additionally, this study aimed to estimate the feasibility and potential efficacy of the VBT. During 3 months, 64 stroke patients were screened for eligibility, 13 stroke patients were included (4 women and 9 men; age range: 24-91 years; mean time post stroke: 28.2 days). Nine sessions of 30 min VBT, three times per week as an add-on to conventional therapy with stroke inpatients. Primary outcome was the usability of the system measured with the System Usability Scale. Secondary outcomes concerning feasibility were the compliance rate calculated from the total time spent on the intervention (TT) compared to planned time, the opinion of participants via open-end questions, and the level of active participation measured with the Pittsburgh Rehabilitation Participation Scale. Regarding the potential efficacy secondary outcomes were: functional dexterity measured with the Nine Hole Peg Test (NHPT), subjective dexterity measured with the Dexterity Questionnaire 24, grip strength measured with the Jamar dynamometer, and motor impairment of the upper limb measured with the Fugl-Meyer Upper Extremity (FM-UE) scale. Primarily, the usability of the system was good to excellent. The patient's perception of usability remained stable over a mean period of 3 weeks of VBT. Secondly, the compliance rate was good, and the level of active participation varied between good and very good. The opinion of the participants revealed that despite individual differences, the overall impression of the therapy and device was good. Patients showed significant

Usability of Videogame-Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study

Directory of Open Access Journals (Sweden)

Tim Vanbellingen

2017-12-01

Full Text Available BackgroundApproximately 70–80% of stroke survivors have limited activities of daily living, mainly due to dexterous problems. Videogame-based training (VBT along with virtual reality seems to be beneficial to train upper limb function.ObjectiveTo evaluate the usability of VBT using the Leap Motion Controller (LMC to train fine manual dexterity in the early rehabilitation phase of stroke patients as an add-on to conventional therapy. Additionally, this study aimed to estimate the feasibility and potential efficacy of the VBT.MethodsDuring 3 months, 64 stroke patients were screened for eligibility, 13 stroke patients were included (4 women and 9 men; age range: 24–91 years; mean time post stroke: 28.2 days.InterventionNine sessions of 30 min VBT, three times per week as an add-on to conventional therapy with stroke inpatients.Outcome measuresPrimary outcome was the usability of the system measured with the System Usability Scale. Secondary outcomes concerning feasibility were the compliance rate calculated from the total time spent on the intervention (TT compared to planned time, the opinion of participants via open-end questions, and the level of active participation measured with the Pittsburgh Rehabilitation Participation Scale. Regarding the potential efficacy secondary outcomes were: functional dexterity measured with the Nine Hole Peg Test (NHPT, subjective dexterity measured with the Dexterity Questionnaire 24, grip strength measured with the Jamar dynamometer, and motor impairment of the upper limb measured with the Fugl-Meyer Upper Extremity (FM-UE scale.ResultsPrimarily, the usability of the system was good to excellent. The patient’s perception of usability remained stable over a mean period of 3 weeks of VBT. Secondly, the compliance rate was good, and the level of active participation varied between good and very good. The opinion of the participants revealed that despite individual differences, the overall impression

Analysis in usability evaluations

DEFF Research Database (Denmark)

Følstad, Asbjørn; Lai-Chong Law, Effie; Hornbæk, Kasper

2010-01-01

While the planning and implementation of usability evaluations are well described in the literature, the analysis of the evaluation data is not. We present interviews with 11 usability professionals on how they conduct analysis, describing the resources, collaboration, creation of recommendations......, and prioritization involved. The interviews indicate a lack of structure in the analysis process and suggest activities, such as generating recommendations, that are unsupported by existing methods. We discuss how to better support analysis, and propose four themes for future research on analysis in usability...

Feedback from Usability Evaluation to User Interface Design

DEFF Research Database (Denmark)

Nielsen, C. M.; Overgaard, M.; Pedersen, M. B.

2005-01-01

This paper reports from an exploratory study of means for providing feedback from a usability evaluation to the user interface designers. In this study, we conducted a usability evaluation of a mobile system that is used by craftsmen to register use of time and materials. The results...... and weaknesses of the system. The findings indicate that detailed descriptions of problems and log descriptions of the user's interaction with the system and of system interaction are useful for the designers when trying to understand the usability problems that the users have encountered....

Usability study of clinical exome analysis software: top lessons learned and recommendations.

Science.gov (United States)

Shyr, Casper; Kushniruk, Andre; Wasserman, Wyeth W

2014-10-01

New DNA sequencing technologies have revolutionized the search for genetic disruptions. Targeted sequencing of all protein coding regions of the genome, called exome analysis, is actively used in research-oriented genetics clinics, with the transition to exomes as a standard procedure underway. This transition is challenging; identification of potentially causal mutation(s) amongst ∼10(6) variants requires specialized computation in combination with expert assessment. This study analyzes the usability of user interfaces for clinical exome analysis software. There are two study objectives: (1) To ascertain the key features of successful user interfaces for clinical exome analysis software based on the perspective of expert clinical geneticists, (2) To assess user-system interactions in order to reveal strengths and weaknesses of existing software, inform future design, and accelerate the clinical uptake of exome analysis. Surveys, interviews, and cognitive task analysis were performed for the assessment of two next-generation exome sequence analysis software packages. The subjects included ten clinical geneticists who interacted with the software packages using the "think aloud" method. Subjects' interactions with the software were recorded in their clinical office within an urban research and teaching hospital. All major user interface events (from the user interactions with the packages) were time-stamped and annotated with coding categories to identify usability issues in order to characterize desired features and deficiencies in the user experience. We detected 193 usability issues, the majority of which concern interface layout and navigation, and the resolution of reports. Our study highlights gaps in specific software features typical within exome analysis. The clinicians perform best when the flow of the system is structured into well-defined yet customizable layers for incorporation within the clinical workflow. The results highlight opportunities to

Design and Usability of Digital Libraries: Case Studies in the Asia Pacific

Science.gov (United States)

Theng, Yin-Leng, Ed.; Foo, Schubert, Ed.

2005-01-01

This book showcases some of the best digital library practices from organizations in the Asia Pacific. Particular emphasis has been placed on the design, use and usability of digital libraries. Not only are digital libraries examined, but related technologies, the management of knowledge in digital libraries, and the associated usability and…

A Usability Evaluation of Academic Virtual Reference Services

Science.gov (United States)

Chow, Anthony S.; Croxton, Rebecca A.

2014-01-01

This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…

Towards a Usability and Error "Safety Net": A Multi-Phased Multi-Method Approach to Ensuring System Usability and Safety.

Science.gov (United States)

Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth

2017-01-01

The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.

Virtual gaming simulation of a mental health assessment: A usability study.

Science.gov (United States)

Verkuyl, Margaret; Romaniuk, Daria; Mastrilli, Paula

2018-05-18

Providing safe and realistic virtual simulations could be an effective way to facilitate the transition from the classroom to clinical practice. As nursing programs begin to include virtual simulations as a learning strategy; it is critical to first assess the technology for ease of use and usefulness. A virtual gaming simulation was developed, and a usability study was conducted to assess its ease of use and usefulness for students and faculty. The Technology Acceptance Model provided the framework for the study, which included expert review and testing by nursing faculty and nursing students. This study highlighted the importance of assessing ease of use and usefulness in a virtual game simulation and provided feedback for the development of an effective virtual gaming simulation. The study participants said the virtual gaming simulation was engaging, realistic and similar to a clinical experience. Participants found the game easy to use and useful. Testing provided the development team with ideas to improve the user interface. The usability methodology provided is a replicable approach to testing virtual experiences before a research study or before implementing virtual experiences into curriculum. Copyright © 2018 Elsevier Ltd. All rights reserved.

A Survey of Usability Practices in Free/Libre/Open Source Software

Science.gov (United States)

Paul, Celeste Lyn

A review of case studies about usability in eight Free/Libre/Open Source Software (FLOSS) projects showed that an important issue regarding a usability initiative in the project was the lack of user research. User research is a key component in the user-centered design (UCD) process and a necessary step for creating usable products. Reasons why FLOSS projects suffered from a lack of user research included poor or unclear project leadership, cultural differences between developer and designers, and a lack of usability engineers. By identifying these critical issues, the FLOSS usability community can begin addressing problems in the efficacy of usability activities and work towards creating more usable FLOSS products.

Usability in Scientific Databases

Directory of Open Access Journals (Sweden)

Ana-Maria Suduc

2012-07-01

Full Text Available Usability, most often defined as the ease of use and acceptability of a system, affects the users' performance and their job satisfaction when working with a machine. Therefore, usability is a very important aspect which must be considered in the process of a system development. The paper presents several numerical data related to the history of the scientific research of the usability of information systems, as it is viewed in the information provided by three important scientific databases, Science Direct, ACM Digital Library and IEEE Xplore Digital Library, at different queries related to this field.

Towards an empirical method of usability testing of system parts : a methodological study

NARCIS (Netherlands)

Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.

2007-01-01

Current usability evaluation methods are essentially holistic in nature. However, engineers that apply a component-based software engineering approach might also be interested in understanding the usability of individual parts of an interactive system. This paper examines the efficiency dimension of

The effect of a feedback signal in a computer mouse on hovering behaviour, productivity, comfort and usability in a field study

NARCIS (Netherlands)

Kraker, H. de; Korte, E. de; Mil, F. van; Rijs, B.; Bongers, P.

2008-01-01

The aim of this study was to determine the effect of a tactile feedback signal on hovering behaviour, productivity, usability and comfort after 1 week of using an experimental mouse. In a randomized controlled trial, a regular computer mouse was compared to a new developed mouse with a tactile,

Design and usability study of an iconic user interface to ease information retrieval of medical guidelines.

Science.gov (United States)

Griffon, Nicolas; Kerdelhué, Gaétan; Hamek, Saliha; Hassler, Sylvain; Boog, César; Lamy, Jean-Baptiste; Duclos, Catherine; Venot, Alain; Darmoni, Stéfan J

2014-10-01

Doc'CISMeF (DC) is a semantic search engine used to find resources in CISMeF-BP, a quality controlled health gateway, which gathers guidelines available on the internet in French. Visualization of Concepts in Medicine (VCM) is an iconic language that may ease information retrieval tasks. This study aimed to describe the creation and evaluation of an interface integrating VCM in DC in order to make this search engine much easier to use. Focus groups were organized to suggest ways to enhance information retrieval tasks using VCM in DC. A VCM interface was created and improved using the ergonomic evaluation approach. 20 physicians were recruited to compare the VCM interface with the non-VCM one. Each evaluator answered two different clinical scenarios in each interface. The ability and time taken to select a relevant resource were recorded and compared. A usability analysis was performed using the System Usability Scale (SUS). The VCM interface contains a filter based on icons, and icons describing each resource according to focus group recommendations. Some ergonomic issues were resolved before evaluation. Use of VCM significantly increased the success of information retrieval tasks (OR=11; 95% CI 1.4 to 507). Nonetheless, it took significantly more time to find a relevant resource with VCM interface (101 vs 65 s; p=0.02). SUS revealed 'good' usability with an average score of 74/100. VCM was successfully implemented in DC as an option. It increased the success rate of information retrieval tasks, despite requiring slightly more time, and was well accepted by end-users. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

How to Reach Evidence-Based Usability Evaluation Methods

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda

2017-01-01

This paper discusses how and why to build evidence-based knowledge on usability evaluation methods. At each step of building evidence, requisites and difficulties to achieve it are highlighted. Specifically, the paper presents how usability evaluation studies should be designed to allow capitalizing

A continuous usability evaluation of an electronic medication administration record application.

Science.gov (United States)

Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva

2017-12-01

The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.

Usability Problem Identification in Culturally Diverse Settings

DEFF Research Database (Denmark)

Clemmensen, Torkil

2012-01-01

There are indications that established methods for evaluating information system usability that have been developed for use in, e.g. Europe or the USA, fail to give reliable results in countries such as India, China or Malaysia. This paper presents the theoretical background, related work...... and a definition of culture that should be useful for studies of multiple-country usability testing. This includes a discussion of cultural fit and the consequences of cultural (in)consistencies between stakeholders in system development and use. As an illustrative example of the kind of academic research...... that needs to be done, a pilot study is described. The pilot study exemplifies themes to explore, who should be participants and where should the study be done, how to find examples of multiple-country usability testing, how to collect data and how to analyse that data and what kind of results and discussion...

Developer Driven and User Driven Usability Evaluations

DEFF Research Database (Denmark)

Bruun, Anders

2013-01-01

Usability evaluation provide software development teams with insights on the degree to which a software application enables a user to achieve his/her goals, how fast these goals can be achieved, how easy it is to learn and how satisfactory it is in use Although usability evaluations are crucial...... in the process of developing software systems with a high level of usability, its use is still limited in the context of small software development companies. Several approaches have been proposed to support software development practitioners (SWPs) in conducting usability evaluations, and my thesis explores two...... of these: 1) The first approach is to support SWPs by training them to drive usability evaluations. 2) The second approach to support SWPs involves minimalist training of end users to drive usability evaluations. In related work, a set of five quality criteria for usability evaluations is applied...

Evaluating Youtube Platform Usability by People with Intellectual Disabilities (A User Experience Case Study Performed in a Six-Month Period)

OpenAIRE

Tânia Rocha; José Martins; Frederico Branco; Ramiro Gonçalves

2017-01-01

A comparison study of the Web interaction evolution of a group of people with intellectual disabilities, when performing search tasks using the YouTube platform, is presented. For the effect, we compare results in two assessment moments (the second assessment moment was performed, within the 6 months after the first one). We aimed at evaluating the evolution of their digital skills by comparing two assessment moments through the following usability variables: effectiveness, we register the...

Users' performance in lab and non-lab environments through online usability testing:A case of evaluating the usability of digital academic libraries' websites

OpenAIRE

Alharbi, Abeer; Mayhew, Pam

2015-01-01

The factors related to the environment in which users operate may be of a vital importance when trying to understand how they experience a particular system. It is required that we find out how we can get to know those factors to investigate if they affect the users' performance in usability testing. An online usability study has emerged that can be attempted by a large, varied pool of users' anywhere with an Internet connection. Would the usage of an online usability study help to give compr...

web portal usability among na case study of univer se study of ...

African Journals Online (AJOL)

User

2014-04-02

Apr 2, 2014 ... ABSTRACT. The web portal technology by Nigerian universitie university ... Portal Usability Success (WEBPUS) Model .... to deliver education to students [4]. Despite ..... and Mobile Research Lab (ITML) and group members.

Usable security history, themes, and challenges

CERN Document Server

Garfinkel, Simson

2014-01-01

There has been roughly 15 years of research into approaches for aligning research in Human Computer Interaction with computer Security, more colloquially known as ``usable security.'' Although usability and security were once thought to be inherently antagonistic, today there is wide consensus that systems that are not usable will inevitably suffer security failures when they are deployed into the real world. Only by simultaneously addressing both usability and security concerns will we be able to build systems that are truly secure. This book presents the historical context of the work to dat

Earthdata Search Client: Usability Review Process, Results, and Implemented Changes, Using Earthdata Search Client as a Case Study

Science.gov (United States)

Siarto, Jeff; Reese, Mark; Shum, Dana; Baynes, Katie

2016-01-01

User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.

Dogmas in the assessment of usability evaluation methods

DEFF Research Database (Denmark)

Hornbæk, Kasper

2010-01-01

Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work ...... research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined......Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work...... on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win-lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss...

An Intelligent Framework for Website Usability

Directory of Open Access Journals (Sweden)

Alexiei Dingli

2014-01-01

Full Text Available With the major advances of the Internet throughout the past couple of years, websites have come to play a central role in the modern marketing business program. However, simply owning a website is not enough for a business to prosper on the Web. Indeed, it is the level of usability of a website that determines if a user stays or abandons it for another competing one. It is therefore crucial to understand the importance of usability on the web, and consequently the need for its evaluation. Nonetheless, there exist a number of obstacles preventing software organizations from successfully applying sound website usability evaluation strategies in practice. From this point of view automation of the latter is extremely beneficial, which not only assists designers in creating more usable websites, but also enhances the Internet users’ experience on the Web and increases their level of satisfaction. As a means of addressing this problem, an Intelligent Usability Evaluation (IUE tool is proposed that automates the usability evaluation process by employing a Heuristic Evaluation technique in an intelligent manner through the adoption of several research-based AI methods. Experimental results show there exists a high correlation between the tool and human annotators when identifying the considered usability violations.

Using a fuzzy comprehensive evaluation method to determine product usability: A proposed theoretical framework.

Science.gov (United States)

Zhou, Ronggang; Chan, Alan H S

2017-01-01

In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.

Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.

Science.gov (United States)

Pulantara, I Wayan; Parmanto, Bambang; Germain, Anne

2018-05-17

Healthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur in specialty sleep clinics, which suffer from an insufficient number of trained clinicians. Smartphone-based interventions offer a promising means for improving the delivery of CBTI. Furthermore, novel features such as real-time monitoring and assessment, personalization, dynamic adaptations of the intervention, and context awareness can enhance treatment personalization and effectiveness, and reduce associated costs. Ultimately, this "Just in Time Adaptive Intervention" for insomnia-an intervention approach that is acceptable to patients and clinicians, and is based on mobile health (mHealth) platform and tools-can significantly improve patient access and clinician delivery of evidence-based insomnia treatments. This study aims to develop and assess the usability of a Just in Time Adaptive Intervention application platform called iREST ("interactive Resilience Enhancing Sleep Tactics") for use in behavioral insomnia interventions. iREST can be used by both patients and clinicians. The development of iREST was based on the Iterative and Incremental Development software development model. Requirement analysis was based on the case study's description, workflow and needs, clinician inputs, and a previously conducted BBTI military study/implementation of the Just in Time Adaptive Intervention architecture. To evaluate the usability of the iREST mHealth tool, a pilot usability study was conducted. Additionally, this study explores the feasibility of using an off-the-shelf wearable device to

Determination of the effectiveness of two methods for usability evaluation using a CPOE medication ordering system

NARCIS (Netherlands)

Khajouei, R.; Hasman, A.; Jaspers, M. W. M.

2011-01-01

Objectives: To assess the effectiveness of two usability evaluation methods, cognitive walkthrough (CW) and think aloud (TA), for identifying usability problems and to compare the performance of CW and TA in identifying different types of usability problems. Methods: A CW was performed by two

DEVELOPMENT OF USABILITY CRITERIA FOR E-LEARNING CONTENT DEVELOPMENT SOFTWARE

Directory of Open Access Journals (Sweden)

Serkan ÇELIK

2012-04-01

Full Text Available Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step towards the definition of criteria for evaluating e-learning tools. A preliminary user study involving a group of pre-service instructional designers, observed during their interaction with e-learning tools, is reported. Throughout the study, specific usability attributes of these e-learning tools were identified. Participants were assigned to rate the importance of functional and pedagogical competences proposed during the criteria development phase. The findings of the study revealed 31 evaluation criteria under the headings of technical, media, and assessment competences. Among the groups of benchmarks proposed and rated by the users, assessment was considered as the most important one while technical and media features were even.The following step was actual implemention of the usability criteria into evaluation of fifteen leading software used in e-learning across the world. Mostly, tools were observed as having limitations in terms of capabilities. Comparing to the other software, Captivate, Softchalk, and Lectora were regarded as outstanding tools by the participants. Following the discussion on the limitations of the study, some implications for further research were proposed.

Managing Product Usability: How companies deal with usability in the development of electronic consumer products

OpenAIRE

Van Kuijk, J.I.

2010-01-01

Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. That the usability of electronic consumer products is under pressure is attributed to an incre...

Users Views about the Usability of Digital Libraries

Science.gov (United States)

Koohang, Alex; Ondracek, James

2005-01-01

This study examined users' views about the usability of digital libraries' current and perceived importance. Age, gender, prior experience with the Internet, college status, and digital library proficiency are the independent variables. Users' current views about the usability of digital libraries and users perceived importance of digital library…

Usability evaluation of healthcare information systems: comparison of methods and classification of usability problems

NARCIS (Netherlands)

Khajouei, R.

2011-01-01

In ziekenhuizen wordt steeds meer gebruik gemaakt van informatiesystemen, maar de usability laat vaak te wensen over. Reza Khajouei testte twee methodes om de usability te beoordelen. Hij constateert dat beide methoden ongeveer evenveel, maar verschillende problemen aan het licht brengen. Uit een

Why Citizen Science Without Usability Testing Will Underperform

Science.gov (United States)

Romano, C.; Gay, P.; Owens, R.; Burlea, G.

2017-12-01

Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.

A Usability Evaluation Model for Academic Library Websites: Efficiency, Effectiveness and Learnability

Directory of Open Access Journals (Sweden)

Soohyung Joo

2011-12-01

Full Text Available Purpose – This paper aimed to develop a usability evaluation model and associated survey tool in the context of academic libraries. This study not only proposed a usability evaluation model but also a practical survey tool tailored to academic library websites. Design/methodology – A usability evaluation model has been developed for academic library websites based on literature review and expert consultation. Then, the authors verified the reliability and validity of the usability evaluation model empirically using the survey data from actual users. Statistical analysis, such as descriptive statistics, internal consistency test, and a factor analysis, were applied to ensure both the reliability and validity of the usability evaluation tool. Findings – From the document analysis and expert consultation, this study identified eighteen measurement items to survey the three constructs of the usability, effectiveness, efficiency, and learnability, in academic library websites. The evaluation tool was then validated with regard to data distribution, reliability, and validity. The empirical examination based on 147 actual user responses proved the survey evaluation tool suggested herein is acceptable in assessing academic library website usability. Originality/Value – This research is one of the few studies to engender a practical survey tool in evaluating library website usability. The usability model and corresponding survey tool would be useful for librarians and library administrators in academic libraries who plan to conduct a usability evaluation involving large sample.

Discovering How Students Search a Library Web Site: A Usability Case Study.

Science.gov (United States)

Augustine, Susan; Greene, Courtney

2002-01-01

Discusses results of a usability study at the University of Illinois Chicago that investigated whether Internet search engines have influenced the way students search library Web sites. Results show students use the Web site's internal search engine rather than navigating through the pages; have difficulty interpreting library terminology; and…

How Do Clinical Information Systems Affect the Cognitive Demands of General Practitioners?: Usability Study with a Focus on Cognitive Workload

Directory of Open Access Journals (Sweden)

Ferran Ariza

2015-11-01

Full Text Available Background Clinical information systems in the National Health Service do not need to conform to any explicit usability requirements. Poor usability can increase the mental workload experienced by clinicians and cause fatigue, increase error rates and impact the overall patient safety. Mental workload can be used as a measure of usability.Objective To assess the subjective cognitive workload experienced by general practitioners (GPs with their systems. To raise awareness of the importance of usability in system design among users, designers, developers and policymakers.Methods We used a modified version of the NASA Task Load Index, adapted for web. We developed a set of common clinical scenarios and computer tasks on an online survey. We emailed the study link to 199 clinical commissioning groups and 1,646 GP practices in England. Results Sixty-seven responders completed the survey. The respondents had spent an average of 17 years in general practice, had experience of using a mean of 1.5 GP computer systems and had used their current system for a mean time of 6.7 years. The mental workload score was not different among systems. There were significant differences among the task scores, but these differences were not specific to particular systems. The overall score and task scores were related to the length of experience with their present system. Conclusion Four tasks imposed a higher mental workload on GPs: ‘repeat prescribing’, ‘find episode’, ‘drug management’ and ‘overview records’. Further usability studies on GP systems should focus on these tasks. Users, policymakers, designers and developers should remain aware of the importance of usability in system design.What does this study add?• Current GP systems in England do not need to conform to explicit usability requirements. Poor usability can increase the mental workload of clinicians and lead to errors.• Some clinical computer tasks incur more cognitive workload

Dimensions for hearing-impaired mobile application usability model

Science.gov (United States)

Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan

2017-10-01

This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.

Getting a technology-based diabetes intervention ready for prime time: a review of usability testing studies.

Science.gov (United States)

Lyles, Courtney R; Sarkar, Urmimala; Osborn, Chandra Y

2014-10-01

Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009 to 2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n = 11), descriptive quantitative (n = 9), and qualitative methods (n = 3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes and publish usability findings to inform interpretation of why an intervention succeeded or failed and for whom.

Advancing Usability Evaluation through Human Reliability Analysis

International Nuclear Information System (INIS)

Ronald L. Boring; David I. Gertman

2005-01-01

This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probability of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues

Exploring the Usability of Mobile Apps Supporting Radiologists' Training in Diagnostic Decision Making.

Science.gov (United States)

Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K

2016-03-01

The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

A Benchmark Usability Study of the Tactical Decision Making Under Stress Decision Support System

National Research Council Canada - National Science Library

Schmorrow, Dylan

1998-01-01

This study evaluates the usability of a U.S. Navy Decision Support System (DSS). The DSS was developed to enhance the performance of tactical decision makers within a Navy Combat Information Center...

Examining the Use of Usability Results in a Software Development Company

DEFF Research Database (Denmark)

Høegh, Rune Thaarup; Stage, Jan

2004-01-01

This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...... from the company found that the traditional usability report plays a very little role for the development team. Initial results suggest that textual feedback proves more valuable when accompanied with video and oral feedback.......This paper presents the first results of a study on a usability evaluation for a Danish software development company. The use of the results from the usability evaluation is examined through interviews with two developers from the software company. It is through an interview with a project leader...

A Pedagogical Approach toward Teaching an Information Systems Student How to Conduct a Web Usability Study for an Honors Project: A Case Study

Science.gov (United States)

Jesse, Gayle

2013-01-01

The purpose of this paper is to provide educators with a course model and pedagogy to teach a computer information systems usability course. This paper offers a case study based on an honors student project titled "Web Usability: Phases of Developing an Interactive Event Database." Each individual phase--creating a prototype along with…

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies

DEFF Research Database (Denmark)

Kushniruk, Andre; Nøhr, Christian; Jensen, Sanne

2013-01-01

of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Results: Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under...... such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. Conclusion: In order to bring context of use...

Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.

Science.gov (United States)

Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph

2016-07-08

Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to

A literature review about usability evaluation methods for e-learning platforms.

Science.gov (United States)

Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac

2012-01-01

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.

Applying usability heuristics to radiotherapy systems

International Nuclear Information System (INIS)

Chan, Alvita J.; Islam, Mohammad K.; Rosewall, Tara; Jaffray, David A.; Easty, Anthony C.; Cafazzo, Joseph A.

2012-01-01

Background and purpose: Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. Material and methods: A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. Results: The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Conclusions: Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems.

Usability and Interaction Design in West Africa

DEFF Research Database (Denmark)

Sørensen, Jannick Kirk

Good usability is important in all ICT solutions. To achieve good usability, a good praxis for interaction design is needed. Usability and interaction design have however emerged and established itself in a North European and US context. The ICT industry in Africa do not have the same resources...... for user-involvement and participatory design be directly transferred? How can interaction design and usability be cared for in African ICT development context, given the resources available? This paper aims to initiate a discussion of the conditions for interaction design and usability in West Africa...... in the field of interaction design as in the developed world. While good usability and good user experiences are important to all users of ICT, the question is whether the methods and techniques that were mainly developed in Scandinavia, Europe and US are suitable for ICT development in Africa? Can ideals...

OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.

Science.gov (United States)

Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein

2018-01-01

Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.

Qualitative Marketing Research Through Usability Testing

Directory of Open Access Journals (Sweden)

Orzan Mihai

2008-04-01

Full Text Available Usability is an attribute of any good product, just as its functionality. It refers mainly to the utility of a product for its indented users, as well as to its ease of use. And whilst a correct functionality is critical for the commercial success of any product, its value comes through the human needs that it fulfills, which is determined through various marketing research techniques. In parallel, the IT&C community has developed in the last two decades its own type of research, called usability testing, used mainly to evaluate interface ease of use and all usability problems associated with.software products. This article aims at finding the right place for usability testing and usability professionals in the marketing community, as well as drawing a wider picture, from a marketing research perspective, on one of the most popular topics in IT&C community for the benefit of marketing scholars and professionals.

Understanding Usability Work as a Human Activity

DEFF Research Database (Denmark)

Nørgaard, Mie

Three core themes are explored in eight papers: Usability work as a human activity, usability practice and methods, and persuasiveness of evaluation results and feedback. We explore how usability work is much more than methods and work procedures, and argue that maturing our understanding...

Usability/Sentiment for the Enterprise and ENTERPRISE

Science.gov (United States)

Meza, David; Berndt, Sarah

2014-01-01

The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or

IT investment decision making : Usability of a normative model

NARCIS (Netherlands)

Wijnhoven, Alphonsus B.J.M.; Heerkens, Johannes M.G.

This article analyzes the usability of a multi-criteria decision analysis based on a real options AHP (ROAHP) method for IT-investment decisions. The study presents ROAHP to Chief Information Officers (CIO’s) and collects their opinions on prerequisites for usability, strengths and weaknesses. To

Discovering the User: A Practical Glance at Usability Testing.

Science.gov (United States)

Campbell, Nicole; Walbridge, Sharon; Chisman, Janet; Diller, Karen R.

1999-01-01

This interview focuses on usability testing, one method for evaluating whether library Web sites are useful for users. Discussion includes: benefits and drawbacks of usability testing; why it is important; lessons learned from testing; advice for someone interested in doing a study; and recommendations. (AEF)

Course management systems from a usability perspective

CSIR Research Space (South Africa)

Padayachee, I

2011-01-01

Full Text Available (with knowledge of usability engineering and system domain knowledge) who inspect the Indira Padayachee, Paula Kotz? and Alta van der Merwe 302 interface and determine its compliance with recognized usability principles (the ?heuristics... presents a summary of the results of the severity rating. Table 2: Severity Rating Scale for Usability Problems (Nielsen 2007b) 0 I don?t agree that this is a usability problem at all 1 Cosmetic problem only: need not be fixed unless there is extra...

Usability Problems in a Home Telemedicine System

DEFF Research Database (Denmark)

Bruun, Anders; Stage, Jan

2010-01-01

a high level of usability in order to enable their users to employ the required functionality, especially if the target user group is elderly people. This paper reports from a usability evaluation of a home telemedicine system. Five elderly persons carried out specified tasks with the system, and based...... on that we identified usability problems with the system. The problems are presented, analysed in relation to 12 different usability themes and related to results from other evaluations of similar systems....

Usability testing of interaction components: taking the message exchange as a measure of usability

NARCIS (Netherlands)

Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Jacob, R.J.K.; Limbourg, Q; Vanderdonckt, J.

2004-01-01

Component-based Software Engineering (CBSE) is concerned with the development of systems from reusable parts (components), and the development and maintenance of these parts. This study addresses the issue of usability testing in a CBSE environment, and specifically automatically measuring the

Towards Evidence Based Usability in Health Informatics?

NARCIS (Netherlands)

Marcilly, Romaric; Peute, Linda W.; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W.

2015-01-01

In a Health Information Technology (HIT) regulatory context in which the usability of this technology is more and more a critical issue, there is an increasing need for evidence based usability practice. However, a clear definition of evidence based usability practice and how to achieve it is still

Usability and User Experience Information in Reviews

DEFF Research Database (Denmark)

Hedegaard, Steffen

future versions of the prod- uct? The results show that users write about product use in terms related to standard and popularly researched aspects of usability and user experience, e.g. effiiency, effectiveness, enjoyment, frustration. The frequency with which different aspects are depicted in reviews...... differs significantly between product domains. We also find that reviews contain descriptions of more persistent usability issues. I devise automatic methods for classifying sentences with regard to dimensions of both usability and user experience and usability problems and perform a linguistic analysis...

Implementing a collaborative virtual environment — specification for a usability metamodel

Directory of Open Access Journals (Sweden)

Maria L Villegas R

2009-01-01

Full Text Available This research presents the results of the first phase of a macro-project for constructing a collaborative virtual environment. It was aimed at selecting a graphical interface from five proposed for such environment, considering each one’s level of usability. Seve- ral standards of usability and user-centered design patterns were studied for specifying interface measurment criteria for speci- fying a usability metamodel; this defined the variables and rules to be taken into accout when measuring graphic user interface (GUI usability level for collaborative virtual environments. The use of metaphors when specifying graphic user interfaces is also briefly looked at as a source of new usability and satisfaction related to such interface use.

Web usability evaluation on BloobIS website by using hallway usability testing method and ISO 9241:11

Science.gov (United States)

Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria

2018-03-01

At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.

Sociotechnical Human Factors Involved in Remote Online Usability Testing of Two eHealth Interventions.

Science.gov (United States)

Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S

2016-02-03

Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users

Integrated System Validation Usability Questionnaire: Computerized Procedures

International Nuclear Information System (INIS)

Garcés, Ma. I.; Torralba, B.

2015-01-01

The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to operating procedures, both computer and paper-based, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed, the models used by the nuclear industry and their technical support organizations, mainly, the Electric Power Research Institute, EPRI, are analyzed, and scientist advances are also explored. In the remaining stages, general and specific guidelines for computerized and paper-based procedures are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMLAB.

Managing Product Usability : How companies deal with usability in the development of electronic consumer products

NARCIS (Netherlands)

Van Kuijk, J.I.

2010-01-01

Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to

Web usability testing with a Hispanic medically underserved population.

Science.gov (United States)

Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry

2009-04-01

Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.

Software Usability: Concepts, Attributes and Associated Health Problems

Directory of Open Access Journals (Sweden)

Grīnberga Sabīne

2016-10-01

Full Text Available Digital technologies have opened a large set of opportunities for new electronic services (e-commerce, e-health, e-studies etc.. There are many considerations that need to be made when programmers are building new application software or system software. The software needs to be attractive enough that people want to look at it. It also needs to contain all necessary information that developers want to share with their readers (customers, users in order to help them achieve the objective for which they came to their website, use their software, or interact with their teaching packages. The oversupply of e-services products has created a need for usability research and development. “Usability means making products and systems easier to use, and matching them more closely to user needs and requirements”. Usability is a key concept of the human-computer interface and is concerned with making computer systems easy to learn and easy to use through a user-centered design process. The in-depth understanding of usability concepts and processes are critical for large-scale acceptance of new e-services and knowledge productivity. Poorly designed software can be extremely annoying to users. Smith and Mayes state that „usability is now recognised as a vital determining factor in the success of any new computer system or computer-based service”. Studies have shown that the main health problems of computer users are repetitive strain injuries, visual discomfort and stress-related disorders. Beside other risk factors, such as poor workstation design, uncomfortable work postures, long hours of computer use every day, stress, etc., also poor design and usability of the computer systems, as well as computer technical problems, add to the pressure felt by the user, which may in turn cause stress-related disorders.

The elderly in the shopping centers: the usability study of semipublic spaces as attractiveness generator.

Science.gov (United States)

Bittencourt, Maria Cristina; do Valle Pereira, Vera Lúcia Duarte; Pacheco, Waldemar

2012-01-01

This article aims to study the importance of the attributes of usability and attractiveness for the semi-public spaces of Shopping Centers considering the elderly users, the psycho-cognitive and bio-physiological changes resulting from the aging process, as well as their expectations of the built space. Through a qualitative study of theoretical review with a multidisciplinary focus in architecture, ergonomics, gerontology, environmental psychology and management, the conditions of the elderly users were identified, and also the attributes related to usability and attractiveness, collected in order to understand and organize their interrelationships, to suggest recommendations about the drafting of Shopping Centers, aiming to generate projects and environments that should promote the efficient and satisfactory use for elderly and may also create a competitive advantage for these enterprises.

The role of usability in e-lexicography

Directory of Open Access Journals (Sweden)

André H. du Plessis

2017-05-01

Full Text Available In the development of the metalexicography, the primary focus of metalexicographers was on the development of printed dictionaries. As technology advances, the focus now shifts towards online and electronic products. Tarp (2009:23–24 posits that this shift results in metalexicographic shortcomings. This means that the theories used to create and evaluate dictionaries are not sufficient anymore. Bergenholtz and Bothma (2011:54 show that dictionaries as data carriers are now not only limited to the field of lexicography, but also to information technological fields. For current lexicographers to be successful in the digital age, the theories used in designing, developing and critiquing dictionaries must adapt with regards to current information technological trends, norms and practices. One aspect that must be addressed is the usability of dictionaries and other electronic lexicographic tools. By using usability theories and standards, current metalexicographical principles can be adapted for the digital age in a streamlined fashion. This study aims to show how usability theories and standards can be advantageous for metalexicography and that future electronic metalexicographic endeavours should not be undertaken without considering the usability as part of the theoretical framework.

Improving Public Relations Web Sites through Usability Research.

Science.gov (United States)

Hallahan, Kirk

2001-01-01

Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)

Usability evaluation of augmented reality user interfaces in games and personal navigation assistants

OpenAIRE

Ivanec, Zorian

2017-01-01

This paper studies heuristic usability evaluation of user interfaces. The literature review distinguishes characteristics of augmented reality and smartphones, presents heuristic evaluation, PACMAD usability model, personal navigation assistants, video games, augmented reality and J. Nielsen usability heuristics. In research part, usability heuristics of related subject fields and design guidelines are combined. Created heuristics and control questionnaire are used for evaluation of augmented...

Integrating Usability Evaluations into the Software Development Process

DEFF Research Database (Denmark)

Lizano, Fulvio

as relevant and strategic human–computer interaction (HCI) activities in the software development process, there are obstacles that limit the complete, effective and efficient integration of this kind of testing into the software development process. Two main obstacles are the cost of usability evaluations...... and the software developers' resistance to accepting users’ opinions regarding the lack of usability in their software systems. The ‘cost obstacle’ refers to the constraint of conducting usability evaluations in the software process due to the significant amount of resources required by this type of testing. Some......This thesis addresses the integration of usability evaluations into the software development process. The integration here is contextualized in terms of how to include usability evaluation as an activity in the software development lifecycle. Even though usability evaluations are considered...

A study of the usability of CGDI in health mapping

DEFF Research Database (Denmark)

Gao, Sheng; Mioc, Darka; Xialoun, Yi

, the development of CGDI has shown great potential in many fields like emergency management, public health, disaster relief, transportation, land information system. Our study is to use CGDI to support online mapping of infectious disease across New Brunswick and Maine and to identify the usability of CGDI...... disease information available to officials and public for better support of disease surveillance, we developed a data model for mapping, seamlessly integrating the spatial and health data across the New Brunswick and Maine border. Many factors such as map representation level, mapping variables, data...

A study in usability: redesigning a health sciences library's mobile site.

Science.gov (United States)

Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J

2012-01-01

A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC

From Playability to a Hierarchical Game Usability Model

OpenAIRE

Nacke, Lennart E.

2010-01-01

This paper presents a brief review of current game usability models. This leads to the conception of a high-level game development-centered usability model that integrates current usability approaches in game industry and game research.

Training Software Developers in Usability Engineering: A Literature Review

DEFF Research Database (Denmark)

Bruun, Anders

2010-01-01

. This paper presents a comprehensive literature study of research conducted in this area, where 129 papers are analyzed in terms of research focus, empirical basis, types of training participants and training costs. Findings show a need for further empirical research regarding long term effects of training...... to fund usability specialists or comprehensive consultancy. Training of non-usability personnel in critical usability engineering methods has the potential of easing these challenges. It is, however, unknown how much and what kind of research that has been committed to novice training in UE methods......, training costs and training in user based evaluation methods....

TEAMS (Tele-Exercise and Multiple Sclerosis), a Tailored Telerehabilitation mHealth App: Participant-Centered Development and Usability Study.

Science.gov (United States)

Thirumalai, Mohanraj; Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron

2018-05-24

People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready

Direct Integration: Training Software Developers to Conduct Usability Evaluations

DEFF Research Database (Denmark)

Skov, Mikael B.; Stage, Jan

2008-01-01

is based on an empirical study where 36 teams with a total of 234 first-year university students on software development and design educations were trained in a simple approach for user-based website usability testing that was taught in a 40 hour course. This approach supported them in planning, conducting......Many improvements of the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both approaches involve...... a complete division of work between developers and evaluators, which is an undesirable complexity for many software development projects. This paper takes a different approach by exploring to what extent software developers and designers can be trained to carry out their own usability evaluations. The paper...

An extended protocol for usability validation of medical devices: Research design and reference model.

Science.gov (United States)

Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten

2017-05-01

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.

Usability of PostgreSQL

OpenAIRE

Zeng, Xi

2011-01-01

My topic of the thesis is usability of PostgreSQL. It presents basic information aboutPostgreSQL, such as its history, function, and comparison with one of the most popular databases - MySQL. PostgreSQL has been tested in different environments and with different programming languages. The research is based on the documents from PostgreSQL official website.The thesis introduces and proves the usability and the compatibility of PostgreSQL. PostgreSQL has been installed on Windows workstation a...

Active Involvement of Software Developers in Usability Engineering

DEFF Research Database (Denmark)

Bornoe, Nis; Stage, Jan

2017-01-01

The essence of usability evaluations is to produce feedback that supports the downstream utility so the interaction design can be improved and problems can be fixed. In practice, software development organizations experience several obstacles for conducting usability engineering. One suggested...... approach is to train and involve developers in all phases of usability activities from evaluations, to problem reporting, and making redesign proposals. Only limited work has previously investigated the impact of actively involving developers in usability engineering. In this paper, we present two small......, and problem fixing. At the organizational level, we found that the attitude towards and understanding of the role of usability engineering improved....

Three Contexts for Evaluating Organizational Usability

DEFF Research Database (Denmark)

Hertzum, Morten

2018-01-01

Organizational usability is about the match between the user and the system, between the organization and the system, and between the environment and the system. While the first of these matches can, to a large extent, be evaluated in the lab, the two others cannot. Organizational usability must......, provide a brief example, and discuss the challenges it presents. To strengthen the focus on evaluation in the three contexts we propose the measurement of specified effects, combined with a sensitivity toward emergent effects. Incorporating effects in the evaluation of organizational usability makes...

The relationship between perceived usability of a beautiful interface and of an ugly interface

OpenAIRE

Mohammed, Naitullah; Syed.Mohammed, Mahamood Ur Rahman

2012-01-01

The relationship between the perceived usability of a beautiful interface and of an ugly interface is analyzed in this study. This study correlates the visual aesthetics of the website with perceived usability. This research is performed to know the significance of visual aesthetics on perceived usability. A website is designed with two interfaces. One interface is designed by following design guidelines with respect to usability and the other interface is designed without following guideline...

Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?

DEFF Research Database (Denmark)

Hertzum, Morten; Hansen, Kristin Due; Andersen, Hans Henrik

2009-01-01

thinking aloud participants took longer to solve tasks, spent a larger part of tasks on general distributed visual behaviour, issued more commands to navigate both within and between the pages of the websites used in the experiment, and experienced higher mental workload. Implications for usability......Thinking aloud is widely used for usability evaluation. The validity of the method is, however, debatable because it is generally used in a relaxed way that conflicts with the prescriptions of the classic model for obtaining valid verbalisations of thought processes. This study investigates whether...... participants that think aloud in the classic or relaxed way behave differently compared to performing in silence. Results indicate that whereas classic thinking aloud has little or no effect on behaviour apart from prolonging tasks, relaxed thinking aloud affects behaviour in multiple ways. During relaxed...

"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.

Science.gov (United States)

Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin

2017-10-01

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets

MATHEMATICAL MODEL FOR SOFTWARE USABILITY AUTOMATED EVALUATION AND ASSURANCE

Directory of Open Access Journals (Sweden)

І. Гученко

2011-04-01

Full Text Available The subject of the research is software usability and the aim is construction of mathematicalmodel of estimation and providing of the set level of usability. Methodology of structural analysis,methods of multicriterion optimization and theory of making decision, method of convolution,scientific methods of analysis and analogies is used in the research. The result of executed work isthe model for software usability automated evaluation and assurance that allows not only toestimate the current level of usability during every iteration of agile development but also tomanage the usability of created software products. Results can be used for the construction ofautomated support systems of management the software usability.

The Usability Analysis of An E-Learning Environment

Directory of Open Access Journals (Sweden)

Fulya TORUN

2015-10-01

Full Text Available In this research, an E-learning environment is developed for the teacher candidates taking the course on Scientific Research Methods. The course contents were adapted to one of the constructivist approach models referred to as 5E, and an expert opinion was received for the compliance of this model. An usability analysis was also performed to determine the usability of the e-learning environment. The participants of the research comprised 42 teacher candidates. The mixed method was used in the research. 3 different data collection tools were used in order to measure the three basic concepts of usability analyses, which are the dimensions of effectiveness, efficiency and satisfaction. Two of the data collection tools were the scales developed by different researchers and were applied with the approval received from the researchers involved. On the other hand, the usability test as another data tool was prepared by the researchers who conducted this study for the purpose of determining the participants’ success in handling the twelve tasks assigned to them with respect to the use of elearning environment, the seconds they spent on that environment and the number of clicks they performed. Considering the results of the analyses performed within the data obtained, the usability of the developed e-learning environment proved to be at a higher rate.

A Study of the Usability of Ergonomic Camera Vest Based on Spirometry Parameters

Directory of Open Access Journals (Sweden)

Shirazeh Arghami

2017-12-01

Full Text Available Background: Being a cameraman is one of those occupations that expose people to musculoskeletal disorders (MSDs. Therefore, control measures should be taken to protect cameramen’s health. To solve the given problem, a vest was designed for cameramen to prevent MSDs by reducing the pressure and contact stress while carrying the camera on their shoulder. However, the usability of vest had to be considered. The aim of this study was to determine the usability of the proposed vest using the spirometry parameters indicator. Methods: In this experimental study, 120 spirometry experiments were conducted with 40 male volunteer subjects with and without designed vest. Data were analyzed using SPSS- 16 with dependent t-test, at 0.05 significance level. Results: Based on the spirometry results, there is a significant difference between Forced Vital Capacity (FVC, Forced Expiratory Volume (FEV1 and heart rate in activity with and without vest (p<0.001. Conclusion: The results suggest that the promising impact of this invention on the health of cameramen makes this domestically designed camera vest a good option for mass production.

A usability evaluation of the prototype Afrikaanse idiome-woordeboek

African Journals Online (AJOL)

When digital tools are developed it is important to consider the usability of the tool. Usability evaluation was done on the Afrikaanse idiome-woordeboek to determine with what success it can be used. Discount usability methods, viz. heuristic evaluation and usability testing were used. This article reports on the findings from ...

Evaluating Usability of E-Learning Systems in Universities

OpenAIRE

Nicholas Kipkurui Kiget; Professor G. Wanyembi; Anselemo Ikoha Peters

2014-01-01

The use of e-learning systems has increased significantly in the recent times. E-learning systems are supplementing teaching and learning in universities globally. Kenyan universities have adopted e-learning technologies as means for delivering course content. However despite adoption of these systems, there are considerable challenges facing the usability of the systems. Lecturers and students have different perceptions in regard to the usability of e-learning systems. The aim of this study ...

Usability of a new disposable autoinjector platform device: results of a formative study conducted with a broad user population

Directory of Open Access Journals (Sweden)

Lange J

2015-06-01

Full Text Available Jakob Lange,1 Philipp Richard,1 Nick Bradley2 1Ypsomed AG, Burgdorf, Switzerland; 2BERGO UK, Bearsden, Glasgow, UK Abstract: This article presents a late-stage formative usability study of an autoinjector platform device. Such devices are used for the subcutaneous delivery of biopharmaceuticals, primarily for self-administration by the patient. Previous usability work on autoinjectors reported in the literature has been specific to single indications. This study was instead conducted with a broad user population, defined to represent user characteristics across a range of indications. The goals of the study were to evaluate whether users could use the devices safely and effectively, and could understand the instructions for use (IFU as well as the accompanying training. Further objectives were to capture any usability issues and to obtain participants' subjective ratings on the IFU and training as well as the confidence and comfort in using the device. A total of 43 participants in 5 groups received training and performed simulated injections either into an injection pad or a mannequin. All participants were able to successfully use the device. The device was well appreciated by all users, with a reported degree of confidence in using the device of 98%, of user comfort of 93%, and of comprehensibility of IFU and training of 98%. These values are higher than other comparable results reported in the literature. The presence of both audible and visible feedback during injection was seen to be a significant factor contributing to injection success. The observation that the device can be safely and efficiently used by all tested user groups provides confidence that the device and IFU in their current form will pass future summative testing in specific applications. Keywords: human factors engineering, autoinjector, handling study, use error, instructions for use, YpsoMate™

Usability Evaluation of www.budget.com

DEFF Research Database (Denmark)

Bruun, Anders; Jensen, Janne Jul; Skov, Mikael B.

This report presents the results of a usability evaluation of the budget.com website. The evaluation was carried out by a team of 4 HCI experts, and it involved 10 potential users. The evaluation is based on measurement of (1) task completion time, (2) task completion, (3) user satisfaction and (4......) perceived workload. We have also analyzed the user interaction with the website for (5) usability problems. Through the evaluation, we have found the following weaknesses of the website:   Reservation takes considerably more time than promised. The website indicates that a reservation can be made in 60...... is not useful for specific purposes. The user satisfaction is generally low. Except one high and two low scores, the user satisfaction was in the middle range. There are too many severe usability problems. The evaluation identified a considerable number of usability problems. 5 of them were critical which means...

Usability Testing: Too Early? Too Much Talking? Too Many Problems?

DEFF Research Database (Denmark)

Hertzum, Morten

2016-01-01

Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues that usabil......Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues...... that usability should (also) be evaluated late, that usability professionals should be wary of thinking aloud, and that they should focus more on effects achievement than problem detection....

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

Science.gov (United States)

Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M

2013-01-01

The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Usability evaluations in user-centred design

NARCIS (Netherlands)

Ruyter, de B.E.R.; Vet, de J.H.M.

1997-01-01

Improving usability of consumer applications has been the focus of much research. Estimating the advantage of these efforts, however, still is very cumbersome since evaluating product improvements in terms of their usability requires good measuring methods and tools. In this paper activities in the

Usability Assessment of E-Café Operational Management Simulation Game

Science.gov (United States)

Chang, Chiung-sui; Huang, Ya-Ping

2013-01-01

To ensure the quality of digital simulation game, we utilized the usability evaluation heuristic in the design and development processes of e-café operational management game-based learning material for students. The application of usability evaluations during this study is described. Additionally, participant selection, data collection and…

Usability evaluation model for mobile e-book applications

Science.gov (United States)

Matraf, Munya Saleh Ba; Hussain, Azham

2017-10-01

Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.

A qualitative study exploring the usability of Nintendo Wii Fit among persons with multiple sclerosis.

Science.gov (United States)

Plow, Matthew; Finlayson, Marcia

2014-03-01

The purpose of this study was to examine the usability of Nintendo Wii Fit to promote physical activity in adults with multiple sclerosis. Qualitative interviews were conducted as part of a pilot study that examined the health outcomes of a 14-week Wii Fit home-exercise programme in 30 adults with multiple sclerosis. We found participants reported that Wii Fit helped build confidence in abilities, achieve goals related to engagement in leisure activities and remove barriers associated with going to a gym to exercise. However, Wii Fit induced initial reactions of intimidation and worries about falling, and feedback during game play reminded participants of their impairments. Wii Fit was limited in its customizability to accommodate different functional levels. Understanding how to improve the usability and customizability of commercially available exergaming technology could be of benefit to people with disabling conditions. Before conducting randomized controlled trials of commercially available exergaming technology in adults with disabling conditions, we recommend that strategies be identified to remove usability barriers so those with moderate impairments can be included in the trial. This will reduce the likelihood of ceiling effects and clinical irrelevance. In terms of clinical recommendations, rehabilitation professionals need to consider patients' functional level, surrounding environment and preferences when prescribing a Wii Fit-based exercise programme. Copyright © 2013 John Wiley & Sons, Ltd.

Reusable Software Usability Specifications for mHealth Applications.

Science.gov (United States)

Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali

2018-01-25

One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.

Bringing content understanding into usability testing in complex application domains—a case study in eHealth

DEFF Research Database (Denmark)

Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik

2017-01-01

A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...... domains involving different kinds of users and evaluators are needed before we can tell whether CUT with QU is an effective usability testing technique of wider applicability. Performing CUT with QU is very demanding by drawing heavily on the evaluators’ ability to respond effectively to openings...

Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach

Science.gov (United States)

Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel

The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.

Integrated System Validation Usability Questionnaire: Information Display Element

International Nuclear Information System (INIS)

Garcés, Ma. I.; Torralba, B.

2015-01-01

The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to information displays, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed and the models proposed by the nuclear energy industry and their technical support organizations, mainly, the United States Electric Power Research Institute, EPRI, are analyzed. In the remaining stages, general and specific guidelines for information displays, in particular, display pages, formats, elements and data quality and update rate recommendations are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMMLAB.

Investigating the effect of m-commerce design usability on customers' trust

Science.gov (United States)

Hussain, Azham Bin; Mahmood, Alaa Thamer; Naser, Raed Kamil

2017-10-01

User experience may vary from one user to another based on the design characteristics for processing a certain task. Our review of the literature revealed that there is a noticeable lack of studies on the effect of mobile or m-commerce design usability on customers' trust to perform certain activities. We investigated the effect of m-commerce design usability in terms of navigability, supportability, readability, creditability, and content relevant. A close-ended questionnaire was distributed to 20 customers who were asked to perform some tasks. The result showed that majority of the participants found m-commerce design usability to influence their trust of the app. The mentioned usability elements were found to positively influence customers' trust except for supportability. Our findings provide some insights to the m-commerce designers and developers and extend the current understanding about the potential of design usability in explaining users' usage behavior.

Usability Evaluation of a Web-Based Learning System

Science.gov (United States)

Nguyen, Thao

2012-01-01

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

Evaluation Methods on Usability of M-Learning Environments

Directory of Open Access Journals (Sweden)

Teresa Magal-Royo

2007-10-01

Full Text Available Nowadays there are different evaluation methods focused in the assessment of the usability of telematic methods. The assessment of 3rd generation web environments evaluates the effectiveness and usability of application with regard to the user needs. Wireless usability and, specifically in mobile phones, is concentrated in the validation of the features and tools management using conventional interactive environments. There is not a specific and suitable criterion to evaluate created environments and m-learning platforms, where the restricted and sequential representation is a fundamental aspect to be considered.The present paper exposes the importance of the conventional usability methods to verify both: the employed contents in wireless formats, and the possible interfaces from the conception phases, to the validations of the platform with such characteristics.The development of usability adapted inspection could be complemented with the Remote’s techniques of usability testing, which are being carried out these days in the mobile devices field and which pointed out the need to apply common criteria in the validation of non-located learning scenarios.

A Novel Information Retrieval Tool to Find Hospital Care Team Members: Development and Usability Study.

Science.gov (United States)

Morawski, Kyle; Monsen, Craig; Takhar, Sukhjit; Landman, Adam

2018-04-16

Hospital communication among members of a patient's care team is a central part of clinical workflow and consumes a large amount of a health care provider's time. Oftentimes the complexity of hospital care leads to difficulty in finding the appropriate contact, which can lead to inefficiencies and frustration. Squire is a Web-based information retrieval app created to improve the speed and efficiency in reaching the appropriate team member during the care of a hospitalized patient. The objective of the study was to design and develop Squire and to evaluate the usage, usability, and perceived effect of the app on finding the correct contact within a hospital. We used a mixed-methods design using a before-after survey methodology combined with one-on-one interviews to understand the perceived effect of Squire. The study took place at an academic medical center with internal medicine resident physicians. We surveyed residents on demographics, as well as time and efficiency of hospital communication before and after the use of Squire. After using Squire, participants were also asked to evaluate Squire's Net Promoter Score (NPS). A subset of voluntary participants participated in one-on-one interviews and completed the System Usability Scale (SUS). We performed descriptive statistics on participant characteristics, app usage data, and responses to surveys. Survey results were compared before and after Squire adoption using the Wilcoxon rank-sum test and a general linear model. Interview data were analyzed using content analysis with a qualitative description approach to review and categorize feedback from participants. There was a 67.9% (74/109) response rate to the pre-Squire survey and 89.9% (98/109) response rate to the post-Squire survey. At baseline, there was an average of 22.2 (95% CI 18.4-26.0) minutes/day spent searching for the right contact, and this decreased to 16.3 (95% CI 13.9-18.7) minutes/day after Squire was launched (P=.01). There were favorable

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

Science.gov (United States)

Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L

2017-01-01

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914

On the Usability of Spoken Dialogue Systems

DEFF Research Database (Denmark)

Larsen, Lars Bo

 This work is centred on the methods and problems associated with defining and measuring the usability of Spoken Dialogue Systems (SDS). The starting point is the fact that speech based interfaces has several times during the last 20 years fallen short of the high expectations and predictions held...... by industry, researchers and analysts. Several studies in the literature of SDS indicate that this can be ascribed to a lack of attention from the speech technology community towards the usability of such systems. The experimental results presented in this work are based on a field trial with the OVID home...

Usability and Accessibility of Air Force Intranet Web Sites

National Research Council Canada - National Science Library

Bentley, Richard S

2006-01-01

.... The Technology Acceptance Model suggests that information systems must not only be useful but also be usable and a large body of usability engineering knowledge exists to support usable design. In addition, the U.S...

Analysis of usability factors affecting purchase intention in online e-commerce sites

Science.gov (United States)

Perdana, R. A.; Suzianti, A.

2017-03-01

The growing number of internet users plays a significant role in the emergence of a variety of online e-commerce sites to meet the needs of Indonesians. However, there are still some problems faced by the users in using e-commerce sites. Therefore, a research related to user experience on their purchase intention to foster e-commerce sites is required. This study is conducted to find out the relationship between usability factors on e-commerce users’ purchase intention using a case study by using SEM to analyse the usability of the website. The result of this study shows that credibility, readability and telepresence are usability factors that directly affect purchase intention, while simplicity, consistency and interactivity are usability factors that indirectly affect purchase intention. Therefore, we can conclude that Indonesian consumers are on the Early Majority phase in adopting Company A.

The Focus of Current HCI Research in Usability Evaluation and Feedback

DEFF Research Database (Denmark)

Høegh, Rune Thaarup

2007-01-01

This paper presents the findings from a systematic literature study of the research on usability evaluation and feedback. The literature study covers the papers published from five key human-computer interaction journals for a period of four years, and depicts the most current research within...... the field with regard to usability evaluation and feedback....

A Framework for Usability Evaluation in EHR Procurement.

Science.gov (United States)

Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja

2018-01-01

Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.

Intra- and Inter-Cultural Usability in Computer-Supported Collaboration

DEFF Research Database (Denmark)

Vatrapu, Ravi; Suthers, Dan

2010-01-01

In this paper, we argue for an increased scope of universal design to encompass usability and accessibility for not only users with physical disabilities but also for users from different cultures. Towards this end, we present an empirical evaluation of cultural usability in computer......-Chinese, and Chinese-Chinese) appropriated affordances and produced technological intersubjectivity. Cultural usability was analyzed through the use of performance and satisfaction measures. The results show a systemic variation in efficiency, effectiveness, and satisfaction between the two cultural groups....... Implications of these findings for the research and practice of usability, in general, and cultural usability, in particular, are discussed in this paper....

Usability Assessment of the Missouri Cancer Registry’s Published Interactive Mapping Reports: Round One

Science.gov (United States)

Jackson-Thompson, Jeannette; Schmaltz, Chester Lee

2017-01-01

Background  Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective  The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods   An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

Science.gov (United States)

Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M

2012-05-01

To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Usability in a cultural context

DEFF Research Database (Denmark)

Clemmensen, Torkil; Yammiyavar, Pradeep; Ørngreen, Rikke

2010-01-01

This paper focuses on presenting and discussing the aim, context, challenges, results, and impact of the Cultural usability project named as CultUsab. This project was a four year international research effort from 2006 to 2009, which was supported by a grant for the Danish Research Councils...... for Independent Research in Culture and Communication. The project aimed at innovating processes in Information and Communication Technology development through an understanding of culturally sensitive aspects of usability evaluation methods....

Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: A methodological comparison

NARCIS (Netherlands)

Van Den Haak, M. J.; De Jong, M. D T; Schellens, P. J.

2004-01-01

This paper describes a comparative study of three usability test approaches: concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction. These three methods were compared by means of an evaluation of an online library catalogue, which involved four points of

Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison.

NARCIS (Netherlands)

van den Haak, M.J.; de Jong, Menno D.T.; Schellens, P.J.

2004-01-01

This paper describes a comparative study of three usability test approaches: concurrent think-aloud protocols, retrospective think-aloud protocols, and constructive interaction. These three methods were compared by means of an evaluation of an online library catalogue, which involved four points of

Estimating Sample Size for Usability Testing

Directory of Open Access Journals (Sweden)

Alex Cazañas

2017-02-01

Full Text Available One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.

Effect of improving the usability of an e-learning resource: a randomized trial.

Science.gov (United States)

Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L

2014-06-01

Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.

Connection between competence, usability, environment and risk of falls in elderly adults

Directory of Open Access Journals (Sweden)

José Alex Leiva-Caro

2015-12-01

Full Text Available Objective: to determine connections between competence, usability, environment and risk of falls in elderly adults. Method: correlational descriptive study, 123 elderly adults, both male and female, aged 70 years and older were included. Data was collected via the Tinetti Scale, CESD-7 Scale, Montreal Cognitive Assessment, Usability Questionnaire on Housing and Housing Enabler; and sociodemographic and health background certificate data. For data analysis, descriptive and inferential statistics were used, multivariate linear and logistic regression models were adjusted. Results: 42.0% of the elderly adults had presented with falls, with a higher prevalence in women, and in the group of 70-75 years. The physical environment of the house, gait, and usability were set as risk factors for falls. A negative relationship between usability and depressive symptoms, cognitive health, balance, gait, the social and physical environment was found, p <0.05; and a strong positive correlation between walking and balance, p <0.05. Conclusion: this study helps to better understand the phenomenon of falling, to find a connection between usability with the risk of falls, and other variables.

Clinical pathways for primary care: current use, interest and perceived usability.

Science.gov (United States)

Waters, Richard C; Toy, Jennifer M; Drechsler, Adam

2018-02-26

Translating clinical evidence to daily practice remains a challenge and may improve with clinical pathways. We assessed interest in and usability of clinical pathways by primary care professionals. An online survey was created. Interest in pathways for patient care and learning was assessed at start and finish. Participants completed baseline questions then pathway-associated question sets related to management of 2 chronic diseases. Perceived pathway usability was assessed using the system usability scale. Accuracy and confidence of answers was compared for baseline and pathway-assisted questions. Of 115 participants, 17.4% had used clinical pathways, the lowest of decision support tool types surveyed. Accuracy and confidence in answers significantly improved for all pathways. Interest in using pathways daily or weekly was above 75% for the respondents. There is low utilization of, but high interest in, clinical pathways by primary care clinicians. Pathways improve accuracy and confidence in answering written clinical questions.

Usability: Human Research Program - Space Human Factors and Habitability

Science.gov (United States)

Sandor, Aniko; Holden, Kritina L.

2009-01-01

The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.

Usability Evaluation of a Video Conferencing System in a University’s Classroom

DEFF Research Database (Denmark)

Khalid, Md. Saifuddin; Hossan, Md. Iqbal

2016-01-01

-Time Communications (e.g. Google Hangout, Adobe Connect, Cisco WebEx, and appear.in), and dedicated (e.g. Polycom). There is a lack of empirical study on usability evaluation of the interactive systems in educational contexts. This study identifies usability errors and measures user satisfaction of a dedicated VCS...

Finding online health-related information: usability issues of health portals.

Science.gov (United States)

Gurel Koybasi, Nergis A; Cagiltay, Kursat

2012-01-01

As Internet and computers become widespread, health portals offering online health-related information become more popular. The most important point for health portals is presenting reliable and valid information. Besides, portal needs to be usable to be able to serve information to users effectively. This study aims to determine usability issues emerging when health-related information is searched on a health portal. User-based usability tests are conducted and eye movement analyses are used in addition to traditional performance measures. Results revealed that users prefer systematic, simple and consistent designs offering interactive tools. Moreover, content and partitions needs to be shaped according to the medical knowledge of target users.

The Usability of Online Geographic Virtual Reality for Urban Planning

Science.gov (United States)

Zhang, S.; Moore, A. B.

2013-08-01

Virtual reality (VR) technology is starting to become widely and freely available (for example the online OpenSimulator tool), with potential for use in 3D urban planning and design tasks but still needing rigorous assessment to establish this. A previous study consulted with a small group of urban professionals, who concluded in a satisfaction usability test that online VR had potential value as a usable 3D communication and remote marketing tool but acknowledged that visual quality and geographic accuracy were obstacles to overcome. This research takes the investigation a significant step further to also examine the usability aspects of efficiency (how quickly tasks are completed) and effectiveness (how successfully tasks are completed), relating to OpenSimulator in an urban planning situation. The comparative study pits a three-dimensional VR model (with increased graphic fidelity and geographic content to address the feedback of the previous study) of a subdivision design (in a Dunedin suburb) against 3D models built with GIS (ArcGIS) and CAD (BricsCAD) tools, two types of software environment well established in urban professional practice. Urban professionals participated in the study by attempting to perform timed tasks correctly in each of the environments before being asked questions about the technologies involved and their perceived importance to their professional work. The results reinforce the positive feedback for VR of the previous study, with the graphical and geographic data issues being somewhat addressed (though participants stressed the need for accurate and precise object and terrain modification capabilities in VR). Ease-ofuse and associated fastest task completion speed were significant positive outcomes to emerge from the comparison with GIS and CAD, pointing to a strong future for VR in an urban planning context.

Educational software usability: Artifact or Design?

Science.gov (United States)

Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A

2017-03-01

Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.

E-commerce Adoption in China’s Service SMEs: a Study from Web Usability Perspective

OpenAIRE

Mingxuan Wu; Li Zhang; Qiudan Xing; Li Dai; Hongmei Du

2014-01-01

Although China’s economy continues to grow rapidly over the last decade, some researchers have been aware that China has had to develop its service sector if China wants to sustain this growth. However, researches on the electronic commerce (e-commerce) adoption in China’s service industries are still lacking and are limited so far. In literature review, few works discuss e-commerce adoption by measuring web site usability / web usability.This paper reviews the research on China’s small and m...

Factors Affecting Faculty Web Portal Usability

Science.gov (United States)

Bringula, Rex P.; Basa, Roselle S.

2011-01-01

The study investigated the factors that might significantly affect web portal usability. Results of the study were intended to serve as inputs for faculty web portal development of the University of the East-Manila. Descriptive statistics utilized questionnaire data from 82 faculty members. The data showed that most of the respondents were…

Comparing Web Applications with Desktop Applications: An Empirical Study

DEFF Research Database (Denmark)

Pop, Paul

2002-01-01

In recent years, many desktop applications have been ported to the world wide web in order to reduce (multiplatform) development, distribution and maintenance costs. However, there is little data concerning the usability of web applications, and the impact of their usability on the total cost...... of developing and using such applications. In this paper we present a comparison of web and desktop applications from the usability point of view. The comparison is based on an empirical study that investigates the performance of a group of users on two calendaring applications: Yahoo!Calendar and Microsoft...... Calendar. The study shows that in the case of web applications the performance of the users is significantly reduced, mainly because of the restricted interaction mechanisms provided by current web browsers....

An Online Social Constructivist Course: Toward a Framework for Usability Evaluations

Science.gov (United States)

Phillips, Alana S.; Sheffield, Anneliese; Moore, Michelle; Robinson, Heather A.

2016-01-01

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

The Role of Human Web Assistants in E-Commerce: An Analysis and a Usability Study.

Science.gov (United States)

Aberg, Johan; Shahmehri, Nahid

2000-01-01

Discusses electronic commerce and presents the concept of Web assistants, human assistants working in an electronic Web shop. Presents results of a usability study of a prototype adaptive Web assistant system that show users were enthusiastic about the concept of Web assistants and its implications. (Author/LRW)

Methods uncovering usability issues in medication-related alerting functions: results from a systematic review.

Science.gov (United States)

Marcilly, Romaric; Vasseur, Francis; Ammenwerth, Elske; Beuscart-Zephir, Marie-Catherine

2014-01-01

This paper aims at listing the methods used to evaluate the usability of medication-related alerting functions and at knowing what type of usability issues those methods allow to detect. A sub-analysis of data from this systematic review has been performed. Methods applied in the included papers were collected. Then, included papers were sorted in four types of evaluation: "expert evaluation", "user- testing/simulation", "on site observation" and "impact studies". The types of usability issues (usability flaws, usage problems and negative outcomes) uncovered by those evaluations were analyzed. Results show that a large set of methods are used. The largest proportion of papers uses "on site observation" evaluation. This is the only evaluation type for which every kind of usability flaws, usage problems and outcomes are detected. It is somehow surprising that, in a usability systematic review, most of the papers included use a method that is not often presented as a usability method. Results are discussed about the opportunity to provide usability information collected after the implementation of the technology during their design process, i.e. before their implementation.

A Fuzzy method for the usability evaluation of nuclear medical equipment

Energy Technology Data Exchange (ETDEWEB)

Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V., E-mail: grecco@ien.gov.br, E-mail: luquetti@ien.gov.br, E-mail: msantana@ien.gov.br, E-mail: larissapfarias@ymail.com, E-mail: marques@ien.gov.br [Instituto de Engenharia Nuclear (DENN/IEN/CNEN/RJ), Rio de Janeiro, RJ (Brazil). Departamento de Engenharia Nuclear

2017-11-01

To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

A Fuzzy method for the usability evaluation of nuclear medical equipment

International Nuclear Information System (INIS)

Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V.

2017-01-01

To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)

A usability test is not an interview

DEFF Research Database (Denmark)

Hertzum, Morten

2016-01-01

Usability tests are conducted to gauge users’ experience with a system, preferably before it is released for real use, and thereby find any problems that prevent users from completing their tasks, slow them down, or otherwise degrade their user experience. Such tests are important to successful...... systems development, yet test procedures vary and the quality of test results is sometimes contested. While there is no single accepted procedure for usability specialists to follow when conducting usability tests, these tests normally involve users who think out loud while using a system and an evaluator...... who observes the users’ behavior and listens in on their thoughts. This common core of usability tests is illustrated in Figure 1. The possible variations include, for example, whether the users work individually or in pairs, whether the evaluator is in the room with the user or in an adjoining room...

Usability evaluation of mobile applications; where do we stand?

Science.gov (United States)

Zahra, Fatima; Hussain, Azham; Mohd, Haslina

2017-10-01

The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.

Usability Metrics for Gamified E-learning Course: A Multilevel Approach

Directory of Open Access Journals (Sweden)

Aleksandra Sobodić

2018-04-01

Full Text Available This paper discusses the effect of a gamified learning system for students of the master course on Web Design and Programming performed at the Faculty of Organization and Informatics. A new set of usability metrics was derived from web-based learning usability, user experience and instructional design literature and incorporated into the questionnaire which consists of three main categories: Usability, Educational Usability and User Experience. The main contribution of this paper is the development and validation of a questionnaire for measuring the usability of a gamified e-learning course from students’ perspective. Usability practitioners can use the developed metrics with confidence when evaluating the design of a gamified e-learning course in order to improve students’ engagement and motivation.

Cultural Cognition in Usability Evaluation

DEFF Research Database (Denmark)

Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

2009-01-01

We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences' helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users' cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

Cultural Cognition in Usability Evaluation

DEFF Research Database (Denmark)

Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren

2009-01-01

We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences’ helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users’ cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...

Building a Remote Usability Testing Body of Knowledge (RUTBOK)

DEFF Research Database (Denmark)

Lizano, Fulvio; Stage, Jan

2012-01-01

Remote Usability Testing (RUT) is an alternative method of usability evaluations. The main aim of RUT is the reduction of costs in the usability evaluation process. Since middle of the 90s RUT, has emerged as a technique which seems as is gaining maturity across the time. In general any discipline...

Long-term usability

International Nuclear Information System (INIS)

Holmgren, M.

1998-01-01

Longitudinal studies of the usability of a computer based system for process control has been performed. The whole life-cycle of one system has been of interest, as the problems are varying over time. Repeated measurements of the operators' experiences of this system have been made during 15 years. Of main interest have been the advantages/ disadvantages of computer based system for process control compared with conventional instrumentation. The results showed among other things that (1) computer based systems made it easier to control the process and increased security (2) age differences could be explained by other factors (3 ) expectations before the installation may influence the attitudes and use of equipment for quite some time In some questions the attitudes changed over time while in others they were quite stable, for example, in questions concerning preference for type of equipment. What do operators appreciate in a computer based system for process control? About 300 operators were asked about that. The main factor seems to include a reliable system with valid information that functions during disturbances. Hopefully new systems are designed with that in mind. (author)

The Development of a Formative and a Reflective Scale for the Assessment of On-Line Store Usability

Directory of Open Access Journals (Sweden)

Timo Christophersen

2008-10-01

Full Text Available In usability research, difference between formative and reflective measurement models for the assessment of latent variables has been ignored largely. As a consequence, many usability scales are misspecified. This might result in reduced scale validity because of the elimination of important usability facets within the procedure of scale development. The aim of the current study was to develop a questionnaire for the evaluation of On-line store usability (UFOS-V2 that includes both a formative and a reflective scale. 378 subjects participated in a laboratory experimental study. Each participant visited two out of 35 On-line stores. The usability and intention to buy was assessed for both stores. In addition, actual purchase behaviour was observed by combining the subjects' reward with the decision to buy. In a two-construct PLS structural equation model the formative usability scale was used as a predictor for the reflective usability measure. Results indicate that the formative usability scale UFOS-V2f forms a valid set of items for the user-based assessment of online store usability. The reflective usability scale shows high internal consistency. Positive relationships to intention and decision to buy confirm high scale validity.

Usability in the lifecycle of medical software development

Directory of Open Access Journals (Sweden)

Trauzettel Franziska

2016-09-01

Full Text Available A close cooperation with users is necessary to ensure that interactive systems are robust, easy to use and accepted. Therefore, in medical technology, standards for usability are of fundamental importance. We investigated with the presented study how the concept of usability is currently understood and implemented in medical software companies. Interviews were conducted with 21 employees of German enterprises. Furthermore we extended an already existing quantitative online survey where 53 companies (including 24 from the health industry sector participated in. Results show that the importance of usability is recognized by most of the respondents. Moreover, a wide variety of methods and approaches is known and implemented for exploring user needs and evaluating system prototypes. However, it was observed that human-centered design activities mainly focus on functionality, risk prevention and accessibility. Hedonic user needs and subjective perceptions (“user experience” still play a minor role. Based on the results, practical requirements are derived and a “best case” for methodological approach is introduced.

To twist or poke? A method for identifying usability issues with the rotary controller and touch screen for control of in-vehicle information systems.

Science.gov (United States)

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-07-01

In-vehicle information systems (IVIS) can be controlled by the user via direct or indirect input devices. In order to develop the next generation of usable IVIS, designers need to be able to evaluate and understand the usability issues associated with these two input types. The aim of this study was to investigate the effectiveness of a set of empirical usability evaluation methods for identifying important usability issues and distinguishing between the IVIS input devices. A number of usability issues were identified and their causal factors have been explored. These were related to the input type, the structure of the menu/tasks and hardware issues. In particular, the translation between inputs and on-screen actions and a lack of visual feedback for menu navigation resulted in lower levels of usability for the indirect device. This information will be useful in informing the design of new IVIS, with improved usability. STATEMENT OF RELEVANCE: This paper examines the use of empirical methods for distinguishing between direct and indirect IVIS input devices and identifying usability issues. Results have shown that the characteristics of indirect input devices produce more serious usability issues, compared with direct devices and can have a negative effect on the driver-vehicle interaction.

Adding SPICE to a Library Internet Site: A Recipe to Enhance Usability

Directory of Open Access Journals (Sweden)

Ingrid Tonnison

2006-03-01

Full Text Available Objective - To produce a highly- usable intranet site, use the project to explore the practical application of evidence-based librarianship (EBL, and refine the library's project management methodology. Methods - Evidence was gathered via a literature review, an online survey, scenario-based usability testing, and the completion of a usability checlist. Usability issues were then addressed, guided by the Research-Based Web Design and Usability Guidelines. Results - After a preliminary revision, the site achieved a usability index of 79% after application of the "Raward Library Usability Analysis Tool". Finding the information and supporting user tasks were identified as areas of weakness. Usability testing and cleint feedback supported these findings. After these issues were addressed by a major site redeveloment, the usability index increased to 98%. Conclusions - Raward's checklist is an easy and effective tool for measuring and identifying usability issues. Its value was enhanced by scenario-based usability testing, which yielded rich, client specific information. The application of EBL and project management princples ehnanced the outcomes of the project, and the professional development of the project team.

Usability Testing for Serious Games: Making Informed Design Decisions with User Data

Directory of Open Access Journals (Sweden)

Pablo Moreno-Ger

2012-01-01

Full Text Available Usability testing is a key step in the successful design of new technologies and tools, ensuring that heterogeneous populations will be able to interact easily with innovative applications. While usability testing methods of productivity tools (e.g., text editors, spreadsheets, or management tools are varied, widely available, and valuable, analyzing the usability of games, especially educational “serious” games, presents unique usability challenges. Because games are fundamentally different than general productivity tools, “traditional” usability instruments valid for productivity applications may fall short when used for serious games. In this work we present a methodology especially designed to facilitate usability testing for serious games, taking into account the specific needs of such applications and resulting in a systematically produced list of suggested improvements from large amounts of recorded gameplay data. This methodology was applied to a case study for a medical educational game, MasterMed, intended to improve patients’ medication knowledge. We present the results from this methodology applied to MasterMed and a summary of the central lessons learned that are likely useful for researchers who aim to tune and improve their own serious games before releasing them for the general public.

Defining Usability of PN Services

DEFF Research Database (Denmark)

Nicolajsen, Hanne Westh; Ahola, Titta; Fleury, Alexandre

In this deliverable usability and user experience are defined in relation to MAGNET Beyond technologies, and it is described how the main MAGNET Beyond concepts can be evaluated through the involvement of users. The concepts include the new "Activity based communication approach" for interacting...... with the MAGNET Beyond system, as well as the core concepts: Personal Network, Personal Network-Federation, Service Discovery, User Profile Management, Personal Network Management, Privacy and Security and Context Awareness. The overall plans for the final usability evaluation are documented based on the present...

Revealing unawareness in usability related decision-making

NARCIS (Netherlands)

Harkema, C.L.E.

2012-01-01

Nowadays, many users experience usability issues with their electronic products. It does not work as they expect or otherwise irritates the user, so he becomes dissatisfied about the product and may even complain about it. Th ese numbers of complaints to companies and usability issues are high and

Relationship between trust and usability in virtual environments: An ongoing study

NARCIS (Netherlands)

Salanitri, Davide; Hare, Chrisminder; Borsci, Simone; Lawson, Glyn; Sharples, Sarah; Water Fi Eld, Brian; Kurosu, Masaaki

2015-01-01

Usability and trust have been observed to be related in several domains including web retail, information systems, and e-health. Trust in technology reflects beliefs about the attributes of a technology. Research has shown that trust is a key factor for the success of different systems – e.g.,

Barefooted Usability Evaluation: Addressing the Mindset, Resources and Competences

OpenAIRE

Bruun , Anders

2011-01-01

Part 1: Long and Short Papers; International audience; Lack of usability specialists, high resource requirements and developer mindsets are three considerable barriers for introducing usability engineering into software companies. This Ph.D. project explores the effect of letting software developers and end users apply usability engineering methods instead of a specialist, a solution which may reduce the barriers.

Cost-justifying usability an update for the internet age

CERN Document Server

Bias, Randolph G; Bias, Randolph G

2005-01-01

You just know that an improvement of the user interface will reap rewards, but how do you justify the expense and the labor and the time-guarantee a robust ROI!-ahead of time? How do you decide how much of an investment should be funded? And what is the best way to sell usability to others? In this completely revised and new edition, Randolph G. Bias (University of Texas at Austin, with 25 years' experience as a usability practitioner and manager) and Deborah J. Mayhew (internationally recognized usability consultant and author of two other seminal books including The Usability Enginee

On the Concepts of Usability and Reusability of Learning Objects

Directory of Open Access Journals (Sweden)

Miguel-Angel Sicilia

2003-10-01

Full Text Available “Reusable learning objects” oriented towards increasing their potential reusability are required to satisfy concerns about their granularity and their independence of concrete contexts of use. Such requirements also entail that the definition of learning object “usability,” and the techniques required to carry out their “usability evaluation” must be substantially different from those commonly used to characterize and evaluate the usability of conventional educational applications. In this article, a specific characterization of the concept of learning object usability is discussed, which places emphasis on “reusability,” the key property of learning objects residing in repositories. The concept of learning object reusability is described as the possibility and adequacy for the object to be usable in prospective educational settings, so that usability and reusability are considered two interrelated – and in many cases conflicting – properties of learning objects. Following the proposed characterization of two characteristics or properties of learning objects, a method to evaluate usability of specific learning objects will be presented.

Observer Role and Field Study Knowledge--An Essay Review of Usable Knowledge and SAFARI I.

Science.gov (United States)

Smith, Louis M.; And Others

1981-01-01

A synthesis is presented of the work of Lindblom and Cohen, MacDonald and Walker, and the current authors. The synthesis considers issues in the usefulness of social science theory and research, and how observer roles in qualitative field studies yield multiple kinds of usable knowledge to a variety of audiences. (Author/BW)

Standards for Instrument Migration When Implementing Paper Patient-Reported Outcome Instruments Electronically: Recommendations from a Qualitative Synthesis of Cognitive Interview and Usability Studies.

Science.gov (United States)

Muehlhausen, Willie; Byrom, Bill; Skerritt, Barbara; McCarthy, Marie; McDowell, Bryan; Sohn, Jeremy

2018-01-01

To synthesize the findings of cognitive interview and usability studies performed to assess the measurement equivalence of patient-reported outcome (PRO) instruments migrated from paper to electronic formats (ePRO), and make recommendations regarding future migration validation requirements and ePRO design best practice. We synthesized findings from all cognitive interview and usability studies performed by a contract research organization between 2012 and 2015: 53 studies comprising 68 unique instruments and 101 instrument evaluations. We summarized study findings to make recommendations for best practice and future validation requirements. Five studies (9%) identified minor findings during cognitive interview that may possibly affect instrument measurement properties. All findings could be addressed by application of ePRO best practice, such as eliminating scrolling, ensuring appropriate font size, ensuring suitable thickness of visual analogue scale lines, and providing suitable instructions. Similarly, regarding solution usability, 49 of the 53 studies (92%) recommended no changes in display clarity, navigation, operation, and completion without help. Reported usability findings could be eliminated by following good product design such as the size, location, and responsiveness of navigation buttons. With the benefit of accumulating evidence, it is possible to relax the need to routinely conduct cognitive interview and usability studies when implementing minor changes during instrument migration. Application of design best practice and selecting vendor solutions with good user interface and user experience properties that have been assessed in a representative group may enable many instrument migrations to be accepted without formal validation studies by instead conducting a structured expert screen review. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Usability of synchronization for cognitive modeling

International Nuclear Information System (INIS)

Diebner, Hans H.; Grond, Florian

2005-01-01

We discuss the synchronization features of a previously introduced adaptive system for dynamics recognition in more detail. We investigate the usability of synchronization for modeling and parameter estimations. It is pointed out inhowfar the adaptive system based on synchronization can become a powerful tool in modeling. The adaptive system can store modules of pre-adapted dynamics and is potentially capable of undergoing self-modification. We compare the stored modules with pre-knowledge that a modeler puts into his or her models. In this sense the adaptive system functions like an expert system

Usability Evaluation Methods for Gesture-Based Games: A Systematic Review.

Science.gov (United States)

Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti

2016-10-04

Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology

Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability.

Science.gov (United States)

de Góes, Fernanda dos Santos Nogueira; Fonseca, Luciana Mara Monti; de Camargo, Rosangela Andrade Aukar; de Oliveira, Gustavo Faria; Felipe, Helena Reche

2015-11-01

The use of new technology has recently grown considerably as an increasing number of college students using Internet. In nursing education, the personal computer and the Internet facilitate teaching theoretical and practical knowledge. Evaluate an educational technology known as "Anatomy and Vital Signs" with respect to content, appearance and usability. This was a first stage evaluation-by specialists to verify content and functioning, prior to a second validation as to learning by students. A methodological study in which instructional technologists (11 participants) and nursing specialists (17 participants) used the technology in an unguided manner and completed three questionnaires. The evaluation was measured by the difference between disagreement and agreement for each statement in the questionnaires. Most of the items were positively evaluated at a level higher than 70% by most of the evaluators except for the following usability criteria: grouping by shape, minimum actions and user control, which did not attain the 70% agreement level among instructional technologists. The evaluation was useful to improve the technology and guarantee suitable product for nursing education. It may be a reliable educational tool for nursing education that applies technological resources. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Web Aesthetics and Usability: An Empirical Study of the Effects of White Space

OpenAIRE

Constantinos K. Coursaris; Konstantinos Kripintris

2012-01-01

Usability has been an essential component of the Web User Experience (UX) and a focal research topic. In recent years, the penetration of interactive technologies in all aspects of everyday life challenges the way UX is understood and designed. The past decade, Human-Computer Interaction (HCI) scholars have been continuously attempting to introduce and explore new and non-traditional factors in the UX arena, such as aesthetics, emotions, affect, and trust. This study contributes to the field ...

The Performance and Usability of a Factory-Calibrated Flash Glucose Monitoring System

OpenAIRE

Bailey, Timothy; Bode, Bruce W.; Christiansen, Mark P.; Klaff, Leslie J.; Alva, Shridhara

2015-01-01

Abstract Introduction: The purpose of the study was to evaluate the performance and usability of the FreeStyle? Libre? Flash glucose monitoring system (Abbott Diabetes Care, Alameda, CA) for interstitial glucose results compared with capillary blood glucose results. Materials and Methods: Seventy-two study participants with type 1 or type 2 diabetes were enrolled by four U.S. clinical sites. A sensor was inserted on the back of each upper arm for up to 14 days. Three factory-only calibrated s...

Usability of clinical decision support system as a facilitator for learning the assistive technology adaptation process.

Science.gov (United States)

Danial-Saad, Alexandra; Kuflik, Tsvi; Weiss, Patrice L Tamar; Schreuer, Naomi

2016-01-01

The aim of this study was to evaluate the usability of Ontology Supported Computerized Assistive Technology Recommender (OSCAR), a Clinical Decision Support System (CDSS) for the assistive technology adaptation process, its impact on learning the matching process, and to determine the relationship between its usability and learnability. Two groups of expert and novice clinicians (total, n = 26) took part in this study. Each group filled out system usability scale (SUS) to evaluate OSCAR's usability. The novice group completed a learning questionnaire to assess OSCAR's effect on their ability to learn the matching process. Both groups rated OSCAR's usability as "very good", (M [SUS] = 80.7, SD = 11.6, median = 83.7) by the novices, and (M [SUS] = 81.2, SD = 6.8, median = 81.2) by the experts. The Mann-Whitney results indicated that no significant differences were found between the expert and novice groups in terms of OSCAR's usability. A significant positive correlation existed between the usability of OSCAR and the ability to learn the adaptation process (rs = 0.46, p = 0.04). Usability is an important factor in the acceptance of a system. The successful application of user-centered design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically in developing other systems. Implications for Rehabilitation Creating a CDSS with a focus on its usability is an important factor for its acceptance by its users. Successful usability outcomes can impact the learning process of the subject matter in general, and the AT prescription process in particular. The successful application of User-Centered Design principles during the development of OSCAR may serve as a case study that models the significant elements to be considered, theoretically and practically. The study emphasizes the importance of close collaboration between the developers and

Interplay between usability evaluation and software development (I-USED 2009)

DEFF Research Database (Denmark)

Abrahão, S.; Hornbæk, Kasper Anders Søren; Law, E.

2009-01-01

This workshop is aimed at bringing together researchers and practitioners from the Human-Computer Interaction (HCI) and Software Engineering (SE) fields to determine the state-of-the-art in the interplay between usability evaluation and software development and to generate ideas for new...... and improved relations between these activities. The aim is to base the determination of the current state on empirical studies. Presentations of new ideas on how to improve the interplay between HCI & SE to the design of usable software systems should also be based on empirical studies....

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

Science.gov (United States)

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

Usability Study Identifies Vocabulary, Facets, and Education as Primary Primo Discovery System Interface Problems

Directory of Open Access Journals (Sweden)

Ruby Muriel Lavallee Warren

2017-09-01

Full Text Available A Review of: Brett, K. R., Lierman, A., & Turner, C. (2016. Lessons learned: A Primo usability study. Information Technology and Libraries, 35(1, 7-25. https://doi.org/10.6017/ital.v35i1.8965 Abstract Objective – To discover whether users can effectively complete common research tasks in a modified Primo Discovery System interface. Design – Usability testing. Setting – University of Houston Libraries. Subjects – Users of the University of Houston Libraries Ex Libris Primo Discovery System interface. Methods – The researchers used a think aloud usability test methodology, with participants asked to verbalize their thought processes as they completed a set of tasks. Four tasks were developed and divided into two task sets (Test 1 and Test 2, with session facilitators alternating sets for each participant. Tasks were as follows: locating a known article, finding a peer reviewed article on a requested subject, locating a book, and finding a newspaper article on a topic. Tests were conducted in front of the library entrance using a laptop equipped with Morae (screen and audio recording software, and participants were recruited via an assigned “caller” at the table offering library merchandise and food as a research incentive. Users could opt out of having their session recorded, resulting in a total of fifteen sessions completed with fourteen recorded. Thirteen of the fifteen participants were undergraduate students, one was a graduate student, one was a post-baccalaureate student, and there were no faculty participants. Facilitators completed notes on a standard rubric, coding participant responses into successes or failures and noting participant feedback. Main Results – All eight participants assigned Test 1 successfully completed Test 1, Task 1: locating a known article. Participants expressed a need for an author limiter in advanced search, and had difficulty using the citation formatted information to locate materials

The influence of socio-cultural background and product value in usability testing.

Science.gov (United States)

Sonderegger, Andreas; Sauer, Juergen

2013-05-01

This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

A Comparison of Quantitative and Qualitative Data from a Formative Usability Evaluation of an Augmented Reality Learning Scenario

Directory of Open Access Journals (Sweden)

Dragos Daniel IORDACHE

2009-01-01

Full Text Available The proliferation of augmented reality (AR technologies creates opportunities for the devel-opment of new learning scenarios. More recently, the advances in the design and implementation of desktop AR systems make it possible the deployment of such scenarios in primary and secondary schools. Usability evaluation is a precondition for the pedagogical effectiveness of these new technologies and requires a systematic approach for finding and fixing usability problems. In this paper we present an approach to a formative usability evaluation based on heuristic evaluation and user testing. The basic idea is to compare and integrate quantitative and qualitative measures in order to increase confidence in results and enhance the descriptive power of the usability evaluation report.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

Science.gov (United States)

Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna

2010-04-01

The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Usability engineering: domain analysis activities for augmented-reality systems

Science.gov (United States)

Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.

2002-05-01

This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.

Business-Intelligence-Systeme im Spannungsfeld zwischen Usability und Sicherheit

OpenAIRE

Hinck, Thorsten

2010-01-01

Business-Intelligence-Systeme stehen im Spannungsfeld zwischen Usability und Sicherheit. Die Gefahren und Sicherheitsmaßnahmen für Informationssysteme werden ermittelt und ökonomisch in Bezug zur Gebrauchstauglichkeit gesetzt. Es entsteht ein Sicherheitsprofil für Business-Intelligence-Systeme. Business-Intelligence-Systems are in tension between Usability and IT-Security. Risks and safety measures of informationsystems are defined and set in (economic) regard to Usability. A security prof...

Usability of Three Electroencephalogram Headsets for Brain-Computer Interfaces: A Within Subject Comparison

NARCIS (Netherlands)

Gamboa, H.; Nijboer, Femke; van de Laar, B.L.A.; Plácido da Silva, H.; Gilleade, K.; Gerritsen, Steven; Nijholt, Antinus; Bermúdez i Badia, S.; Poel, Mannes; Fairclough, S.

Currently the field of brain–computer interfacing is increasingly focused on developing usable brain–computer interfaces (BCIs) to better ensure technology transfer and acceptance. Many studies have investigated the usability of BCI applications as a whole. Here we aim to investigate one specific

Can eye tracking boost usability evaluation of computer games?

DEFF Research Database (Denmark)

Johansen, Sune Alstrup; Noergaard, Mie; Soerensen, Janus Rau

2008-01-01

Good computer games need to be challenging while at the same time being easy to use. Accordingly, besides struggling with well known challenges for usability work, such as persuasiveness, the computer game industry also faces system-specific challenges, such as identifying methods that can provide...... data on players' attention during a game. This position paper discusses how eye tracking may address three core challenges faced by computer game producer IO Interactive in their on-going work to ensure games that are fun, usable, and challenging. These challenges are: (1) Persuading game designers...... about the relevance of usability results, (2) involving game designers in usability work, and (3) identifying methods that provide new data about user behaviour and experience....

The Impact of Mobile TradeManager on Fashion Product Sales: From Usability Perspective

Directory of Open Access Journals (Sweden)

Zilong Liu

2014-01-01

Full Text Available The competition in fashion and textiles (FTs industry is strong. Enterprises have to compete at all levels and need to adapt to the mobile commerce (MC context. Mobile TradeManager (MTM is a typical MC application and good use of it will facilitate the sales of FTs products. Plenty of prior studies on MC were developed to discuss the subjective beliefs. Motivated by the research that appeals for more attention to IT artifact itself, this paper integrates the system usability of MC into the behavioral model. To this end, the purpose of this study is twofold: (a to identify the impact of MTM usability on consumers’ online shopping behavior of FTs production, and (b to explore and understand how usability of MTM could be improved. Data analysis, based on a survey of 837 MTM users, reveals that perceived entertainment, MTM system usability, subjective norm, and consumer’s self-efficacy significantly affect individual’s intention to use MTM. Meanwhile, it is revealed that MTM usability is a joint function of mobile device’s system performance, WAP website’s design, and the characteristics of wireless communication networks.

Post-deployment usability evaluation of a radiology workstation

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A.; Oudkerk, Matthijs; Van Ooijen, Peter M. A.

Objectives: To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical

Usability of Low-Cost Android Data Collection System for Community-Based Participatory Research.

Science.gov (United States)

Salihu, Hamisu M; Salinas-Miranda, Abraham; Turner, DeAnne; King, Lindsey; Paothong, Arnut; Austin, Deborah; Berry, Estrellita Lo

2016-01-01

Android tablet computers can be valuable tools for data collection, but their usability has not been evaluated in community-based participatory research (CBPR). This article examines the usability of a low-cost bilingual touchscreen computerized survey system using Android tablets, piloted with a sample of 201 community residents in Tampa, Florida, from November 2013 to March 2014. Needs assessment questions were designed with the droidSURVEY software, and deployed using Android tablet computers. In addition, participants were asked questions about system usability. The mean system usability was 77.57 ± 17.66 (range, 0-100). The mean completion time for taking the 63 survey questions in the needs assessment was 23.11 ± 9.62 minutes. The survey completion rate was optimal (100%), with only 6.34% missingness per variable. We found no sociodemographic differences in usability scores. Our findings indicate that Android tablets could serve as useful tools in CBPR studies.

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

Science.gov (United States)

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Usability Assessment of International Office Website of Diponegoro University With Scenario Based Usability Evaluation Method and Wammi Method

OpenAIRE

Ratna Purwaningsih; Ikhsan Yenifi

2015-01-01

Website development needs to pay attention to usability aspect which consist of four factors: efficiency, effectiveness, satisfactions and error rate. The website of International Office of Diponegoro University provides academic information for Indonesian students and foreign students. The website still has some problem, especially on searching certain information. This research aims to evaluate the design of the existing website and measures the usability. A well-designed website will help ...

Post-deployment usability evaluation of a radiology workstation

NARCIS (Netherlands)

Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi; Oudkerk, Matthijs; van Ooijen, Peter

2015-01-01

Objective To evaluate the usability of a radiology workstation after deployment in a hospital. Significance In radiology, it is difficult to perform valid pre-deployment usability evaluations due to the heterogeneity of the user group, the complexity of the radiological workflow, and the complexity

Usability Plans and Schemes for Low Fidelity Prototypes

DEFF Research Database (Denmark)

Schultz, Nette; Kirk Sørensen, Jannick; Sørensen, Lene

2006-01-01

Internal report of WP1 task 4 activities from August 2006 to December 2006. This report describes the setup of a usability evaluation framework for evaluating core MAGNET concepts in terms of usability. Initially, these core concepts are identified and modes of operation involving...

Usability evaluation of a locomotor therapy device considering different strategies

Directory of Open Access Journals (Sweden)

Langthaler Sonja

2016-09-01

Full Text Available Usability of medical devices is one of the main determining factors in preventing use errors in treatment and strongly correlates to patient safety and quality of treatment. This thesis demonstrates the usability testing and evaluation of a prototype for locomotor therapy of infants. Therefore, based on the normative requirements of the EN 62366, a concept combined of evaluation procedures and assessing methods was created to enable extensive testing and analysis of the different aspects of usability. On the basis of gathered information weak points were identified and appropriate measures were presented to increase the usability and operating safety of the locomotor prototype. The overall outcome showed an usability value of 77.4% and an evaluation score of 6.99, which can be interpreted as “satisfactory”.

Usability Testing for Developing Effective Interactive Multimedia Software: Concepts, Dimensions, and Procedures

Directory of Open Access Journals (Sweden)

Sung Heum Lee

1999-04-01

Full Text Available Usability testing is a dynamic process that can be used throughout the process of developing interactive multimedia software. The purpose of usability testing is to find problems and make recommendations to improve the utility of a product during its design and development. For developing effective interactive multimedia software, dimensions of usability testing were classified into the general categories of: learnability; performance effectiveness; flexibility; error tolerance and system integrity; and user satisfaction. In the process of usability testing, evaluation experts consider the nature of users and tasks, tradeoffs supported by the iterative design paradigm, and real world constraints to effectively evaluate and improve interactive multimedia software. Different methods address different purposes and involve a combination of user and usability testing, however, usability practitioners follow the seven general procedures of usability testing for effective multimedia development. As the knowledge about usability testing grows, evaluation experts will be able to choose more effective and efficient methods and techniques that are appropriate to their goals.

User’s Emotions and Usability Study of a Brain-Computer Interface Applied to People with Cerebral Palsy

Directory of Open Access Journals (Sweden)

Alejandro Rafael García Ramírez

2018-02-01

Full Text Available People with motor and communication disorders face serious challenges in interacting with computers. To enhance this functionality, new human-computer interfaces are being studied. In this work, a brain-computer interface based on the Emotiv Epoc is used to analyze human-computer interactions in cases of cerebral palsy. The Phrase-Composer software was developed to interact with the brain-computer interface. A system usability evaluation was carried out with the participation of three specialists from The Fundação Catarinense de Educação especial (FCEE and four cerebral palsy volunteers. Even though the System Usability Scale (SUS score was acceptable, several challenges remain. Raw electroencephalography (EEG data were also analyzed in order to assess the user’s emotions during their interaction with the communication device. This study brings new evidences about human-computer interaction related to individuals with cerebral palsy.

Improving the Usability of the User Interface for a Digital Textbook Platform for Elementary-School Students

Science.gov (United States)

Lim, Cheolil; Song, Hae-Deok; Lee, Yekyung

2012-01-01

Usability is critical to the development of a user-friendly digital textbook platform interface, yet thorough research on interface development based on usability principles is in short supply. This study addresses that need by looking at usability attributes and corresponding design elements from a learning perspective. The researchers used a…

Black box integration of computer-aided diagnosis into PACS deserves a second chance: results of a usability study concerning bone age assessment.

Science.gov (United States)

Geldermann, Ina; Grouls, Christoph; Kuhl, Christiane; Deserno, Thomas M; Spreckelsen, Cord

2013-08-01

Usability aspects of different integration concepts for picture archiving and communication systems (PACS) and computer-aided diagnosis (CAD) were inquired on the example of BoneXpert, a program determining the skeletal age from a left hand's radiograph. CAD-PACS integration was assessed according to its levels: data, function, presentation, and context integration focusing on usability aspects. A user-based study design was selected. Statements of seven experienced radiologists using two alternative types of integration provided by BoneXpert were acquired and analyzed using a mixed-methods approach based on think-aloud records and a questionnaire. In both variants, the CAD module (BoneXpert) was easily integrated in the workflow, found comprehensible and fitting in the conceptual framework of the radiologists. Weak points of the software integration referred to data and context integration. Surprisingly, visualization of intermediate image processing states (presentation integration) was found less important as compared to efficient handling and fast computation. Seamlessly integrating CAD into the PACS without additional work steps or unnecessary interrupts and without visualizing intermediate images may considerably improve software performance and user acceptance with efforts in time.

Evaluating the Usability of a Controlled Language Authoring Assistant

Directory of Open Access Journals (Sweden)

Miyata Rei

2017-06-01

Full Text Available This paper presents experimental results of a usability evaluation of a controlled language (CL authoring assistant designed to help non-professional writers create machine translatable source texts. As the author drafts the text, the system detects CL rule violations and proscribed terms. It also incorporates several support functions to facilitate rephrasing of the source. In order to assess the usability of the system, we conducted a rewriting experiment, in which we compared two groups of participants, one with the aid of the system and the other without it. The results revealed that our system helped reduce the number of CL violations by about 9% and the time to correct violations by more than 30%. The CL-applied source text resulted in higher fluency and adequacy of MT outputs. Questionnaire and interview results also implied the improved satisfaction with the task completion of those participants who used the system.

CMMAD Usability Case Study in Support of Countermine and Hazard Sensing

Energy Technology Data Exchange (ETDEWEB)

Victor G. Walker; David I. Gertman

2010-04-01

During field trials, operator usability data were collected in support of lane clearing missions and hazard sensing for two robot platforms with Robot Intelligence Kernel (RIK) software and sensor scanning payloads onboard. The tests featured autonomous and shared robot autonomy levels where tasking of the robot used a graphical interface featuring mine location and sensor readings. The goal of this work was to provide insights that could be used to further technology development. The efficacy of countermine systems in terms of mobility, search, path planning, detection, and localization were assessed. Findings from objective and subjective operator interaction measures are reviewed along with commentary from soldiers having taken part in the study who strongly endorse the system.

Quickscan QTI addendum #1 - Usability study of QTI for De Digitale Universiteit

NARCIS (Netherlands)

dr. Pierre Gorissen

2003-01-01

De Digitale Universiteit (DU) performed a quickscan to determine the usability of the IMS Question and TestInteroperability (QTI) specification as a format to store questions and tests developed for and by the consortium. The original report is available in Dutch from the website of De Digitale

Privacy Enhancing Keyboard: Design, Implementation, and Usability Testing

Directory of Open Access Journals (Sweden)

Zhen Ling

2017-01-01

Full Text Available To protect users from numerous password inference attacks, we invent a novel context aware privacy enhancing keyboard (PEK for Android touch-based devices. Usually PEK would show a QWERTY keyboard when users input text like an email or a message. Nevertheless, whenever users enter a password in the input box on his or her touch-enabled device, a keyboard will be shown to them with the positions of the characters shuffled at random. PEK has been released on the Google Play since 2014. However, the number of installations has not lived up to our expectation. For the purpose of usable security and privacy, we designed a two-stage usability test and performed two rounds of iterative usability testing in 2016 and 2017 summer with continuous improvements of PEK. The observations from the usability testing are educational: (1 convenience plays a critical role when users select an input method; (2 people think those attacks that PEK prevents are remote from them.

A human reliability based usability evaluation method for safety-critical software

International Nuclear Information System (INIS)

Boring, R. L.; Tran, T. Q.; Gertman, D. I.; Ragsdale, A.

2006-01-01

Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thus allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)

A Usability Evaluation of a Blended MOOC Environment: An Experimental Case Study

Directory of Open Access Journals (Sweden)

Ahmed Mohamed Fahmy Yousef

2015-04-01

Full Text Available In the past few years, there has been an increasing interest in Massive Open Online Courses (MOOCs as a new form of Technology-Enhanced Learning (TEL, in higher education and beyond. Recognizing the limitations of standalone MOOCs, blended MOOCs (bMOOCs that aim at bringing in-class (i.e. face-to-face interactions and online learning components together have emerged as an alternative MOOC model of teaching and learning in a higher education context. In this paper, we present the design, implementation, and evaluation details of a bMOOC course on “Teaching Methodologies” at Fayoum University, Egypt in cooperation with RWTH Aachen University, Germany, provided using the bMOOC platform L2P-bMOOC. In order to gauge the usability and effectiveness of the course, we employed an evaluation approach based on Conole’s 12 dimensions rubrics, ISONORM 9241/110-S as a general usability evaluation, and a custom effectiveness questionnaire reflecting the different MOOC stakeholder perspectives.

WEB USABILITY OF PUBLIC ORGANIZATION WEBSITES: The Case of Indonesian Ministry Websites

Directory of Open Access Journals (Sweden)

Ali Rokhman

2012-08-01

Full Text Available As a consequence of the development of Information and Communication Technologies (ICT, nowadays almost all governments around the world, included Indonesian government have official websites to provide information and services for their citizen. In the second period of President Susilo Bambang Yudhoyono administration has thirty two ministries and each ministries have an official website. However implementation of the ministry websites have not been measured yet on usability aspect. The objective of this research is to examine the usability of ministry websites of Indonesian Government. Eleven websites was taken as sample in this study. Respondents are 128 Internet users who have competency for assessing web usability. Usability of websites were measured by several indicators were adapted from E-Government Toolkit for Developing Countries that was prepared by the National Informatics Centre and UNESCO. The main indicators consist of navigation architecture, layout design, and content.

A usability evaluation of Lazada mobile application

Science.gov (United States)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Jamaludin, Nur Hafiza; Moh, Somia T. L.

2017-10-01

This paper reports on a usability evaluation of Lazada mobile application, an online shopping app for mobile devices. The evaluation was conducted using 12 users of ages 18 to 24. Seven (7) were expert users and the other 5 were novice users. The study objectives were to evaluate the perceived effectiveness, efficiency and satisfaction of the mobile application. The result provides a positive feedback and shows that the mobile shopping app is effective, efficient, and satisfying as perceived by the study participants. However, there are some observed usability issues with the main menu and the payment method that necessitates improvements to increase the application's effectiveness, efficiency and satisfaction. The suggested improvements include: 1) the main menu should be capitalized and place on the left side of mobile app and 2) payment method tutorial should be included as a hyperlink in the payment method page. This observation will be helpful to the owners of the application in future version development of the app.

Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning

Science.gov (United States)

Peters, Vanessa L.; Songer, Nancy Butler

2013-10-01

This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.

Information users and usability in the digital age

CERN Document Server

Chowdhury, G G

2013-01-01

Gives an overview of the necessary issues relating to information users and the usability of information services in the digital world, including user-centred design, and the characteristics and behaviour of information users. This book helps readers understand why information users and the usability of information services are important.

Design of New-Generation Usable Forms of Topical Haemostatic Agents Containing Chitosan

Directory of Open Access Journals (Sweden)

Dorota Zielińska

2017-12-01

Full Text Available Designing usable forms of topical haemostatic agents is the most important activity during the design process, resulting in strengthened functional properties of the final medical devices. This study aimed to propose indications for a research programme based on risk management supporting the development of two usable forms of a topical haemostatic agent: chitosan/alginate lyophilized foam and chitosan/alginate impregnated gauze. Both of the usable forms of the topical haemostatic agent, being the main part of the modified combat gauze, were fabricated using the chitosan/alginate complex. Risk analysis is helpful in developing an appropriate research programme, significantly reducing the risk to an acceptable level.

Integrating discount usability in scrum development process in Ethiopia

DEFF Research Database (Denmark)

Teka, Degif; Dittrich, Y.; Kifle, Mesfin

2017-01-01

be adapted and integrated into the Scrum-agile development with especial emphasis on the Ethiopian context. The research aims at adapting software engineering and ICT development methods to the specific situation and integrating user-centered design (UCD) and lightweight usability methods into agile...... end users and developers. Culturally adapted user pair testing and heuristic evaluation supported usability testing and supported developers in getting early feedback. Integrated approach of discount usability with the Scrum process has been developed and evaluated first with the involved...

A framework for characterizing usability requirements elicitation and analysis methodologies (UREAM)

NARCIS (Netherlands)

Trienekens, J.J.M.; Kusters, R.J.; Mannaert, H.

2012-01-01

Dedicated methodologies for the elicitation and analysis of usability requirements have been proposed in literature, usually developed by usability experts. The usability of these approaches by non-expert software engineers is not obvious. In this paper, the objective is to support developers and

Usability Evaluation and Implementation of a Health Information Technology Dashboard of Evidence-Based Quality Indicators.

Science.gov (United States)

Schall, Mark Christopher; Cullen, Laura; Pennathur, Priyadarshini; Chen, Howard; Burrell, Keith; Matthews, Grace

2017-06-01

Health information technology dashboards that integrate evidence-based quality indicators can efficiently and accurately display patient risk information to promote early intervention and improve overall quality of patient care. We describe the process of developing, evaluating, and implementing a dashboard designed to promote quality care through display of evidence-based quality indicators within an electronic health record. Clinician feedback was sought throughout the process. Usability evaluations were provided by three nurse pairs and one physician from medical-surgical areas. Task completion times, error rates, and ratings of system usability were collected to compare the use of quality indicators displayed on the dashboard to the indicators displayed in a conventional electronic health record across eight experimental scenarios. Participants rated the dashboard as "highly usable" following System Usability Scale (mean, 87.5 [SD, 9.6]) and Poststudy System Usability Questionnaire (mean, 1.7 [SD, 0.5]) criteria. Use of the dashboard led to reduced task completion times and error rates in comparison to the conventional electronic health record for quality indicator-related tasks. Clinician responses to the dashboard display capabilities were positive, and a multifaceted implementation plan has been used. Results suggest application of the dashboard in the care environment may lead to improved patient care.

VoIP Accessibility: A Usability Study of Voice over Internet Protocol (VoIP) Systems and A Survey of VoIP Users with Vision Loss

Science.gov (United States)

Packer, Jaclyn; Reuschel, William

2018-01-01

Introduction: Accessibility of Voice over Internet Protocol (VoIP) systems was tested with a hands-on usability study and an online survey of VoIP users who are visually impaired. The survey examined the importance of common VoIP features, and both methods assessed difficulty in using those features. Methods: The usability test included four paid…

Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

Science.gov (United States)

Guo, J.; Iribarren, S.; Kapsandoy, S.; Perri, S.; Staggers, N.

2011-01-01

Background Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. Objective To conduct a formal usability evaluation of an implemented eMAR. Methods Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. Results Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. Conclusion The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses’ medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety. PMID:23616871

Virtual Reality for Architectural or Territorial Representations: Usability Perceptions

Directory of Open Access Journals (Sweden)

Atta Idrawani Zaini

2017-05-01

Full Text Available Virtual reality (VR is widely being researched within various aspects of real-world applications. As architecture and urban design are very much adhered to evaluating and designing space, physical representations are deemed as incompetent to deliver a full-scale depiction of a space. Similarly, digital models are very much also limited in that sense. VR can deliver a full-scale virtual environment (VE, tricking users to be immersed in the replicated environment. This is an advantage for the aforementioned design disciplines, as more relatable and realistic depiction of a space can be modelled. The notion of its usability has become important to be understood from the perspective of architecture and urban design. This paper measured the respondents’ perceptions of VR’s usability through measuring its quality of use based on several criteria. The criteria established were the ease of use, usefulness, and satisfaction. Different levels of architectural details were decided as a form of control. A total of N=96 randomly selected respondents from various backgrounds participated in the survey as they were divided into four different group of treatments. Each group experienced a different VE with different level of architectural details. The first section of analysis is a one-sample analysis and the second is a group difference analysis. From the first analysis, it was found that the respondents perceived VR as a usable tool for architectural or territorial representation. Using Kruskal-Wallis test, it was found that there was no statistically significant difference between groups, suggesting that the respondents perceived VR as usable regardless of the level of architectural details. As this paper used perception data based on the quality of use alone, the efficiency of VR system was not measured. Thus, this paper recommends further studies to be conducted on the system’s efficiency to reflect its usability in full extent.

Assessment of Usability Benchmarks: Combining Standardized Scales with Specific Questions

Directory of Open Access Journals (Sweden)

Stephanie Bettina Linek

2011-12-01

Full Text Available The usability of Web sites and online services is of rising importance. When creating a completely new Web site, qualitative data are adequate for identifying the most usability problems. However, changes of an existing Web site should be evaluated by a quantitative benchmarking process. The proposed paper describes the creation of a questionnaire that allows a quantitative usability benchmarking, i.e. a direct comparison of the different versions of a Web site and an orientation on general standards of usability. The questionnaire is also open for qualitative data. The methodology will be explained by the digital library services of the ZBW.

Workshop on cultural usability and human work interaction design

DEFF Research Database (Denmark)

Clemmensen, Torkil; Ørngreen, Rikke; Roese, Kerstin

2008-01-01

it into interaction design. The workshop will present current research into cultural usability and human work interaction design. Cultural usability is a comprehensive concept, which adheres to all kinds of contexts in which humans are involved (private family, work, public and private organizations, nature......, Workplace observation, Think-Aloud Usability Test, etc. These techniques often give - seemingly - similar results when applied in diverse cultural settings, but experience shows that we need a deep understanding of the cultural, social and organizational context to interpret the results, and to transform...

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability

Science.gov (United States)

Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.

2014-01-01

Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725

Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards.

Science.gov (United States)

Moumane, Karima; Idri, Ali; Abran, Alain

2016-01-01

This paper presents an empirical study based on a set of measures to evaluate the usability of mobile applications running on different mobile operating systems, including Android, iOS and Symbian. The aim is to evaluate empirically a framework that we have developed on the use of the Software Quality Standard ISO 9126 in mobile environments, especially the usability characteristic. To do that, 32 users had participated in the experiment and we have used ISO 25062 and ISO 9241 standards for objective measures by working with two widely used mobile applications: Google Apps and Google Maps. The QUIS 7.0 questionnaire have been used to collect measures assessing the users' level of satisfaction when using these two mobile applications. By analyzing the results we highlighted a set of mobile usability issues that are related to the hardware as well as to the software and that need to be taken into account by designers and developers in order to improve the usability of mobile applications.

Usability Evaluation Method for Agile Software Development

Directory of Open Access Journals (Sweden)

Saad Masood Butt

2015-02-01

Full Text Available Agile methods are the best fit for tremendously growing software industry due to its flexible and dynamic nature. But the software developed using agile methods do meet the usability standards? To answer this question we can see that majority of agile software development projects currently involve interactive user interface designs, which can only be possible by following User Centered Design (UCD in agile methods. The question here is, how to integrate UCD with agile models. Both Agile models and UCD are iterative in nature but agile models focus on coding and development of software; whereas, UCD focuses on user interface of the software. Similarly, both of them have testing features where the agile model involves automated tested code while UCD involves an expert or a user to test the user interface. In this paper, a new agile usability model is proposed and the evaluation is of the proposed model is presented by practically implementing it in three real life projects. . Key results from these projects clearly show: the proposed agile model incorporates usability evaluation methods, improves the relationship between usability experts to work with agile software experts; in addition, allows agile developers to incorporate the result from UCD into subsequent interactions.

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care

NARCIS (Netherlands)

Bakhshi-Raiez, F.; de Keizer, N. F.; Cornet, R.; Dorrepaal, M.; Dongelmans, D.; Jaspers, M. W. M.

2012-01-01

Objective: To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Design: Observational study with user-based usability evaluations

VoIP for Telerehabilitation: A Pilot Usability Study for HIPAA Compliance

Directory of Open Access Journals (Sweden)

Valerie R. Watzlaf

2012-06-01

Full Text Available Consumer-based, free Voice and video over the Internet Protocol (VoIP software systems such as Skype and others are used by health care providers to deliver telerehabilitation and other health-related services to clients. Privacy and security applications as well as HIPAA compliance within these protocols have been questioned by practitioners, health information managers, and other healthcare entities. This pilot usability study examined whether four respondents who used the top three, free consumer-based, VoIP software systems perceived these VoIP technologies to be private, secure, and HIPAA compliant;  most did not.  While the pilot study limitations include the number of respondents and systems assessed, the protocol can be applied to future research and replicated for instructional purposes.  Recommendations are provided for VoIP companies, providers, and users. 

Microneedle patches: usability and acceptability for self-vaccination against influenza.

Science.gov (United States)

Norman, James J; Arya, Jaya M; McClain, Maxine A; Frew, Paula M; Meltzer, Martin I; Prausnitz, Mark R

2014-04-01

While therapeutic drugs are routinely self-administered by patients, there is little precedent for self-vaccination. Convenient self-vaccination may expand vaccination coverage and reduce administration costs. Microneedle patches are in development for many vaccines, but no reports exist on usability or acceptability. We hypothesized that naïve patients could apply patches and that self-administered patches would improve stated intent to receive an influenza vaccine. We conducted a randomized, repeated measures study with 91 venue-recruited adults. To simulate vaccination, subjects received placebo microneedle patches given three times by self-administration and once by the investigator, as well as an intramuscular injection of saline. Seventy participants inserted patches with thumb pressure alone and the remainder used snap-based devices that closed shut at a certain force. Usability was assessed by skin staining and acceptability was measured with an adaptive-choice analysis. The best usability was seen with the snap device, with users inserting a median value of 93-96% of microneedles over three repetitions. When a self-administered microneedle patch was offered, intent to vaccinate increased from 44% to 65% (CI: 55-74%). The majority of those intending vaccination would prefer to self-vaccinate: 64% (CI: 51-75%). There were no serious adverse events associated with use of microneedle patches. The findings from this initial study indicate that microneedle patches for self-vaccination against influenza are usable and may lead to improved vaccination coverage. Copyright © 2014 Elsevier Ltd. All rights reserved.

Ergonomic adjustments on a website from the usability of functions: Can deficits impair functionalities?

Directory of Open Access Journals (Sweden)

Dalila Giovana Pagnoncelli Laperuta

2017-09-01

Full Text Available Current study assesses whether deficits and usability of ergonomics impair the functionality of a university website. The concepts of functionality, usability and ergonomics were foregrounded by contextualizing them within a university profile. Later, a satisfaction survey was proposed to users to measure the satisfaction in the use of the website and to map the problems in usability. In addition, an ergonomic inspection was performed on the site by applying Bastien and Scapin´s ergonomic criteria. After analyzing results by descriptive statistics and content analysis, the ergonomic and usability problems were detected, or rather, feedback deficits, minimum action (navigation, flexibility and experience impaired the excellence of website´s functionality, causing dissatisfaction or abandonment of the website by the users. After the analysis of the results, ergonomic adjustments were suggested for the website. They may be a help in new website projects or adjust products in which usability has not been incorporated to the development process.

APPLICATION OF USABILITY CONCEPTS IN WINE MARKETING: A MULTIDISCIPLINARY REVIEW

Directory of Open Access Journals (Sweden)

Cătălina CHIVU-DRAGHIA

2015-10-01

Full Text Available Various studies have shown that the wine consumption decline in young generation could be influenced by the perception of wine as intimidating and difficult to understand, and by the lack of adaptability of the product’s communication strategy and packaging design to their lifestyle. Information available on the packaging is often complex and confusing for novice wine consumers and sometimes even irrelevant in regards to the intrinsic characteristics of the product. Furthermore, wine is seen by young adult consumers as old fashion, formal and mostly not associated with their relaxed attitude and “on the move” lifestyle. The objective of this paper is to analyse the usability key principles and heuristic and their applicability in wine marketing as a mean to improve the perception and increase understanding of wine for the young and/or novice consumers. The paper aims to review the existing knowledge and findings about the concept of usability (with special emphasis on Usability Engineering and Human Computer Interaction (HCI, in order to explore the aspects applicable in wine marketing. The usability concept proves useful in wine marketing to simplify the decision process, to make the meeting with the product less intimidating and more engaging, and to decrease the risk perception for the inexperienced wine consumers.

Social Context in Usability Evaluations: Concepts, Processes and Products

DEFF Research Database (Denmark)

Jensen, Janne Jul

social context is considered important, only little research has been done to identify how it influences usability evaluations. In this thesis I explore how social context affects the process and product of a usability evaluation and explain the findings in terms of the theory of behaviour settings...... leader) and non-operatives (members, spectators, neutrals and potentials) from the theory of behaviour settings to usability evaluations generates an understanding and create an awareness of the level of power possessed by each of the participants in the social context. 2. On the operative level...... and a field experiment. Findings from these activities are presented in five published paper contributions. I furthermore introduce the theory of behaviour settings as a tool to help characterise the key concepts of social context which, together with an understanding of usability evaluations, provide...

An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach.

Science.gov (United States)

Georgsson, Mattias; Staggers, Nancy

2016-02-01

mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability

Assessment of the usability of a digital learning technology prototype for monitoring intracranial pressure

Directory of Open Access Journals (Sweden)

Lilian Regina de Carvalho

Full Text Available ABSTRACT Objective: to assess the usability of a digital learning technology prototype as a new method for minimally invasive monitoring of intracranial pressure. Method: descriptive study using a quantitative approach on assessing the usability of a prototype based on Nielsen's ten heuristics. Four experts in the area of Human-Computer interaction participated in the study. Results: the evaluation delivered eight violated heuristics and 31 usability problems in the 32 screens of the prototype. Conclusion: the suggestions of the evaluators were critical for developing an intuitive, user-friendly interface and will be included in the final version of the digital learning technology.

Determining Reliability and Validity of the Persian Version of Software Usability Measurements Inventory (SUMI) Questionnaire

OpenAIRE

seyed abolfazl zakerian; Roya Azizi; Mehdi Rahgozar

2013-01-01

The term usability refers to a special index for success of an operating system. This study aimed to determine the reliability and validity of the Software Usability Measurements Inventory (SUMI) questionnaire as one of the valid and common questionnaires about usability evaluation. The back translation method was used to translate the questionnaire from English to Persian back to English. Moreover, repeatability or test-retest reliability was practically used to determine the reliability of ...

Evaluation of Virtual Teaching-Learning Environments based on usability standards

Directory of Open Access Journals (Sweden)

Jose I. Cocunubo-Suarez

2018-01-01

Full Text Available The main objective of this review article is to determine the necessary sub-characteristics or aspects for the evaluation of Virtual Teaching-Learning Environments (VTLEs as final or finished products based on ISO 9126, 14598 and 25000-SQuaRE standards. A systematic information search was carried out. A total of 108 documents were retrieved about subjects such as web usability, virtual learning environments, usability, educational software, educational web evaluation, usability evaluation and web usability evaluation. Out of the 108 documents, 70 were selected by inclusion and exclusion analysis. The eight subfeatures of greater statistical frequency were identified among the subset of documents and then integrated as a proposal for standard 25000-SQuaRE.

Game usability advancing the player experience

CERN Document Server

Isbister, Katherine

2008-01-01

I. What is usability and why should I care?A. Overview chapter Isbister and Schaffer (Editors)Introduces key concepts and positions book for primary audiences: game developers andstudents aspiring to work in game development. Addresses key concerns that developersmay have about adopting usability, and sets a broad road map of what is to come in thebook.B. Interview with Tobi Saulnier of 1st PlayableA discussion with the CEO of a small game studio about why and how she uses usabilitytechniques in her development.C. Interview with Don Norman of Nielsen Norman groupA discussion with one of the pr

Preliminary study of online machine translation use of nursing literature: quality evaluation and perceived usability

Directory of Open Access Journals (Sweden)

Anazawa Ryoko

2012-11-01

Full Text Available Abstract Background Japanese nurses are increasingly required to read published international research in clinical, educational, and research settings. Language barriers are a significant obstacle, and online machine translation (MT is a tool that can be used to address this issue. We examined the quality of Google Translate® (English to Japanese and Korean to Japanese, which is a representative online MT, using a previously verified evaluation method. We also examined the perceived usability and current use of online MT among Japanese nurses. Findings Randomly selected nursing abstracts were translated and then evaluated for intelligibility and usability by 28 participants, including assistants and research associates from nursing universities throughout Japan. They answered a questionnaire about their online MT use. From simple comparison of mean scores between two language pairs, translation quality was significantly better, with respect to both intelligibility and usability, for Korean-Japanese than for English-Japanese. Most respondents perceived a language barrier. Online MT had been used by 61% of the respondents and was perceived as not useful enough. Conclusion Nursing articles translated from Korean into Japanese by an online MT system could be read at an acceptable level of comprehension, but the same could not be said for English-Japanese translations. Respondents with experience using online MT used it largely to grasp the overall meanings of the original text. Enrichment in technical terms appeared to be the key to better usability. Users will be better able to use MT outputs if they improve their foreign language proficiency as much as possible. Further research is being conducted with a larger sample size and detailed analysis.

The organization of information in electronic patient record under the perspective of usability recommendations: proposition of organization of information.

Directory of Open Access Journals (Sweden)

Tatiana Tissa Kawakami

2017-10-01

Full Text Available Introduction: Among the various areas of studies, health information is highlighted in this study. More specifically, the patient's electronic medical records and issues related to it’s informational organization and usability. Objectives: suggest Usability recommendations applicable to the Electronic Patient Record. More specifically, identify, according to the specialized literature, recommendations of Usability, as well as to develop a checklist with recommendations of Usability for the Electronic Patient Record. Methodology: the study’s basic purpose is the theoretical nature. The deductive method of documental delimitation was chosen. Results: elaboration of checklist with recommendations of Usability for Electronic Patient Records. Conclusion: Usability recommendations can be used to improve electronic patient records. However, it should be noted that knowledge in the scope of Information Science should be considered and summed up, since a great deal of content related to Usability refers to operational and visual aspects of the interface, not clearly or directly contemplating the issues related to information.

The Software Therapist: Usability Problem Diagnosis Through Latent Semantic Analysis

National Research Council Canada - National Science Library

Sparks, Randall; Hartson, Rex

2006-01-01

The work we report on here addresses the problem of low return on investment in software usability engineering and offers support for usability practitioners in identifying, understanding, documenting...

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study.

Science.gov (United States)

Fagher, Kristina; Jacobsson, Jenny; Dahlström, Örjan; Timpka, Toomas; Lexell, Jan

2017-11-29

Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes' additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes' self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items related to the impairments were

An eHealth Application of Self-Reported Sports-Related Injuries and Illnesses in Paralympic Sport: Pilot Feasibility and Usability Study

Science.gov (United States)

2017-01-01

Background Sport participation is associated with a risk of sports-related injuries and illnesses, and Paralympic athletes’ additional medical issues can be a challenge to health care providers and medical staff. However, few prospective studies have assessed sports-related injuries and illnesses in Paralympic sport (SRIIPS) over time. Advances in mobile phone technology and networking systems offer novel opportunities to develop innovative eHealth applications for collection of athletes’ self-reports. Using eHealth applications for collection of self-reported SRIIPS is an unexplored area, and before initiation of full-scale research of SRIIPS, the feasibility and usability of such an approach needs to be ascertained. Objective The aim of this study was to perform a 4-week pilot study and (1) evaluate the monitoring feasibility and system usability of a novel eHealth application for self-reported SRIIPS and (2) report preliminary data on SRIIPS. Methods An eHealth application for routine collection of data from athletes was developed and adapted to Paralympic athletes. A 4-week pilot study was performed where Paralympic athletes (n=28) were asked to weekly self-report sport exposure, training load, general well-being, pain, sleep, anxiety, and possible SRIIPS. The data collection was followed by a poststudy use assessment survey. Quantitative data related to the system use (eg, completed self-reports, missing responses, and errors) were analyzed using descriptive statistics. The qualitative feasibility and usability data provided by the athletes were condensed and categorized using thematic analysis methods. Results The weekly response rate was 95%. The athletes were of the opinion that the eHealth application was usable and feasible but stated that it was not fully adapted to Paralympic athletes and their impairments. For example, it was difficult to understand how a new injury or illness should be identified when the impairment was involved. More survey items

Wireless application guidelines for usability design and evaluation for developing countries

International Nuclear Information System (INIS)

Khoja, S.A.; Ursani, A.A.; Ali, A.

2009-01-01

The aim of this paper is to provide guidelines for designing wireless applications. These guidelines are developed with the help of Human Computer Interaction based Usability Evaluation surveys and tests results. These guidelines will help in making wireless applications more usable and attractive for users and will help designers to plan effective interactive applications. The guidelines presented in the paper have been derived from the results of surveys, usability tests and SET (Summative Evaluation Tests) carried out over 200 people of Karachi, Pakistan, from different walks of life with different academic and professional backgrounds, making imperative suggestions not only to improve the usability of exciting features given in wireless and mobile products, but also provide suggestions to improve usability of basic components such as, text, navigation, interactivity, multimedia, control and behavior. (author)

The reliability and usability of district health information software ...

African Journals Online (AJOL)

The reliability and usability of district health information software: case studies from Tanzania. ... The District Health Information System (DHIS) software from the Health Information System ... EMAIL FREE FULL TEXT EMAIL FREE FULL TEXT

An Iterative, Mixed Usability Approach Applied to the Telekit System from the Danish TeleCare North Trial

Science.gov (United States)

Schaarup, Clara; Hejlesen, Ole Kristian

2016-01-01

Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888

Evaluating Distributed Usability: the role of user interfaces in an activity system

Directory of Open Access Journals (Sweden)

Lejla Vrazalic

2003-11-01

Full Text Available Traditional definitions of usability localise this fundamental Human Computer Interaction (HCI concept in the user interface and reduce it to a variety of qualitative and quantitative attributes of the computer system. This simplistic view of usability has been used as the basis for developing design and evaluation methods in the discipline. This paper argues that, as a result, HCI methods are ineffective and suffer from various shortcomings. It is proposed that the notion of usability must be extended to include contextual factors, and viewed as being distributed across an activity system. Adopting this notion of distributed usability then requires a review of existing HCI methods. Usability testing, as a complete and self-contained HCI method, was chosen for this purpose, and the result, a distributed usability evaluation method (DUEM, is presented in this paper.

Accessibility and usability OCW data: The UTPL OCW

Directory of Open Access Journals (Sweden)

Germania Rodríguez

2017-08-01

Full Text Available This data article provides a data description on article entitled “A framework for improving web accessibility and usability of Open Course Ware sites” [3] This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.

Usability and clinical efficacy of diabetes mobile applications for adults with type 2 diabetes: A systematic review.

Science.gov (United States)

Fu, Helen; McMahon, Siobhan K; Gross, Cynthia R; Adam, Terrence J; Wyman, Jean F

2017-09-01

To assess the usability and clinical effectiveness of diabetes mobile applications (diabetes apps) developed for adults with type 2 diabetes. A systematic review of the usability and effectiveness of diabetes apps was conducted. Searches were performed using MEDLINE, EMBASE, COMPENDEX, and IEEE XPLORE for articles published from January 1, 2011, to January 17, 2017. Search terms included: diabetes, mobile apps, and mobile health (mHealth). The search yielded 723 abstracts of which seven usability studies and ten clinical effectiveness studies met the inclusion criteria from 20 publications. Usability, as measured by satisfaction ratings from experts and patients, ranged from 38% to 80%. Usability problem ratings ranged from moderate to catastrophic. Top usability problems are multi-steps task, limited functionality and interaction, and difficult system navigation. Clinical effectiveness, measured by reductions in HbA1c, ranged from 0.15% to 1.9%. Despite meager satisfaction ratings and major usability problems, there is some limited evidence supporting the effectiveness of diabetes apps to improve glycemic control for adults with type 2 diabetes. Findings strongly suggest that efforts to improve user satisfaction, incorporate established principles of health behavior change, and match apps to user characteristics will increase the therapeutic impact of diabetes apps. Copyright © 2017 Elsevier B.V. All rights reserved.

Usability of a patient education and motivation tool using heuristic evaluation.

Science.gov (United States)

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design

Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.

Science.gov (United States)

Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas

2015-09-10

As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on

Mobile PHRs compliance with Android and iOS usability guidelines.

Science.gov (United States)

Cruz Zapata, Belén; Hernández Niñirola, Antonio; Idri, Ali; Fernández-Alemán, José Luis; Toval, Ambrosio

2014-08-01

Mobile Personal Health Records (PHRs) have achieved a particularly strong market share since the appearance of more powerful mobile devices and popular worldwide mobile application markets such as Apple's App Store and Android's Google Play. However, Android and Apple have a set of recommendations on design and usability targeted towards developers who wish to publish apps in their stores: Android Design Guidelines and iOS Human Interface Guidelines. This paper aims to evaluate compliance with these guidelines by assessing the usability recommendations of a set of 24 selected mobile PHR applications. An analysis process based on a well-known Systematic Literature Review (SLR) protocol was used. The results show that the 24 mobile PHR applications studied are not suitably structured. 46 % of these applications do not use any of the recommended patterns, using instead lists or springboards, which are deprecated patterns for top-level menus. 70 % of the PHRs require a registration to be able to test the application when these interactions should be delayed. Our study will help both PHR users to select user-friendly mobile PHRs and PHR providers and developers to identify the good usability practices implemented by the applications with the highest scores.

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

Science.gov (United States)

Fay, Nicolas; Ellison, T Mark

2013-01-01

This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Spatial Awareness

Science.gov (United States)

2017-08-08

created. For the test, the space created was a virtual factory space and a machine shop . Into this space the test administrators were able to inject...Using Competitive Usability Analysis”, Transactions of the ASME, Journal of Computing and Information Science in Engineering, June 2012, Vol, 12. 5

Determining the Number of Participants Needed for the Usability Evaluation of E-Learning Resources: A Monte Carlo Simulation

Science.gov (United States)

Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.

2015-01-01

The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…

Comparability and Usability: Key issues in the design of internet forms for New Zealand’s 2006 Census of Populations and Dwellings

Directory of Open Access Journals (Sweden)

Lyn Potaka

2008-03-01

Full Text Available Designing internet questionnaires to collect data that will ultimately be comparable with the data collected from paper questionnaires can present a number of challenges for developers. This paper discusses the design and development of internet forms for use in a mixed-mode Census in New Zealand in 2006. Using experiences from the design and testing of prototype forms, it describes design features intended to take full advantage of the capabilities of the internet mode, while preserving the qualities of paper based responding to help prevent mode effects. The discussion also highlights the role of usability testing as a key tool in evaluating the success of those design strategies and ensuring that the forms would be simple and easy to use.

Website Usability in Asia “From Within”

DEFF Research Database (Denmark)

Nawaz, Ather; Clemmensen, Torkil

2013-01-01

As the number of website users in Asia grows, there is an increasing need to gain an overview of human–computer interaction (HCI) research about users and websites in that context. This article presents an overview of HCI research on website usability in Asia “from within,” which outlines...... discusses the results and the need for a greater sensitivity to what is “local” and “from within” in HCI research and what this can add to the existing literature on website usability....

Usability challenges in an Ethiopian software development organization

DEFF Research Database (Denmark)

Teka, Degif; Dittrich, Yvonne; Kifle, Mesfin

2016-01-01

Usability and user centered design (UCD) are central to software development. In developing countries, the gap between IT development and the local use situation is larger than in western countries. However, usability is neither well addressed in software practice nor at the policy making level...... in Ethiopia. Software practitioners focus on functional requirements, meeting deadlines and budget. The software development industry in Ethiopia is in its early stage. The article aims at understanding usability practices in an Ethiopian software development company. Developers, system analysts, product...... configuration, their experience, cultural knowledge and common sense regarding the users' situation guided the design. Prototypes and fast delivery of working versions helped in getting user feedback even if early user focus proved to be a challenge as communication between developers and users suffered from...

Usability Briefing - a process model for healthcare facilities

DEFF Research Database (Denmark)

Fronczek-Munter, Aneta

2014-01-01

Background: In complex buildings with many types of users it can be difficult to satisfy the numerous, often contradictory requirements. Research in usability mostly focuses on evaluating products or facilities with users, after they were built. This paper is part of a PhD project “Usability...... with various users/stakeholders, using creative boundary objects at workshops.  Practical Implications: The research results have relevance to researchers, client organisations, facility managers and architects planning new complex facilities.  Research limitations: The proposed model is theoretical and needs...... briefing for hospitals”, where methods for capturing user needs and experiences at hospital facilities are investigated in order to feed into design processes and satisfy the users’ needs and maximise the effectiveness of facilities. Purpose: This paper introduces the concept of usability briefing...

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

Science.gov (United States)

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

The AutoProof Verifier: Usability by Non-Experts and on Standard Code

Directory of Open Access Journals (Sweden)

Carlo A. Furia

2015-08-01

Full Text Available Formal verification tools are often developed by experts for experts; as a result, their usability by programmers with little formal methods experience may be severely limited. In this paper, we discuss this general phenomenon with reference to AutoProof: a tool that can verify the full functional correctness of object-oriented software. In particular, we present our experiences of using AutoProof in two contrasting contexts representative of non-expert usage. First, we discuss its usability by students in a graduate course on software verification, who were tasked with verifying implementations of various sorting algorithms. Second, we evaluate its usability in verifying code developed for programming assignments of an undergraduate course. The first scenario represents usability by serious non-experts; the second represents usability on "standard code", developed without full functional verification in mind. We report our experiences and lessons learnt, from which we derive some general suggestions for furthering the development of verification tools with respect to improving their usability.

Training Software Developers and Designers to Conduct Usability Evaluations

Science.gov (United States)

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

Ten factors to consider when developing usability scenarios and tasks for health information technology.

Science.gov (United States)

Russ, Alissa L; Saleem, Jason J

2018-02-01

The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.

A Persuasive and Social mHealth Application for Physical Activity: A Usability and Feasibility Study.

Science.gov (United States)

Al Ayubi, Soleh U; Parmanto, Bambang; Branch, Robert; Ding, Dan

2014-05-22

Advances in smartphones and the wide usage of social networking systems offer opportunities for the development of innovative interventions to promote physical activity. To that end, we developed a persuasive and social mHealth application designed to monitor and motivate users to walk more every day. The objectives of this project were to conduct a focused review on the fundamental characteristics of mHealth for physical activity promotion, to develop an mHealth application that meets such characteristics, and to conduct a feasibility study to deploy the application in everyday life. This project started as an analytical study to review the fundamental characteristics of the technologies used in physical activity monitoring and promotion. Then, it was followed by a technical development of the application. Next, a 4 week deployment was conducted where participants used the application as part of their daily life. A think-aloud method and in-depth semistructured interviews were conducted following the deployment. A qualitative description method was used to thematically analyze the interviews. Feasibility measures included, adherence to the program, user-system interactions, motivation to use, and experience with physical activity and online social interactions. There were seven fundamental characteristics of physical activity monitoring and promotion that were identified, which were then used as a foundation to develop the application. There were fourteen participants that enrolled in the application evaluation. The age range was from 24 to 45; body mass index ranged from 18.5 to 42.98, with 4 of the subjects falling into the category "obese". Half of them were experienced with smartphones, and all were familiar with a social network system. There were thirteen participants that completed the study; one was excluded. Overall, participants gave high scores to almost all of the usability factors examined, with averages of 4.52 out of a 5.00 maximum. Over 29 days

Safety and usability evaluation of a web-based insulin self-titration system for patients with type 2 diabetes mellitus.

Science.gov (United States)

Simon, Airin C R; Holleman, Frits; Gude, Wouter T; Hoekstra, Joost B L; Peute, Linda W; Jaspers, Monique W M; Peek, Niels

2013-09-01

The rising incidence of type 2 diabetes mellitus (T2DM) induces severe challenges for the health care system. Our research group developed a web-based system named PANDIT that provides T2DM patients with insulin dosing advice using state of the art clinical decision support technology. The PANDIT interface resembles a glucose diary and provides advice through pop-up messages. Diabetes nurses (DNs) also have access to the system, allowing them to intervene when needed. The objective of this study was to establish whether T2DM patients can safely use PANDIT at home. To this end, we assessed whether patients experience usability problems with a high risk of compromising patient safety when interacting with the system, and whether PANDIT's insulin dosing advice are clinically safe. The study population consisted of patients with T2DM (aged 18-80) who used a once daily basal insulin as well as DNs from a university hospital. The usability evaluation consisted of think-aloud sessions with four patients and three DNs. Video data, audio data and verbal utterances were analyzed for usability problems encountered during PANDIT interactions. Usability problems were rated by a physician and a usability expert according to their potential impact on patient safety. The usability evaluation was followed by an implementation with a duration of four weeks. This implementation took place at the patients' homes with ten patients to evaluate clinical safety of PANDIT advice. PANDIT advice were systematically compared with DN advice. Deviating advice were evaluated with respect to patient safety by a panel of experienced physicians, which specialized in diabetes care. We detected seventeen unique usability problems, none of which was judged to have a high risk of compromising patient safety. Most usability problems concerned the lay-out of the diary, which did not clearly indicate which data entry fields had to be entered in order to obtain an advice. 27 out of 74 (36.5%) PANDIT advice

Usability inspection to improve an electronic provincial medication repository.

Science.gov (United States)

Kitson, Nicole A; Price, Morgan; Bowen, Michael; Lau, Francis

2013-01-01

Medication errors are a significant source of actual and potential harm for patients. Community medication records have the potential to reduce medication errors, but they can also introduce unintended consequences when there is low fit to task (low cognitive fit). PharmaNet is a provincially managed electronic repository that contains the records for community-based pharmacy-dispensed medications in British Columbia. This research explores the usability of PharmaNet, as a representative community-based medication repository. We completed usability inspections of PharmaNet through vendor applications. Vendor participants were asked to complete activity-driven scenarios, which highlighted aspects of medication management workflow. Screen recording was later reviewed. Heuristics were applied to explore usability issues and improvement opportunities. Usability inspection was conducted with four PharmaNet applications. Ninety-six usability issues were identified; half of these had potential implications for patient safety. These were primarily related to login and logout procedures; display of patient name; display of medications; update and display of alert information; and the changing or discontinuation of medications. PharmaNet was designed primarily to support medication dispensing and billing activities by community pharmacies, but is also used to support care providers with monitoring and prescribing activities. As such, some of the features do not have a strong fit for other clinical activities. To improve fit, we recommend: having a Current Medications List and Displaying Medication Utilization Charts.

Palliative Care Planner: A Pilot Study to Evaluate Acceptability and Usability of an Electronic Health Records System-integrated, Needs-targeted App Platform.

Science.gov (United States)

Cox, Christopher E; Jones, Derek M; Reagan, Wen; Key, Mary D; Chow, Vinca; McFarlin, Jessica; Casarett, David; Creutzfeldt, Claire J; Docherty, Sharron L

2018-01-01

The quality and patient-centeredness of intensive care unit (ICU)-based palliative care delivery is highly variable. To develop and pilot an app platform for clinicians and ICU patients and their family members that enhances the delivery of needs-targeted palliative care. In the development phase of the study, we developed an electronic health record (EHR) system-integrated mobile web app system prototype, PCplanner (Palliative Care Planner). PCplanner screens the EHR for ICU patients meeting any of five prompts (triggers) for palliative care consultation, allows families to report their unmet palliative care needs, and alerts clinicians to these needs. The evaluation phase included a prospective before/after study conducted at a large academic medical center. Two control populations were enrolled in the before period to serve as context for the intervention. First, 25 ICU patients who received palliative care consults served as patient-level controls. Second, 49 family members of ICU patients who received mechanical ventilation for at least 48 hours served as family-level controls. Afterward, 14 patients, 18 family members, and 10 clinicians participated in the intervention evaluation period. Family member outcomes measured at baseline and 4 days later included acceptability (Client Satisfaction Questionnaire [CSQ]), usability (Systems Usability Scale [SUS]), and palliative care needs, assessed with the adapted needs of social nature, existential concerns, symptoms, and therapeutic interaction (NEST) scale; the Patient-Centeredness of Care Scale (PCCS); and the Perceived Stress Scale (PSS). Patient outcomes included frequency of goal concordant treatment, hospital length of stay, and discharge disposition. Family members reported high PCplanner acceptability (mean CSQ, 14.1 [SD, 1.4]) and usability (mean SUS, 21.1 [SD, 1.7]). PCplanner family member recipients experienced a 12.7-unit reduction in NEST score compared with a 3.4-unit increase among controls (P�

A health literacy and usability heuristic evaluation of a mobile consumer health application.

Science.gov (United States)

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

Comparison of CTA and Textual Feedback in Usability Testing for Malaysian Users

DEFF Research Database (Denmark)

Sivaji, Ashok; Clemmensen, Torkil; Nielsen, Søren Feodor

Usability moderators found that the concurrent think-aloud (CTA) method has some cultural limitation that impacts usability testing with Malaysian users. This gives rise to proposing a new method called textual feedback. The research question is to determine whether there are any differences...... in usability defects from the concurrent think-aloud (CTA) method (Condition 2) and textual feedback method (Condition 1) within the same group of Malaysian users. A pair-wise t-test was used, whereby users were subjected to performing usability task using both methods. Results reveal that we can reject...

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

Science.gov (United States)

Chalil Madathil, Kapil; Greenstein, Joel S

2017-11-01

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual

E-commerce usability: do we need guidelines for emerging economies?

CSIR Research Space (South Africa)

Chelule, E

2010-07-01

Full Text Available This paper presents the results of a usability study conducted on South African B2C bricks-and-clicks retailers' e-commerce websites. The study employed two evaluation techniques namely; user evaluation and heuristic evaluation (HE). The results...

Videoconferencing for site initiations in clinical studies: Mixed methods evaluation of usability, acceptability, and impact on recruitment.

Science.gov (United States)

Randell, Rebecca; Backhouse, Michael R; Nelson, E Andrea

2016-12-01

A critical issue for multicentre clinical studies is conducting site initiations, ensuring sites are trained in study procedures and comply with relevant governance requirements before they begin recruiting patients. How technology can support site initiations has not previously been explored. This study sought to evaluate use of off-the-shelf web-based videoconferencing to deliver site initiations for a large national multicentre study. Participants in the initiations, including podiatrists, diabetologists, trial coordinators, and research nurses, completed an online questionnaire based on the System Usability Scale (SUS) (N = 15). This was followed by semi-structured interviews, with a consultant diabetologist, a trial coordinator, and three research nurses, exploring perceived benefits and limitations of videoconferencing. The mean SUS score for the videoconferencing platform was 87.2 (SD = 13.7), suggesting a good level of usability. Interview participants perceived initiations delivered by videoconferencing as being more interactive and easier to follow than those delivered by teleconference. In comparison to face-to-face initiations, videoconferencing takes less time, easily fitting in with the work of staff at the local sites. Perceptions of impact on communication varied according to the hardware used. Off-the-shelf videoconferencing is a viable alternative to face-to-face site initiations and confers advantages over teleconferencing.

Lessons Learned from Two Usability Studies of Digital Skiing Game with Elderly People in Finland and Japan

Directory of Open Access Journals (Sweden)

Aung Pyae

2017-12-01

Full Text Available Physical decline is associated with old age. Engagement in regular physical exercises can help elderly people improve their physical functionalities, as well as cognitive abilities. Among modern technologies, digital games have the potential to promote elderly people’s engagement in physical exercises through fun and enjoyable gameplay. Although commercial digital games show promise, most of them are not senior-friendly. The literature also suggests that more studies need to be undertaken to understand the usability and usefulness of digital games for elderly people. Hence, in this study, we designed and developed a digital game-based Skiing activity for elderly people. Then, we evaluated it with the Finnish and Japanese elderly participants in Finland and Japan to investigate their feedback towards the usability and usefulness of the game. The findings from both studies show that digital games are useful for promoting elderly people’s engagement in physical activities. While digital games are promising to be used as an alternative solution for promoting the Japanese elderly participant’s physical activities, the Finnish elderly participants recommend to use it when they don’t have access to non-digital physical exercises. The lessons learned from this study can help researchers and practitioners gain insights into game design and development for elderly people and their physical activities.

The cultural evolution of human communication systems in different sized populations: usability trumps learnability.

Directory of Open Access Journals (Sweden)

Nicolas Fay

Full Text Available This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both, and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity, but harder to learn (identification accuracy for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.

Feasibility and usability of a home monitoring concept based on mobile phones and near field communication (NFC) technology.

Science.gov (United States)

Morak, Jürgen; Kollmann, Alexander; Schreier, Günter

2007-01-01

Utilization of mobile information and communication technologies in home monitoring applications is becoming more and more common. The mobile phone, acting as a patient terminal for patients suffering from chronic diseases, provides an active link to the caregiver to transmit health status information and receive feedback. In such a concept the usability is still limited by the necessity of entering the values via the mobile phone's small keypad. The near field communication technology (NFC), a touch-based wireless interface that became available recently, may improve the usability level of such applications significantly. The focus of this paper is to describe the development of a prototype application based on this technology embedded in a home monitoring system. The feasibility and usability of this approach are evaluated and compared with concepts used in previous approaches. The high quantifier with respect to overall usability indicates that NFC may be the technology of choice for some tasks in home monitoring applications.

Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP study

Directory of Open Access Journals (Sweden)

Boessen AB

2017-08-01

Full Text Available April BCG Boessen,1 Joan Vermeulen,2 Luc P de Witte3 1Research Centre for Technology in Care, Faculty of Health, Zuyd University of Applied Sciences, Heerlen, the Netherlands; 2Lunet zorg, Eindhoven, the Netherlands; 3The Innovation Centre, The University of Sheffield, Sheffield, UK Background: Large-scale cohort studies are needed to confirm the relation between dementia and its possible risk factors. The inclusion of people with dementia in research is a challenge, however, children of people with dementia are at risk and are highly motivated to participate in dementia research. For technologies to support home-based data collection during large-scale studies, participants should be able and willing to use technology for a longer period of time. Objective: This study investigated acceptance and usability of iVitality, a research platform for home-based monitoring of dementia health indicators, in 151 children of people with dementia and investigated which frequency of measurements is acceptable for them. Methods: Participants were randomized to fortnightly or monthly measurements. At baseline and after 3 months, participants completed an online questionnaire regarding the acceptance (Technology Acceptance Model; 38 items and usability (Post-Study System Usability Questionnaire; 24 items of iVitality. Items were rated from 1 (I totally disagree to 7 (I totally agree. Participants were also invited to take part in an online focus group (OFG after 3 months of follow-up. Descriptive statistics and both two-sample/independent and paired t-tests were used to analyze the online questionnaires and a directed content analysis was used to analyze the OFGs. Results: Children of people with dementia accept iVitality after long-term use and evaluate iVitality as a user-friendly, useful, and trusted technology, despite some suggestions for improvement. Overall, mean scores on acceptance and usability were higher than 5 (I somewhat agree, although the

Effects of two hospital bed design features on physical demands and usability during brake engagement and patient transportation: a repeated measures experimental study.

Science.gov (United States)

Kim, Sunwook; Barker, Linsey M; Jia, Bochen; Agnew, Michael J; Nussbaum, Maury A

2009-03-01

Work-related musculoskeletal disorders (WMSDs) are prevalent among healthcare workers worldwide. While existing research has focused on patient-handling techniques during activities which require direct patient contact (e.g., patient transfer), nursing tasks also involve other patient-handling activities, such as engaging bed brakes and transporting patients in beds, which could render healthcare workers at risk of developing WMSDs. Effectiveness of hospital bed design features (brake pedal location and steering-assistance) was evaluated in terms of physical demands and usability during brake engagement and patient transportation tasks. Two laboratory-based studies were conducted. In simulated brake engagement tasks, three brake pedal locations (head-end vs. foot-end vs. side of a bed) and two hands conditions (hands-free vs. hands-occupied) were manipulated. Additionally, both in-room and corridor patient transportation tasks were simulated, in which activation of steering-assistance features (5th wheel and/or front wheel caster lock) and two patient masses were manipulated. Nine novice participants were recruited from the local student population and community for each study. During brake engagement, trunk flexion angle, task completion time, and questionnaires were used to quantify postural comfort and usability. For patient transportation, dependent measures were hand forces and questionnaire responses. Brake pedal locations and steering-assistance features in hospital beds had significant effects on physical demands and usability during brake engagement and patient transportation tasks. Specifically, a brake pedal at the head-end of a bed increased trunk flexion by 74-224% and completion time by 53-74%, compared to other pedal locations. Participants reported greater overall perceived difficulty and less postural comfort with the brake pedal at the head-end. During in-room transportation, participants generally reported "Neither Low nor High" physical demands

Negative Feedback for Small Capacitive Touchscreen Interfaces: A Usability Study for Data Entry Tasks.

Science.gov (United States)

Parikh, S P; Esposito, J M

2012-01-01

Touchscreen technology has become pervasive in the consumer product arena over the last decade, offering some distinct advantages such as software reconfigurable interfaces and the removal of space consuming mice and keyboards. However, there are significant drawbacks to these devices that have limited their adoption by some users. Most notably, standard touchscreens demand the user's visual attention and require them to look at the input device to avoid pressing the wrong button. This issue is particularly important for mobile, capacitive sensing, nonstylus devices, such as the iPhone where small button sizes can generate high error rates. While previous work has shown the benefits of augmenting such interfaces with audio or vibrotactile feedback, only positive feedback (confirmation of button presses) has been considered. In this paper, we present a simple prototype interface that provides negative vibrotactile feedback. By negative, we mean feedback is generated when an inactive or ambiguous part of the screen, such as the area between two buttons, is touched. First, we present a usability study comparing positive and negative vibrotactile feedback for a benchmark numerical data entry task. The difference in performance is not statistically significant, implying negative feedback provides comparable benefits. Next, based on the experimenter's observations and the users comments, we introduce a multimodal feedback strategy-combining complementary positive audio and negative vibrotactile signals. User tests on a text entry experiment show that, with multimodal feedback, users exhibit a (statistically significant) 24 percent reduction in corrective key presses, as compared to positive audio feedback alone. Exit survey comments indicate that users favor multimodal feedback.

Pilot implementation Driven by Effects Specifications and Formative Usability Evaluation

DEFF Research Database (Denmark)

Barlach, Anders; Hertzum, Morten; Simonsen, Jesper

2013-01-01

This chapter reports on the usability-engineering work performed throughout the pilot implementation of an Electronic Healthcare Record (EHR). The case describes and analyzes the use of pilot implementations to formatively evaluate whether the usability of the EHR meets the effects specified for ...

Methods in Mapping Usability of Malaysia’s Shopping Centre

Directory of Open Access Journals (Sweden)

Abdul Ghani Aida Affina

2016-01-01

Full Text Available With more than 200 number of shopping centre in Klang Valley itself, we the consumer actually have vast of choices. Instead of the machineries varieties from the lower class product till the posh one, each of those shopping centres eventually offers the typical product same as others. Those shopping centers are competing with each other and in great endeavour to attract more consumers, to visit and spend. As for the visitor, the typical product and boring ambience seems similar in all malls, and is looking something beyond the standard. Something that promising quality embedded in shopping centre which evokes the various emotions of the user along their journey in malls. This quality is known as usability. Usability; as defined generally is a global user’s experience response with product, environment, service or facilities. It is an assessment in extracting the qualities of shopping centre design. In mapping it, there are a few synthesizing methods to implement it. Therefore, this paper purposely to review the method that been used in usability of Malaysia’s shopping centre research with a few references on previous research done in usability assessment by predecessor’s scholars. With the accentuation on three elements that anchoring what the usability is: effectiveness, efficient and satisfaction, it is hope that this overview can lead other researcher in portraying its relationship with the quality and ‘user friendly’ design of shopping centre.

A Dose of Reality: Overcoming Usability Challenges\\ud in VR Head-Mounted Displays

OpenAIRE

McGill, M.; Boland, Daniel; Murray-Smith, Roderick; Brewster, Stephen

2015-01-01

We identify usability challenges facing consumers adopting\\ud Virtual Reality (VR) head-mounted displays (HMDs) in a survey\\ud of 108 VR HMD users. Users reported significant issues\\ud in interacting with, and being aware of their real-world\\ud context when using a HMD. Building upon existing work on\\ud blending real and virtual environments, we performed three\\ud design studies to address these usability concerns. In a typing\\ud study, we show that augmenting VR with a view of reality\\ud sig...

Post-Mission Assessment for Tactical Training-Trends Analysis (PMATT-TA): Usability Analysis Report

Science.gov (United States)

2014-07-01

information, PMATT-TA also supports data calls to understand fleet readiness and proficiency. Additionally, PMATT-TA addresses a need for a digitally based...Software Quality Journal, 4(2), 115-130. Gray, W. D., & Salzman, M. C. (1998). Damaged merchandise ? A review of experiments that compare usability

An app for patient education and self-audit within an enhanced recovery program for bowel surgery: a pilot study assessing validity and usability.

Science.gov (United States)

Pecorelli, Nicolò; Fiore, Julio F; Kaneva, Pepa; Somasundram, Abarna; Charlebois, Patrick; Liberman, A Sender; Stein, Barry L; Carli, Franco; Feldman, Liane S

2018-05-01

While patient engagement and clinical audit are key components of successful enhanced recovery programs (ERPs), they require substantial resource allocation. The objective of this study was to assess the validity and usability of a novel mobile device application for education and self-reporting of adherence for patients undergoing bowel surgery within an established ERP. Prospectively recruited patients undergoing bowel surgery within an ERP used a novel app specifically designed to provide daily recovery milestones and record adherence to 15 different ERP processes and six patient-reported outcomes (PROs). Validity was measured by the agreement index (Cohen's kappa coefficient for categorical, and interclass correlation coefficient (ICC) for continuous variables) between patient-reported data through the app and data recorded by a clinical auditor. Acceptability and usability of the app were measured by the System Usability Scale (SUS). Forty-five patients participated in the study (mean age 61, 64% male). Overall, patients completed 159 of 179 (89%) of the available questionnaires through the app. Median time to complete a questionnaire was 2 min 49 s (i.q.r. 2'32″-4'36″). Substantial (kappa > 0.6) or almost perfect agreement (kappa > 0.8) and strong correlation (ICC > 0.7) between data collected through the app and by the clinical auditor was found for 14 ERP processes and four PROs. Patient-reported usability was high; mean SUS score was 87 (95% CI 83-91). Only 6 (13%) patients needed technical support to use the app. Forty (89%) patients found the app was helpful to achieve their daily goals, and 34 (76%) thought it increased their motivation to recover after surgery. This novel application provides a tool to record patient adherence to care processes and PROs, with high agreement with traditional clinical audit, high usability, and patient satisfaction. Future studies should investigate the use of mobile device apps as strategies to increase

Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation.

Science.gov (United States)

Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew

2016-11-16

Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.

Usability principles to design mobile workplace learning content

Directory of Open Access Journals (Sweden)

Alessia Messuti

2015-04-01

Full Text Available The article describes the design of a mobile workplace learning tool for trainers of the International Training Centre of the International Labour Organization. The motivation behind is to provide trainers with a practical tool that will enable them to recall information at the moment of need and continue to learn in context. On this purpose a set of visual augmented reality cards was created, taking into consideration the fundamental mobile learning and usability principles. The nature of the article is empirical as it reports an experiment carried out with trainers which aimed at testing cards usability and learnability. Results show that the integration of both online and offline strategies was perceived as an added value as trainers could choose to retrieve information as they mostly like; finally, it also resulted in high usability scores, an aspect that contributes to their effectiveness at the workplace.

Physician satisfaction with a critical care clinical information system using a multimethod evaluation of usability.

Science.gov (United States)

Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J

2018-04-01

Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.

Cost Effective Development of Usable Systems: Gaps between HCI and Software Architecture Design

Science.gov (United States)

Folmer, Eelke; Bosch, Jan

A software product with poor usability is likely to fail in a highly competitive market; therefore software developing organizations are paying more and more attention to ensuring the usability of their software. Practice, however, shows that product quality (which includes usability among others) is not that high as it could be. Studies of software projects (Pressman, 2001) reveal that organizations spend a relative large amount of money and effort on fixing usability problems during late stage development. Some of these problems could have been detected and fixed much earlier. This avoidable rework leads to high costs and because during development different tradeoffs have to be made, for example between cost and quality leads to systems with less than optimal usability. This problem has been around for a couple of decades especially after software engineering (SE) and human computer interaction (HCI) became disciplines on their own. While both disciplines developed themselves, several gaps appeared which are now receiving increased attention in research literature. Major gaps of understanding, both between suggested practice and how software is actually developed in industry, but also between the best practices of each of the fields have been identified (Carrol et al, 1994, Bass et al, 2001, Folmer and Bosch, 2002). In addition, there are gaps in the fields of differing terminology, concepts, education, and methods.

Exploring the Design, Development and Use of Websites through Accessibility and Usability Studies

Science.gov (United States)

Foley, Alan

2011-01-01

In this paper, data obtained from a university website accessibility and usability validation process are analyzed and used to demonstrate how the design process can affect the online experience for users with disabilities. Interviews, observations, and use data (e.g. where users clicked on a page or what path taken through a site) were collected.…

Usability Testing, User-Centered Design, and LibGuides Subject Guides: A Case Study

Science.gov (United States)

Sonsteby, Alec; DeJonghe, Jennifer

2013-01-01

Usability testing has become a routine way for many libraries to ensure that their Web presence is user-friendly and accessible. At the same time, popular subject guide creation systems, such as LibGuides, decentralize Web content creation and put authorship into the hands of librarians who may not be trained in user-centered design principles. At…

Usability styles of the plant safety monitoring and assesment system, PLASMA

International Nuclear Information System (INIS)

Green, M.; Hornaes, A.; Hulsund, J.E.; Vegh, J.; Major, Cs.; Lipcsei, S.; Borbely, S.

2001-01-01

Development of the PLASMA (Plant Safety Monitoring and Assessment) system was started in 1998 in the framework of an international Research and Development project supported by OECD/NEA. The objective of this project was to develop an on-line information system to support VVER reactor operators during the execution of symptom-based Emergency Operating Procedures (EOPs), with the Paks NPP in Hungary as the target plant. In connection with the installation of the PLASMA system at Paks NPP it was decided to perform a usability study of the system through interviewing NPP operators after they had completed a short training course on the PLASMA system and used it during a validation and training session in the training simulator at Paks. This report describes the basic process used in preparations and execution of the usability studies, including methods for gathering information and analysis of the findings from the validation. As a general conclusion from the usability studies it can be stated that the PLASMA system received very favourable ratings from the operators. User satisfaction was generally rated highly and comments from operators were positive. This is particularly encouraging considering the relatively short introduction and experience that the operators had with the system at the time of the-evaluation. (Author)

DEVELOPING AND VALIDATION A USABILITY EVALUATION TOOLS FOR DISTANCE EDUCATION WEBSITES: Persian Version

Directory of Open Access Journals (Sweden)

Soheila HAFEZI

2010-07-01

Full Text Available The web is playing a central role in distance education. The word “usability” is usually synonymous with functionality of the system for the user. Also, usability of a website is defined as something that can be used by a specific group of people to carry out specific objectives in an effective way, with efficiency and satisfaction. There are some useful usability evaluation instruments of websites in other languages. The aim of this study was to develop a Persian instrument to evaluate usability in distance education websites. This study was a methodology research design. According to review literature, the main structure of evaluation instrument for usability designed. It was consisted of forty-eight items divided in 8 domains. Each domain was composed of closed multiple choice questions in which an ordinal scale with three values is used (always, sometimes and never that measures the opinion of the evaluator about the frequency of visiting each item selected in the website. After that, we used face validity method. It refers to what instrument appears superficially to measure. At the final step, we omputed a formal content validity index (CVI across the experts’ ratings of each item’s relevance. The content validity index was measured by set of ten experts, who evaluated each item individually. According to CVI, the final version of instrument was composed of 40 questions divided into 8 domains: Navigation, Functionality, Feedback, Control, Language, Consistency, Error prevention and correction, and Visual clarity.CVI score for each phrase was more than 0.75. According to our findings, this instrument has enough validity to apply in evaluation usability of educational websites of Persian distance education websites. However, instrument reliability can be measured in further study.

Usability evaluation of user interface of thesis title review system

Science.gov (United States)

Tri, Y.; Erna, A.; Gellysa, U.

2018-03-01

Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

Web-Based Intervention for Nutritional Management in Cystic Fibrosis: Development, Usability, and Pilot Trial.

Science.gov (United States)

Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W

2016-06-01

Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Web-Based Cognitive Behavioral Relapse Prevention Program With Tailored Feedback for People With Methamphetamine and Other Drug Use Problems: Development and Usability Study.

Science.gov (United States)

Takano, Ayumi; Miyamoto, Yuki; Kawakami, Norito; Matsumoto, Toshihiko

2016-01-06

Although drug abuse has been a serious public health concern, there have been problems with implementation of treatment for drug users in Japan because of poor accessibility to treatment, concerns about stigma and confidentiality, and costs. Therapeutic interventions using the Internet and computer technologies could improve this situation and provide more feasible and acceptable approaches. The objective of the study was to show how we developed a pilot version of a new Web-based cognitive behavioral relapse prevention program with tailored feedback to assist people with drug problems and assessed its acceptance and usability. We developed the pilot program based on existing face-to-face relapse prevention approaches using an open source Web application to build an e-learning website, including relapse prevention sessions with videos, exercises, a diary function, and self-monitoring. When users submitted exercise answers and their diary, researchers provided them with personalized feedback comments using motivational interviewing skills. People diagnosed with drug dependence were recruited in this pilot study from a psychiatric outpatient ward and nonprofit rehabilitation facilities and usability was evaluated using Internet questionnaires. Overall, website usability was assessed by the Web Usability Scale. The adequacy of procedures in the program, ease of use, helpfulness of content, and adverse effects, for example, drug craving, mental distress, were assessed by original structured questionnaires and descriptive form questions. In total, 10 people participated in the study and completed the baseline assessment, 60% completed all relapse prevention sessions within the expected period. The time needed to complete one session was about 60 minutes and most of the participants took 2 days to complete the session. Overall website usability was good, with reasonable scores on subscales of the Web Usability Scale. The participants felt that the relapse prevention

Usability Testing For Android Based Application “Jogja Smart Tourism”

Science.gov (United States)

Harwati; Djati Widodo, Imam

2017-06-01

The android based application “Jogja Smart Tourism (JST)” is designed to help everyone who visited Yogyakarta to enjoy their travel. As new application, it is need to be tested for its usability before launched. Usability testing will show how easy user interfaces are to used. The objective of this research is to demonstrate the result of usability testing for application JST based on five characteristics: learnability, effectiveness, memorability, errors, and satisfaction. About 30 respondents were involved to test the usability of this application. Learnability and effectiveness is calculated from some task that should be finished by respondents, and the rest aspects are calculated from questionnaires that should be answered after simulation. There are 14 functions bound in this usability testing. The result shows total usability level is in 81.75%. Learnability testing shows that 98.8% of respondent could finish the task successfully with 87.5% in efficiency. The memorability level of respondents is good (84.5%) where their ability to fix the errors is 71.5%. And the last for satisfaction level of application interface is 66.25%. Low level of satisfaction occurred because most of respondent felt uncomfortable with landscape interface of application because they should turn their mobile phone while using JST application and also it happened because the lack of using picture and colour inside the application. Both of these becomes important note for the improvement of further applications where the interface in a portrait version is more comfort the use and also utilization of colour and the image will be the main focus to improve customer satisfaction.

Usability evaluation of low-cost virtual reality hand and arm rehabilitation games.

Science.gov (United States)

Seo, Na Jin; Arun Kumar, Jayashree; Hur, Pilwon; Crocher, Vincent; Motawar, Binal; Lakshminarayanan, Kishor

2016-01-01

The emergence of lower-cost motion tracking devices enables home-based virtual reality rehabilitation activities and increased accessibility to patients. Currently, little documentation on patients' expectations for virtual reality rehabilitation is available. This study surveyed 10 people with stroke for their expectations of virtual reality rehabilitation games. This study also evaluated the usability of three lower-cost virtual reality rehabilitation games using a survey and House of Quality analysis. The games (kitchen, archery, and puzzle) were developed in the laboratory to encourage coordinated finger and arm movements. Lower-cost motion tracking devices, the P5 Glove and Microsoft Kinect, were used to record the movements. People with stroke were found to desire motivating and easy-to-use games with clinical insights and encouragement from therapists. The House of Quality analysis revealed that the games should be improved by obtaining evidence for clinical effectiveness, including clinical feedback regarding improving functional abilities, adapting the games to the user's changing functional ability, and improving usability of the motion-tracking devices. This study reports the expectations of people with stroke for rehabilitation games and usability analysis that can help guide development of future games.

Identifying Usability and Productivity Dimensions for Measuring the Success of Mobile Business Services

Directory of Open Access Journals (Sweden)

Maiju Vuolle

2008-01-01

Full Text Available This paper reviews existing measures used for evaluating the usability of information systems and those used for evaluating the level of the productivity of a company. We discuss the usefulness of the existing measures in the mobile business context, where both mobility and work-context pose specific demands for the mobile business services. The review showed that the existing measures rarely consider the great contextual variation caused by the mobility of the services and the demands this poses on usability; which, in turn, affects productivity. To build a measurement tool that better meets the requirements of mobile business services, we completed case studies on two mobile business services, one used in passenger transport and the other in construction sites. Based on the understanding gained from the case studies, we propose a list of dimensions and items addressing both usability and productivity aspects that work as the basis for a multidisciplinary measurement tool.

Usability of consumer-related information sources for design improvement

NARCIS (Netherlands)

Thiruvenkadam, G.; Brombacher, A.C.; Lu, Y.; Ouden, den P.H.

2008-01-01

In this paper we report the findings of a study intended to assess the usability of consumer related information sources in order to improve the design processes of innovative electronic products. Specifically, an evaluation is done of the quality and content of information that would help product

Usability of Commercially Available Mobile Applications for Diverse Patients.

Science.gov (United States)

Sarkar, Urmimala; Gourley, Gato I; Lyles, Courtney R; Tieu, Lina; Clarity, Cassidy; Newmark, Lisa; Singh, Karandeep; Bates, David W

2016-12-01

Mobile applications or 'apps' intended to help people manage their health and chronic conditions are widespread and gaining in popularity. However, little is known about their acceptability and usability for low-income, racially/ethnically diverse populations who experience a disproportionate burden of chronic disease and its complications. The objective of this study was to investigate the usability of existing mobile health applications ("apps") for diabetes, depression, and caregiving, in order to facilitate development and tailoring of patient-facing apps for diverse populations. Usability testing, a mixed-methods approach that includes interviewing and direct observation of participant technology use, was conducted with participants (n = 9 caregivers; n = 10 patients with depression; and n = 10 patients with diabetes) on a total of 11 of the most popular health apps (four diabetes apps, four depression apps, and three caregiver apps) on both iPad and Android tablets. The participants were diverse: 15 (58 %) African Americans, seven (27 %) Whites, two (8 %) Asians, two (8 %) Latinos with either diabetes, depression, or who were caregivers. Participants were given condition-specific tasks, such as entering a blood glucose value into a diabetes app. Participant interviews were video recorded and were coded using standard methods to evaluate attempts and completions of tasks. We performed inductive coding of participant comments to identify emergent themes. Participants completed 79 of 185 (43 %) tasks across 11 apps without assistance. Three themes emerged from participant comments: lack of confidence with technology, frustration with design features and navigation, and interest in having technology to support their self-management. App developers should employ participatory design strategies in order to have an impact on chronic conditions such as diabetes and depression that disproportionately affect vulnerable populations. While patients

Robot services for elderly with cognitive impairment: testing usability of graphical user interfaces.

Science.gov (United States)

Granata, C; Pino, M; Legouverneur, G; Vidal, J-S; Bidaud, P; Rigaud, A-S

2013-01-01

Socially assistive robotics for elderly care is a growing field. However, although robotics has the potential to support elderly in daily tasks by offering specific services, the development of usable interfaces is still a challenge. Since several factors such as age or disease-related changes in perceptual or cognitive abilities and familiarity with computer technologies influence technology use they must be considered when designing interfaces for these users. This paper presents findings from usability testing of two different services provided by a social assistive robot intended for elderly with cognitive impairment: a grocery shopping list and an agenda application. The main goal of this study is to identify the usability problems of the robot interface for target end-users as well as to isolate the human factors that affect the use of the technology by elderly. Socio-demographic characteristics and computer experience were examined as factors that could have an influence on task performance. A group of 11 elderly persons with Mild Cognitive Impairment and a group of 11 cognitively healthy elderly individuals took part in this study. Performance measures (task completion time and number of errors) were collected. Cognitive profile, age and computer experience were found to impact task performance. Participants with cognitive impairment achieved the tasks committing more errors than cognitively healthy elderly. Instead younger participants and those with previous computer experience were faster at completing the tasks confirming previous findings in the literature. The overall results suggested that interfaces and contents of the services assessed were usable by older adults with cognitive impairment. However, some usability problems were identified and should be addressed to better meet the needs and capacities of target end-users.

Usability analysis of indoor map application in a shopping centre

Science.gov (United States)

Dewi, R. S.; Hadi, R. K.

2018-04-01

Although indoor navigation is still new in Indonesia, its future development is very promising. Similar to the outdoor one, the indoor navigation technology provides several important functions to support route and landmark findings. Furthermore, there is also a need that indoor navigation can support the public safety especially during disaster evacuation process in a building. It is a common that the indoor navigation technologies are built as applications where users can access this technology using their smartphones, tablets, or personal computers. Therefore, a usability analysis is important to ensure the indoor navigation applications can be operated by users with highest functionality. Among several indoor map applications which were available in the market, this study chose to analyse indoor Google Maps due to its availability and popularity in Indonesia. The experiments to test indoor Google Maps was conducted in one of the biggest shopping centre building in Surabaya, Indonesia. The usability was measured by employing System Usability Scale (SUS) questionnaire. The result showed that the SUS score of indoor Google Maps was below the average score of other cellular applications to indicate the users still had high difficulty in operating and learning the features of indoor Google Maps.

New Options for Usability Testing Projects in Business Communication Courses

Science.gov (United States)

Jameson, Daphne A.

2013-01-01

The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…

Earning the Stamp of Approval: How To Achieve Optimal Usability.

Science.gov (United States)

Makar, Susan

2003-01-01

Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)

Measurement properties and usability of non-contact scanners for measuring transtibial residual limb volume.

Science.gov (United States)

Kofman, Rianne; Beekman, Anna M; Emmelot, Cornelis H; Geertzen, Jan H B; Dijkstra, Pieter U

2018-06-01

Non-contact scanners may have potential for measurement of residual limb volume. Different non-contact scanners have been introduced during the last decades. Reliability and usability (practicality and user friendliness) should be assessed before introducing these systems in clinical practice. The aim of this study was to analyze the measurement properties and usability of four non-contact scanners (TT Design, Omega Scanner, BioSculptor Bioscanner, and Rodin4D Scanner). Quasi experimental. Nine (geometric and residual limb) models were measured on two occasions, each consisting of two sessions, thus in total 4 sessions. In each session, four observers used the four systems for volume measurement. Mean for each model, repeatability coefficients for each system, variance components, and their two-way interactions of measurement conditions were calculated. User satisfaction was evaluated with the Post-Study System Usability Questionnaire. Systematic differences between the systems were found in volume measurements. Most of the variances were explained by the model (97%), while error variance was 3%. Measurement system and the interaction between system and model explained 44% of the error variance. Repeatability coefficient of the systems ranged from 0.101 (Omega Scanner) to 0.131 L (Rodin4D). Differences in Post-Study System Usability Questionnaire scores between the systems were small and not significant. The systems were reliable in determining residual limb volume. Measurement systems and the interaction between system and residual limb model explained most of the error variances. The differences in repeatability coefficient and usability between the four CAD/CAM systems were small. Clinical relevance If accurate measurements of residual limb volume are required (in case of research), modern non-contact scanners should be taken in consideration nowadays.

Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development

DEFF Research Database (Denmark)

Stage, Jan; Høegh, Rune Thaarup; Hornbæk, K.

2007-01-01

t is often argued that usability problems should be identified as early as possible during software development, but many usability evaluation methods do not fit well in early development activities. We propose a method for usability evaluation of use cases, a widely used representation of design...... ideas produced early in software development processes. The method proceeds by systematic inspection of use cases with reference to a set of guidelines for usable design. To validate the method, four evaluators inspected a set of use cases for a health care application....

Reducing and Sustaining Duplicate Medical Record Creation by Usability Testing and System Redesign.

Science.gov (United States)

Khunlertkit, Adjhaporn; Dorissaint, Leonard; Chen, Allen; Paine, Lori; Pronovost, Peter J

2017-10-25

Duplicate medical record creation is a common and consequential health care systems error often caused by poor search system usability and inappropriate user training. We conducted two phases of scenario-based usability testing with patient registrars working in areas at risk of generating duplicate medical records. Phase 1 evaluated the existing search system, which led to system redesigns. Phase 2 tested the redesigned system to mitigate potential errors before health system-wide implementation. To evaluate system effectiveness, we compared the monthly potential duplicate medical record rates for preimplementation and postimplementation months. The existing system could not effectively handle a misspelling, which led to failed search and duplicate medical record creation. Using the existing system, 96% of registrars found commonly spelled patient names whereas only 69% successfully found complicated names. Registrars lacked knowledge and usage of a phonetic matching function to assist in misspelling. The new system consistently captured the correct patient regardless of misspelling, but search returned more potential matches, resulting in, on average, 4 seconds longer to select common names. Potential monthly duplicate medical record rate reduced by 38%, from 4% to 2.3% after implementation of the new system, and has sustained at an average of 2.5% for 2 years. Usability testing was an effective method to reveal problems and aid system redesign to deliver a more user friendly system, hence reducing the potential for medical record duplication. Greater standards for usability would ensure that these improvements can be realized before rather than after exposing patients to risks.

Performance and Usability of Various Robotic Arm Control Modes from Human Force Signals

Directory of Open Access Journals (Sweden)

Sébastien Mick

2017-10-01

Full Text Available Elaborating an efficient and usable mapping between input commands and output movements is still a key challenge for the design of robotic arm prostheses. In order to address this issue, we present and compare three different control modes, by assessing them in terms of performance as well as general usability. Using an isometric force transducer as the command device, these modes convert the force input signal into either a position or a velocity vector, whose magnitude is linearly or quadratically related to force input magnitude. With the robotic arm from the open source 3D-printed Poppy Humanoid platform simulating a mobile prosthesis, an experiment was carried out with eighteen able-bodied subjects performing a 3-D target-reaching task using each of the three modes. The subjects were given questionnaires to evaluate the quality of their experience with each mode, providing an assessment of their global usability in the context of the task. According to performance metrics and questionnaire results, velocity control modes were found to perform better than position control mode in terms of accuracy and quality of control as well as user satisfaction and comfort. Subjects also seemed to favor quadratic velocity control over linear (proportional velocity control, even if these two modes did not clearly distinguish from one another when it comes to performance and usability assessment. These results highlight the need to take into account user experience as one of the key criteria for the design of control modes intended to operate limb prostheses.

Usability testing of a monitoring and feedback tool to stimulate physical activity

Directory of Open Access Journals (Sweden)

van der Weegen S

2014-03-01

Full Text Available Sanne van der Weegen,1 Renée Verwey,1,2 Huibert J Tange,3 Marieke D Spreeuwenberg,1 Luc P de Witte1,2 1Department of Health Services Research, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands; 2Research Centre Technology in Care, Zuyd University of Applied Sciences, Heerlen, the Netherlands; 3Department of General Practice, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands Introduction: A monitoring and feedback tool to stimulate physical activity, consisting of an activity sensor, smartphone application (app, and website for patients and their practice nurses, has been developed: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40–70 years, to improve the user interfaces and content of the tool. Patients and methods: The study had four phases: 1 a heuristic evaluation with six technology experts; 2 a usability test in a laboratory by five patients; 3 a pilot in real life wherein 20 patients used the tool for 3 months; and 4 a final lab test by five patients. In both lab tests (phases 2 and 4 qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ was completed for the app and the website. In the pilot test (phase 3, all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI was completed. Results: After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server

A Novel Multifactor Authentication System Ensuring Usability and Security

OpenAIRE

Mathew, Gloriya; Thomas, Shiney

2013-01-01

User authentication is one of the most important part of information security. Computer security most commonly depends on passwords to authenticate human users. Password authentication systems will be either been usable but not secure, or secure but not usable. While there are different types of authentication systems available alphanumeric password is the most commonly used authentication mechanism. But this method has significant drawbacks. An alternative solution to the text based authenti...

Are Language Learning Websites Special? Towards a Research Agenda for Discipline-Specific Usability

Science.gov (United States)

Shield, Lesley; Kukulska-Hulme, Agnes

2006-01-01

With the intention of defining an initial research agenda for discipline-specific factors in the usability of e-learning websites, this article focuses on the example of foreign language learning. First, general notions and concepts of usability are analyzed, and the term "pedagogical usability" is proposed as a means of focusing on the close…

Improving Usability of Passphrase Authentication

DEFF Research Database (Denmark)

Nielsen, Glen; Vedel, Michael; Jensen, Christian D.

2014-01-01

. This is done to ensure an appropriate degree of security, but instead, it makes it difficult for users to remember their password, which results in passwords that are either insecure, but easy to remember, or written down on paper. In this paper we address the problem of usability in user authentication...

Harnessing scientific literature reports for pharmacovigilance. Prototype software analytical tool development and usability testing.

Science.gov (United States)

Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier

2017-03-22

We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.

Usability testing of indonesia tourism promotion website

Science.gov (United States)

Yunus, U.; Anindito; Tanuar, E.; Maryani

2018-03-01

Indonesian tourism has been viewed as one of the source of foreign exchange, therefore visit Indonesia campaign through Wonderful Indonesia should be given attention. This research aims to test the usability of web http://www.indonesia.travel/en, at the end can give input to the Tourism Ministry of the Republic of Indonesia. The concept used based on usabilitygeek.com which mentions the three main categories for usability testing, i. e. explorative, assessment and comparative with the users are three classes of Communication Department students of Bina Nusantara University with a total of 120 students, however finally only 22 students were elected because of the criteria are the students should be like travelling and access to the tourism website more than 12 times. The methodology used is qualitative descriptive and experiments, with data collection techniques through observation and interviews after participants’ access to the web: Due to their one-on-one nature, interviews enable the observer to ask direct questions to the user and the participants posted their opinion in online discussion forum. The results mentioned that the elements web of Wonderful Indonesia has a high learning ability and memorability but less efficiency and satisfaction, as well as several times errors when used. In conclusion, to maximize about the visit of tourism to Indonesia, this web is only able to learn and impress the visitor, but do not give satisfaction to users.

Usability testing of ANSWER: a web-based methotrexate decision aid for patients with rheumatoid arthritis.

Science.gov (United States)

Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L

2013-12-01

Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the

Usability: managing facilities for social outcomes

DEFF Research Database (Denmark)

Alexander, Keith; Blakstad, Siri; Hansen, Geir

2013-01-01

The paper argues for the development of usability concepts, methodologies and tools, in considering the effects of the built environment from a user, organisational and community perspective, in order to have a positive influence on social outcomes. Since it was formed over ten years ago, the CIB W......111 on Usability has been exploring concepts, methods and tools, developed in the evaluation of all kinds of consumer products, applied to the built environment. In the most recent phase of this work, conducted over the past three years, an international network of partners has collaborated to focus...... properties of a workplace, they could better manage and design the facilities for improved social outcomes. Interpretation and analysis of the built environment (and support services) based on how it is socially constructed will enable integration of organisational use and the facilities provided to arrive...

Usability laboratories at Philips : supporting research, development, and design for consumer and professional products

NARCIS (Netherlands)

Vries, de G.; Gelderen, van T.; Brigham, F.

1994-01-01

This paper describes two of the usability laboratories at Philips, discusses practical issues arising from our experience using the facilities, gives an example of a typical usability evaluation, and briefly outlines our vision for the future of the laboratories. Usability tests at Philips can

Low-Cost Rapid Usability Testing: Its Application in Both Product Development and System Implementation.

Science.gov (United States)

Kushniruk, Andre; Borycki, Elizabeth

2017-01-01

In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.

The McMaster Optimal Aging Portal: Usability Evaluation of a Unique Evidence-Based Health Information Website

Science.gov (United States)

Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder

2016-01-01

Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be

The value of usability testing for Internet-based adolescent self-management interventions: "Managing Hemophilia Online".

Science.gov (United States)

Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N

2013-10-04

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.

Evidence-based Heuristics for Evaluating Demands on eHealth Literacy and Usability in a Mobile Consumer Health Application.

Science.gov (United States)

Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W

2015-01-01

Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.

A New Electronic Monitoring Device to Measure Medication Adherence: Usability of the Helping Hand™

Directory of Open Access Journals (Sweden)

Sabina De Geest

2010-03-01

Full Text Available The aim of this study was to test the user performance, satisfaction and acceptability of the Helping Hand™ (B&O Medicom electronic medication adherence monitor. Using a mixed-method design, we studied 11 kidney transplant patients and 10 healthy volunteers during three weeks. Although testing showed positive usability aspects, several areas requiring technical improvement were identified: the most important obstacles to usability and acceptability were the weak sound signal, problems loading the medication, and the fact that only one medication could be used at a time.