Romano, C.; Gay, P.; Owens, R.; Burlea, G.
Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.
Rocchio, L. E.; Davis, A. L.
Science has long served humankind. Breakthroughs in medicine have increased longevity and advances in technology have made modern-day conveniences possible. Yet, social benefits begotten by the environmental sciences, although critical for the survival of humanity, have not always been as widely recognized or used. To benefit today's rapidly growing population, the divides between environmental research, applied environmental science, and use of this information by decision makers must be bridged. Lessons about the translation from research to usable science can be learned from the four decades of Landsat history, and these lessons can serve as useful models for bridging the gaps between new technology, scientific research, and the use of that research and technology in real-world problem solving. In 1965, William Pecora, then-director of the U.S. Geological Survey, proposed the idea of a remote sensing satellite program to gather facts about natural resources of Earth. For the next seven years, an intense campaign showing the depth and diversity of satellite imagery applications was waged. This led to the 1972 launch of the first civilian land-observing satellite, Landsat 1. By 1975, successful application research based on Landsat 1 imagery prompted then-NASA Administrator Dr. James Fletcher to proclaim that if one space age development would save the world, it would be Landsat and its successor satellites. Thirty-four years of continual Landsat imaging and related-research has lead to the implementation of many socially beneficial applications, such as improved water management techniques, crop insurance fraud reduction, illicit crop inventories, natural disaster relief planning, continent-scale carbon estimates, and extensive cartographic advances. Despite these successes, the challenge of translating Landsat research into realized social benefits remains. Even in this geospatially-savvy era, the utility of Landsat largely escapes policymakers. Here, in an
Beach, A. L., III; Northup, E. A.; Early, A. B.; Chen, G.
Airborne field studies are an effective way to gain a detailed understanding of atmospheric processes for scientific research on climate change and air quality relevant issues. One major function of airborne project data management is to maintain seamless data access within the science team. This allows individual instrument principal investigators (PIs) to process and validate their own data, which requires analysis of data sets from other PIs (or instruments). The project's web platform streamlines data ingest, distribution processes, and data format validation. In May 2016, the NASA Langley Research Center (LaRC) Atmospheric Science Data Center (ASDC) developed a new data management capability to help support the Korea U.S.-Air Quality (KORUS-AQ) science team. This effort is aimed at providing direct NASA Distributed Active Archive Center (DAAC) support to an airborne field study. Working closely with the science team, the ASDC developed a scalable architecture that allows investigators to easily upload and distribute their data and documentation within a secure collaborative environment. The user interface leverages modern design elements to intuitively guide the PI through each step of the data management process. In addition, the new framework creates an abstraction layer between how the data files are stored and how the data itself is organized(i.e. grouping files by PI). This approach makes it easy for PIs to simply transfer their data to one directory, while the system itself can automatically group/sort data as needed. Moreover, the platform is "server agnostic" to a certain degree, making deployment and customization more straightforward as hardware needs change. This flexible design will improve development efficiency and can be leveraged for future field campaigns. This presentation will examine the KORUS-AQ data portal as a scalable solution that applies consistent and intuitive usability design practices to support ingest and management of airborne
Spielberg, Freya; Kurth, Ann E; Severynen, Anneleen; Hsieh, Yu-Hsiang; Moring-Parris, Daniel; Mackenzie, Sara; Rothman, Richard
Providers in emergency care settings (ECSs) often face barriers to expanded HIV testing. We undertook formative research to understand the potential utility of a computer tool, "CARE," to facilitate rapid HIV testing in ECSs. Computer tool usability and acceptability were assessed among 35 adult patients, and provider focus groups were held, in two ECSs in Washington State and Maryland. The computer tool was usable by patients of varying computer literacy. Patients appreciated the tool's privacy and lack of judgment and their ability to reflect on HIV risks and create risk reduction plans. Staff voiced concerns regarding ECS-based HIV testing generally, including resources for follow-up of newly diagnosed people. Computer-delivered HIV testing support was acceptable and usable among low-literacy populations in two ECSs. Such tools may help circumvent some practical barriers associated with routine HIV testing in busy settings though linkages to care will still be needed.
Oakley, N.; Daudert, B.
Accessing scientific data through an online portal can be a frustrating task. The concept of making web interfaces easy to use known as "usability" has been thoroughly researched in the field of e-commerce but has not been explicitly addressed in the atmospheric sciences. As more observation stations are installed, satellite missions flown, models run, and field campaigns performed, large amounts of data are produced. Portals on the Internet have become the favored mechanisms to share this information and are ever increasing in number. Portals are often created without being tested for usability with the target audience though the expenses of testing are low and the returns high. To remain competitive and relevant in the provision of atmospheric data, it is imperative that developers understand design elements of a successful portal to make their product stand out among others. This presentation informs the audience of the benefits and basic principles of usability for web pages presenting atmospheric data. We will also share some of the best practices and recommendations we have formulated from the results of usability testing performed on two data provision web sites hosted by the Western Regional Climate Center.
Denton, Andrea H; Moody, David A; Bennett, Jason C
User testing, a method of assessing website usability, can be a cost-effective and easily administered process to collect information about a website's effectiveness. A user experience (UX) team at an academic health sciences library has employed user testing for over three years to help refine the library's home page. Test methodology used in-person testers using the "think aloud" method to complete tasks on the home page. Review of test results revealed problem areas of the design and redesign; further testing was effective in refining the page. User testing has proved to be a valuable method to engage users and provide feedback to continually improve the library's home page.
Rosati, A.; Yarmey, L.
It is well understood that a good data scientist needs domain science, analysis, programming, and communication skills to create finished data products, visualizations, and reports. Articles and blogs tout the need for "expert" skill levels in domain knowledge, statistics, storytelling, graphic design, technology…and the list goes on. Since it seems impossible that one person would encompass all these skills, it is often suggested that data science be done by a team instead of an individual. This research into, and experience with, data product design offers an augmented definition - one that elevates relationships and engagement with the final user of a product. Essentially, no matter how fantastic or technically advanced a product appears, the intended audience of that product must be able to understand, use, and find value in the product in order for it to be considered a success. Usability is often misunderstood and seen as common sense or common knowledge, but it is actually an important and challenging piece of product development. This paper describes the National Snow and Ice Data Center's process to usability test the Arctic Data Explorer (ADE). The ADE is a federated data search tool for interdisciplinary Arctic science data that has been improved in features, appearance, functionality, and quality through a series of strategic and targeted usability testing and assessments. Based on the results, it is recommended that usability testing be incorporated into the skill set of each data science team.
Full Text Available Usability, most often defined as the ease of use and acceptability of a system, affects the users' performance and their job satisfaction when working with a machine. Therefore, usability is a very important aspect which must be considered in the process of a system development. The paper presents several numerical data related to the history of the scientific research of the usability of information systems, as it is viewed in the information provided by three important scientific databases, Science Direct, ACM Digital Library and IEEE Xplore Digital Library, at different queries related to this field.
unless confronted with alternative images. This study delineates six images of usability: universal usability, situational usability, perceived usability, hedonic usability, organizational usability, and cultural usability. The different foci of the images provide opportunities for becoming sensitized...... assume different images of usability and a need for supplementary methods addressing the collaborative and long-term aspects of usability. Moreover, the images call for extending the scope of practical usability work to include the effects achieved by users during their use of systems for real work....
Bachelet, D. M.; Gough, M.; Baker, B.; Sheehan, T.; Mutch, T.; Brown, M.
Conservation Biology Institute (CBI) has been developing web applications to serve credible and usable information that allows land stewards, as well as the general public, to better understand the challenges posed by on-going environmental change. Working with 18 Landscape Conservation Cooperatives (LCCs), CBI has developed Conservation Atlases that allow users to visualize regional spatial data. Some include specific tools such as the Conservation Blueprint in the South Atlantic LCC conservation atlas which is a living spatial plan that identifies priority areas for shared conservation action based on ecosystem indicator condition and connectivity. More than 400 people from over 100 different organizations have actively participated in its development so far. CBI worked closely with 4 LCCs to design a Landscape Climate Dashboard (http://bit.ly/2atu8Df) that provides CMIP5 climate projections averaged over federally and tribally protected lands in the western US. With support from BLM and Great Basin LCC, a Sagebrush Climate Console provides managers short-term NOAA forecasts, CMIP5 climate projections, regional intactness and site sensitivity over sagebrush extent and grouse range. The USDA Pacific Northwest Climate Hub and the US Forest Service are currently funding a collaborative effort between CBI programmers, USFS and Oregon State University forest geneticists to develop a seedlot source tool for the conterminous US and Alaska. This tool has inspired Great Basin sagebrush restoration scientists who have collected information on seed provenance and will hopefully soon collaborate to help develop the first seed source tool for sagebrush managers. Furthermore, with support from USDA Northwest Climate Hub, CBI's Data Basin site (http://bit.ly/2aLRlhZ) is providing downscaled CMIP5 climate projections and impacts from a Climate Science Center and NOAA Regional Integrated Science Assessment funded project that was the result of a collaborative effort between
The concept of usability has become an increasingly important consideration in the design of all kinds of technology. As more products are aimed at global markets and developed through internationally distributed teams, usability design needs to be addressed in global terms. Interest in usability as a design issue and specialist area of research and education has developed steadily in North America and Europe since the 1980's. However, it is only over the last ten years that it has emerged as a global concern. Global Usability provides an introduction to the important issues in globalizing des
Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J
A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC
Morgan, Eric Lease
Suggests that one of the best ways to get word-of-mouth marketing of library technology is to provide "usable" products and services. Provides an international standards definition on usability and notes that understanding usability combines an understanding of user needs/wants with an understanding of goals, functions, and limitations…
Chang, M.; Ignizio, D.; Langseth, M. L.; Norkin, T.
In 2013, the White House released initiatives requiring federally funded research to be made publicly available and machine readable. In response, the U.S. Geological Survey (USGS) has been developing a unified approach to make USGS data available and open. This effort has involved the establishment of internal policies and the release of a Public Access Plan, which outlines a strategy for the USGS to move forward into the modern era in scientific data management. Originally designed as a catalog and collaborative data management platform, ScienceBase (www.sciencebase.gov) is being leveraged to serve as a robust data hosting solution for USGS researchers to make scientific data accessible. With the goal of maintaining persistent access to formal data products and developing a management approach to facilitate stable data citation, the ScienceBase Data Release Team was established to ensure the quality, consistency, and meaningful organization of USGS data through standardized workflows and best practices. These practices include the creation and maintenance of persistent identifiers for data, improving the use of open data formats, establishing permissions for read/write access, validating the quality of standards compliant metadata, verifying that data have been reviewed and approved prior to release, and connecting to external search catalogs such as the USGS Science Data Catalog (data.usgs.gov) and data.gov. The ScienceBase team is actively building features to support this effort by automating steps to streamline the process, building metrics to track site visits and downloads, and connecting published digital resources in line with USGS and Federal policy. By utilizing ScienceBase to achieve stewardship quality and employing a dedicated team to help USGS scientists improve the quality of their data, the USGS is helping to meet today's data quality management challenges and ensure that reliable USGS data are available to and reusable for the public.
Yiou, P.; Vautard, R.
Most socio-economic regulations related to the resilience to climate extremes, from infrastructure or network design to insurance premiums, are based on a present-day climate with an assumption of stationarity. Climate extremes (heat waves, cold spells, droughts, storms and wind stilling) affect in particular energy production, supply, demand and security in several ways. While national, European or international projects have generated vast amounts of climate projections for the 21st century, their practical use in long-term planning remains limited. Estimating probabilistic diagnostics of energy user relevant variables from those multi-model projections will help the energy sector to elaborate medium to long-term plans, and will allow the assessment of climate risks associated to those plans. The project "Extreme Events for Energy Providers" (E3P) aims at filling a gap between climate science and its practical use in the energy sector and creating in turn favourable conditions for new business opportunities. The value chain ranges from addressing research questions directly related to energy-significant climate extremes to providing innovative tools of information and decision making (including methodologies, best practices and software) and climate science training for the energy sector, with a focus on extreme events. Those tools will integrate the scientific knowledge that is developed by scientific communities, and translate it into a usable probabilistic framework. The project will deliver projection tools assessing the probabilities of future energy-relevant climate extremes at a range of spatial scales varying from pan-European to local scales. The E3P project is funded by the Knowledge and Innovation Community (KIC Climate). We will present the mechanisms of interactions between academic partners, SMEs and industrial partners for this project. Those mechanisms are elementary bricks of a climate service.
Hudson, J; Nguku, S M; Sleiman, J; Karlen, W; Dumont, G A; Petersen, C L; Warriner, C B; Ansermino, J M
To increase the use of pulse oximetry by capitalise on the wide availability of mobile phones, we have designed, developed and evaluated a prototype pulse oximeter interfaced to a mobile phone. Usability of this Phone Oximeter was tested as part of a rapid prototyping process. Phase 1 of the study (20 subjects) was performed in Canada. Users performed 23 tasks, while thinking aloud. Time for completion of tasks and analysis of user response to a mobile phone usability questionnaire were used to evaluate usability. Five interface improvements were made to the prototype before evaluation in Phase 2 (15 subjects) in Uganda. The lack of previous pulse oximetry experience and mobile phone use increased median (IQR [range]) time taken to perform tasks from 219 (160-247 [118-274]) s in Phase 1 to 228 (151-501 [111-2661]) s in Phase 2. User feedback was positive and overall usability high (Phase 1--82%, Phase 2--78%). Anaesthesia © 2012 The Association of Anaesthetists of Great Britain and Ireland.
Hertzum, Morten; Clemmesen, Torkil; Hornbæk, Kasper Anders Søren
Whereas research on usability predominantly employs universal definitions of the aspects that comprise usability, people experience their use of information systems through personal constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected...... use of constructs traditionally associated with usability (e.g., easy-to-use, intuitive, and liked). Further analysis of the data is ongoing...
Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K
To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.
Hall, Valerie; Conboy-Hill, Suzanne; Taylor, Dave
People with intellectual disabilities have poor access to health care, which may be further compromised by a lack of accessible health information. To be effective, health information must be easily understood and remembered. People with intellectual disabilities learn better from multimodal information sources, and virtual reality offers a 3-dimensional (3D) computer-generated environment that can be used for providing information and learning. To date, research into virtual reality experiences for people with intellectual disabilities has been limited to skill-based training and leisure opportunities within the young to mid age ranges. This study assessed the acceptability, usability, and potential utility of a virtual reality experience as a means of providing health care-related information to people with intellectual disabilities. We designed a prototype multimodal experience based on a hospital scenario and situated on an island in the Second Life 3D virtual world. We wanted to know how people of different ages and with varying levels of cognitive function would participate in the customized virtual environment, what they understood from being there, and what they remembered a week later. The study drew on qualitative data. We used a participatory research approach that involved working alongside people with intellectual disabilities and their supporters in a community setting. Cognitive function was assessed, using the Matrix Analogies Test and the British Picture Vocabulary Scale, to describe the sample. Participants, supported by facilitators, were video recorded accessing and engaging with the virtual environment. We assessed recall 1 week later, using a specialized interview technique. Data were downloaded into NVivo 8 and analyzed using the framework analysis technique. Study participants were 20 people aged between 20 and 80 years with mild to severe intellectual disabilities. All participants were able to access the environment and voluntarily stayed
Conboy-Hill, Suzanne; Taylor, Dave
Background People with intellectual disabilities have poor access to health care, which may be further compromised by a lack of accessible health information. To be effective, health information must be easily understood and remembered. People with intellectual disabilities learn better from multimodal information sources, and virtual reality offers a 3-dimensional (3D) computer-generated environment that can be used for providing information and learning. To date, research into virtual reality experiences for people with intellectual disabilities has been limited to skill-based training and leisure opportunities within the young to mid age ranges. Objective This study assessed the acceptability, usability, and potential utility of a virtual reality experience as a means of providing health care-related information to people with intellectual disabilities. We designed a prototype multimodal experience based on a hospital scenario and situated on an island in the Second Life 3D virtual world. We wanted to know how people of different ages and with varying levels of cognitive function would participate in the customized virtual environment, what they understood from being there, and what they remembered a week later. Methods The study drew on qualitative data. We used a participatory research approach that involved working alongside people with intellectual disabilities and their supporters in a community setting. Cognitive function was assessed, using the Matrix Analogies Test and the British Picture Vocabulary Scale, to describe the sample. Participants, supported by facilitators, were video recorded accessing and engaging with the virtual environment. We assessed recall 1 week later, using a specialized interview technique. Data were downloaded into NVivo 8 and analyzed using the framework analysis technique. Results Study participants were 20 people aged between 20 and 80 years with mild to severe intellectual disabilities. All participants were able to access
Goldstein, P.; Fornwall, M.
Commercial and industrial information systems have long built and relied upon standard data formats and transactions. Business processes, analytics, applications, and social networks emerge on top of these standards to create value. Examples of value delivered include operational productivity, analytics that enable growth and profit, and enhanced human communication and creativity for innovation. In science informatics, some research and operational activities operate with only scattered adoption of standards and few of the emergent benefits of interoperability. In-situ biological data management in the marine domain is an exemplar. From the origination of biological occurrence records in surveys, observer programs, monitoring and experimentation, through distribution techniques, to applications, decisions, and management response, marine biological data can be difficult, limited, and costly to integrate because of non-standard and undocumented conditions in the data. While this presentation identifies deficits in marine biological data practices, the presentation also identifies this as a field of opportunity. Standards for biological data and metadata do exist, with growing global adoption and extensibility features. Scientific, economic, and social-value motivations provide incentives to maximize marine science investments. Diverse science communities of national and international scale begin to see benefits of collaborative technologies. OBIS-USA (http://USGS.gov/obis-usa) is a program of the United States Geological Survey. This presentation shows how OBIS-USA directly addresses the opportunity to enhance ocean science outcomes through data infrastructure, including: (1) achieving rapid, economical, and high-quality data capture and data flow, (2) offering technology for data storage and methods for data discovery and quality/suitability evaluation, (3) making data understandable and consistent for application purposes, (4) distributing and integrating data in
Culture has already played an important role in the global market. It not only affects products, but also impacts on usability evaluation methods. This project aims to examine in the established thinking aloud usability evaluation method (TA UEM), how does the evaluator build a supportive...
Nørgaard, Mie; Høegh, Rune T.
Usability evaluation is widely accepted as a valuable activity in software development. However, how results effectively are fed back to developers is still a relatively unexplored area. We argue that usability feedback can be understood as an argument for a series of usability problems......, and that basic concepts from argumentation theory can help us understand how to create persuasive feedback. We revisit two field studies on usability feedback to study if concepts from Toulmin's model for argumentation and Aristotle's modes of persuasion can explain why some feedback formats outperform others....... We recommend that evaluators specifically back up the warrants behind their usability claims, that their arguments use several modes of persuasion, and that they present feedback in browsable amounts not to overwhelm developers with information. For complex and controversial problems, we advise...
Bright, Patricia R.; Buxton, Herbert T.; Balistrieri, Laurie S.; Barber, Larry B.; Chapelle, Francis H.; Cross, Paul C.; Krabbenhoft, David P.; Plumlee, Geoffrey S.; Sleeman, Jonathan M.; Tillitt, Donald E.; Toccalino, Patricia L.; Winton, James R.
disasters. * Strategic Science Action 2. - Enhance methods to anticipate, prepare for, and identify environmental, ecological, and related health impacts of future disasters. This strategy is one of seven USGS science strategies developed concurrently: * Climate and Land Use Change * Core Science Systems * Ecosystems * Energy and Mineral Resources * Environmental Health * Natural Hazards * Water. This strategy describes how USGS will address the highest priority environmental health issues facing the Nation. The ultimate intended outcome of this science strategy is prevention and reduction of adverse impacts to the quality of the environment, the health of our living resources, and human health. Communication with, and receiving input from, partners and stakeholders regarding their science needs is essential for successful implementation of this strategy. It is incumbent on USGS to reach out to all stakeholders to ensure that USGS efforts are focused on the highest priority environmental health issues and that products are provided in the most timely and usable form to all those who can use them. USGS must reach out to the scientific community, internally and externally, to ensure that our efforts are integrated with and take full advantage of the activities of others.
Clemmensen, Torkil; Goyal, Shivam
In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user....... This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud...... and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively...
Emily R. Newsom
Full Text Available Abstract As climate-science graduate students at the University of Washington, we had the opportunity to engage in a political process focused on implementing legislation to reduce greenhouse gas emissions in Washington State. Our insights gained from this rare, first-hand, experience may be particularly relevant to other climate scientists. We argue that inflexible research goals within the United States climate-science community limit the relevance of the knowledge our community creates. The mismatch between climate-science research and the information needs of policy makers, while widely acknowledged in certain domains, has yet to be fully appreciated within many earth science disciplines. Broadening the climate-science training of graduate students to include education on the uses of climate information outside of academic settings would both inform and motivate new research directions, and engender validation of non-traditional research within disciplinary cultures.
Devine, Emily Beth; Lee, Chia-Ju; Overby, Casey L; Abernethy, Neil; McCune, Jeannine; Smith, Joe W; Tarczy-Hornoch, Peter
Pharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption. The study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers. Using a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making. Nine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Usability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and
This PhD thesis is a contribution to an ongoing debate in Denmark about improving the building design processes of complex buildings, especially in relation to the current hospital developments. It provides knowledge about capturing user needs and defines the process model for usability briefing...... and evaluations, can be fed into briefing and design processes. This PhD thesis proposes methods for usability briefing.Usability is a concept similar to functionality, but usability depends on: subjective view of users, context, culture, situation and experience. Understanding usability is achieved by involving...... users. This PhD thesis extends the research in usability of buildings to include all building design phases, therefore not only proposes usability evaluations, but also defines usability briefing. Briefing, also called architectural programming, is usually understood as one of the first phases...
Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A
Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.
Teng, William; Rui, Hualan; Strub, Richard; Vollmer, Bruce
A long-standing "Digital Divide" in data representation exists between the preferred way of data access by the hydrology community and the common way of data archival by earth science data centers. Typically, in hydrology, earth surface features are expressed as discrete spatial objects (e.g., watersheds), and time-varying data are contained in associated time series. Data in earth science archives, although stored as discrete values (of satellite swath pixels or geographical grids), represent continuous spatial fields, one file per time step. This Divide has been an obstacle, specifically, between the Consortium of Universities for the Advancement of Hydrologic Science, Inc. and NASA earth science data systems. In essence, the way data are archived is conceptually orthogonal to the desired method of access. Our recent work has shown an optimal method of bridging the Divide, by enabling operational access to long-time series (e.g., 36 years of hourly data) of selected NASA datasets. These time series, which we have termed "data rods," are pre-generated or generated on-the-fly. This optimal solution was arrived at after extensive investigations of various approaches, including one based on "data curtains." The on-the-fly generation of data rods uses "data cubes," NASA Giovanni, and parallel processing. The optimal reorganization of NASA earth science data has significantly enhanced the access to and use of the data for the hydrology user community.
Dee, Cheryl; Allen, Maryellen
Reference interactions with patrons in a digital library environment using digital reference services (DRS) has become widespread. However, such services in many libraries appear to be underutilized. A study surveying the ease and convenience of such services for patrons in over 100 academic health science library Web sites suggests that…
Society is transforming the Earth's system in unprecedented ways, often with significant variations across space and time. In turn, the impacts of climate change on the human system vary dramatically due to differences in cultural, socioeconomic, institutional, and physical processes at the local level. The Climate Science and Applications Program (CSAP) at the National Center for Atmospheric Research in Boulder Colorado addresses societal vulnerability, impacts and adaptation to climate change through the development of frameworks and methods for analyzing current and future vulnerability, and integrated analyses of climate impacts and adaptation at local, regional and global scales. CSAP relies heavily on GIS-based scientific data and knowledge systems to bridge social and physical science approaches in its five focus areas: Governance of inter-linked natural and managed resource systems. The role of urban areas in driving emissions of climate change Weather, climate and global human health, GIS-based science data & knowledge systems. Regional Climate Science and Services for Adaptation Advanced methodologies and frameworks for assessing current and future risks to environmental hazards through the integration of physical and social science models, research results, and remote sensing data are presented in the context of recent national and international projects on climate change and food/water security, urban carbon emissions, metropolitan extreme heat and global health. In addition, innovative CSAP international capacity building programs teaching interdisciplinary approaches for using geospatial technologies to integrate multi-scale spatial information of weather, climate change into important sectors such as disaster reduction, agriculture, tourism and society for decision-making are discussed.
Christensen, Lars; Frøkjær, Erik
We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary......, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server......, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented...
Benski, Anne Caroline; Stancanelli, Giovanna; Scaringella, Stefano; Herinainasolo, Josea Léa; Jinoro, Jéromine; Vassilakos, Pierre; Petignat, Patrick; Schmidt, Nicole C
Background Madagascar's maternal health mortality ratio in 2013 was 478 deaths per 100,000 live births. Most deaths are related to direct complications during pregnancy and childbirth and could be reduced by providing comprehensive antenatal care (ANC). Objective The objective of the study was to assess the usability and feasibility of a mobile health system (mHealth) to provide high-quality ANC, according to World Health Organization (WHO) recommendations. Methods PANDA (Pregnancy And Newborn Diagnostic Assessment) is an easy-to-use mHealth system that uses affordable communications technology to support diagnosis and health care worker decision-making regarding ANC. From January to March 2015, a cross-sectional pilot study was conducted in Ambanja District, Madagascar, in which ANC using PANDA was provided to 100 pregnant women. The collected data were transmitted to a database in the referral hospital to create individual electronic patient records. Accuracy and completeness of the data were closely controlled. The PANDA software was assessed and the number of abnormal results, treatments performed, and participants requiring referral to health care facilities were monitored. Results The PANDA system facilitated creation of individual electronic patient records that included socio-demographic and medical data for 100 participants. Duration of ANC visits averaged 29.6 min. Health care providers were able to collect all variables (100%) describing personal and medical data. No major technical problems were encountered and no data were lost. During 17 ANC visits (17%), an alert function was generated to highlight abnormal clinical results requiring therapy or referral to an affiliated hospital. Participants' acceptability of the system was very high. Conclusion This pilot study proved the usability and feasibility of the PANDA mHealth system to conduct complete and standardised ANC visits according to WHO guidelines, thus providing a promising solution to
Downs, R. R.; Peng, G.; Wei, Y.; Ramapriyan, H.; Moroni, D. F.
Earth science data products and services are being used by representatives of various science and social science disciplines, by planning and decision-making professionals, by educators and learners ranging from primary through graduate and informal education, and by the general public. The diversity of users and uses of Earth science data is gratifying and offers new challenges for enabling the usability of these data by audiences with various purposes and levels of expertise. Users and other stakeholders need capabilities to efficiently find, explore, select, and determine the applicability and suitability of data products and services to meet their objectives and information needs. Similarly, they need to be able to understand the limitations of Earth science data, which can be complex, especially when considering combined or simultaneous use of multiple data products and services. Quality control efforts of stakeholders, throughout the data lifecycle, can contribute to the usability of Earth science data to meet the needs of diverse users. Such stakeholders include study design teams, data producers, data managers and curators, archives, systems professionals, data distributors, end-users, intermediaries, sponsoring organizations, hosting institutions, and others. Opportunities for engaging stakeholders to review, describe, and improve the quality of Earth science data products and services throughout the data lifecycle are identified and discussed. Insight is shared from the development of guidelines for implementing the Group on Earth Observations (GEO) Data Management Principles, the recommendations from the Earth Science Data System Working Group (ESDSWG) on Data Quality, and the efforts of the Information Quality Cluster of the Federation of Earth Science Information Partners (ESIP). Examples and outcomes from quality control efforts of data facilities, such as scientific data centers, that contribute to the usability of Earth science data also are offered.
Aryana, Bijan; Clemmensen, Torkil
In this article, a country specific comparative mobile usability study is presented, using Iran and Turkey as the two chosen emerging/emergent nation exemplars of smartphone usage and adoption. In a focus group study, three mobile applications were selected by first-time users of smartphones...... personal contacts. The results and analysis establish the existence of country specific issues and concerns, as well as reveal generic usability issues. The article concludes that the source of these issues is most likely due to a combination of certain contextual features endemic to both Iran and Turkey...
Yen, Po-Yin; Lara, Barbara; Lopetegui, Marcelo; Bharat, Aseem; Ardoin, Stacy; Johnson, Bernadette; Mathur, Puneet; Embi, Peter J; Curtis, Jeffrey R
RhEumAtic Disease activitY (READY) is a mobile health (mHealth) application that aims to create a shared platform integrating data from both patients and physicians, with a particular emphasis on arthritis disease activity. We made READY available on an iPad and pilot implemented it at a rheumatology outpatient clinic. We conducted 1) a usability evaluation study to explore patients' and physicians' interactions with READY, and 2) a time motion study (TMS) to observe the clinical workflow before and after the implementation. A total of 33 patients and 15 physicians participated in the usability evaluation. We found usability problems in navigation, data entry, pain assessment, documentation, and instructions along with error messages. Despite these issues, 25 (75,76%) patients reported they liked READY. Physicians provided mixed feedback because they were concerned about the impact of READY on clinical workflow. Six physicians participated in the TMS. We observed 47 patient visits (44.72 hours) in the pre-implementation phase, and 42 patient visits (37.82 hours) in the post-implementation phase. We found that patients spent more time on READY than paper (4.39mins vs. 2.26mins), but overall, READY did not delay the workflow (pre = 52.08 mins vs. post = 45.46 mins). This time difference may be compensated with READY eliminating a workflow step for the staff. Patients preferred READY to paper documents. Many found it easier to input information because of the larger font size and the ease of 'tapping' rather than writing-out or circling answers. Even though patients spent more time on READY than using paper documents, the longer usage of READY was mainly due to when troubleshooting was needed. Most patients did not have problems after receiving initial support from the staff. This study not only enabled improvements to the software but also serves as good reference for other researchers or institutional decision makers who are interested in implementing such a
the same questions in another 5-10 years. One concept that may be useful is that of the wholesale and retail dynamic. Products move through society and are found readily and often when they are available through many different outlets. The process of efficiently distributing products has developed where wholesalers do a great job on the backend with all the logistics of getting the product ready and out to market, and retailers do a great job of getting product directly into the hands of the consumer. So, how does this model play out with scientific data? How might it help us in examining the potentially flawed notion of 'one-stop shop' catalogs and portals and other things we've tried to make scientific data more discoverable? We may also benefit from determining where we are simply outgunned in developing a certain capability, adopting something that is already established, and shifting focus to the hard problems not yet solved. Recent developments to establish a profile for datasets as part of the schema.org methodology adopted by commercial search providers shows great promise as a way to distinguish scientific data from all the other possible search results. Rather than determining that big public search engines are a priori not suited to the discovery of scientific data, how might we experiment with applying those capabilities to our domain and so take advantage of all the other things the world is figuring out about needles in haystacks?
Høegh, Rune Thaarup; Nielsen, Christian Monrad; Pedersen, Michael Bach
of the system. This article presents results from an exploratory study of 2 ways of providing feedback from a usability evaluation: observation of user tests and reading usability reports. A case study and a field experiment were used to explore how observation and usability reports impact developers......' understanding of usability data. The results indicate that observation of user tests facilitated a rich understanding of usability problems and created empathy with the users and their work. The usability report had a strong impact on the developers' understanding of specific usability problems and supported...
Herbert, Sandra; Lynch, Julianne
Keeping classroom animals is a common practice in many classrooms. Their value for learning is often seen narrowly as the potential to involve children in learning biological science. They also provide opportunities for increased empathy, as well as socio-emotional development. Realization of their potential for enhancing primary children's…
Hertzum, Morten; Clemmensen, Torkil
distinguishing it from user experience. On the basis of repertory-grid interviews with 24 Chinese, Danish, and Indian usability professionals we find that they make use of more utilitarian than experiential, i.e. user-experience related, constructs. This indicates that goal-related performance is central......’ constructs, particularly their experiential constructs, go considerably beyond ISO 9241 usability, indicating a discrepancy between this definition of usability and the thinking of the professionals concerned with delivering usability. Finally, usability is construed rather similarly across the three...
Wallace, Carolyn S.; Coffey, Debra
The "Next Generation Science Standards'" ("NGSS") eight scientific and engineering practices invite teachers to develop key investigative skills while addressing important disciplinary science ideas (NGSS Lead States 2013). The "NGSS" can also provide direct links to "Common Core English Language Arts…
Although knowledge-discovery tools are new to the exposure science community, these tools are critical for leveraging exposure information to design health studies and interpret results for improved public health decisions. Standardized ontologies define relationships, allow for automated reasoning, and facilitate meta-analyses. ExO will facilitate development of biologically relevant exposure metrics, design of in vitro toxicity tests, and incorporation of information on susceptibility and background exposures for risk assessment. In this approach, there are multiple levels of organization, from the global environment down through ecosystems, communities, indoor spaces, populations, organisms, tissues, and cells. We anticipate that the exposure science and environmental health community will adopt and contribute to this work, as wide acceptance is key to integration and federated searching of exposure data to support environmental and public health research. In particular, we anticipate acceptance of the concept that exposure science provides the spatial/temporal narrative about the intensity (concentration) of a stressor at the boundary between two systems: one functioning as an “environment” (stressor) and one functioning as a target (receptor). An agreed-upon exposure ontology with clear definitions and relationships should help to facilitate decision-making, study design and prioritization of research initiatives by enhancing the capacity for data colle
Usability studies are important for developing usable, enjoyable products, identifying design flaws (usability problems) likely to compromise the user experience. Usability testing is recommended for improving interactive design, but discovery of usability problems depends on the number of users
Severity assessments enable prioritization of problems encountered during usability evaluations and thereby provide a device for guiding the utilization of design resources. However, designers' response to usability evaluations is also influenced by other factors, which may overshadow severity....... With the purpose of enhancing the impact of severity assessments, this study combines a field study of factors that influence the impact of evaluations with an experimental study of severity assessments made during usability inspections. The results show that even in a project receptive to input from evaluations...... their impact was highly dependent on conducting evaluations early. This accorded with an informal method that blended elements of usability evaluation and participatory design and could be extended with user-made severity assessments. The major cost associated with the evaluations was not finding but fixing...
Usability evaluation provide software development teams with insights on the degree to which a software application enables a user to achieve his/her goals, how fast these goals can be achieved, how easy it is to learn and how satisfactory it is in use Although usability evaluations are crucial...... in the process of developing software systems with a high level of usability, its use is still limited in the context of small software development companies. Several approaches have been proposed to support software development practitioners (SWPs) in conducting usability evaluations, and my thesis explores two...... of these: 1) The first approach is to support SWPs by training them to drive usability evaluations. 2) The second approach to support SWPs involves minimalist training of end users to drive usability evaluations. In related work, a set of five quality criteria for usability evaluations is applied...
This research study evaluated the use of Second Life and its virtual museums as a means of providing effective informal science education for both junior high and high school students. This study investigated whether the attitudes of students toward science change as a result of scholastic exposure to the science museums in Second Life. The dependence between attitudes and learning styles was also investigated. The data gathered from the experiences and the perceptions of students using Second Life in informal science education were analyzed to address the questions of the study. The researcher used qualitative and quantitative research methodologies to investigate the research questions. The first and second research questions were quantitative and used TOSRA2 research instrument to assess attitude and perceptions and learning style questionnaire scores. The attitudes toward science before and after visiting the Second Life museums showed no significant change. A weak relationship between the attitudes toward science and the participants learning styles was found. The researcher therefore concluded that no relationship existed between the average of the TOSRA scores and the learning styles questionnaire scores. To address questions research three and four, a collective qualitative case study approach (Creswell, 2007), as well as a structured interviews focusing on the students' perspectives about using Second Life for informal science education was used. The students did not prefer informal science education using second life over formal education. This was in part attributed to the poor usability and/or familiarity with the program. Despite the students' technical difficulties confronted in visiting Second Life the perception of student about their learning experiences and the use of Second Life on informal science environment were positive.
Describes a means for determining student knowledge in science. Written in student-level language, WALLS contains statements about science knowledge within bricks on a worksheet. Students shade in bricks they know or activities they have done and part-shade any they are unsure about, giving a differentiated starting point that allows them to plan…
Usability testing seems complicated and time-consuming. Is it though? In fact, it is the best way to understand how real users experience your product. In this interactive session, we will do a live usability test and you will get advice on how to conduct your own usability tests.
Industrial usability work often fails to produce the expected impact on software products even though significant resources have been used on uncovering problems and suggesting improvements. So, it seems that feedback from industrial usability work lacks persuasiveness, i.e. it fails to convince...... the key stakeholders that actions need to be taken. This study reports from interviews with 26 stakeholders in software development projects. Our data suggests that the interviewees address usability using different perspectives and based on our observations we describe five such perspectives. Further, we...... discuss how applying different usability perspectives might inform the persuasiveness of usability work....
Eriksson, Elina; Cajander, Åsa; Gulliksen, Jan
How do you do usability work when no usability expertise is available? What happens in an organization when system developers, with no previous HCI knowledge, after a 3-day course, start applying usability methods, and particularly field studies? In order to answer these questions qualitative data were gathered through participatory observations, a feed back survey, field study documentation and interviews from 47 system developers from a public authority. Our results suggest that field studies enhance the developer’s understanding of the user perspective, and provide a more holistic overview of the use situation, but that some developers were unable to interpret their observations and see solutions to the users’ problems. The field study method was very much appreciated and has now become standard operating procedure within the organization. However, although field studies may be useful, it does not replace the need for usability pro fes sion als, as their knowledge is essential for more complex observations, analysis and for keeping the focus on usability.
Ronald L. Boring; David I. Gertman
This paper introduces a novel augmentation to the current heuristic usability evaluation methodology. The SPAR-H human reliability analysis method was developed for categorizing human performance in nuclear power plants. Despite the specialized use of SPAR-H for safety critical scenarios, the method also holds promise for use in commercial off-the-shelf software usability evaluations. The SPAR-H method shares task analysis underpinnings with human-computer interaction, and it can be easily adapted to incorporate usability heuristics as performance shaping factors. By assigning probabilistic modifiers to heuristics, it is possible to arrive at the usability error probability (UEP). This UEP is not a literal probability of error but nonetheless provides a quantitative basis to heuristic evaluation. When combined with a consequence matrix for usability errors, this method affords ready prioritization of usability issues
Swanson, Lauren; Solorza, Ruben; Fissore, Cinzia
This article explores undergraduates' efforts to engage in scientific argumentation during exam settings. Thirteen undergraduate students enrolled in an environmental science course completed exams with questions linked around a central theme. Three types of questions were used, including those that prompted students to construct scientific…
Scalice, Daniella; Weiss, Peter
In today's media-intensive environment, the ability to convey science can reshape the face of scientific exploration and discovery. Many early-career scientists could benefit from training on how to communicate their work effectively to all stakeholders along their career paths, from deans and political representatives to neighbors and students, and perhaps even to public audiences through the lens of a camera or the voice of a blog.
Cuff, K. E.; Corazza, L.; Liang, J.
A U.C. Berkeley-based outreach program known as Environmental Science Information Technology Activities has been in operation over the past four years. The primary aim of the program is to provide opportunities for grades 9 and 10 students in diverse East San Francisco Bay Area communities to develop deeper understandings of the nature and conduct of science, which will increase their capacity to enroll and perform successfully in science, technology, engineering, and mathematics (STEM) courses in the future. Design of the program has been informed by recent research that indicates a close relationship between educational activities that promote the perception of STEM as being relevant and the ability to foster development of deeper conceptual understandings among teens. Accordingly, ESITA includes an important student-led environmental science research project component, which provides participants with opportunities to engage in research investigations that are directly linked to relevant, real-world environmental problems and issues facing their communities. Analysis of evidence gleaned from questionnaires, interviews with participants and specific assessment/evaluation instruments indicates that ESITA program activities, including after-school meetings, summer and school year research projects, and conference preparations and presentations has provided students with high-quality inquiry science experiences that increased their knowledge of STEM and IT concepts, as well as their understanding of the nature of the scientific enterprise. In addition, the program has achieved a high degree of success in that it has: enhanced participants' intellectual self-confidence with regard to STEM; developed deeper appreciation of how scientific research can contribute to the maintenance of healthy local environments; developed a greater interest in participating in STEM-related courses of study and after school programs; and improved attitudes toward STEM. Overall
Full Text Available The subject of the research is software usability and the aim is construction of mathematicalmodel of estimation and providing of the set level of usability. Methodology of structural analysis,methods of multicriterion optimization and theory of making decision, method of convolution,scientific methods of analysis and analogies is used in the research. The result of executed work isthe model for software usability automated evaluation and assurance that allows not only toestimate the current level of usability during every iteration of agile development but also tomanage the usability of created software products. Results can be used for the construction ofautomated support systems of management the software usability.
van Lieshout, Remko; Pisters, Martijn F; Vanwanseele, Benedicte; de Bie, Rob A; Wouters, Eveline J; Stukstette, Mirelle J
Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient's compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user's perspective. To describe the usability from the physical therapists' and a patients' perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. This study gives insight in the usability of two biofeedback devices from the patient's and physical therapist's perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient's perspective. The study findings could help
Horack, John M.; Borchelt, Rick E.
Nowhere is the disconnect between needing to better communicate science and technology and the skills and techniques used for that communication more evident than in the Federal research enterprise. As Federal research budgets stagnate or decline, and despite public clamor for more and better scientific information, communication of basic research results continues to rank among the lowest agency priorities, mortgaged against traditional public-relations activities to polish an agency's image or control negative information flow to the press and public. Alone among the Federal agencies, NASA articulates in its strategic plan the need "...to advance and communicate scientific knowledge and understanding..." These words emphasize the reality that if new knowledge is generated but not communicated, only half the job has been done. This is a reflection of the transition of NASA from primarily an engineering organization used to help win the Cold War to a producer of new knowledge and technology in the National interest for the 21st century.
Snider, Jean; Martin, Florence
Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…
Hertzum, Morten; Clemmensen, Torkil; Hornbæk, Kasper
Whereas the concept of usability is predominantly defined analytically, people relate to systems through personal usability constructs. Based on 48 repertory-grid interviews, this study investigates how such personal constructs are affected by two factors crucial to the international development...
Lizano, Fulvio; Sandoval, Maria Marta; Bruun, Anders
Several emerging countries experience increasing software development activities. With the purpose of provide useful feedback on possible courses of action for increasing application of usability evaluation in such countries, this paper explores the status of usability evaluation in a digitally...... emerging country. Our aim is to identifying common characteristics or behavioral patterns that could be compared with digitally advanced countries. We used an online survey answered by 26 software development organizations, which gave a snapshot of the application of usability evaluation...... in these organizations. We found many similarities with advanced countries, several completely new obstacles more connected with software development matters and a relatively positive improvement in the lack of “usability culture”. These findings suggest good conditions to improve conduction of usability evaluations...
Konnerup, Merete; Kongsted, Hans Christian
Formalised research synthesis to underpin evidence-based policy and practice has become increasingly important in areas of public policy. In this paper we discuss whether the Cochrane standard for systematic reviews of healthcare interventions is appropriate for social research. We examine...... the formal criteria of the Cochrane Collaboration for including particular study designs and search the Cochrane Library to provide quantitative evidence on the de facto standard of actual Cochrane reviews. By identifying the sample of Cochrane reviews that consider observational designs, we are able...... to conclude that the majority of reviews appears limited to considering randomised controlled trials only. Because recent studies have delineated conditions for observational studies in social research to produce valid evidence, we argue that an inclusive approach is essential for truly evidence-based policy...
Turrin, M.; Boghosian, A.; Bell, R. E.; Frearson, N.
Looking at data sparks questions, discussion and insights. By integrating multiple data sets we deepen our understanding of how cryosphere processes operate. Field collected data provide measurements from multiple instruments supporting rapid insights. Icepod provides a platform focused on the integration of multiple instruments. Over the last three seasons, the ROSETTA-Ice project has deployed Icepod to comprehensively map the Ross Ice Shelf, Antarctica. This integrative data collection along with new methods of data visualization allows us to answer questions about ice shelf structure and evolution that arise during data processing and review. While data are vetted and archived in the field to confirm instruments are operating, upon return to the lab data are again reviewed for accuracy before full analysis. Recent review of shallow ice radar data from the Beardmore Glacier, an outlet glacier into the Ross Ice Shelf, presented an abrupt discontinuity in the ice surface. This sharp 8m surface elevation drop was originally interpreted as a processing error. Data were reexamined, integrating the simultaneously collected shallow and deep ice radar with lidar data. All the data sources showed the surface discontinuity, confirming the abrupt 8m drop in surface elevation. Examining high resolution WorldView satellite imagery revealed a persistent source for these elevation drops. The satellite imagery showed that this tear in the ice surface was only one piece of a larger pattern of "chatter marks" in ice that flows at a rate of 300 m/yr. The markings are buried over a distance of 30 km or after 100 years of travel down Beardmore Glacier towards the front of the Ross Ice Shelf. Using Icepod's lidar and cameras we map this chatter mark feature in 3D to reveal its full structure. We use digital elevation models from WorldView to map the other along flow chatter marks. In order to investigate the relationship between these surface features and basal crevasses, the deep ice
Meinald T. Thielsch
Full Text Available Usability is a core construct of website evaluation and inherently defined as interactive. Yet, when analysing first impressions of websites, expected usability, i.e., before use, is of interest. Here we investigate to what extend ratings of expected usability are related to (a experienced usability, i.e., ratings after use, and (b objective usability measures, i.e., task performance. Furthermore, we try to elucidate how ratings of expected usability are correlated to aesthetic judgments. In an experiment, 57 participants submitted expected usability ratings after the presentation of website screenshots in three viewing-time conditions (50, 500, and 10,000 ms and after an interactive task (experienced usability. Additionally, objective usability measures (task completion and duration and subjective aesthetics evaluations were recorded for each website. The results at both the group and individual level show that expected usability ratings are not significantly related either to experienced usability or objective usability measures. Instead, they are highly correlated with aesthetics ratings. Taken together, our results highlight the need for interaction in empirical website usability testing, even when exploring very early usability impressions. In our study, user ratings of expected usability were no valid proxy neither for objective usability nor for experienced website usability.
Følstad, Asbjørn; Lai-Chong Law, Effie; Hornbæk, Kasper
While the planning and implementation of usability evaluations are well described in the literature, the analysis of the evaluation data is not. We present interviews with 11 usability professionals on how they conduct analysis, describing the resources, collaboration, creation of recommendations......, and prioritization involved. The interviews indicate a lack of structure in the analysis process and suggest activities, such as generating recommendations, that are unsupported by existing methods. We discuss how to better support analysis, and propose four themes for future research on analysis in usability...
Frank, David G.; Wallace, Alan R.; Schneider, Jill L.
Minerals in the environment and products manufactured from mineral materials are all around us and we use and come into contact with them every day. They impact our way of life and the health of all that lives. Minerals are critical to the Nation's economy and knowing where future mineral resources will come from is important for sustaining the Nation's economy and national security. The U.S. Geological Survey (USGS) Mineral Resources Program (MRP) provides scientific information for objective resource assessments and unbiased research results on mineral resource potential, production and consumption statistics, as well as environmental consequences of mining. The MRP conducts this research to provide information needed for land planners and decisionmakers about where mineral commodities are known and suspected in the earth's crust and about the environmental consequences of extracting those commodities. As part of the MRP scientists of the Western Mineral and Environmental Resources Science Center (WMERSC or 'Center' herein) coordinate the development of national, geologic, geochemical, geophysical, and mineral-resource databases and the migration of existing databases to standard models and formats that are available to both internal and external users. The unique expertise developed by Center scientists over many decades in response to mineral-resource-related issues is now in great demand to support applications such as public health research and remediation of environmental hazards that result from mining and mining-related activities. Western Mineral and Environmental Resources Science Center Results of WMERSC research provide timely and unbiased analyses of minerals and inorganic materials to (1) improve stewardship of public lands and resources; (2) support national and international economic and security policies; (3) sustain prosperity and improve our quality of life; and (4) protect and improve public health, safety, and environmental quality. The MRP
Organizational usability is about the match between the user and the system, between the organization and the system, and between the environment and the system. While the first of these matches can, to a large extent, be evaluated in the lab, the two others cannot. Organizational usability must......, provide a brief example, and discuss the challenges it presents. To strengthen the focus on evaluation in the three contexts we propose the measurement of specified effects, combined with a sensitivity toward emergent effects. Incorporating effects in the evaluation of organizational usability makes...
Nørgaard, Mie; Hornbæk, Kasper
In theory, usability work is an important and well-integrated activity in developing software. In practice, collaboration on improving usability is ridden with challenges relating to conflicting professional goals, tight project schedules, and unclear usability findings. The authors study those...... challenges through 16 interviews with software developers, usability experts, and project managers. Four themes that are key challenges to successful interaction between stakeholders are identified: poor timing when delivering usability results, results lacking relevance, little respect for other disciplines...
Donna M. Kridelbaugh
Full Text Available Citizen science is becoming even more accessible to the general public through technological advances in the development of mobile applications, facilitating information dissemination and data collection. With the advent of “big data,” many citizen-science projects designed to help researchers sift through piles of research data now exist entirely online, either in the form of playing a game or via other digital avenues. Recent trends in citizen science have also focused on “crowdsourcing” solutions from the general public to help solve societal issues, often requiring nothing more than brainstorming and a computer to submit ideas. Online citizen science thus provides an excellent platform to expand the accessibility of experiential learning opportunities for a broad range of nonmajor science students at institutions with limited resources (e.g., community colleges. I created an activity for a general microbiology lecture to engage students in hands-on experiences via participation in online citizen-science projects. The objectives of the assignment were for students to: 1 understand that everyone can be a scientist; 2 learn to be creative and innovative in designing solutions to health and science challenges; and 3 further practice science communication skills with a written report. This activity is designed for introductory science courses with nonmajor science students who have limited opportunities to participate in undergraduate research experiences.
McQuillen, John; Green, Robert D.; Henrie, Ben; Miller, Teresa; Chiaramonte, Fran
The Physical Science Informatics (PSI) system is the next step in this an effort to make NASA sponsored flight data available to the scientific and engineering community, along with the general public. The experimental data, from six overall disciplines, Combustion Science, Fluid Physics, Complex Fluids, Fundamental Physics, and Materials Science, will present some unique challenges. Besides data in textual or numerical format, large portions of both the raw and analyzed data for many of these experiments are digital images and video, requiring large data storage requirements. In addition, the accessible data will include experiment design and engineering data (including applicable drawings), any analytical or numerical models, publications, reports, and patents, and any commercial products developed as a result of the research. This objective of paper includes the following: Present the preliminary layout (Figure 2) of MABE data within the PSI database. Obtain feedback on the layout. Present the procedure to obtain access to this database.
Storm, Jeroen; Kostons, Danny
Storm, J., & Kostons, D. (2009). Usability at the CELSTEC MediaLab. Presentation about the usability testing, usability research and User Centered Design conducted at the CELSTEC MediaLab. July, 7, 2009, Heerlen, The Netherlands: Open University of the Netherlands.
One of the qualities that has received increased attention in recent decades is usability. A software product with poor usability is likely to fail in a highly competitive market; therefore software developing organizations are paying more and more attention to ensuring the usability of their
Full Text Available Obtaining user feedback is valuable yet often overlooked, so when Memorial University Libraries launched OCLC’s WorldCat Local discovery tool for Fall 2010, usability testing was a logical next step. Two branches, each with distinct user groups, the Ferriss Hodgett Library in Corner Brook, and the Health Sciences Library in St. John’s, conducted unique usability studies to gain evidence into how WorldCat Local performed common research tasks. The Health Sciences Library was inspired by the information seeking habits of Memorial University’s Faculty of Medicine, School of Nursing, and School of Pharmacy. This demographic’s heavy reliance on journal literature, and known item searching made these users an interesting test group. The Ferriss Hodgett Library, serving an undergraduate Liberal Arts and Sciences population, was interested in the information seeking behavior of new students with little to no experience using library resources. At the local level, evidence obtained as a result of this usability testing will provide guidance into future use of WCL at Memorial University Libraries. On a broader scale, the usability findings are relevant to any library considering the shift to a new discovery tool.
Bulens, J.D.; Vullings, L.A.E.; Houtkamp, J.M.; Vanmeulebrouk, B.
As INSPIRE progresses to be implemented in the EU, many new discovery portals are built to facilitate finding spatial data. Currently the structure of the discovery portals is determined by the way spatial data experts like to work. However, we argue that the main target group for discovery portals are not spatial data experts but professionals with limited spatial knowledge, and a focus outside the spatial domain. An exploratory usability experiment was carried out in which three discovery p...
Budden, A. E.; Frame, M. T.; Tenopir, C.; Volentine, R.
DataONE was conceived as a 10-year project to enable new science and knowledge creation through universal access to data about life on Earth and the environment that sustains it. In Phase I (2009-2014) more than 300 DataONE participants designed, developed and deployed a robust cyberinfrastructure (CI) with innovative services, and directly engaged and educated a broad stakeholder community. DataONE provides a resilient, scalable infrastructure using Member Nodes (data repositories), Coordinating Nodes, and an Investigator Toolkit to support the data access and data management needs of biological, Earth, and environmental science researchers in the U.S. and across the globe. DataONE collaborators, such as the U.S. Geological Survey, University of New Mexico, and the University of Tennessee, perform research to measure both the current data practices and opinions of DataONE stakeholders and the usability of DataONE for these stakeholders. Stakeholders include scientists, data managers, librarians, and educators among others. The DataONE Usability and Assessment Working Group, which includes members from multiple sectors, does research, development, and implementation projects on DataONE processes, systems, and methods. These projects are essential to insure that DataONE products and services meet network goals, include appropriate community involvement, and demonstrate progress and achievements of DataONE. This poster will provide an overview of DataONE's usability analysis and assessment methodologies, benefits to DataONE and its collaborators, and current tools/techniques being utilized by the participants.
Hussain, Azham; Mkpojiogu, Emmanuel O. C.
Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.
Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The
Johnson, Megan; Purpur, Geraldine; Abbott, Lisa T.
In spring semester 2009, two of the authors taught LIB 5020--Information Sources & Services to graduate library science students at Appalachian State University. The course covers information seeking patterns and provides an overview of reference services. The course is also designed to examine and evaluate library reference materials and…
Wagaba, Francis; Treagust, David F.; Chandrasegaran, A. L.; Won, Mihye
An action research study was designed to evaluate the effectiveness of providing metacognitive support to enhance Year 9 students' metacognitive capabilities in order to better understand science concepts related to light, environmental health, ecosystems, genetics, ecology, atoms and the Periodic Table. The study was conducted over three years…
Ross, Julia Myers; Peterman, Karen; Daugherty, Jenny L.; Custer, Rodney L.
An Engineering Innovation Tool was designed to support science teachers as they navigate the opportunities and challenges the inclusion of engineering affords by providing a useful tool to be used within the professional development environment and beyond. The purpose of this manuscript is to share the design, development and substance of the tool…
Web Usability Policies/Standards/Guidelines Do Not Influence Practices at ARL Academic Libraries. A Review of: Chen, Yu‐Hui, Carol Anne Germain and Huahai Yang. “An Exploration into the Practices of Library Web Usability in ARL Academic Libraries.” Journal of the American Society for Information Science and Technology 60.5 (2009: 953‐68.
Full Text Available Objective – To survey the current status of Web usability Policies/Standards/Guidelines (PSGs found in academic libraries of the Association of Research Libraries (ARL. Researchers sought to investigate whether PSGs are in place, the levels of difficulty surrounding implementation, the impact of PSGs on design, testing, and resource allocation, and the relationship between ARL ranking and usability practice or PSGs.Design – Survey.Setting – North America.Subjects – Academic libraries of the ARL.Methods – An 18‐question survey consisting of multiple choice, Likert scale, and open‐ended questions was sent to all 113 ARL libraries in November 2007. Survey recipients were selected as the person in charge of Web site usability by visiting library Web sites and phone inquiry. The survey was concluded in January 2008 with a response rate of 74% (84 institutions. The researchers used t‐test to detect any difference in ARL library ranking between libraries with and without PSGs. Pair‐wise t‐tests were conducted to identify gaps in difficulty implementing PSGs. In addition, they used Pearson’s Correlation to investigate any significant correlations between variables such as ARL rank and resource allocation.Main Results – Of the 84 respondents, 34 (40% have general library Web PSGs and 25 (30% have specific usability PSGs; 41 (49% have at least one type of in‐library PSG. Of the 43 (51% libraries that do not have PSGs, 30 (36% are at universities with institutional Web usability PSGs; 26 (87% follow those guidelines. There was no statistically significant relationship between ARL ranking and PSG status (see Table 1. The authors asked about difficulty in implementing PSGs. Of the 32 libraries responding to a question about general library Web PSGs, most had slight or moderate difficulty. Twenty‐three libraries with specific usability PSGs identified difficulty levels; some had no difficulty, but a majority had moderate difficulty
Campbell, Bryan A; Tossell, Chad C; Byrne, Michael D; Kortum, Philip
The goal of this research was to assess the usability of a voting system designed for smart-phones. Smartphones offer remote participation in elections through the use of pervasive technology. Voting on these devices could, among other benefits, increase voter participation while allowing voters to use familiar technology. However, the usability of these systems has not been assessed. A mobile voting system optimized for use on a smartphone was designed and tested against traditional voting platforms for usability. There were no reliable differences between the smartphone-based system and other voting methods in efficiency and perceived usability. More important, though, smartphone owners committed fewer errors on the mobile voting system than on the traditional voting systems. Even with the known limitations of small mobile platforms in both displays and controls, a carefully designed system can provide a usable voting method. Much of the concern about mobile voting is in the area of security; therefore, although these results are promising, security concerns and usability issues arising from mitigating them must be strongly considered. The results of this experiment may help to inform current and future election and public policy officials about the benefits of allowing voters to vote with familiar hardware.
communicate their subjective opinions. Keywords: Usability Analysis; CAVETM (Cave Automatic Virtual Environments); Human Computer Interface (HCI...the differences in interaction when compared with traditional human computer interfaces. This paper provides analysis via usability study methods
Full Text Available Business Intelligence (BI applications provide business information to drive decision support. Usability is one of the factors determining the optimal use and eventual benefit derived from BI applications. The documented need for more BI usability research together with the practical necessity for BI evaluation guidelines in the mining industry provides the rationale for this study. The purpose of the study was to investigate the usability evaluation of BI applications in the context of a coal mining organization. The research is guided by the question: How can existing usability criteria be customized to evaluate the usability of BI applications. The research design included user observation, heuristic evaluation and a survey. Based on observations made during user support on a BI application used at a coal mining organization a log of usability issues was compiled. The usability issues extracted from this log was compared and contrasted with general usability criteria from literature to synthesize an initial set of BI usability evaluation criteria. These criteria were used as the basis for a heuristic evaluation of the BI application used at the coal mining organization. The same BI application was also evaluated using the Software Usability Measurement Inventory (SUMI standardized questionnaire. The results from the two evaluations were triangulated and then compared with the BI user issues again to contextualize the findings and synthesize a validated and refined set of criteria. The main contribution of the study is the usability evaluation criteria for BI applications presented as guidelines. These guidelines deviate from existing evaluation guidelines in the emphasis on information architecture, learnability and operability.
de Castro Lozano, Carlos; Salcines, Enrique García; Sainz de Abajo, Beatriz; Burón Fernández, F. Javier; Ramírez, José Miguel; Recellado, José Gabriel Zato; Montoya, Rafael Sanchez; Bell, John; Marin, Francisco Alcantud
When designing "interfaces for everyone" for interactive systems, it is important to consider factors such as cost, the intended market, the state of the environment, etc. User interfaces are fundamental for the developmental process in any application, and its design must be contemplated from the start. Of the distinct parts of a system (hardware and software), it is the interface that permits the user access to computer resources. The seven principles of "Universal Design" or "Design for Everyone" focus on a universal usable design, but at the same time acknowledge the influences of internal and external factors. Structural changes in social and health services could provide an increase in the well-being of a country's citizens through the use of self-care programming and proactive management/prevention of disease. Automated home platforms can act as an accessibility instrument which permits users to avoid, compensate, mitigate, or neutralize the deficiencies and dependencies caused by living alone.
Full Text Available The Digital Doorway (DD is a joint initiative between the South African Department of Science and Technology (DST and the Meraka Institute of the Council for Scientific and Industrial Research (CSIR. The DD is a non-standard computer system deployed amongst underprivileged communities in South Africa with the objective to promote computer literacy. Since its inception, there has been no usability or accessibility evaluation of the software installed on the DD, mainly due to lack of usability engineering or interaction design expertise within the development team. The goal of the research presented in this paper was to design a solution to this problem by developing a suitable instrument that could guide DD application developers in the design and development of more usable DD software and interfaces. Design research was used as a research methodology. We first investigated the applicability of the standard usability and accessibility evaluation methods for evaluating the software installed on the DD. During the first cycle of design research, we established that a heuristic-like evaluation method would be an appropriate method for evaluating the usability and direct accessibility support provided by the DD. During a second cycle of design research, embedded in the first, we also developed a set of multi-category heuristics as the ‘instrument’ that could guide the developers during design of applications as well as in the first-level (formative evaluation thereof. To verify the heuristics, we conducted a usability evaluation of the DD and triangulated the results with a direct field observation at a natural environment of DD use, together with user-administered questionnaires.
Schneider, Maria Victoria; Griffin, Philippa C; Tyagi, Sonika; Flannery, Madison; Dayalan, Saravanan; Gladman, Simon; Watson-Haigh, Nathan; Bayer, Philipp E; Charleston, Michael; Cooke, Ira; Cook, Rob; Edwards, Richard J; Edwards, David; Gorse, Dominique; McConville, Malcolm; Powell, David; Wilkins, Marc R; Lonie, Andrew
EMBL Australia Bioinformatics Resource (EMBL-ABR) is a developing national research infrastructure, providing bioinformatics resources and support to life science and biomedical researchers in Australia. EMBL-ABR comprises 10 geographically distributed national nodes with one coordinating hub, with current funding provided through Bioplatforms Australia and the University of Melbourne for its initial 2-year development phase. The EMBL-ABR mission is to: (1) increase Australia's capacity in bioinformatics and data sciences; (2) contribute to the development of training in bioinformatics skills; (3) showcase Australian data sets at an international level and (4) enable engagement in international programs. The activities of EMBL-ABR are focussed in six key areas, aligning with comparable international initiatives such as ELIXIR, CyVerse and NIH Commons. These key areas-Tools, Data, Standards, Platforms, Compute and Training-are described in this article. © The Author 2017. Published by Oxford University Press.
Klein Teeselink, G.; Siepe, A.H.M.; Pijper, de J.R.
The aim of this study is to gain insight in the usefulness of log file analysis as a method to evaluate the usability of individual interface components and their influence on the usability of the overall user interface. We selected a music player as application, with four different interfaces and
Folmer, E; van Gurp, J; Bosch, J; Bastide, R; Palanque, P; Roth, J
Studies of software engineering projects show that a large number of usability related change requests are made after its deployment. Fixing usability problems during the later stages of development often proves to be costly, since many of the necessary changes require changes to the system that
Hills, Laura; Utley, Andrea
To highlight the benefits and the need for sport science support for athletes with learning difficulties, and to reflect on our experience of working with the GB squad for athletes with learning difficulties. A review of key and relevant literature is presented, followed by a discussion of the sport science support provision and the issues that emerged in working with athletes with learning difficulties. Pre- and post- physiological tests along with evaluations of athletes' potential to benefit from sport psychology support were conducted. The aim of these tests was to provide information for the athletes and the coaches on fitness levels, to use this information to plan future training, and to identify how well the performance could be enhanced. A case study is presented for one athlete, who had competed in distance events. The focus is the psychological support that was provided. It is clear that athletes with learning difficulties require the same type of sports science support as their mainstream peers. However, sport scientists will need to consider ways to extend their practice in order to provide the appropriate level of support.
Cheng, Yiwei; Richardson, Sally
As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.
Borrego, H.; Ellins, K. K.
Through three years of participation in the TeXas Earth and Space Science (TXESS) Revolution, an NSF-sponsored teacher professional development program, my knowledge of earth science, new pedagogical approaches, and confidence has improved dramatically. I have also received instructional materials and learned how to access high quality online resources and use a variety of web-based tools. In this session, I will share my experiences and report on how I used my own learning to help both teachers and students to become more earth science literate individuals. Earth Science test scores at the elementary level throughout South Texas are consistently low in comparison to other regions in the state. The majority of the teachers lack the content-knowledge, confidence, or experience to teach Earth Sciences. My TXESS Revolution experience helped me to understand the needs of these teachers and to identify teaching resources that would be useful to them. Particularly noteworthy are TERC's EarthLabs: Earth System Science and GLOBE activities. Although these Earthlab investigations are designed for high schools students, I demonstrated how they could be adapted for elementary students. As a result, I have provided professional development in the Earth Sciences to about 300 South Texas elementary teachers. TXESS Revolution has also equipped me to empower the students I teach. My students this past year presented their challenge Legacy Cycle Project to the community. The TXESS Revolution teamed up with the Texas Water Development Board to deliver training on the implementation of a new online challenged-based curriculum called the Water Exploration Legacy Cycles. This training gave me the tools to guide my students learning through authentic scientific research. To carry out their challenge, students researched an area of interest, read literature, consulted with experts in the field, consider different prospective, and presented their final products via PowerPoint, poster
It is appropriate that after almost half a century of Science and Mathematics education reform we take a look back and a peek forward to understand the present state of this wonderfully complex system. Each of the components of this system including teaching, professional development, assessment, content and the district K-12 curriculum all need to work together if we hope to provide quality science, mathematics and technology education for ALL students. How do the state and national standards drive the system? How do state policies on student testing and teacher licensure come into play? How do we improve the preparation, retention and job satisfaction of our K-12 teachers? What initiatives have made or are making a difference? What else needs to be done? What can the physics community do to support local efforts? This job is too big for any single organization or individual but we each can contribute to the effort. Our Center at Northeastern University, with support from the National Science Foundation, has a sharply defined focus: to get high quality, research-based instructional materials into the hands of K-12 classroom teachers and provide the support they need to use the materials effectively in their classrooms.
Longitudinal studies of the usability of a computer based system for process control has been performed. The whole life-cycle of one system has been of interest, as the problems are varying over time. Repeated measurements of the operators' experiences of this system have been made during 15 years. Of main interest have been the advantages/ disadvantages of computer based system for process control compared with conventional instrumentation. The results showed among other things that (1) computer based systems made it easier to control the process and increased security (2) age differences could be explained by other factors (3 ) expectations before the installation may influence the attitudes and use of equipment for quite some time In some questions the attitudes changed over time while in others they were quite stable, for example, in questions concerning preference for type of equipment. What do operators appreciate in a computer based system for process control? About 300 operators were asked about that. The main factor seems to include a reliable system with valid information that functions during disturbances. Hopefully new systems are designed with that in mind. (author)
Webster, S.A.; Tomasi, L.T.; Bernier, R.A.
After 2 yr of preparation, 1988 finally saw the nuclear industry writing operator-oriented technical specifications. This effort is a continuation of previous efforts to develop improved and usable standard technical specifications (STSs), and is being conducted by the four nuclear steam supply system vendor owners' groups under the auspices of the Nuclear Management Resources Council. Each participant is currently preparing a set of improved STSs based on a writer's guide that was developed through a combined industry effort. In May of 1987, a Human Factors Improvements to Technical Specifications (HFITS) task group was formed to prepare a writer's guide for improved, industrywide STSs. This task group was composed of two representatives from each owners' group, one with a human factors background and one with some operations background. Two documents were prepared in 6 months, a human factors report laying the groundwork for the considerations to go into technical specifications and a writer's guide for their preparation. This paper reports on the application of this writer's guide to the writing of improved STS
Huber, Sigbert; Baumgarten, Andreas; Birli, Barbara; Englisch, Michael; Tulipan, Monika; Zechmeister-Boltenstern, Sophie
The Austrian Soil Science Society (ASSS), founded in 1954, is a non-profit organisation aiming at furthering all branches of soil science in Austria. The ASSS provides information on the current state of soil research in Austria and abroad. It organizes annual conferences for scientists from soil and related sciences to exchange their recent studies and offers a journal for scientific publications. Annually, ASSS awards the Kubiena Research Prize for excellent scientific studies provided by young scientists. In order to conserve and improve soil science in the field, excursions are organized, also in cooperation with other scientific organisations. Due to well-established contacts with soil scientists and soil science societies in many countries, the ASSS is able to provide its members with information about the most recent developments in the field of soil science. This contributes to a broadening of the current scientific knowledge on soils. The ASSS also co-operates in the organisation of excursions and meetings with neighbouring countries. Several members of the ASSS teach soil science at various Austrian universities. More detail on said conferences, excursions, publications and awards will be given in the presentation. Beside its own scientific journal, published once or twice a year, and special editions such as guidebooks for soil classification, the ASSS runs a website providing information on the Society, its activities, meetings, publications, awards and projects. Together with the Environment Agency Austria the ASSS runs a soil platform on the internet. It is accessible for the public and thus informs society about soil issues. This platform offers a calendar with national and international soil events, contacts of soil related organisations and networks, information on national projects and publications. The society has access to products, information material and information on educational courses. Last but not least information on specific soil
Do you want to improve the usability of your library website, but feel that it is too difficult, time-consuming, or expensive? Usability Testing: A Practical Guide for Librarians will teach you how to make the case for usability testing, define your audience and their goals, select a usability testing method appropriate for your particular context, plan for an in-house usability test, conduct an effective in-house usability test, analyze usability test results, and create and implement a plan for ongoing, systematic usability testing. Step-by-step instructions, along with a myriad of examples,
Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva
The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.
Zahabi, Maryam; Kaber, David B; Swangnetr, Manida
The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.
Scholarly publishing is no longer about simply producing and packaging articles and sending out to subscribers. To be successful, as well as being global and digital, Publishers and their journals need to be fully engaged with their stakeholders (authors, readers, funders, libraries etc), and constantly developing new products and services to support their needs in the ever-changing environment that we work in.Astronomy & Astrophysics (A&A) is a high quality, major international Journal that belongs to the astronomical communities of a consortium of European and South American countries supported by ESO who sponsor the journal. EDP Sciences is a non-profit publisher belonging to several learned societies and is appointed by ESO to publish the journal.Over the last decade, as well as publishing the results of worldwide astronomical and astrophysical research, A&A and EDP Sciences have worked in partnership to develop a wide range of services for the authors and readers of A&A:- A specialist language editing service: to provide a clear and excellent level of English ensuring full understanding of the high-quality science.- A flexible and progressive Open Access Policy including Gold and Green options and strong links with arXiv.- Enriched articles: authors are able to enhance their articles using a wide range of rich media such as 3D models, videos and animations.Multiple publishing formats: allowing readers to browse articles on multiple devices including eReaders and Kindles.- “Scientific Writing for Young Astronomers”: In 2008 EDP Sciences and A&A set up the Scientific Writing for Young Astronomers (SWYA) School with the objective to teach early PhD Students how write correct and efficient scientific papers for different mediums (journals, proceedings, thesis manuscripts, etc.).
Ramsey, Ellen C
Recent research has shown a backlash against the enthusiastic promotion of technological solutions as replacements for traditional educational content delivery. Many institutions, including the University of Virginia, have committed staff and resources to supporting state-of-the-art, showpiece educational technology projects. However, the Claude Moore Health Sciences Library has taken the approach of helping Health Sciences faculty be more comfortable using technology in incremental ways for instruction and research presentations. In July 2004, to raise awareness of self-service multimedia resources for instructional and professional development needs, the Library conducted a "Multimedia Bootcamp" for nine Health Sciences faculty and fellows. Case study. Program stewardship by a single Library faculty member contributed to the delivery of an integrated learning experience. The amount of time required to attend the sessions and complete homework was the maximum fellows had to devote to such pursuits. The benefit of introducing technology unfamiliar to most fellows allowed program instructors to start everyone at the same baseline while not appearing to pass judgment on the technology literacy skills of faculty. The combination of wrapping the program in the trappings of a fellowship and selecting fellows who could commit to a majority of scheduled sessions yielded strong commitment from participants as evidenced by high attendance and a 100% rate of assignment completion. Response rates to follow-up evaluation requests, as well as continued use of Media Studio resources and Library expertise for projects begun or conceived during Bootcamp, bode well for the long-term success of this program. An incremental approach to integrating technology with current practices in instruction and presentation provided a supportive yet energizing environment for Health Sciences faculty. Keys to this program were its faculty focus, traditional hands-on instruction, unrestricted
Simor, Fernando Winckler; Brum, Manoela Rogofski; Schmidt, Jaison Dairon Ebertz; Rieder, Rafael; De Marchi, Ana Carolina Bertoletti
Gestural interaction systems are increasingly being used, mainly in games, expanding the idea of entertainment and providing experiences with the purpose of promoting better physical and/or mental health. Therefore, it is necessary to establish mechanisms for evaluating the usability of these interfaces, which make gestures the basis of interaction, to achieve a balance between functionality and ease of use. This study aims to present the results of a systematic review focused on usability evaluation methods for gesture-based games, considering devices with motion-sensing capability. We considered the usability methods used, the common interface issues, and the strategies adopted to build good gesture-based games. The research was centered on four electronic databases: IEEE, Association for Computing Machinery (ACM), Springer, and Science Direct from September 4 to 21, 2015. Within 1427 studies evaluated, 10 matched the eligibility criteria. As a requirement, we considered studies about gesture-based games, Kinect and/or Wii as devices, and the use of a usability method to evaluate the user interface. In the 10 studies found, there was no standardization in the methods because they considered diverse analysis variables. Heterogeneously, authors used different instruments to evaluate gesture-based interfaces and no default approach was proposed. Questionnaires were the most used instruments (70%, 7/10), followed by interviews (30%, 3/10), and observation and video recording (20%, 2/10). Moreover, 60% (6/10) of the studies used gesture-based serious games to evaluate the performance of elderly participants in rehabilitation tasks. This highlights the need for creating an evaluation protocol for older adults to provide a user-friendly interface according to the user's age and limitations. Through this study, we conclude this field is in need of a usability evaluation method for serious games, especially games for older adults, and that the definition of a methodology
Vi, Chi Thanh; Hornbæk, Kasper; Subramanian, Sriram
Usability has a distinct subjective component, yet surprisingly little is known about its neural basis and relation to the neuroanatomy of aesthetics. To begin closing this gap, we conducted two functional magnetic resonance imaging studies in which participants were shown static webpages (in...... the first study) and videos of interaction with webpages (in the second study). The webpages were controlled so as to exhibit high and low levels of perceived usability and perceived aesthetics. Our results show unique links between perceived usability and brain areas involved in functions such as emotional...... processing (left fusiform gyrus, superior frontal gyrus), anticipation of physical interaction (precentral gyrus), task intention (anterior cingulate cortex), and linguistic processing (medial and bilateral superior frontal gyri). We use these findings to discuss the brain correlates of perceived usability...
Clemmensen, Torkil; Yammiyavar, Pradeep; Ørngreen, Rikke
This paper focuses on presenting and discussing the aim, context, challenges, results, and impact of the Cultural usability project named as CultUsab. This project was a four year international research effort from 2006 to 2009, which was supported by a grant for the Danish Research Councils...... for Independent Research in Culture and Communication. The project aimed at innovating processes in Information and Communication Technology development through an understanding of culturally sensitive aspects of usability evaluation methods....
White, Jennifer Meux; Hosoume, Kimi
The Lawrence Hall of Science (LHS), University of California at Berkeley has completed a 3-year project to develop a science and mathematics education course and science curriculum for early childhood educators. This project was in response to the need for improving the science and mathematics knowledge and teaching skills of adults who work with…
Nielsen, C. M.; Overgaard, M.; Pedersen, M. B.
This paper reports from an exploratory study of means for providing feedback from a usability evaluation to the user interface designers. In this study, we conducted a usability evaluation of a mobile system that is used by craftsmen to register use of time and materials. The results...... and weaknesses of the system. The findings indicate that detailed descriptions of problems and log descriptions of the user's interaction with the system and of system interaction are useful for the designers when trying to understand the usability problems that the users have encountered....
... 34 Education 3 2010-07-01 2010-07-01 false What additional services do Upward Bound Math and... Program? § 645.13 What additional services do Upward Bound Math and Science Centers provide and how are... provided under § 645.11(b), an Upward Bound Math and Science Center must provide— (1) Intensive instruction...
Sousa, Vanessa E C; Dunn Lopez, Karen
The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However
Russ, Alissa L; Saleem, Jason J
The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.
Full Text Available Like any other software system quality attribute, usability places requirements on software components. In particular, it has been demonstrated that certain usability features have a direct impact throughout the software process. This paper details an approach that looks at how to deal with certain usability features in the early software development stages. In particular, we consider usability features as functional usability requirements using patterns that have been termed usability patterns to elicit requirements. Additionally, we clearly establish the responsibilities of all the players at the usability requirements elicitation stage.
Kridelbaugh, Donna M.
Citizen science is becoming even more accessible to the general public through technological advances in the development of mobile applications, facilitating information dissemination and data collection. With the advent of “big data,” many citizen-science projects designed to help researchers sift through piles of research data now exist entirely online, either in the form of playing a game or via other digital avenues. Recent trends in citizen science have also focused on “crowdsourcing” so...
Alexander, Keith; Blakstad, Siri; Hansen, Geir
The paper argues for the development of usability concepts, methodologies and tools, in considering the effects of the built environment from a user, organisational and community perspective, in order to have a positive influence on social outcomes. Since it was formed over ten years ago, the CIB W......111 on Usability has been exploring concepts, methods and tools, developed in the evaluation of all kinds of consumer products, applied to the built environment. In the most recent phase of this work, conducted over the past three years, an international network of partners has collaborated to focus...... properties of a workplace, they could better manage and design the facilities for improved social outcomes. Interpretation and analysis of the built environment (and support services) based on how it is socially constructed will enable integration of organisational use and the facilities provided to arrive...
Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Jamaludin, Nur Hafiza; Moh, Somia T. L.
This paper reports on a usability evaluation of Lazada mobile application, an online shopping app for mobile devices. The evaluation was conducted using 12 users of ages 18 to 24. Seven (7) were expert users and the other 5 were novice users. The study objectives were to evaluate the perceived effectiveness, efficiency and satisfaction of the mobile application. The result provides a positive feedback and shows that the mobile shopping app is effective, efficient, and satisfying as perceived by the study participants. However, there are some observed usability issues with the main menu and the payment method that necessitates improvements to increase the application's effectiveness, efficiency and satisfaction. The suggested improvements include: 1) the main menu should be capitalized and place on the left side of mobile app and 2) payment method tutorial should be included as a hyperlink in the payment method page. This observation will be helpful to the owners of the application in future version development of the app.
Johansen, Sune Alstrup; Noergaard, Mie; Soerensen, Janus Rau
Good computer games need to be challenging while at the same time being easy to use. Accordingly, besides struggling with well known challenges for usability work, such as persuasiveness, the computer game industry also faces system-specific challenges, such as identifying methods that can provide...... data on players' attention during a game. This position paper discusses how eye tracking may address three core challenges faced by computer game producer IO Interactive in their on-going work to ensure games that are fun, usable, and challenging. These challenges are: (1) Persuading game designers...... about the relevance of usability results, (2) involving game designers in usability work, and (3) identifying methods that provide new data about user behaviour and experience....
van Lieshout, Remko; Pisters, Martijn F.; Vanwanseele, Benedicte; de Bie, Rob A.; Wouters, Eveline J.; Stukstette, Mirelle J.
Background Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient’s compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user’s perspective. Aim To describe the usability from the physical therapists’ and a patients’ perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. Methods In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Results Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. Conclusion This study gives insight in the usability of two biofeedback devices from the patient’s and physical therapist’s perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the
Yen, Po-Yin; Wantland, Dean; Bakken, Suzanne
We developed a customizable questionnaire, the Health Information Technology (IT) Usability Evaluation Scale (Health-ITUES) and conducted an exploratory factor analysis to examine the scale’s psychometric properties. Nurses (n=377) completed Health-ITUES to rate the usability of a web-based communication system for scheduling nursing staff. The analysis revealed a four-factor structure of Health-ITUES. The results provided preliminary evidence for the factorial validity and internal consistency reliability of Health-ITUES. PMID:21347112
sensitivity, and colour vision data were collected under protocol 2013-073: Automated Target Cueing in Scene Search (Dr. Mackenzie Glaholt, DRDC Toronto... Psychological Science, 1(3), 181- 210. Ryu, Y. S., & Smith-Jackson, T. L. (2006). Reliability and Validity of the Mobile Phone Usability Questionnaire
Department of Computer Science, University of Dar-es-Salaam, P.O. Box 35062, Dar-es-Salaam, Tanzania ... in order to assure usability and reduce the incidences and impact of human .... the questions were directed during the DHIS user.
Garcia Arriola, Alfonso
In the last twenty years in US science education, professional development has emphasized the need to change science instruction from a direct instruction model to a more participatory and constructivist learning model. The result of these reform efforts has seen an increase in science education professional development that is focused on providing teaching strategies that promote inquiry learning to learn science content. Given these reform efforts and teacher responses to professional development, research seems to indicate that whether teachers actually change their practice may depend on the teachers' basic epistemological beliefs about the nature of science. The person who builds the bridge between teacher beliefs and teacher practice is the designer and facilitator of science teacher professional development. Even though these designers and facilitators of professional development are critical to science teacher change, few have studied how these professionals approach their work and what influence their beliefs have on their professional development activities. Eight developers and designers of science education professional development participated in this study through interviews and the completion of an online questionnaire. To examine the relationship between professional development providers' science beliefs and their design, development, and implementation of professional development experiences for science teachers, this study used the Views on Science Education Questionnaire (VOSE), and interview transcripts as well as analysis of the documents from teacher professional development experiences. Through a basic interpretive qualitative analysis, the predominant themes that emerged from this study suggest that the nature of science is often equated with the practice of science, personal beliefs about the nature of science have a minimal impact on the design of professional development experiences, current reform efforts in science education have a
Ratna Purwaningsih; Ikhsan Yenifi
Website development needs to pay attention to usability aspect which consist of four factors: efficiency, effectiveness, satisfactions and error rate. The website of International Office of Diponegoro University provides academic information for Indonesian students and foreign students. The website still has some problem, especially on searching certain information. This research aims to evaluate the design of the existing website and measures the usability. A well-designed website will help ...
Mei R. Fu, PhD, RN, FAAN
Conclusions: This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.
Jensen, Janne Jul
social context is considered important, only little research has been done to identify how it influences usability evaluations. In this thesis I explore how social context affects the process and product of a usability evaluation and explain the findings in terms of the theory of behaviour settings...... leader) and non-operatives (members, spectators, neutrals and potentials) from the theory of behaviour settings to usability evaluations generates an understanding and create an awareness of the level of power possessed by each of the participants in the social context. 2. On the operative level...... and a field experiment. Findings from these activities are presented in five published paper contributions. I furthermore introduce the theory of behaviour settings as a tool to help characterise the key concepts of social context which, together with an understanding of usability evaluations, provide...
My topic of the thesis is usability of PostgreSQL. It presents basic information aboutPostgreSQL, such as its history, function, and comparison with one of the most popular databases - MySQL. PostgreSQL has been tested in different environments and with different programming languages. The research is based on the documents from PostgreSQL official website.The thesis introduces and proves the usability and the compatibility of PostgreSQL. PostgreSQL has been installed on Windows workstation a...
Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren
We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences' helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users' cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...
Clemmensen, Torkil; Hertzum, Morten; Hornbæk, Kasper Anders Søren
We discuss the impact of cultural differences on usability evaluations that are based on the thinking-aloud method (TA). The term ‘cultural differences’ helps distinguish differences in the perception and thinking of Westerners (people from Western Europe and US citizens with European origins...... and evaluator. In conclusion, we point to the importance of matching the task presentation to users’ cultural background, the different effects of thinking aloud on task performance between Easterners and Westerners, the differences in nonverbal behaviour that affect usability problem detection, and, finally...
Nicolajsen, Hanne Westh; Ahola, Titta; Fleury, Alexandre
In this deliverable usability and user experience are defined in relation to MAGNET Beyond technologies, and it is described how the main MAGNET Beyond concepts can be evaluated through the involvement of users. The concepts include the new "Activity based communication approach" for interacting...... with the MAGNET Beyond system, as well as the core concepts: Personal Network, Personal Network-Federation, Service Discovery, User Profile Management, Personal Network Management, Privacy and Security and Context Awareness. The overall plans for the final usability evaluation are documented based on the present...
Mendez, B. J.; Smith, D.; Shipp, S. S.; Schwerin, T. G.; Stockman, S. A.; Cooper, L. P.; Peticolas, L. M.
NASA is working with four newly-formed Science Education and Public Outreach Forums (SEPOFs) to increase the overall coherence of the Science Mission Directorate (SMD) Education and Public Outreach (E/PO) program. SEPOFs support the astrophysics, heliophysics, planetary and Earth science divisions of NASA SMD in three core areas: * E/PO Community Engagement and Development * E/PO Product and Project Activity Analysis * Science Education and Public Outreach Forum Coordination Committee Service. SEPOFs are collaborating with NASA and external science and education and outreach communities in E/PO on multiple levels ranging from the mission and non-mission E/PO project activity managers, project activity partners, and scientists and researchers, to front line agents such as naturalists/interpreters, teachers, and higher education faculty, to high level agents such as leadership at state education offices, local schools, higher education institutions, and professional societies. The overall goal for the SEPOFs is increased awareness, knowledge, and understanding of scientists, researchers, engineers, technologists, educators, product developers, and dissemination agents of best practices, existing NASA resources, and community expertise applicable to E/PO. By coordinating and supporting the NASA E/PO Community, the NASA/SEPOF partnerships will lead to more effective, sustainable, and efficient utilization of NASA science discoveries and learning experiences.
Cybersecurity_Framework.ashx Byres, Eric and Justin Lowe, 2004, The Myths and Facts behind Cyber Security Risks for Industrial Control Systems, Proceedings of the VDE ...Myths and Facts behind Cyber Security Risks for Industria l Control Systems, Proceedings of the VDE Kongress, 2004. Kshetri, Nir, 2005, Pattern of
Spaniol, K; Geerling, G
Enrollment in MD PhD programs offers the opportunity of a basic science education for medical students and doctors. These programs originated in the USA where structured programs have been offered for many years, but now German universities also run MD PhD programs. The MD PhD programs provided by German universities were investigated regarding entrance requirements, structure and financing modalities. An internet and telephone-based search was carried out. Out of 34 German universities 22 offered MD PhD programs. At 15 of the 22 universities a successfully completed course of studies in medicine was required for enrollment, 7 programs admitted medical students in training and 7 programs required a medical doctoral thesis, which had to be completed with at least a grade of magna cum laude in 3 cases. Financing required scholarships in many cases. Several German universities currently offer MD PhD programs; however, these differ considerably regarding entrance requirements, structure and financing. A detailed analysis investigating the success rates of these programs (e.g. successful completion and career paths of graduates) would be of benefit.
Voth, M.H.; Jester, W.A.
The power reactor industry emerged from extensive research and development performed at nonpower reactors (NPRs). As the industry matures, NPRs continue to support and enhance power reactor technology. With the closure of many government and private industry NPRS, there is an increasing call for the 33 universities with operating research reactors to provide the needed services. The Penn State Radiation Science and Engineering Center (RSEC) includes a 1-MW pool-type pulsing TRIGA reactor, a neutron beam laboratory with real-time neutron radiography equipment, hot cells with master-slave manipulators for remote handling of radioactive materials, a gamma-ray irradiation pool, a low-level radiation monitoring laboratory, and extensive equipment for radiation monitoring, dosimetry, and material properties determination. While equipment is heavily utilized in the instructional and academic research programs, significant time remains available for service work. Cost recovery for service work generates income for personnel, equipment maintenance, and facility improvements. With decreasing federal and state funding for educational programs, it is increasingly important that facilities be fully utilized to generate supplementary revenue. The following are examples of such work performed at the RSEC
Forest biology is undergoing a fundamental change fostered by the application of genomic science to longstanding questions surrounding the evolution, adaptive traits, development, and environmental interactions of tree species. Genomic science has made major technical leaps in recent years, most notably with the advent of 'next generation sequencing' but...
Chisman, Janet; Walbridge, Sharon; Diller, Karen
Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)
Nielsen, Glen; Vedel, Michael; Jensen, Christian D.
. This is done to ensure an appropriate degree of security, but instead, it makes it difficult for users to remember their password, which results in passwords that are either insecure, but easy to remember, or written down on paper. In this paper we address the problem of usability in user authentication...
Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria
At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.
Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry
Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.
Jiguet, Frédéric; Devictor, Vincent; Julliard, Romain; Couvet, Denis
Volunteer-based standardized monitoring of birds has been widely implemented in Europe and North America. In France, a breeding bird survey is running since 1989 and offers keen birdwatchers to count spring birds annually during 5 min exactly on 10 fix points within a randomly selected square. The first goal of such breeding bird surveys is to measure temporal trends in order to detect possible species declines. Combining annual indices of species sharing ecological affinities or a protected/red list status further provides biodiversity indicators for policy makers. Because the sampling effort is similar among sites, and because the initial selection of monitored sites is random, the temporal trends can be considered representative of national trends, and spatial comparisons of the obtained metrics are possible. Species abundance, community richness but also community specialization and average trophic level can be estimated for each site and each year and further related to the wide range of habitat and landscape characteristics and to agricultural or forestry practices. The large number of sites allows overcoming the opposition between adaptive and passive monitoring, making such schemes fitted to adaptive monitoring. This provides opportunities to determine which type of management or practices favour biodiversity. The comparison of population fate or community dynamics across a wide range of climates and temperatures, e.g. from southern to northern Europe, revealed how European birds are already affected by climate change. Bird communities are shifting northwards, but at a slower rate than temperatures, while bird populations have larger growth rates away from their hot thermal limit. Finally, such large-scale long-term monitoring data on a complete taxonomic group (Aves) is original and offers the opportunity to compare different measures of biological diversity, such as taxonomic, phylogenetic and functional diversity. Such a citizen science scheme is an
The Association of Polar Early Career Scientists (APECS) grew out of the 4th International Polar Year (IPY-4) 2007-08 and is an international and interdisciplinary organization of over 1200 undergraduate and graduate students, postdoctoral researchers, early faculty members, educators and others with interests in Polar Regions and the wider cryosphere from more than 40 countries. Our aims are to stimulate interdisciplinary and international research collaborations, and develop effective future leaders in polar research, education and outreach. As potentially one of the major legacies of IPY-4, APECS members have been at the forefront of increasing scientific knowledge and public interest in the polar regions, centered around global climate change, and enhancing scientific understanding, media attention, primary and secondary school (K-12) educational programs, and public literacy campaigns. Research and Educational Outreach activities by APECS members during IPY-4 have improved both our understanding and the communication of all aspects of the Polar Regions and the importance of their broader global connections. APECS National Committees have run Polar Contests where young researchers partnered with teachers and students to develop curriculum and activities to share their research, have participated in many field based communication exchanges and are mentoring youth to pursue careers in science, and enhancing the public perception of scientists through photo, video and museum exhibits. In cooperation with the IPY Teachers Network and the IPY IPO, APECS is developing a polar education resource book that will feature education and outreach activities by young researchers, as well as provide examples of classroom activities for teachers to incorporate polar literacy into their curriculum and a 'how to' guide for researchers interested in conducting education and outreach. As young researchers share their excitement and experiences in deepening our understanding of the
French, R.; Cifuentes-Lorenzen, A.; Kooris, D.; O'Donnell, J.
The Connecticut Institute for Resilience and Climate Adaptation (CIRCA) provides actionable science to accelerate adaptation and resilience strategies for Connecticut's inland and coastal waterways communities. Connecticut's coastal area has some of the most valuable real estate in the United States due to the Metro North and Shoreline East commuter rail line that connects all 24 coastal municipalities through transit hubs to the New York City metropolitan region. On its way to NY, the rail runs through neighborhoods and coastal marshes and crosses local and state roads. During coastal storms and increasingly at high tides as the sea level rises, the rail line may act like a berm, but also cuts off coastal neighborhoods from the upland. When it crosses a road in a marsh setting, the clearance restriction also severely limits communities' options for moving or elevating the roadway. These flooded roadways and vulnerable transit hubs are already a challenge for municipalities and will continue to be in the future. However, given scarce resources, it is not sufficient to simply know that they are vulnerable using existing low resolution mapping tools. Communities need site-specific, exact estimates of frequency of flooding, incorporating future sea level rise, to make cost determinations and accurately project the useful life of their investment. To address this need CIRCA developed high-resolution dynamic coastal flood risk models and partnered with municipal staff, regional planning bodies and the state to apply them to infrastructure decision-making. We will present three case studies of this approach: 1) the implementation of the US HUD National Disaster Resilience Competition pilot project of road elevation and berm construction in partnership with the Department of Housing and the City of Bridgeport; 2) the City of New London's first rail and ferry transit hub vulnerability assessment for sea level rise and storms and 3) the flooding frequency of a state road
Although knowledge-discovery tools are new to the exposure science community, these tools are critical for leveraging exposure information to design health studies and interpret results for improved public health decisions. Standardized ontologies define relationships, allow for ...
Kock, W. E.
The contributions of science and technology to the success of the United States as a world leader are discussed. Specific instances of the manner in which science advances and new technologies resulting from space research have contributed to a higher standard of living are presented. It is concluded that the benefits of the space program are not reflected only in the material advancements, but that intangible results have also been achieved in greater incentives to improve the present culture.
Johnson, S. Y.; Cochrane, G. R.; Golden, N. E.; Dartnell, P.; Hartwell, S. R.; Cochran, S. A.; Watt, J. T.
The California Seafloor Mapping Program (CSMP) is a collaborative effort to develop comprehensive bathymetric, geologic, and habitat maps and data for California's State Waters, which extend for 1,350 km from the shoreline to 5.6 km offshore. CSMP began in 2007 when the California Ocean Protection Council and NOAA allocated funding for high-resolution bathymetric mapping to support the California Marine Life Protection Act and update nautical charts. Collaboration and support from the USGS and other partners has led to development and dissemination of one of the world's largest seafloor-mapping datasets. CSMP data collection includes: (1) High-resolution bathymetric and backscatter mapping using swath sonar sensors; (2) "Ground-truth" imaging from a sled mounted with video and still cameras; (3) High-resolution seismic-reflection profiling at 1 km line spacing. Processed data are all publicly available. Additionally, 25 USGS map and datasets covering one third of California's coast have been published. Each publication contains 9 to 12 pdf map sheets (1:24,000 scale), an explanatory pamphlet, and a catalog of digital geospatial data layers (about 15 to 25 per map area) with web services. Map sheets display bathymetry, backscatter, perspective views, habitats, groundtruth imagery, seismic profiles, sediment distribution and thickness, and onshore-offshore geology. The CSMP goal is to serve a large constituency, ranging from senior GIS analysts in large agencies, to local governments with limited resources, to non-governmental organizations, the private sector, and concerned citizens. CSMP data and publications provide essential science and data for ocean and coastal management, stimulate and enable research, and raise public education and awareness of coastal and ocean issues. Specific applications include: Delineation and designation of marine protected areas Characterization and modeling of benthic habitats and ecosystems Updating nautical charts Earthquake hazard
Bruun, Anders; Stage, Jan
a high level of usability in order to enable their users to employ the required functionality, especially if the target user group is elderly people. This paper reports from a usability evaluation of a home telemedicine system. Five elderly persons carried out specified tasks with the system, and based...... on that we identified usability problems with the system. The problems are presented, analysed in relation to 12 different usability themes and related to results from other evaluations of similar systems....
Full Text Available This study presents a usability testing as method, which can be used to improve controlling of web map sites. Study refers to the basic principles of this method and describes particular usability tests of mapping sites. In this paper are identified potential usability problems of web sites: Amapy.cz, Google maps and Mapy.cz. The usability testing was focused on problems related with user interfaces, addresses searching and route planning of the map sites.
Full Text Available (with knowledge of usability engineering and system domain knowledge) who inspect the Indira Padayachee, Paula Kotz? and Alta van der Merwe 302 interface and determine its compliance with recognized usability principles (the ?heuristics... presents a summary of the results of the severity rating. Table 2: Severity Rating Scale for Usability Problems (Nielsen 2007b) 0 I don?t agree that this is a usability problem at all 1 Cosmetic problem only: need not be fixed unless there is extra...
Marcilly, Romaric; Peute, Linda W.; Beuscart-Zephir, Marie-Catherine; Jaspers, Monique W.
In a Health Information Technology (HIT) regulatory context in which the usability of this technology is more and more a critical issue, there is an increasing need for evidence based usability practice. However, a clear definition of evidence based usability practice and how to achieve it is still
Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.
Usability tests are applied in industry to evaluate systems and in research as a yardstick for other usability evaluation methods. However, one potential threat to the reliability of usability tests has been left unaddressed: the evaluator effect. In this study, four evaluators analyzed four vide...
Three core themes are explored in eight papers: Usability work as a human activity, usability practice and methods, and persuasiveness of evaluation results and feedback. We explore how usability work is much more than methods and work procedures, and argue that maturing our understanding...
Hart, Thomas; Xie, Lei
The conventional one-drug-one-target-one-disease drug discovery process has been less successful in tracking multi-genic, multi-faceted complex diseases. Systems pharmacology has emerged as a new discipline to tackle the current challenges in drug discovery. The goal of systems pharmacology is to transform huge, heterogeneous, and dynamic biological and clinical data into interpretable and actionable mechanistic models for decision making in drug discovery and patient treatment. Thus, big data technology and data science will play an essential role in systems pharmacology. This paper critically reviews the impact of three fundamental concepts of data science on systems pharmacology: similarity inference, overfitting avoidance, and disentangling causality from correlation. The authors then discuss recent advances and future directions in applying the three concepts of data science to drug discovery, with a focus on proteome-wide context-specific quantitative drug target deconvolution and personalized adverse drug reaction prediction. Data science will facilitate reducing the complexity of systems pharmacology modeling, detecting hidden correlations between complex data sets, and distinguishing causation from correlation. The power of data science can only be fully realized when integrated with mechanism-based multi-scale modeling that explicitly takes into account the hierarchical organization of biological systems from nucleic acid to proteins, to molecular interaction networks, to cells, to tissues, to patients, and to populations.
Tatiana Tissa Kawakami
Full Text Available Introduction: Among the various areas of studies, health information is highlighted in this study. More specifically, the patient's electronic medical records and issues related to it’s informational organization and usability. Objectives: suggest Usability recommendations applicable to the Electronic Patient Record. More specifically, identify, according to the specialized literature, recommendations of Usability, as well as to develop a checklist with recommendations of Usability for the Electronic Patient Record. Methodology: the study’s basic purpose is the theoretical nature. The deductive method of documental delimitation was chosen. Results: elaboration of checklist with recommendations of Usability for Electronic Patient Records. Conclusion: Usability recommendations can be used to improve electronic patient records. However, it should be noted that knowledge in the scope of Information Science should be considered and summed up, since a great deal of content related to Usability refers to operational and visual aspects of the interface, not clearly or directly contemplating the issues related to information.
Debelius, Justine W; Vázquez-Baeza, Yoshiki; McDonald, Daniel; Xu, Zhenjiang; Wolfe, Elaine; Knight, Rob
The role of the human microbiome is the subject of continued investigation resulting in increased understanding. However, current microbiome research has only scratched the surface of the variety of healthy microbiomes. Public participation in science through crowdsourcing and crowdfunding microbiome research provides a novel opportunity for both participants and investigators. However, turning participatory science into publishable data can be challenging. Clear communication with the participant base and among researchers can ameliorate some challenges. Three major aspects need to be considered: recruitment and ongoing interaction, sample collection, and data analysis. Usable data can be maximized through diligent participant interaction, careful survey design, and maintaining an open source pipeline. While participatory science will complement rather than replace traditional avenues, it presents new opportunities for studies in the microbiome and beyond.
Justine W. Debelius
Full Text Available The role of the human microbiome is the subject of continued investigation resulting in increased understanding. However, current microbiome research has only scratched the surface of the variety of healthy microbiomes. Public participation in science through crowdsourcing and crowdfunding microbiome research provides a novel opportunity for both participants and investigators. However, turning participatory science into publishable data can be challenging. Clear communication with the participant base and among researchers can ameliorate some challenges. Three major aspects need to be considered: recruitment and ongoing interaction, sample collection, and data analysis. Usable data can be maximized through diligent participant interaction, careful survey design, and maintaining an open source pipeline. While participatory science will complement rather than replace traditional avenues, it presents new opportunities for studies in the microbiome and beyond.
Allen, J. S.; Tobola, K. W.; Betrue, R.
How do we reach the public with the exciting story of Solar System Exploration? How do we encourage girls to think about careers in science, math, engineering and technology? Why should NASA scientists make an effort to reach the public and informal education settings to tell the Solar System Exploration story? These are questions that the Solar System Exploration Forum, a part of the NASA Office of Space Science Education (SSE) and Public Outreach network, has tackled over the past few years. The SSE Forum is a group of education teams and scientists who work to share the excitement of solar system exploration with colleagues, formal educators, and informal educators like museums and youth groups. One major area of the SSE Forum outreach supports the training of Girl Scouts of the USA (GS) leaders and trainers in a suite of activities that reflect NASA missions and science research. Youth groups like Girl Scouts structure their activities as informal education.
Kahaner, David K. [Asian Technology Information Program
The Asian Technology Information Program (ATIP) conducted a seven-month Asian science and technology information program for the Office:of Energy Research (ER), U.S: Department of Energy (DOE.) The seven-month program consists of 1) monitoring, analyzing, and dissemiuating science and technology trends and developments associated with Asian high performance computing and communications (HPC), networking, and associated topics, 2) access to ATIP's annual series of Asian S&T reports for ER and HPC related personnel and, 3) supporting DOE and ER designated visits to Asia to study and assess Asian HPC.
Ramli, Rindra M.; Bukhari, Duaa
This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.
Ramli, Rindra M.
This usability testing project was conducted to elicit an understanding of our community use of the library website. The researchers wanted to know how our users are interacting with the library website and the ease of obtaining relevant information from the website. The methodology deployed was computer user testing where participants are made to answer several questions and executing the actions on the library website. Their actions are recorded via Techsmith Camtasia software for later analysis by the researchers.
Zhou, Ronggang; Chan, Alan H S
In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan  proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework , a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.
Uldall-Espersen, Tobias; Frøkjær, Erik
Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop......Usability, Case Study, Software Engineering, Software Quality, Organizational Impact, Usability Requirement Management, CHI 2007 workshop...
In his article “The Usability Construct: A Dead End?”, Tractinsky (in Human-Computer Interaction) contends that for scientific research on usability to progress, the usability construct should be unbundled and replaced by well-defined constructs. This contention is presented as the conclusion...... that follows naturally from taking a scientist’s viewpoint on usability. Similar calls for definitive concepts – constructs in Tractinsky’s terminology – have been made in other scientific fields with concepts as ambiguous as that of usability. But counterarguments have also been presented....
Rye, J A; Chester, A L
In response to the need to help West Virginia secondary school students overcome educational and economic barriers and to increase the number of health professionals in the state, the Health Sciences and Technology Academy (hereafter, "the Academy") was established in 1994. The Academy is a partnership between West Virginia University (WVU)--including the Robert C. Byrd Health Sciences Center, Eberly College of Arts and Sciences, and the College of Human Resources and Education--and members of the community, including secondary-school teachers, health care professionals, and other community leaders. The Academy targets students from underrepresented groups (mainly African Americans and financially disadvantaged whites) in grades nine through 12. By November 1997, 290 students (69% girls and 33% African American) from 17 counties were Academy participants. Funding is from the W. K. Kellogg Foundation, Howard Hughes Medical Institute, the National Institutes of Health, the Coca-Cola Foundation, and other sources. Academy programs are an on-campus summer institute and community-based clubs, where students engage in activities for science and math enrichment, leadership development, and health careers awareness. In the Academy's clubs, students carry out extended investigations of problems related to human health and local communities. Most students report that the Academy has increased their interest in health care careers, and almost all who have continued to participate in Academy programs through their senior year have been accepted into college.
Science research courses have been around for years at the university and high school level. As inquiry based learning has become more and more a part of the science teacher's vocabulary, many of these courses have adopted an inquiry model for studying science. Learners of all ages benefit from learning through the natural process of inquiry. I participated in the CIRES Earthworks program for science teachers (Colorado University) in the summer of 2007 and experienced, first hand, the value of inquiry learning. With the support and vision of my school administration, and with the support and commitment of community partners, I have developed a Middle School Science Research Program that is transforming how science is taught to students in my community. Swift Creek Middle School is located in Tallahassee, Florida. There are approximately 1000 students in this suburban public school. Students at Swift Creek are required to take one science class each year through 8th grade. As more emphasis is placed on learning a large number of scientific facts and information, in order to prepare students for yearly, standardized tests, there is a concern that less emphasis may be placed on the process and nature of science. The program I developed draws from the inquiry model followed at the CIRES Earthworks program, utilizes valuable community partnerships, and plays an important role in meeting that need. There are three major components to this Middle School Research Program, and the Center for Integrated Research and Learning (CIRL) at the National High Magnetic Field Lab (NHMFL) at Florida State University is playing an important role in all three. First, each student will develop their own research question and design experiments to answer the question. Scientists from the NHMFL are serving as mentors, or "buddy scientists," to my students as they work through the process of inquiry. Scientists from the CIRES - Earthworks program, Florida State University, and other
Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V., E-mail: firstname.lastname@example.org, E-mail: email@example.com, E-mail: firstname.lastname@example.org, E-mail: email@example.com, E-mail: firstname.lastname@example.org [Instituto de Engenharia Nuclear (DENN/IEN/CNEN/RJ), Rio de Janeiro, RJ (Brazil). Departamento de Engenharia Nuclear
To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)
Grecco, Cláudio H.S.; Santos, Isaac J.A.L.; Farias, Marcos S.; Farias, Larissa P.; Filho, Alfredo M.V.
To avoid errors when handling nuclear medical equipment, it is important to develop products with a high degree of usability. This can be achieved by performing usability evaluations in the product development process to detect and mitigate potential usability problems. Usability evaluation focuses on how well users can learn and use a product to achieve their goals. Thus, the usability evaluation has become recognized as a valuable complement to the established approaches to design good user interfaces, to reduce incidents and accidents as well the time required to learn how to use the equipment. To gather information about usability, practitioners use a variety of methods that gather feedback from users about an existing interface or plans related to a new interface. A wide range of usability evaluation methods have been proposed, but few methods focus on developing an objective and practical evaluation method for usability. Moreover, the usability evaluations are based on human judgments and most methods cannot fully solve the subjectivity of these evaluations. In order to remedy this deficiency, the purpose of this work is to adopt a Fuzzy Set Theory (FST) approach to establish a method for the usability evaluation of nuclear medical equipment based on usability heuristics for user interface design and international standards for ergonomics of human-system interaction. To exemplify the method we performed a usability evaluating of the Digital Spectrometer ESP 13004 by testing it with representative users. The results showed that the method is a proactive tool to provide a basis for checking usability of medical device interfaces. (author)
Høegh, Rune Thaarup
This paper presents a study of the strengths and weaknesses of written, multimedia and oral feedback from usability evaluations to developers. The strengths and weaknesses are related to how well the feedback supports the developers in addressing usability problems in a software system. The study...... concludes that using the traditional written usability report, as the only form of feedback from usability evaluations is associated with problems related to the report not supporting the process of addressing the usability problems. The report is criticized for representing an overwhelming amount...... of information, while still not offering the required information to address usability problems. Other forms of feedback, such as oral or multimedia feedback helps the developer in understanding the usability problems better, but are on the other hand less cost-effective than a written description....
Full Text Available This data article provides a data description on article entitled “A framework for improving web accessibility and usability of Open Course Ware sites”  This Data in Brief presents the data obtained from the accessibility and usability evaluation of the UTPL OCW. The data obtained from the framework evaluation consists of the manual evaluation of the standards criteria and the automatic evaluation of the tools Google PageSpeed and Google Analytics. In addition, this article presents the synthetized tables from standards that are used by the framework to evaluate the accessibility and usability of OCW, and the questionnaires required to extract the data. As a result, the article also provides the data required to reproduce the evaluation of other OCW.
Boring, R. L.; Tran, T. Q.; Gertman, D. I.; Ragsdale, A.
Boring and Gertman (2005) introduced a novel method that augments heuristic usability evaluation methods with that of the human reliability analysis method of SPAR-H. By assigning probabilistic modifiers to individual heuristics, it is possible to arrive at the usability error probability (UEP). Although this UEP is not a literal probability of error, it nonetheless provides a quantitative basis to heuristic evaluation. This method allows one to seamlessly prioritize and identify usability issues (i.e., a higher UEP requires more immediate fixes). However, the original version of this method required the usability evaluator to assign priority weights to the final UEP, thus allowing the priority of a usability issue to differ among usability evaluators. The purpose of this paper is to explore an alternative approach to standardize the priority weighting of the UEP in an effort to improve the method's reliability. (authors)
Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza
This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.
Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric
Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.
Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein
Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.
Kitson, Nicole A; Price, Morgan; Bowen, Michael; Lau, Francis
Medication errors are a significant source of actual and potential harm for patients. Community medication records have the potential to reduce medication errors, but they can also introduce unintended consequences when there is low fit to task (low cognitive fit). PharmaNet is a provincially managed electronic repository that contains the records for community-based pharmacy-dispensed medications in British Columbia. This research explores the usability of PharmaNet, as a representative community-based medication repository. We completed usability inspections of PharmaNet through vendor applications. Vendor participants were asked to complete activity-driven scenarios, which highlighted aspects of medication management workflow. Screen recording was later reviewed. Heuristics were applied to explore usability issues and improvement opportunities. Usability inspection was conducted with four PharmaNet applications. Ninety-six usability issues were identified; half of these had potential implications for patient safety. These were primarily related to login and logout procedures; display of patient name; display of medications; update and display of alert information; and the changing or discontinuation of medications. PharmaNet was designed primarily to support medication dispensing and billing activities by community pharmacies, but is also used to support care providers with monitoring and prescribing activities. As such, some of the features do not have a strong fit for other clinical activities. To improve fit, we recommend: having a Current Medications List and Displaying Medication Utilization Charts.
Meza, David; Berndt, Sarah
The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or
Matraf, Munya Saleh Ba; Hussain, Azham
Evaluation for mobile e-book applications are limited and did not address all the important usability measurements. Hence, this study aimed to identify the characteristics that affect user satisfaction on the usability of mobile e-book applications. Five characteristics that have a significant effect on the user satisfaction of mobile e-book applications have been identified namely readability, effectiveness, accessibility, efficiency, and navigation. A usability evaluation was conducted on three mobile e-book applications namely Adobe Acrobat Reader, Ebook Reader, and Amazon Kindle. 30 students from Universiti Utara Malaysia evaluated the mobile e-book applications and their satisfaction was measured using questionnaire. The outcomes discovered that the five characteristics have a significant positive relationship with user satisfaction. This provides insights into the main characteristics that increase user satisfaction.
Full Text Available The article describes the design of a mobile workplace learning tool for trainers of the International Training Centre of the International Labour Organization. The motivation behind is to provide trainers with a practical tool that will enable them to recall information at the moment of need and continue to learn in context. On this purpose a set of visual augmented reality cards was created, taking into consideration the fundamental mobile learning and usability principles. The nature of the article is empirical as it reports an experiment carried out with trainers which aimed at testing cards usability and learnability. Results show that the integration of both online and offline strategies was perceived as an added value as trainers could choose to retrieve information as they mostly like; finally, it also resulted in high usability scores, an aspect that contributes to their effectiveness at the workplace.
Sørensen, Jannick Kirk
Good usability is important in all ICT solutions. To achieve good usability, a good praxis for interaction design is needed. Usability and interaction design have however emerged and established itself in a North European and US context. The ICT industry in Africa do not have the same resources...... for user-involvement and participatory design be directly transferred? How can interaction design and usability be cared for in African ICT development context, given the resources available? This paper aims to initiate a discussion of the conditions for interaction design and usability in West Africa...... in the field of interaction design as in the developed world. While good usability and good user experiences are important to all users of ICT, the question is whether the methods and techniques that were mainly developed in Scandinavia, Europe and US are suitable for ICT development in Africa? Can ideals...
Følstad, Asbjørn; Hornbæk, Kasper
Usability evaluation helps to determine whether interactive systems support users in their work tasks. However, knowledge about those tasks and, more generally, about the work-domain is difficult to bring to bear on the processes and outcome of usability evaluation. One way to include such work......-domain knowledge might be Cooperative Usability Testing, an evaluation method that consists of (a) interaction phases, similar to classic usability testing, and (b) interpretation phases, where the test participant and the moderator discuss incidents and experiences from the interaction phases. We have studied...... whether such interpretation phases improve the relevance of usability evaluations in the development of work-domain specific systems. The study included two development cases. We conclude that the interpretation phases generate additional insight and redesign suggestions related to observed usability...
Hollander, S M
A questionnaire was mailed to 148 publicly and privately supported academic health sciences libraries affiliated with Association of American Medical Colleges (AAMC-accredited medical schools in the United States and Canada to determine level of access and services provided to the general public. For purposes of this study, "general public" was defined as nonaffiliated students or health care professionals, attorneys and other nonhealth-related professionals, patients from affiliated or other hospitals or clinics, and general consumers. One hundred five (71%) libraries responded. Results showed 98% of publicly supported libraries and 88% of privately supported libraries provided access to some or all of the general public. Publicly supported libraries saw greater numbers of public patrons, often provided more services, and were more likely to circulate materials from their collections than were privately supported libraries. A significant number of academic health sciences libraries housed a collection of consumer-oriented materials and many provided some level of document delivery service, usually for a fee. Most allowed the public to use some or all library computers. Results of this study indicated that academic health sciences libraries played a significant role in serving the information-seeking public and suggested a need to develop written policies or guidelines covering the services that will be provided to minimize the impact of this service on primary clientele.
Hollander, Sue M.
A questionnaire was mailed to 148 publicly and privately supported academic health sciences libraries affiliated with Association of American Medical Colleges (AAMC)–accredited medical schools in the United States and Canada to determine level of access and services provided to the general public. For purposes of this study, “general public” was defined as nonaffiliated students or health care professionals, attorneys and other nonhealth-related professionals, patients from affiliated or other hospitals or clinics, and general consumers. One hundred five (71%) libraries responded. Results showed 98% of publicly supported libraries and 88% of privately supported libraries provided access to some or all of the general public. Publicly supported libraries saw greater numbers of public patrons, often provided more services, and were more likely to circulate materials from their collections than were privately supported libraries. A significant number of academic health sciences libraries housed a collection of consumer-oriented materials and many provided some level of document delivery service, usually for a fee. Most allowed the public to use some or all library computers. Results of this study indicated that academic health sciences libraries played a significant role in serving the information-seeking public and suggested a need to develop written policies or guidelines covering the services that will be provided to minimize the impact of this service on primary clientele. PMID:10658965
Lozano, María D; Tesoriero, Ricardo; Penichet, Victor MR
Written by international researchers in the field of Distributed User Interfaces (DUIs), this book brings together important contributions regarding collaboration and usability in Distributed User Interface settings. Throughout the thirteen chapters authors address key questions concerning how collaboration can be improved by using DUIs, including: in which situations a DUI is suitable to ease the collaboration among users; how usability standards can be used to evaluate the usability of systems based on DUIs; and accurately describe case studies and prototypes implementing these concerns
will discuss some of the key elements of successful interactions between science and policy, as well as some specifics for the carbon management context. I will draw on case studies of previous monitoring efforts developed for policy and illustrate some of the key elements to be considered as well as lessons learned. The paper will also examine how the carbon context may be different from other contexts we have encountered in the past. Finally, I will conclude with some implications for structuring decision support science policies within the U.S. Global Change Research Program and other related programs.
There has been roughly 15 years of research into approaches for aligning research in Human Computer Interaction with computer Security, more colloquially known as ``usable security.'' Although usability and security were once thought to be inherently antagonistic, today there is wide consensus that systems that are not usable will inevitably suffer security failures when they are deployed into the real world. Only by simultaneously addressing both usability and security concerns will we be able to build systems that are truly secure. This book presents the historical context of the work to dat
future versions of the prod- uct? The results show that users write about product use in terms related to standard and popularly researched aspects of usability and user experience, e.g. effiiency, effectiveness, enjoyment, frustration. The frequency with which different aspects are depicted in reviews...... differs significantly between product domains. We also find that reviews contain descriptions of more persistent usability issues. I devise automatic methods for classifying sentences with regard to dimensions of both usability and user experience and usability problems and perform a linguistic analysis...
Full Text Available in these types of development projects, the dream of the providing effective access may remain just that – a dream. This paper highlights the important role that usability plays in the drive towards narrowing the digital divide. We report on the outcome of a...
Girard, Tulay; Pinar, Musa
This research advances the understanding of the usability of marketing case study modules in the area of interactive web-based technologies through the assignment of seven interactive case modules in a Principles of Marketing course. The case modules were provided for marketing students by the publisher, McGraw Hill Irwin, of the…
Lopes, J. Bernardino; Branco, Julia; Jimenez-Aleixandre, Maria Pilar
According to the literature, there is a very important corpus of knowledge that allows for the investigation of some dimensions of `learning experience' provided to students, in relation to epistemic, pedagogical and meta-cognitive practices. However, in the literature, there is little investigation into the invariance (or not) of the characteristics of students' learning experience while being taught a scientific subject by the same teacher. This paper suggests that the relationship between the learning experience provided and the competences developed is not properly highlighted. This paper analyses the learning experience provided to students in epistemic, pedagogical and meta-cognitive terms. The students were taught the proprieties and applications of light by one teacher, in three classes, over 7 weeks. We analysed the data in each referred learning experience, using a pre-defined category system. The students' competences were evaluated by a competence test. The epistemic demand of each item and the students' performances were also analysed. Our findings point to the non invariance of learning experiences provided to students and the influence of some dimensions of learning experiences provided in the development of certain competences. These findings and their implications are contextualized and discussed.
Cross, E. V., III; Perera, J. S.; Hanson, A. M.; English, K.; Vu, L.; Amonette, W.
Each exercise device on the International Space Station (ISS) has a unique, customized software system interface with unique layouts / hierarchy, and operational principles that require significant crew training. Furthermore, the software programs are not adaptable and provide no real-time feedback or motivation to enhance the exercise experience and/or prevent injuries. Additionally, the graphical user interfaces (GUI) of these systems present information through multiple layers resulting in difficulty navigating to the desired screens and functions. These limitations of current exercise device GUI's lead to increased crew time spent on initiating, loading, performing exercises, logging data and exiting the system. To address these limitations a Next Generation One Portal (NextGen One Portal) Crew Countermeasure System (CMS) was developed, which utilizes the latest industry guidelines in GUI designs to provide an intuitive ease of use approach (i.e., 80% of the functionality gained within 5-10 minutes of initial use without/limited formal training required). This is accomplished by providing a consistent interface using common software to reduce crew training, increase efficiency & user satisfaction while also reducing development & maintenance costs. Results from the usability evaluations showed the NextGen One Portal UI having greater efficiency, learnability, memorability, usability and overall user experience than the current Advanced Resistive Exercise Device (ARED) UI used by astronauts on ISS. Specifically, the design of the One-Portal UI as an app interface similar to those found on the Apple and Google's App Store, assisted many of the participants in grasping the concepts of the interface with minimum training. Although the NextGen One-Portal UI was shown to be an overall better interface, observations by the test facilitators noted specific exercise tasks appeared to have a significant impact on the NextGen One-Portal UI efficiency. Future updates to
impact on society beyond science and technology ? Nothing to report at this time. 5. CHANGES/PROBLEMS: Changes in approach and reasons for...AWARD NUMBER: W81XWH-16-1-0785 TITLE: Prosthetic Smart Socket Technology to Improve Patient Interaction, Usability, Comfort, Fit and Function...2016 - 29 Sep 2017 4. TITLE AND SUBTITLE Prosthetic Smart Socket Technology to Improve Patient Interaction, Usability, Comfort, Fit and Function 5a
Gupta, Deepak; Ahlawat, Anil K.; Sagar, Kalpna
Evaluation of software quality is an important aspect for controlling and managing the software. By such evaluation, improvements in software process can be made. The software quality is significantly dependent on software usability. Many researchers have proposed numbers of usability models. Each model considers a set of usability factors but do not cover all the usability aspects. Practical implementation of these models is still missing, as there is a lack of precise definition of usability. Also, it is very difficult to integrate these models into current software engineering practices. In order to overcome these challenges, this paper aims to define the term `usability' using the proposed hierarchical usability model with its detailed taxonomy. The taxonomy considers generic evaluation criteria for identifying the quality components, which brings together factors, attributes and characteristics defined in various HCI and software models. For the first time, the usability model is also implemented to predict more accurate usability values. The proposed system is named as fuzzy hierarchical usability model that can be easily integrated into the current software engineering practices. In order to validate the work, a dataset of six software development life cycle models is created and employed. These models are ranked according to their predicted usability values. This research also focuses on the detailed comparison of proposed model with the existing usability models.
Johnston, Lindsay; Williams, Susan B; Ades, Anne
A well-organized educational curriculum for the training of both novice and experienced ECMO providers is critical for the continued function of an institutional ECMO program. ELSO provides guidance for the education for ECMO specialists, physicians and staff, which incorporates "traditional" instructor-centered educational methods, such as didactic lectures and technical skill training. Novel research suggests utilization of strategies that align with principles of adult learning to promote active learner involvement and reflection on how the material can be applied to understand existing and new constructs may be more effective. Some examples include the "flipped classroom," e-learning, simulation, and interprofessional education. These methodologies have been shown to improve active participation, which can be related to improvements in understanding and long-term retention. A novel framework for ECMO training is considered. Challenges in assessment and credentialing are also discussed. Copyright © 2018 Elsevier Inc. All rights reserved.
Full Text Available Online biodiversity portals and databases enabling access to large volumes of biological information represent a potentially extensive set of resources for a variety of user groups. However, in order for these resources to live up to their promise they need to be both useful and easy to use. We discuss a number of principles for designing systems for usability, examine how these have been applied to the development of online biodiversity resources and compare this with a portal project developed by the Astrophysics community. We highlight a lack of user involvement and formalised requirements analysis by biodiversity projects resulting in a poor understanding of both the users and their tasks. We suggest a change in the way large biodiversity portal projects are structured, that is by providing infrastructure and supporting user groups developing individual interfaces.
Kavathatzopoulos, Iordanis; Kostrzewa, Agata; Laaksoharju, Mikael
The objectives of the tutorial are to provide knowledge of basic ethical, psychological and organizational theories that are relevant to consider ethical aspects during design and use of IT systems; knowledge and skills about handling and solving ethical problems in connection with design and use of IT-systems; and skills in using questionnaires, surveys, interviews and the like in connection with software development and IT-use. It contains lectures, workshop and exercises; use of special tools to identify and consider IT ethical issues during planning, construction, installation and use of IT systems; and group exercises where the participants train their ethical skills on IT ethical conflicts and problems. Intended participants are system developers, purchasers, usability experts, academics, HCI teachers.
José Manuel Ojel-Jaramillo
Full Text Available Demographic and sociological changes in the last 50 years have forced Western societies to create services to attend to elderly people in their homes, where they can live within familiar environments. Telecare involves a device plugged into a telephonic network that provides access to teams of professionals who can attend to the needs of the elderly in their homes. These devices have been designed according to the principles of universal design, but the great number of erroneous calls to telecare centers point to the necessity of enhancing the usability of the devices. One analysis of the cognitive functioning of elderly people showed that a possible cause of these errors could be the difficulty elderly people have when processing language. In our experiment, we tested the hypothesis that the numbers of errors could be reduced by using icons instead of words in the device interface. The results support this hypothesis.
Khoja, S.A.; Ursani, A.A.; Ali, A.
The aim of this paper is to provide guidelines for designing wireless applications. These guidelines are developed with the help of Human Computer Interaction based Usability Evaluation surveys and tests results. These guidelines will help in making wireless applications more usable and attractive for users and will help designers to plan effective interactive applications. The guidelines presented in the paper have been derived from the results of surveys, usability tests and SET (Summative Evaluation Tests) carried out over 200 people of Karachi, Pakistan, from different walks of life with different academic and professional backgrounds, making imperative suggestions not only to improve the usability of exciting features given in wireless and mobile products, but also provide suggestions to improve usability of basic components such as, text, navigation, interactivity, multimedia, control and behavior. (author)
Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane
Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…
Jorritsma, Wiard; Cnossen, Fokie; van Ooijen, Peter M. A.
Objectives: To compare the usability of different Picture Archiving and Communication System (PACS) workstations, determine whether a usability test has added value with respect to the traditional way of comparing PACSs based on functional requirements, and to evaluate the appropriateness of a
Ruyter, de B.E.R.; Vet, de J.H.M.
Improving usability of consumer applications has been the focus of much research. Estimating the advantage of these efforts, however, still is very cumbersome since evaluating product improvements in terms of their usability requires good measuring methods and tools. In this paper activities in the
Kelly, Angelita C.; Coronado, Patrick L.; Case, Warren F.; Franklin, Ameilia
The need for realtime data to aid in disaster management and monitoring has been clearly demonstrated for the past several years, e.g., during the tsunami in Indonesia in 2004, the hurricane Katrina in 2005, fires, etc. Users want (and often require) the means to get earth observation data for operational regional use as soon as they are generated by satellites. This is especially true for events that can cause loss of human life and/or property. To meet this need, NASA's Earth Observing System (EOS) satellites, Terra and Aqua, provide realtime data useful to disaster management teams. This paper describes the satellites, their Direct Broadcast (DB) capabilities, the data uses, what it takes to deploy a DB ground station, and the future of the DB.
Rizvi, Rubina F; Marquard, Jenna L; Hultman, Gretchen M; Adam, Terrence J; Harder, Kathleen A; Melton, Genevieve B
Background A substantial gap exists between current Electronic Health Record (EHR) usability and potential optimal usability. One of the fundamental reasons for this discrepancy is poor incorporation of a User-Centered Design (UCD) approach during the Graphical User Interface (GUI) development process. Objective To evaluate usability strengths and weaknesses of two widely implemented EHR GUIs for critical clinical notes usage tasks. Methods Twelve Internal Medicine resident physicians interacting with one of the two EHR systems (System-1 at Location-A and System-2 at Location-B) were observed by two usability evaluators employing an ethnographic approach. User comments and observer findings were analyzed for two critical tasks: (1) clinical notes entry and (2) related information-seeking tasks. Data were analyzed from two standpoints: (1) usability references categorized by usability evaluators as positive, negative, or equivocal and (2) usability impact of each feature measured through a 7-point severity rating scale. Findings were also validated by user responses to a post observation questionnaire. Results For clinical notes entry, System-1 surpassed System-2 with more positive (26% vs. 12%) than negative (12% vs. 34%) usability references. Greatest impact features on EHR usability (severity score pertaining to each feature) for clinical notes entry were: autopopulation (6), screen options (5.5), communication (5), copy pasting (4.5), error prevention (4.5), edit ability (4), and dictation and transcription (3.5). Both systems performed equally well on information-seeking tasks and features with greatest impacts on EHR usability were navigation for notes (7) and others (e.g., looking for ancillary data; 5.5). Ethnographic observations were supported by follow-up questionnaire responses. Conclusion This study provides usability-specific insights to inform future, improved, EHR interface that is better aligned with UCD approach.
Full Text Available This article describes usability testing of two online research guides. One guide was in the area of applied human sciences and the other was geared toward the discipline of psychology. Six undergraduate students were given several tasks to complete by using the guides. The participants also completed two questionnaires. One described the participants’ demographics and how much time they spent on the Internet on a daily basis. On the other questionnaire, filled out after the usability test, the participants rated the online research guides. Overall, the online research guides were found to be difficult to use. By observing how the participants interacted with the online research guides, the author has identified several problem areas that need to be addressed.
MacCall, Steven L
The objective of this study was to determine the number and topical range of available online medical books and to assess how health sciences libraries were providing access to these resources on their public Websites. The collection-based evaluative technique of list checking was used to assess the number and topical range of online medical books of the six largest publishers. Publisher inventory lists were downloaded over a two-day period (May 16-17, 2004). Titles were counted and compared with the 2003 Brandon/Hill list. A sample of health sciences libraries was subsequently derived by consulting the 2004 "Top Medical Schools-Research" in U.S. News & World Report. Bibliographic and bibliothecal access methods were evaluated based on an inspection of the publicly available Websites of the sample libraries. Of 318 currently published online medical books, 151 (47%) were Brandon/Hill titles covering 42 of 59 Brandon/Hill topics (71%). These 151 titles represented 22% (N = 672) of the Brandon/Hill list, which further broke down as 52 minimal core, 41 initial purchase, and 58 other recommended Brandon/Hill titles. These numbers represented 50%, 28%, and 12%, respectively, of all Brandon/Hill titles corresponding to those categories. In terms of bibliographic access, 20 of 21 of sampled libraries created catalog records for their online medical books, 1 of which also provided analytical access at the chapter level, and none provided access at the chapter section level. Of the 21 libraries, 19 had library Website search engines that provided title-level access and 4 provided access at the chapter level and none that at the chapter section level. For bibliothecal access, 19 of 21 libraries provided title-level access to medical books, 8 of which provided classified and alphabetic arrangements, 1 provided a classified arrangement only, and 10 provided an alphabetic arrangement only. No library provided a bibliothecal arrangement for medical book chapters or chapter
Nørgaard, Mie; Hornbæk, Kasper Anders Søren
The format used to present feedback from usability evaluations to developers affects whether problems are understood, accepted, and fixed. Yet, little research has investigated which formats are the most effective. We describe an explorative study where three developers assess 40 usability findings...... presented using five feedback formats. Our usability findings comprise 35 problems and 5 positive comments. Data suggest that feedback serves multiple purposes. Initially, feedback must convince developers about the relevance of a problem and convey an understanding of this. Feedback must next be easy...... working with the feedback to address the usability problems, there were no significant differences among the developers' ratings of the value of the different formats. This suggests that all of the formats may serve equally well as reminders in later stages of working with usability problems...
Full Text Available Usability is an attribute of any good product, just as its functionality. It refers mainly to the utility of a product for its indented users, as well as to its ease of use. And whilst a correct functionality is critical for the commercial success of any product, its value comes through the human needs that it fulfills, which is determined through various marketing research techniques. In parallel, the IT&C community has developed in the last two decades its own type of research, called usability testing, used mainly to evaluate interface ease of use and all usability problems associated with.software products. This article aims at finding the right place for usability testing and usability professionals in the marketing community, as well as drawing a wider picture, from a marketing research perspective, on one of the most popular topics in IT&C community for the benefit of marketing scholars and professionals.
Uldall-Espersen, Tobias; Frøkjær, Erik; Hornbæk, Kasper Anders Søren
Analyzing usability improvement processes as they take place in real-life organizations is necessary to understand the practice of usability work. This paper describes a case study where the usability of an information system is improved and a relationship between the improvements...... and the evaluation efforts is established. Results show that evaluation techniques complemented each other by suggesting different kinds of usability improvement. Among the techniques applied, a combination of questionnaires and Metaphors of Human Thinking (MOT) showed the largest mean impact and MOT produced...... the largest number of impacts. Logging of real-life use of the system over 6 months indicated six aspects of improved usability, where significant differences among evaluation techniques were found. Concerning five of the six aspects Think Aloud evaluations and the above-mentioned combination of questionnaire...
Full Text Available This paper is focused on the testing and evaluating of public administration electronic forms from the usability point of view. Its objective is to design a suitable methodology for usability testing of electronic forms and their description and distribution to public administration information systems professionals. Firstly, methods of usability engineering are summarized and a suitable method for usability testing and evaluation of electronic forms is selected. Farther, the methodology of electronic forms usability testing that uses the selected method is suggested. In the last part of the paper the case study that uses the proposed methodology is suggested and performed. The main benefit of the work is the design of testing methodology and proposition of the set of recommendations for new public administration electronic forms design.
Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna
The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.
Thompson, Britta M; Vannatta, Jerry B; Scobey, Laura E; Fergeson, Mark; Humanities Research Group; Crow, Sheila M
To increase students' understanding of what it means to be a physician and engage in the everyday practice of medicine, a humanities program was implemented into the preclinical curriculum of the medical school curriculum. The purpose of our study was to determine how medical students' views of being a doctor evolved after participating in a required humanities course. Medical students completing a 16-clock hour humanities course from 10 courses were asked to respond to an open-ended reflection question regarding changes, if any, of their views of being a doctor. The constant comparative method was used for coding; triangulation and a variety of techniques were used to provide evidence of validity of the analysis. A majority of first- and second-year medical students (rr = 70%) replied, resulting in 100 pages of text. A meta-theme of Contextualizing the Purpose of Medicine and three subthemes: the importance of Treating Patients Rather than a Disease, Understanding Observation Skills are Important, and Recognizing that Doctors are Fallible emerged from the data. Results suggest that requiring humanities as part of the required preclinical curriculum can have a positive influence on medical students and act as a bridge to contextualize the purpose of medicine.
Rogers, L. D.; Valderrama Graff, P.; Bandfield, J. L.; Christensen, P. R.; Klug, S. L.; Deva, B.; Capages, C.
The Mars Public Mapping Project is a web-based education and public outreach tool developed by the Mars Space Flight Facility at Arizona State University. This tool allows the general public to identify and map geologic features on Mars, utilizing Thermal Emission Imaging System (THEMIS) visible images, allowing public participation in authentic scientific research. In addition, participants are able to rate each image (based on a 1 to 5 star scale) to help build a catalog of some of the more appealing and interesting martian surface features. Once participants have identified observable features in an image, they are able to view a map of the global distribution of the many geologic features they just identified. This automatic feedback, through a global distribution map, allows participants to see how their answers compare to the answers of other participants. Participants check boxes "yes, no, or not sure" for each feature that is listed on the Mars Public Mapping Project web page, including surface geologic features such as gullies, sand dunes, dust devil tracks, wind streaks, lava flows, several types of craters, and layers. Each type of feature has a quick and easily accessible description and example image. When a participant moves their mouse over each example thumbnail image, a window pops up with a picture and a description of the feature. This provides a form of "on the job training" for the participants that can vary with their background level. For users who are more comfortable with Mars geology, there is also an advanced feature identification section accessible by a drop down menu. This includes additional features that may be identified, such as streamlined islands, valley networks, chaotic terrain, yardangs, and dark slope streaks. The Mars Public Mapping Project achieves several goals: 1) It engages the public in a manner that encourages active participation in scientific research and learning about geologic features and processes. 2) It helps to
Hussain, Azham Bin; Mahmood, Alaa Thamer; Naser, Raed Kamil
User experience may vary from one user to another based on the design characteristics for processing a certain task. Our review of the literature revealed that there is a noticeable lack of studies on the effect of mobile or m-commerce design usability on customers' trust to perform certain activities. We investigated the effect of m-commerce design usability in terms of navigability, supportability, readability, creditability, and content relevant. A close-ended questionnaire was distributed to 20 customers who were asked to perform some tasks. The result showed that majority of the participants found m-commerce design usability to influence their trust of the app. The mentioned usability elements were found to positively influence customers' trust except for supportability. Our findings provide some insights to the m-commerce designers and developers and extend the current understanding about the potential of design usability in explaining users' usage behavior.
O'Connor, Rory V.
This paper explores the software processes and usability techniques used by Small and Medium Enterprises (SMEs) that develop web applications. The significance of this research is that it looks at development processes used by SMEs in order to assess to what degree usability is integrated into the process. This study seeks to gain an understanding into the level of awareness of usability within SMEs today and their commitment to usability in practice. The motivation for this research is to explore the current development processes used by SMEs in developing web applications and to understand how usability is represented in those processes. The background for this research is provided by the growth of the web application industry beyond informational web sites to more sophisticated applications delivering a broad range of functionality. This paper presents an analysis of the practices of several Irish SMEs that develop web applications through a series of case studies. With the focus on SMEs that develop web applications as Management Information Systems and not E-Commerce sites, informational sites, online communities or web portals. This study gathered data about the usability techniques practiced by these companies and their awareness of usability in the context of the software process in those SMEs. The contribution of this study is to further the understanding of the current role of usability within the software development processes of SMEs that develop web applications.
Zhou, Ronggang; Chan, Alan H S
In order to compare existing usability data to ideal goals or to that for other products, usability practitioners have tried to develop a framework for deriving an integrated metric. However, most current usability methods with this aim rely heavily on human judgment about the various attributes of a product, but often fail to take into account of the inherent uncertainties in these judgments in the evaluation process. This paper presents a universal method of usability evaluation by combining the analytic hierarchical process (AHP) and the fuzzy evaluation method. By integrating multiple sources of uncertain information during product usability evaluation, the method proposed here aims to derive an index that is structured hierarchically in terms of the three usability components of effectiveness, efficiency, and user satisfaction of a product. With consideration of the theoretical basis of fuzzy evaluation, a two-layer comprehensive evaluation index was first constructed. After the membership functions were determined by an expert panel, the evaluation appraisals were computed by using the fuzzy comprehensive evaluation technique model to characterize fuzzy human judgments. Then with the use of AHP, the weights of usability components were elicited from these experts. Compared to traditional usability evaluation methods, the major strength of the fuzzy method is that it captures the fuzziness and uncertainties in human judgments and provides an integrated framework that combines the vague judgments from multiple stages of a product evaluation process.
Marcilly, Romaric; Vasseur, Francis; Ammenwerth, Elske; Beuscart-Zephir, Marie-Catherine
This paper aims at listing the methods used to evaluate the usability of medication-related alerting functions and at knowing what type of usability issues those methods allow to detect. A sub-analysis of data from this systematic review has been performed. Methods applied in the included papers were collected. Then, included papers were sorted in four types of evaluation: "expert evaluation", "user- testing/simulation", "on site observation" and "impact studies". The types of usability issues (usability flaws, usage problems and negative outcomes) uncovered by those evaluations were analyzed. Results show that a large set of methods are used. The largest proportion of papers uses "on site observation" evaluation. This is the only evaluation type for which every kind of usability flaws, usage problems and outcomes are detected. It is somehow surprising that, in a usability systematic review, most of the papers included use a method that is not often presented as a usability method. Results are discussed about the opportunity to provide usability information collected after the implementation of the technology during their design process, i.e. before their implementation.
Nacke, Lennart E.
This paper presents a brief review of current game usability models. This leads to the conception of a high-level game development-centered usability model that integrates current usability approaches in game industry and game research.
Argues that usability research has particular relevance for enhancing the effectiveness of websites. Examines the nature and value of usability research, and the elements of an effective website based on usability principles. (SR)
Bentley, Richard S
.... The Technology Acceptance Model suggests that information systems must not only be useful but also be usable and a large body of usability engineering knowledge exists to support usable design. In addition, the U.S...
Tri, Y.; Erna, A.; Gellysa, U.
Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.
Jeong, Yeo Won; Kim, Jung A
The purpose of this study was to develop and cross-culturally validate the Korean version of SMArtphone's uSability Heuristics (K-SMASH). In the study, it was used the adaptation process consisted of five stages, namely, translation, synthesis, back translation, expert committee review, and pretesting. In the pretesting stage, a mobile application, using the prefinal K-SMASH, was evaluated for the severity of usability problems by three experts in computer science and informatics. Each participant completed the evaluation and was interviewed about their understanding, interpretation, and opinion of the cultural relevance of the prefinal K-SMASH. Next, we reviewed the differences in the experts' opinions and the questionnaire results. Twelve SMASH items, words and sentences, were translated, back translated, and revised, considering the conceptual meaning in the context of the Korean culture, by experts in various fields, including a Korean linguist and a bilingual translator, through the first stage to the fourth stage. In the pretesting stage, the results showed no major differences among the severity ratings of participants. Furthermore, all participants answered that there were no critical discrepancies or inconsistencies with the cultural relevance of the prefinal K-SMASH. The results of the study provide preliminary evidence that the modified K-SMASH can be used for heuristic evaluation, one of the usability tests, when developing applications in Korea.
Walji, Muhammad F; Kalenderian, Elsbeth; Piotrowski, Mark; Tran, Duong; Kookal, Krishna K; Tokede, Oluwabunmi; White, Joel M; Vaderhobli, Ram; Ramoni, Rachel; Stark, Paul C; Kimmes, Nicole S; Lagerweij, Maxim; Patel, Vimla L
To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35). The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.
Full Text Available With the major advances of the Internet throughout the past couple of years, websites have come to play a central role in the modern marketing business program. However, simply owning a website is not enough for a business to prosper on the Web. Indeed, it is the level of usability of a website that determines if a user stays or abandons it for another competing one. It is therefore crucial to understand the importance of usability on the web, and consequently the need for its evaluation. Nonetheless, there exist a number of obstacles preventing software organizations from successfully applying sound website usability evaluation strategies in practice. From this point of view automation of the latter is extremely beneficial, which not only assists designers in creating more usable websites, but also enhances the Internet users’ experience on the Web and increases their level of satisfaction. As a means of addressing this problem, an Intelligent Usability Evaluation (IUE tool is proposed that automates the usability evaluation process by employing a Heuristic Evaluation technique in an intelligent manner through the adoption of several research-based AI methods. Experimental results show there exists a high correlation between the tool and human annotators when identifying the considered usability violations.
Peter Edward Williams
Full Text Available Introduction: It is well-recognised that the Internet may be an appropriate vehicle to provide information for people with Learning Disabilities. A small but growing body of research has studied the usability of the Internet for this purpose. This review examines the literature relating to this issue. Objectives: The objective of the paper is to examine current research and thinking around the issue of web design for people with Learning Disabilities, including an exploration both of methods used and key findings. Methods: A comprehensive literature review was undertaken encompassing material from the fields of education, computer science and health. Literature was elicited from various appropriate bibliographic databases. In examining the literature, an analytical proforma was used to elicit information, evaluate and compare studies. Results: A large number of methods by which usability has been studied with this cohort were elicited, including using a mainstream website; comparing an especially adapted website against an equivalent ‘’mainstream’ version and comparing various ‘accessible’ website designs. Similarly, studies included those comparing the performance of people with Learning Disabilities with a ‘mainstream’ cohort and on their own. Findings overall suggest that ‘accessible sites’ are easier to use for people with Learning Disabilities. Difficulties encountered include in reading, finding content from a large quantity of text and scrolling. Work examining the efficacy of images or icons has had contradictory findings, from having little or no benefit in terms of access to information, to significantly aiding the understanding of text. Conclusions: Contradictory or inconclusive findings suggest both a need for further research and for greater participation by people with Learning Disabilities themselves in studying the usability of web sites and other IT applications.
Full Text Available University of applied science and technology has been designed to create a platform for multilateral activities such as industrial, military and academic in developing countries to promote science and scientific research applications. These universities are responsible to promote practical training in quantitative and qualitative indicators and they provide appropriate infrastructure to implement theoretical graduates to solve practical problems to build necessary infrastructure to transfer modern technology into developing countries. During the past few years, there have been tremendous development on these units but some of them have not been efficient. In this paper, we present an empirical study to measure the relative efficiencies of various units of applied science and technology universities using data envelopment analysis. The proposed model of this paper uses two inputs including human resources as well as total assets and two outputs including the number of graduate students as well as operating profit. The results of the study have indicated that some of the units are inefficient and need to be merged with other units to increase the relative efficiency of these universities.
Hart, Robert J.; Vaughan, R. Greg; McDougall, Kristin; Wojtowicz, Todd; Thenkenbail, Prasad
The U.S. Geological Survey’s Flagstaff Science Campus is focused on interdisciplinary study of the Earth and solar system, and has the scientific expertise to detect early environmental changes and provide strategies to minimize possible adverse effects on humanity. The Flagstaff Science Campus (FSC) is located in Flagstaff, Arizona, which is situated in the northern part of the State, home to a wide variety of landscapes and natural resources, including (1) young volcanoes in the San Francisco Volcanic Field, (2) the seven ecological life zones of the San Francisco Peaks, (3) the extensive geologic record of the Colorado Plateau and Grand Canyon, (4) the Colorado River and its perennial, ephemeral, and intermittent tributaries, and (5) a multitude of canyons, mountains, arroyos, and plains. More than 200 scientists, technicians, and support staff provide research, monitoring, and technical advancements in planetary geology and mapping, biology and ecology, Earth-based geology, hydrology, and changing climate and landscapes. Scientists at the FSC work in collaboration with multiple State, Federal, Tribal, municipal, and academic partners to address regional, national, and global environmental issues, and provide scientific outreach to the general public.
Sparks, Randall; Hartson, Rex
The work we report on here addresses the problem of low return on investment in software usability engineering and offers support for usability practitioners in identifying, understanding, documenting...
Le Bras, I.; Rosengard, S.; Estefania, M.; Jinich, A.
Clubes de Ciencia, which translates to "Science Clubs" is an initiative started by a group of graduate students at Harvard University in 2014 to encourage scientific exchange between the US and Mexico. These science clubs are one-week long intensive workshops taught by graduate students and/or postdocs on a subject of their choice in six Mexican cities. Instructors apply to teach a workshop by sending a proposal to the organizing committee, who is looking for workshops that emphasize hands-on, practical ideas. The instructors, primarily graduate students in the US, are paired with local co-instructors who assist and often co-teach the workshop. Local student participants, who are in their last two years of high school and the first two years of college, are selected based on their interest and enthusiasm. Each class has about 15-20 students, so that the classroom setting is intimate and interactive Sponsors, who fund instructor stipends, class supplies and program development, include the Mexican department of energy (SENER), the Mexican national science foundation (CONACYT), Harvard and MIT. Host universities also provide space and resources. In this presentation we focus on clubs that were taught in January 2015 on ocean physics and July 2015 on ocean chemistry, both taught in Ensenada, Baja California at the national autonomous university. Both workshops included a combination of data analysis, lectures, experiments and computational modeling. The ocean physics class was also recorded intermittently and is being used as a test case for an online course. The format provided an intensive teaching and networking experience and could be interesting to implement in other contexts.
Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M
To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.
Jaspers, Monique W M
Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the human-computer interaction field, we provide an overview of the methodological and empirical research available on the three usability inspection and testing methods most often used. We describe two 'expert-based' and one 'user-based' usability method: (1) the heuristic evaluation, (2) the cognitive walkthrough, and (3) the think aloud. All three usability evaluation methods are applied in laboratory settings. Heuristic evaluation is a relatively efficient usability evaluation method with a high benefit-cost ratio, but requires high skills and usability experience of the evaluators to produce reliable results. The cognitive walkthrough is a more structured approach than the heuristic evaluation with a stronger focus on the learnability of a computer application. Major drawbacks of the cognitive walkthrough are the required level of detail of task and user background descriptions for an adequate application of the latest version of the technique. The think aloud is a very direct method to gain deep insight in the problems end users encounter in interaction with a system but data analyses is extensive and requires a high level of expertise both in the cognitive ergonomics and in computer system application domain. Each of the three usability evaluation methods has shown its usefulness, has its own advantages and disadvantages; no single method has revealed any significant results indicating that it is singularly effective in all circumstances. A combination of different techniques that compliment one another should preferably be used as their collective application will be more powerful than applied in isolation. Innovative mobile and automated solutions to support end-user testing have
.... To ensure that your sites provide that experience, this guide from usability guru Krug distills his years of on-the-job experience into a practical primer on the do's and don'ts of good Web design...
Abdalla, R. M; Niall, K. K
...) and three-dimensional (3D) visualizations. This report presents an overview of the basic concepts of GIS and spatial databases, provides an analytical usability evaluation and critically analyses different spatial- database applications...
...) concept demonstrator test during June 2000. The questionnaire was designed to examine usability and interface issues relating to the design of the systems or tools, and to provide suggestions for future iterations of the system...
Boothe, Chase; Strawderman, Lesley; Hosea, Ethan
Inconsistencies among testing methods and results in previous research prompted this study that builds upon a systematic usability testing research framework to better understand how interface medium influences users' abilities to detect usability flaws in applications. Interface medium was tested to identify its effects on users' perceptions of usability and abilities to detect usability problems and severe usability problems. Results indicated that medium has no effect on users' abilities to detect usability problems or perceptions of usability. However, results did indicate an interaction between the medium and the tested application in which users were able to identify significantly more usability problems on a higher fidelity medium using a particular application. Results also indicated that as users' perceptions of an application's usability increases, the users are less able to detect usability problems in that application. Usability testing should begin early in the design process, even if low fidelity mediums will be used. Copyright © 2013 Elsevier Ltd and The Ergonomics Society. All rights reserved.
Bruun, Anders; Jensen, Janne Jul; Skov, Mikael B.
This report presents the results of a usability evaluation of the budget.com website. The evaluation was carried out by a team of 4 HCI experts, and it involved 10 potential users. The evaluation is based on measurement of (1) task completion time, (2) task completion, (3) user satisfaction and (4......) perceived workload. We have also analyzed the user interaction with the website for (5) usability problems. Through the evaluation, we have found the following weaknesses of the website: Reservation takes considerably more time than promised. The website indicates that a reservation can be made in 60...... is not useful for specific purposes. The user satisfaction is generally low. Except one high and two low scores, the user satisfaction was in the middle range. There are too many severe usability problems. The evaluation identified a considerable number of usability problems. 5 of them were critical which means...
Wale-Kolade, Adeola; Nielsen, Peter Axel
In this article we report from a case study of a software development organization and we study in particular the developers’ and product managers’ attitudes towards integrating usability work into software development. We offer explanations based on system justification theory illuminating what...... would-be integrators might be up against. The analysis shows how the developers only pay lip service to usability work and how they treat users superficially. It further shows how that leads to stereotyping of usability designers and users in order to preserve status quo, and how internalization...... of inequality between the developers and usability designers rationalizes the preservation of status quo. These findings will have significant implications for managers of software development....
Usability tests are conducted to gauge users’ experience with a system, preferably before it is released for real use, and thereby find any problems that prevent users from completing their tasks, slow them down, or otherwise degrade their user experience. Such tests are important to successful...... systems development, yet test procedures vary and the quality of test results is sometimes contested. While there is no single accepted procedure for usability specialists to follow when conducting usability tests, these tests normally involve users who think out loud while using a system and an evaluator...... who observes the users’ behavior and listens in on their thoughts. This common core of usability tests is illustrated in Figure 1. The possible variations include, for example, whether the users work individually or in pairs, whether the evaluator is in the room with the user or in an adjoining room...
Van Kuijk, J.I.
Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use. That the usability of electronic consumer products is under pressure is attributed to an incre...
Minocha, Shailey; Hall, Pat; Dawson, Liisa
With growing competition in the global E-Market place, the focus of E-Businesses is moving from customer acquisition to customer retention. Towards this, E-Businesses, in addition to providing a usable site, are integrating Customer-relationship Management (CRM) strategies into the design and usability of E-Commerce environments. These CRM strategies include personalisation, providing consistent customer service across different communication channels of the E-Business, meeting customers' exp...
Becker, Sara J; Squires, Daniel D; Strong, David R; Barnett, Nancy P; Monti, Peter M; Petry, Nancy M
Few prospective studies have evaluated theory-driven approaches to the implementation of evidence-based opioid treatment. This study compared the effectiveness of an implementation model (Science to Service Laboratory; SSL) to training as usual (TAU) in promoting the adoption of contingency management across a multisite opioid addiction treatment program. We also examined whether the SSL affected putative mediators of contingency management adoption (perceived innovation characteristics and organizational readiness to change). Sixty treatment providers (39 SSL, 21 TAU) from 15 geographically diverse satellite clinics (7 SSL, 8 TAU) participated in the 12-month study. Both conditions received didactic contingency management training and those in the predetermined experimental region received 9 months of SSL-enhanced training. Contingency management adoption was monitored biweekly, whereas putative mediators were measured at baseline, 3 months, and 12 months. Relative to providers in the TAU region, treatment providers in the SSL region had comparable likelihood of contingency management adoption in the first 20 weeks of the study, and then significantly higher likelihood of adoption (odds ratios = 2.4-13.5) for the remainder of the study. SSL providers also reported higher levels of one perceived innovation characteristic (Observability) and one aspect of organizational readiness to change (Adequacy of Training Resources), although there was no evidence that the SSL affected these putative mediators over time. Results of this study indicate that a fully powered randomized trial of the SSL is warranted. Considerations for a future evaluation are discussed.
Narasimha, Shraddhaa; Madathil, Kapil Chalil; Agnisarman, Sruthy; Rogers, Hunter; Welch, Brandon; Ashok, Aparna; Nair, Aswathi; McElligott, James
One area where telemedicine may prove to be highly effective is in providing medical care to the geriatric population, an age group predicted to account for 20% of the population in the near future. However, even though telemedicine has certain advantages, the usability of these systems with this population merits investigation. This article reviews the literature published from 2000 to 2016 with the goal of analyzing the characteristics of usability-related studies conducted using geriatric participants and the subsequent usability challenges identified. Articles were found using Web of Knowledge and PubMed citation indexing portals using the keywords (1) Telemedicine* AND Geriatrics* (2) Telemedicine* AND Usability* (3) Telemedicine* AND Usability* AND Older Adults*. A total of 297 articles were obtained from the initial search. After further detailed screening, 16 articles were selected for review based on the inclusion criteria. Of these, 60% of the studies focused on the overall usability of telemedicine systems; 6.25% focused on the usability of a telepresence robot; 12.5% compared a face-to-face medical consultation with the use of telemedicine systems, and 25% focused on the study of other aspects of telemedicine in addition to its usability. Findings reported in the studies included high patient satisfaction with telemedicine in 31.25%, whereas another 31.25% indicated a high acceptance of this method of medical consultation. Care coordination in 6.25% of the studies; confidence in telemedicine in 6.25%; trust, privacy, and reliability in 6.25%; and increased convenience when compared to personal visits in 18.75% were also reported. This review suggests limited research providing scientifically valid and reproducible usability evaluation at various stages of telemedicine system development. Telemedicine system designers need to consider the age-related issues in cognition, perception, and behavior of geriatric patients while designing telemedicine
When digital tools are developed it is important to consider the usability of the tool. Usability evaluation was done on the Afrikaanse idiome-woordeboek to determine with what success it can be used. Discount usability methods, viz. heuristic evaluation and usability testing were used. This article reports on the findings from ...
Freire, Luciana Lopes; Arezes, Pedro Miguel; Campos, José Creissac
The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.
Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Almazini, Hassan; Almazini, Hussein
Like searching for a "needle" in a "haystack", suppose that there is a large set of signals (finite sequences of numbers) fs1; s2; s3; g, and a special signal q that may or may not be in the collection. How can the signals be found in the collection that is similar, or identical to q, and how can this be done quickly? A solution to this question is the basis of the Shazam smart phone app, where a listener captures a short excerpt of a recorded song with the smart phone's microphone, and in a matter of moments the app reports the name of the song and the artist. Here, the "needle" is the excerpt, and the "haystack" is a vast corpus of popular music. The Shazam algorithm is powered by Fourier analysis. This paper presents a report on a usability evaluation of Amazon Shazam app. The researchers present the outcome based on a task-based evaluation that involved 15 users of different level of experience who performed 5 tasks using the Shazam mobile app. Post-test questionnaire was used to capture users' perceptions about the app. The results demonstrate that most of the participants were satisfied with services provided by the app.
Full Text Available The internet provides a wide range of scientific information for different areas of research, used by the related scientific communities. Often the design or architecture of these web pages does not correspond to the mental model of their users. As a result the wanted information is difficult to find. Methods established by Usability Engineering and User Experience can help to increase the appeal of scientific internet information services by analyzing the users’ requirements. This paper describes a procedure to analyze and optimize scientific internet information services that can be accomplished with relatively low effort. It consists of a combination of methods that already have been successfully applied to practice: Personas, usability inspections, Online Questionnaire, Kano model and Web Analytics.
Manzke, J M; Egan, D H; Felix, D; Krueger, H
Fifteen blind and sighted subjects, who featured as a control group for acceptance, were asked for their requirements for automated teller machines (ATMs). Both groups also tested the usability of a partially operational ATM mock-up. This machine was based on an existing cash dispenser, providing natural speech output, different function menus and different key arrangements. Performance and subjective evaluation data of blind and sighted subjects were collected. All blind subjects were able to operate the ATM successfully. The implemented speech output was the main usability factor for them. The different interface designs did not significantly affect performance and subjective evaluation. Nevertheless, design recommendations can be derived from the requirement assessment. The sighted subjects were rather open for design modifications, especially the implementation of speech output. However, there was also a mismatch of the requirements of the two subject groups, mainly concerning the key arrangement.
Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Bastide, R.; Palanque, P.; Roth, J.
This paper addresses the issue of usability testing in a component-based software engineering environment, specifically measuring the usability of different versions of a component in a more powerful manner than other, more holistic, usability methods. Three component-specific usability measures are
Hendradewa, Andrie Pasca
Usability is a key factor that determine success of a product or interactive system, like smartphone. The increasing use of smartphone and its rapid technology development, requires usability evaluation method that is more accurate and effective to found usability problem, so it can be used for product improvement in development process. This study suggests a usability evaluation method that is most effective to identify problem in smartphone usage. Three usability evaluation methods that com...
Van Kuijk, J.I.
Problem statement: Even though there is a large amount of methods for user-centred design, the usability of electronic consumer products (e.g., portable music players, washing machines and mobile phones) is under pressure. Usability is the extent to which a product can be used by specified users to
Marcilly, Romaric; Peute, Linda; Beuscart-Zephir, Marie-Catherine
Usability is a critical factor in the acceptance, safe use, and success of health IT. The User-Centred Design process is widely promoted to improve usability. However, this traditional case by case approach that is rooted in the sound understanding of users' needs is not sufficient to improve
In ziekenhuizen wordt steeds meer gebruik gemaakt van informatiesystemen, maar de usability laat vaak te wensen over. Reza Khajouei testte twee methodes om de usability te beoordelen. Hij constateert dat beide methoden ongeveer evenveel, maar verschillende problemen aan het licht brengen. Uit een
Policy-makers today have almost infinite climate-relevant scientific and other information available to them. The problem for climate change decision-making isn't missing science or inadequate knowledge of climate risks; the problem is that the "right" climate change actionable knowledge isn't getting to the right decision-maker, or is getting there too early or too late to effectively influence her decision-making. Actionable knowledge is not one-size-fit-all, and for a given decision-maker might involve scientific, economic, or risk-based information. Simply producing more and more information as we are today is not the solution, and actually makes it harder for individual decision-makers to access "their" actionable knowledge. The Climatographers began building the Climate Web five years ago to test the hypothesis that a knowledge management system could help navigate the gap between infinite information and individual actionable knowledge. Today the Climate Web's more than 1,500 index terms allow instant access to almost any climate change topic. It is a curated public-access knowledgebase of more than 1,000 books, 2,000 videos, 15,000 reports and articles, 25,000 news stories, and 3,000 websites. But it is also much more, linking together tens of thousands of individually extracted ideas and graphics, and providing Deep Dives into more than 100 key topics from changing probability distributions of extreme events to climate communications best practices to cognitive dissonance in climate change decision-making. The public-access Climate Web is uniquely able to support cross-silo learning, collaboration, and actionable knowledge dissemination. The presentation will use the Climate Web to demonstrate why knowledge management should be seen as a critical component of science and policy-making collaborations.
Borycki, Elizabeth M; Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W
The use of mobile devices and healthcare applications is increasing exponentially worldwide. This has lead to the need for the healthcare industry to develop a better understanding of the impact of the usability of mobile software and hardware upon consumer and health professional adoption and use of these technologies. There are many methodological approaches that can be employed in conducting usability evaluation of mobile technologies. More obtrusive approaches to collecting study data may lead to changes in study participant behaviour, leading to study results that are less consistent with how the technologies will be used in the real-world. Alternatively, less obstrusive methods used in evaluating the usability of mobile software and hardware in-situ and laboratory settings can lead to less detailed information being collected about how an individual interacts with both the software and hardware. In this paper we review and discuss several innovative mobile usability evaluation methods on a contiuum from least to most obtrusive and their effects on the quality of the usability data collected. The strengths and limitations of methods are also discussed.
Smith, Louis M.; And Others
A synthesis is presented of the work of Lindblom and Cohen, MacDonald and Walker, and the current authors. The synthesis considers issues in the usefulness of social science theory and research, and how observer roles in qualitative field studies yield multiple kinds of usable knowledge to a variety of audiences. (Author/BW)
created. For the test, the space created was a virtual factory space and a machine shop . Into this space the test administrators were able to inject...Using Competitive Usability Analysis”, Transactions of the ASME, Journal of Computing and Information Science in Engineering, June 2012, Vol, 12. 5
Rajanen, Dorina; Clemmensen, Torkil; Iivari, Netta
This paper examines the views of user experience (UX) professionals on the definitions of usability and UX, and compares the findings between countries and within different socio-cultural groups. A mixed-method analysis was employed on data gathered on 422 professionals through a survey in Turkey......, Finland, Denmark, France, and Malaysia. Usability appears to be an established concept, respondents across all countries agreeing on the importance of the ISO 9241-11 definition. There is also a tendency that UX professionals attach organizational perspective to usability. UX professionals diverge when...... defining UX, and there are systematic differences related to socio-cultural conditions. UX professionals in Finland and France incline more towards the definition highlighting the experiential qualities, when compared to Turkey and Malaysia that incline towards the definition reflecting the ease of use...
There are indications that established methods for evaluating information system usability that have been developed for use in, e.g. Europe or the USA, fail to give reliable results in countries such as India, China or Malaysia. This paper presents the theoretical background, related work...... and a definition of culture that should be useful for studies of multiple-country usability testing. This includes a discussion of cultural fit and the consequences of cultural (in)consistencies between stakeholders in system development and use. As an illustrative example of the kind of academic research...... that needs to be done, a pilot study is described. The pilot study exemplifies themes to explore, who should be participants and where should the study be done, how to find examples of multiple-country usability testing, how to collect data and how to analyse that data and what kind of results and discussion...
Dewi, R. S.; Hadi, R. K.
Although indoor navigation is still new in Indonesia, its future development is very promising. Similar to the outdoor one, the indoor navigation technology provides several important functions to support route and landmark findings. Furthermore, there is also a need that indoor navigation can support the public safety especially during disaster evacuation process in a building. It is a common that the indoor navigation technologies are built as applications where users can access this technology using their smartphones, tablets, or personal computers. Therefore, a usability analysis is important to ensure the indoor navigation applications can be operated by users with highest functionality. Among several indoor map applications which were available in the market, this study chose to analyse indoor Google Maps due to its availability and popularity in Indonesia. The experiments to test indoor Google Maps was conducted in one of the biggest shopping centre building in Surabaya, Indonesia. The usability was measured by employing System Usability Scale (SUS) questionnaire. The result showed that the SUS score of indoor Google Maps was below the average score of other cellular applications to indicate the users still had high difficulty in operating and learning the features of indoor Google Maps.
Prokopy, L. S.; Widhalm, M.
There is a close connection between weather and climate patterns and successful agricultural production. Therefore, incorporating climate information into farm management is likely to reduce the risk of economic losses and increase profitability. While weather and climate information is becoming ever more abundant and accessible, the use of such information in the agricultural community remains limited. Useful to Usable (U2U): Transforming Climate Variability and Change Information for Cereal Crop Producers is a USDA-NIFA funded research and extension project focused on improving the use of climate information for agricultural production in the Midwestern United States by developing user-driven decision tools and training resources. The U2U team is a diverse and uniquely qualified group of climatologists, crop modelers, agronomists, and social scientists from 9 Midwestern universities and two NOAA Regional Climate Centers. Together, we strive to help producers make better long-term plans on what, when and where to plant and also how to manage crops for maximum yields and minimum environmental damage. To ensure relevance and usability of U2U products, our social science team is using a number of techniques including surveys and focus groups to integrate stakeholder interests, needs, and concerns into all aspects of U2U research. It is through this coupling of physical and social science disciplines that we strive to transform existing climate information into actionable knowledge.
Full Text Available Usability is a fundamental quality characteristic for the success of an interactive system. It is a concept that includes a set of metrics and methods in order to obtain easy-to-learn and easy-to-use systems. Usability Evaluation Methods, UEM, are quite diverse; their application depends on variables such as costs, time availability, and human resources. A large number of UEM can be employed to assess interactive software systems, but questions arise when deciding which method and/or combination of methods gives more (relevant information. We propose Collaborative Usability Evaluation Methods, CUEM, following the principles defined by the Collaboration Engineering. This paper analyzes a set of CUEM conducted on different interactive software systems. It proposes combinations of CUEM that provide more complete and comprehensive information about the usability of interactive software systems than those evaluation methods conducted independently.
Full Text Available As a consequence of the development of Information and Communication Technologies (ICT, nowadays almost all governments around the world, included Indonesian government have official websites to provide information and services for their citizen. In the second period of President Susilo Bambang Yudhoyono administration has thirty two ministries and each ministries have an official website. However implementation of the ministry websites have not been measured yet on usability aspect. The objective of this research is to examine the usability of ministry websites of Indonesian Government. Eleven websites was taken as sample in this study. Respondents are 128 Internet users who have competency for assessing web usability. Usability of websites were measured by several indicators were adapted from E-Government Toolkit for Developing Countries that was prepared by the National Informatics Centre and UNESCO. The main indicators consist of navigation architecture, layout design, and content.
I. What is usability and why should I care?A. Overview chapter Isbister and Schaffer (Editors)Introduces key concepts and positions book for primary audiences: game developers andstudents aspiring to work in game development. Addresses key concerns that developersmay have about adopting usability, and sets a broad road map of what is to come in thebook.B. Interview with Tobi Saulnier of 1st PlayableA discussion with the CEO of a small game studio about why and how she uses usabilitytechniques in her development.C. Interview with Don Norman of Nielsen Norman groupA discussion with one of the pr
Larsen, Lars Bo
This work is centred on the methods and problems associated with defining and measuring the usability of Spoken Dialogue Systems (SDS). The starting point is the fact that speech based interfaces has several times during the last 20 years fallen short of the high expectations and predictions held...... by industry, researchers and analysts. Several studies in the literature of SDS indicate that this can be ascribed to a lack of attention from the speech technology community towards the usability of such systems. The experimental results presented in this work are based on a field trial with the OVID home...
Mihajlovski, Andrej; Plieger, Maarten; Som de Cerff, Wim; Page, Christian
indicators Key is the availability of standardized metadata, describing indicator data and services. This will enable standardization and interoperability between the different distributed services of CLIPC. To disseminate CLIPC indicator data, transformed data products to enable impacts assessments and climate change impact indicators a standardized meta-data infrastructure is provided. The challenge is that compliance of existing metadata to INSPIRE ISO standards and GEMINI standards needs to be extended to further allow the web portal to be generated from the available metadata blueprint. The information provided in the headers of netCDF files available through multiple catalogues, allow us to generate ISO compliant meta data which is in turn used to generate web based interface content, as well as OGC compliant web services such as WCS and WMS for front end and WPS interactions for the scientific users to combine and generate new datasets. The goal of the metadata infrastructure is to provide a blueprint for creating a data driven science portal, generated from the underlying: GIS data, web services and processing infrastructure. In the presentation we will present the results and lessons learned.
Hedges, Larry V.
The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…
Salunke, Smita; Tuleu, Catherine
The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.
Robinson, D. A.; Doesken, N.
CoCoRaHS is an acronym for the Community Collaborative Rain, Hail and Snow Network. It is long-running, community-based network of volunteers working together to measure and map precipitation (rain, hail and snow). Precipitation is an ideal element for public engagement because it affects everyone, it is so variable in time and space and it impacts so many things. By using a standard precipitation gauge, stressing training and education, utilizing an interactive website, and having observations undergo quality assurance, the CoCoRaHS program provides high-quality data for natural resource, education and research applications. The program currently operates in all states, Canada and the Bahamas. It originated with the Colorado Climate Center at Colorado State University in 1998 due in part to the Fort Collins flood a year prior. Upwards of 12,000 observers submit observations each day. Observations meet federal guidelines and are archived at the U.S. National Centers for Environmental Information. Because of excellent spatial coverage, data quality, practical relevance, and accessibility, CoCoRaHS observations are used by a wide variety of organizations and individuals. The U.S. National Weather Service, hydrologists, emergency managers, city utilities (water supply, storm water), insurance adjusters, the U.S. Department of Agriculture, engineers, mosquito control commissions, ranchers and farmers, outdoor and recreation interests, teachers and students are just some examples of those who use CoCoRaHS data in making well-informed, meaningful decisions. Some examples of community applications and the science utility of CoCoRaHS observations include storm warnings, water supply and demand forecasts, disaster declarations (drought, winter storm, etc.), drought and food production assessments, calibration/validation of remote sensing, infrastructure evaluation and potential redesign (ice and snow loading, bridge, storm and sewer design), recreation planning, and
Diem, Huynh Thi Thuy; Yuenyong, Chokchai
History of science (HOS) plays a substantial role in the enhancement of rooted understanding in science teaching and learning. HOS of evolution and genetics has not been included in Vietnamese biology textbooks. This study aims to investigate the necessity of introducing evolution and genetics HOS into Vietnamese textbooks. A case study approach…
Nielsen, Lene; Madsen, Sabine
This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12...... different countries. The findings show that the usability professionals share a forced development and innovation in their practice that stem from their clients’ adoption and use of ASD methods. The ASD methods challenge the way usability testing is performed, the abilities of the usability expert......, the usability deliverables, and the experts’ assumptions about the importance of validity....
Jiang, Y.; Sun, X.; Li, H.
in the study, their understanding of fun systems differs across cultural backgrounds. Also, easy-to-use and useful systems are perceived as being similar or different depending on the usability professional’s cultural background. Most other cross-cultural differences relate to categories of construct......Culture influences many aspects of the design and use of computer systems; understanding better this influence on their own thinking may benefit usability professionals who do cross-cultural usability work. Using Kelly’s notion of personal constructs, we focus on one mediator of culture: how...
Enslow, Electra; Fricke, Suzanne; Vela, Kathryn
The purpose of this organizational case study is to describe the complexities librarians face when serving a multi-campus institution that supports both a joint-use library and expanding health sciences academic partnerships. In a system without a centralized health science library administration, liaison librarians are identifying dispersed programs and user groups and collaborating to define their unique service and outreach needs within a larger land-grant university. Using a team-based approach, health sciences librarians are communicating to integrate research and teaching support, systems differences across dispersed campuses, and future needs of a new community-based medical program.
Chan, Alvita J.; Islam, Mohammad K.; Rosewall, Tara; Jaffray, David A.; Easty, Anthony C.; Cafazzo, Joseph A.
Background and purpose: Heuristic evaluations have been used to evaluate safety of medical devices by identifying and assessing usability issues. Since radiotherapy treatment delivery systems often consist of multiple complex user-interfaces, a heuristic evaluation was conducted to assess the potential safety issues of such a system. Material and methods: A heuristic evaluation was conducted to evaluate the treatment delivery system at Princess Margaret Hospital (Toronto, Canada). Two independent evaluators identified usability issues with the user-interfaces and rated the severity of each issue. Results: The evaluators identified 75 usability issues in total. Eighteen of them were rated as high severity, indicating the potential to have a major impact on patient safety. A majority of issues were found on the record and verify system, and many were associated with the patient setup process. While the hospital has processes in place to ensure patient safety, recommendations were developed to further mitigate the risks of potential consequences. Conclusions: Heuristic evaluation is an efficient and inexpensive method that can be successfully applied to radiotherapy delivery systems to identify usability issues and improve patient safety. Although this study was conducted only at one site, the findings may have broad implications for the design of these systems.
Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B
Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.
Bringula, Rex P.; Basa, Roselle S.
The study investigated the factors that might significantly affect web portal usability. Results of the study were intended to serve as inputs for faculty web portal development of the University of the East-Manila. Descriptive statistics utilized questionnaire data from 82 faculty members. The data showed that most of the respondents were…
Saad Masood Butt
Full Text Available Agile methods are the best fit for tremendously growing software industry due to its flexible and dynamic nature. But the software developed using agile methods do meet the usability standards? To answer this question we can see that majority of agile software development projects currently involve interactive user interface designs, which can only be possible by following User Centered Design (UCD in agile methods. The question here is, how to integrate UCD with agile models. Both Agile models and UCD are iterative in nature but agile models focus on coding and development of software; whereas, UCD focuses on user interface of the software. Similarly, both of them have testing features where the agile model involves automated tested code while UCD involves an expert or a user to test the user interface. In this paper, a new agile usability model is proposed and the evaluation is of the proposed model is presented by practically implementing it in three real life projects. . Key results from these projects clearly show: the proposed agile model incorporates usability evaluation methods, improves the relationship between usability experts to work with agile software experts; in addition, allows agile developers to incorporate the result from UCD into subsequent interactions.
Your next usability project could be waiting for you in the college library, registration office, or online admissions process that your college or university utilizes in their daily transactions. As an added bonus, these exercises supplement the IS2002 curriculum model, benefit the instructor's institution, build inter-departmental collaboration,…
Schmettow, Martin; Bach, Cedric; Scapin, Dominique
This paper examines combinations of complementary evaluation methods as a strategy for efficient usability problem discovery. A data set from an earlier study is re-analyzed, involving three evaluation methods applied to two virtual environment applications. Results of a mixed-effects logistic
Paar, J.G.; Porterfield, D.R.
This procedure provides a framework for implementation of radiochemical data verification and validation for environmental remediation activities. It has been developed through participation of many individuals currently involved in analytical radiochemistry, radiochemical validation, and validation program development throughout the DOE complex. It should be regarded as a guidance to use in developing an implementable radiochemical validation strategy. This procedure provides specifications for developing and implementing a radiochemical validation methodology flexible enough to allow evaluation of data useability for project-specific Data Quality Objectives (DQO). Data produced by analytical methods for which this procedure provides limited guidance are classified as open-quotes non-routineclose quotes radionuclides and methods, and analyses by these methods may necessitate adoption of modified criteria from this procedure
Georgsson, Mattias; Staggers, Nancy
mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability
Bhattarai, Priyanka; Newton-John, T R O; Phillips, Jane L
To appraise the quality and usability of currently available pain applications that could be used by community-dwelling older adults to self-manage their arthritic pain. A systematic review. Searches were conducted in App Store and Google Play to identify pain self-management apps relevant to arthritic pain management. English language pain management apps providing pain assessment and documentation function and pain management education were considered for inclusion. A quality evaluation audit tool based on the Stanford Arthritis Self-Management Program was developed a priori to evaluate app content quality. The usability of included apps was assessed using an established usability evaluation tool. Out of the 373 apps that were identified, four met the inclusion criteria. The included apps all included a pain assessment and documentation function and instructions on medication use, communication with health professionals, cognitive behavioral therapy-based pain management, and physical exercise. Management of mood, depression, anxiety, and sleep were featured in most apps (N = 3). Three-quarters (N = 3) of the apps fell below the acceptable moderate usability score (≥3), while one app obtained a moderate score (3.2). Few of the currently available pain apps offer a comprehensive pain self-management approach incorporating evidence-based strategies in accordance with the Stanford Arthritis Self-Management Program. The moderate-level usability across the included apps indicates a need to consider the usability needs of the older population in future pain self-management app development endeavors.
Peters, Vanessa L.; Songer, Nancy Butler
This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.
Bornoe, Nis; Stage, Jan
Despite an interest and use of different usability engineering methods small software development organizations find it challenging to implement usability engineering into the software development process. We present the results from a study about usability engineering in practice. Through a series...... of semistructured interviews we want to get an understanding of how usability is implemented into the organizations and how it’s practiced in reality. We found that the developers found it problematic to combine agile software development methods with classic usability engineering methods. A lack of solid usability...... engineering expertise and not least experience seems to be a main obstacle for a successful implementation of usability engineering into current software development practices. They are requesting methods and procedures that fit better with their current practices and strategies to implement usability...
Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues that usabil......Usability testing has evolved in response to a search for tests that are cheap, early, easy, and fast. In addition, it accords with a situational definition of usability, such as the one propounded by ISO. By approaching usability from an organizational perspective, this author argues...... that usability should (also) be evaluated late, that usability professionals should be wary of thinking aloud, and that they should focus more on effects achievement than problem detection....
Markopoulos, P.; Bekker, M.M.
The paper motivates the need to acquire methodological knowledge for involving children as test users in usability testing. It introduces a methodological framework for delineating comparative assessments of usability testing methods for children participants. This framework consists in three
Brenda M Scholtz
Full Text Available Though the field of management information systems, as a sector and a discipline, is the inventor of many guidelines and models, it appears to be a slow runner on practical implications of interface usability. This usability can influence end users’ attitude and behavior to use IT. The purpose of this paper was to examine the interface usability of a popular Enterprise Resource Planning (ERP software system, SAP, and to identify related issues and implications to the Technology Acceptance Model (TAM. A survey was conducted of 112 SAP ERP users from an organization in the heavy metal industry in Bangladesh. The partial least squares technique was used to analyze the survey data. The survey findings empirically confirmed that interface usability has a significant impact on users’ perceptions of usefulness and ease of use which ultimately affects attitudes and intention to use the ERP software. The research model extends the TAM by incorporating three criteria of interface usability. It is the first known study to investigate usability criteria as an extension of TAM.
Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M
To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (pusability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA
Ponners, Pamela Jones
Transmedia books are new and emerging technologies which are beginning to be used in current classrooms. Transmedia books are a traditional printed book that uses multiple media though the use of Quick Response (QR) codes and augmented reality (AR) triggers to access web-based technology. Using the transmedia book Skills That Engage Me students in kindergarten through second grade engage in curriculum designed to introduce science skills and careers. Using the modified Draw-a-Scientist Test (mDAST), observations and interviews, researchers analyzed pre and post data to describe changes students have about science and scientists. Future study may include the development and validation of a new instrument, Draw a Science Student, and examining the mDAST checklist with the intention of updating the parameters of what is considered positive and negative in relationship with work a scientist conducts.
The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…
Bunz, Ulla K.
This paper discusses Web site usability issues. Specifically, it assumes that the usability of a Web site depends more on the perception of the user than on the objectively assessable usability criteria of the Web site. Two pilot studies, based on theoretical notions of uses and gratifications theory and similar theories, are presented. In the…
Bruun , Anders
Part 1: Long and Short Papers; International audience; Lack of usability specialists, high resource requirements and developer mindsets are three considerable barriers for introducing usability engineering into software companies. This Ph.D. project explores the effect of letting software developers and end users apply usability engineering methods instead of a specialist, a solution which may reduce the barriers.
Can we use the methods of Web usability testing to learn about library instruction? This article is among the first in the field trying to establish a link between usability and instruction. The author discusses useful insights that Web usability can bring to our pedagogy as well as to the efficiency of library instruction. The result of a Web…
Lizano, Fulvio; Stage, Jan
Remote Usability Testing (RUT) is an alternative method of usability evaluations. The main aim of RUT is the reduction of costs in the usability evaluation process. Since middle of the 90s RUT, has emerged as a technique which seems as is gaining maturity across the time. In general any discipline...
Full Text Available A Study about libraries' web sites evaluation, that is the Usability, the study talking about methods of usability testing and define it, and its important in web sites evaluation, then details the methods of usability: questionnaire, core groups, testing experimental model, cards arrangement, and composed evaluation.
Ates, H.; Saracoglu, M.
The purpose of this research was to investigate pre-service science teachers' (PST) views about nuclear energy and to examine what effects, if any, of gender and the university of instruction had on their views. Data were collected through the Risks and Benefits about Nuclear Energy Scale (Iseri, 2012). The sample consisted of 214 PSTs who…
Viitanen, Johanna; Hyppönen, Hannele; Lääveri, Tinja; Vänskä, Jukka; Reponen, Jarmo; Winblad, Ilkka
problems and deficiencies which considerably hindered the efficiency of clinical ICT use and physician's routine work. Systems lacked the appropriate features to support typical clinical tasks, such as decision making, prevention of medical errors, and review of a patient's treatment chart. The systems also required physicians to perform fixed sequences of steps and tasks, and poorly supported the documentation and retrieval of patient data. The findings on ICT support for collaboration showed mainly negative results, aside from collaboration between co-located physicians. In addition, the study results pointed out physicians suffering from system failures and a lack of integration between the systems. The described study and related results are unique in several ways. A national usability study with nearly 4000 respondents had not been conducted in other countries in which healthcare technologies are widely adopted. The questionnaire study provided a generalized picture about the usability problems, however, it should be noted that there were significant differences between legacy systems in use. Previously, researchers had not approached contextual aspects of usability the context of clinical work, where numerous systems are in use. The described usability dimensions and the presented study results can be considered as the first step towards conceptualizing ICT usability in the unique setting of clinical work. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.
Both the United States and Russia are retaining as strategic reserves more plutonium and HEU for potential reuse as weapons, than is legitimately needed. Both have engaged in discussions and have programs in various stages of development to dispose of excess plutonium and HEU. These fissile material disposition programs will take decades to complete. In the interim there will be, as there is now, hundreds of tons of separated weapon-usable fissile material stored in tens of thousands of transportable canisters, each containing from a few to several tons of kgs of weapon-usable fissile material. This material must be secured against theft and unauthorized use. To have high confidence that the material is secure, one must establish criteria against which the adequacy of the protective systems can be judged. For example, one finds such criteria in US Nuclear Regulatory Commission (USNRC) regulations for the protection of special nuclear materials
Full Text Available One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.
Garcés, Ma. I.; Torralba, B.
The Research and Development (R&D) project on “Theoretical and Methodological Approaches to Integrated System Validation of Control Rooms, 2014-2015”, in which the research activities described in this report are framed, has two main objectives: to develop the items for an usability methodology conceived as a part of the measurement framework for performance-based control room evaluation that the OECD Halden Reactor Project will test in the experiments planned for 2015; and the statistical analysis of the data generated in the experimental activities of the Halden Man-Machine Laboratory (HAMMLAB) facility, with previous usability questionnaires, in 2010 and 2011. In this report, the procedure designed to meet the first goal of the project is described, in particular, the process followed to identify the items related to operating procedures, both computer and paper-based, one of the elements to be included in the usability questionnaire. Three phases are performed, in the first one, the approaches developed by the United States Nuclear Regulatory Commission, NRC, are reviewed, the models used by the nuclear industry and their technical support organizations, mainly, the Electric Power Research Institute, EPRI, are analyzed, and scientist advances are also explored. In the remaining stages, general and specific guidelines for computerized and paper-based procedures are compared and criteria for the preliminary selection of the items that should be incorporated into the usability questionnaire are defined. This proposal will be reviewed and adapted by the Halden Reactor Project to the design of the specific experiments performed in HAMLAB.
Kushniruk, Andre W; Borycki, Elizabeth M; Kannry, Joseph
The need for improved usability in healthcare IT has been widely recognized. In addition, methods from usability engineering, including usability testing and usability inspection have received greater attention. Many vendors of healthcare software are now employing usability testing methods in the design and development of their products. However, despite this, the usability of healthcare IT is still considered to be problematic and many healthcare organizations that have purchased systems that have been tested at vendor testing sites are still reporting a range of usability and safety issues. In this paper we explore the distinction between commercial usability testing (conducted at centralized vendor usability laboratories and limited beta test sites) and usability testing that is carried out locally within healthcare organizations that have purchased vendor systems and products (i.e. public "in-situ" usability testing). In this paper it will be argued that both types of testing (i.e. commercial vendor-based testing) and in-situ testing are needed to ensure system usability and safety.
Kjeldskov, Jesper; Skov, Mikael B.; Stage, Jan
We report from a longitudinal laboratory-based usability evaluation of a health care information system. The purpose of the study was to inquire into the nature of usability problems experienced by novice and expert users, and to see to what extend usability problems of a health care information...... system may or may not disappear over time, as the nurses get more familiar with it-if time heals poor design? As our method for studying this, we conducted a longitudinal study with two key studies. A usability evaluation was conducted with novice users when an electronic patient record system was being......, we discuss implications for evaluating usability in health care....
Bornoe, Nis; Stage, Jan
The essence of usability evaluations is to produce feedback that supports the downstream utility so the interaction design can be improved and problems can be fixed. In practice, software development organizations experience several obstacles for conducting usability engineering. One suggested...... approach is to train and involve developers in all phases of usability activities from evaluations, to problem reporting, and making redesign proposals. Only limited work has previously investigated the impact of actively involving developers in usability engineering. In this paper, we present two small......, and problem fixing. At the organizational level, we found that the attitude towards and understanding of the role of usability engineering improved....
Tucker, Deborah L.
Purpose. The purpose of this grounded theory study was to refine, using a Delphi study process, the four categories of the theoretical model of the comprehensive knowledge base required by providers of professional development for K-12 teachers of science generated from a review of the literature. Methodology. This grounded theory study used data collected through a modified Delphi technique and interviews to refine and validate the literature-based knowledge base required by providers of professional development for K-12 teachers of science. Twenty-three participants, experts in the fields of science education, how people learn, instructional and assessment strategies, and learning contexts, responded to the study's questions. Findings. By "densifying" the four categories of the knowledge base, this study determined the causal conditions (the science subject matter knowledge), the intervening conditions (how people learn), the strategies (the effective instructional and assessment strategies), and the context (the context and culture of formal learning environments) surrounding the science professional development process. Eight sections were added to the literature-based knowledge base; the final model comprised of forty-nine sections. The average length of the operational definitions increased nearly threefold and the number of citations per operational definition increased more than twofold. Conclusions. A four-category comprehensive model that can serve as the foundation for the knowledge base required by science professional developers now exists. Subject matter knowledge includes science concepts, inquiry, the nature of science, and scientific habits of mind; how people learn includes the principles of learning, active learning, andragogy, variations in learners, neuroscience and cognitive science, and change theory; effective instructional and assessment strategies include constructivist learning and inquiry-based teaching, differentiation of instruction
Bolchini, Davide; Garzotto, Franca; Sorce, Fabio
Does usability of a web-based communication artifact affect brand, i.e., the set of beliefs, emotions, attitudes, or qualities that people mentally associate to the entity behind that artifact? Intuitively, the answer is “yes”: usability is a fundamental aspect of the quality of the experience with a website, and a “good” experience with a “product” or its reifications tends to translate into “good” brand perception. To date, however, the existence of a connection between web usability and brand perception is shown through anecdotic arguments, and is not supported by published systematic research. This paper discusses a study that empirically investigates this correlation in a more rigorous, analytical, and replicable way. Our main contribution is twofold: on the one hand, we provide empirical evidence to the heuristic principle that web usability influences branding, and we do that through four between subjects controlled experiments that involved 120 subjects. On the other hand, we inform the study with a systematic value-oriented approach to the user experience, and thus provide a conceptual framework that can be reused in other experimental settings, either for replicating our study, or for designing similar studies focusing on the correlation of web branding vs. design factors other than usability.
Lawton, Brandon L.; Rhue, Timothy; Smith, Denise A.; Squires, Gordon K.; Biferno, Anya A.; Lestition, Kathleen; Cominsky, Lynn R.; Godfrey, John; Lee, Janice C.; Manning, Colleen
NASA's Universe of Learning creates and delivers science-driven, audience-driven resources and experiences designed to engage and immerse learners of all ages and backgrounds in exploring the universe for themselves. The project is the result of a unique partnership between the Space Telescope Science Institute, Caltech/IPAC, Jet Propulsion Laboratory, Smithsonian Astrophysical Observatory, and Sonoma State University, and is one of 27 competitively-selected cooperative agreements within the NASA Science Mission Directorate STEM Activation program. The NASA's Universe of Learning team draws upon cutting-edge science and works closely with Subject Matter Experts (scientists and engineers) from across the NASA Astrophysics Physics of the Cosmos, Cosmic Origins, and Exoplanet Exploration themes. As one example, NASA’s Universe of Learning program is uniquely able to provide informal learning venues with a direct connection to the science of NASA astrophysics via the ViewSpace platform. ViewSpace is a modular multimedia exhibit where people explore the latest discoveries in our quest to understand the universe. Hours of awe-inspiring video content connect users’ lives with an understanding of our planet and the wonders of the universe. This experience is rooted in informal learning, astronomy, and earth science. Scientists and educators are intimately involved in the production of ViewSpace material. ViewSpace engages visitors of varying backgrounds and experience at museums, science centers, planetariums, and libraries across the United States. In addition to creating content, the Universe of Learning team is updating the ViewSpace platform to provide for additional functionality, including the introduction of digital interactives to make ViewSpace a multi-modal learning experience. During this presentation we will share the ViewSpace platform, explain how Subject Matter Experts are critical in creating content for ViewSpace, and how we are addressing audience
Owen, S. E.; Hua, H.; Rosen, P. A.; Agram, P. S.; Webb, F.; Simons, M.; Yun, S. H.; Sacco, G. F.; Liu, Z.; Fielding, E. J.; Lundgren, P.; Moore, A. W.
A new era of geodetic imaging arrived with the launch of the ESA Sentinel-1A/B satellites in 2014 and 2016, and with the 2016 confirmation of the NISAR mission, planned for launch in 2021. These missions assure high quality, freely and openly distributed regularly sampled SAR data into the indefinite future. These unprecedented data sets are a watershed for solid earth sciences as we progress towards the goal of ubiquitous InSAR measurements. We now face the challenge of how to best address the massive volumes of data and intensive processing requirements. Should scientists individually process the same data independently themselves? Should a centralized service provider create standard products that all can use? Are there other approaches to accelerate science that are cost effective and efficient? The Advanced Rapid Imaging and Analysis (ARIA) project, a joint venture co-sponsored by California Institute of Technology (Caltech) and by NASA through the Jet Propulsion Laboratory (JPL), is focused on rapidly generating higher level geodetic imaging products and placing them in the hands of the solid earth science and local, national, and international natural hazard communities by providing science product generation, exploration, and delivery capabilities at an operational level. However, there are challenges in defining the optimal InSAR data products for the solid earth science community. In this presentation, we will present our experience with InSAR users, our lessons learned the advantages of on demand and standard products, and our proposal for the most effective path forward.
Full Text Available Science Translational Medicine’s mission is to improve human health care worldwide by providing a forum for communication and interdisciplinary idea exchange between basic scientists and clinical research practitioners from all relevant established and emerging disciplines. The weekly journal debuted in October 2009 and is published by the American Association for the Advancement of Science (AAAS, the publisher of Science and Science Signaling. The journal features peer-reviewed research articles, perspectives and commentary, and is guided by an international Advisory Board, led by Chief Scientific Adviser, Elias A. Zerhouni, M.D., former Director of the National Institutes of Health, and Senior Scientific Adviser, Elazer R. Edelman, M.D., Ph.D., Thomas D. and Virginia W. Cabot Professor of Health Sciences and Technology, Massachusetts Institute of Technology. The Science Translational Medicine editorial team is led by Katrina L. Kelner, Ph.D., AAAS. A profound transition is required for the science of translational medicine. Despite 50 years of advances in our fundamental understanding of human biology and the emergence of powerful new technologies, the rapid transformation of this knowledge into effective health measures is not keeping pace with the challenges of global health care. Creative experimental approaches, novel technologies, and new ways of conducting scientific explorations at the interface of established and emerging disciplines are now required to an unprecedented degree if real progress is to be made. To aid in this reinvention, Science and AAAS have created a new interdisciplinary journal, Science Translational Medicine. The following interview exemplefies the pioneering content found in Science Translational Medicine. It is an excerpt from a Podcast interview with Dr. Samuel Broder, former director of the National Cancer Institute and current Chief Medical Officer at Celera. The Podcast was produced in tangent with Dr
As more Earth science software tools and services move to the web--the design and usability of those tools become ever more important. A good user interface is becoming expected and users are becoming increasingly intolerant of websites and web applications that work against them. The Earthdata UI Pattern Library attempts to give these scientists and developers the design tools they need to make usable, compelling user interfaces without the associated overhead of using a full design team. Patterns are tested and functional user interface elements targeted specifically at the Earth science community and will include web layouts, buttons, tables, typography, iconography, mapping and visualization/graphing widgets. These UI elements have emerged as the result of extensive user testing, research and software development within the NASA Earthdata team over the past year.
Pordes, Ruth; /Fermilab; Kramer, Bill; Olson, Doug; / /LBL, Berkeley; Livny, Miron; Roy, Alain; /Wisconsin U., Madison; Avery, Paul; /Florida U.; Blackburn, Kent; /Caltech; Wenaus, Torre; /Brookhaven; Wurthwein, Frank; /UC, San Diego; Gardner, Rob; Wilde, Mike; /Chicago U. /Indiana U.
The Open Science Grid (OSG) provides a distributed facility where the Consortium members provide guaranteed and opportunistic access to shared computing and storage resources. OSG provides support for and evolution of the infrastructure through activities that cover operations, security, software, troubleshooting, addition of new capabilities, and support for existing and engagement with new communities. The OSG SciDAC-2 project provides specific activities to manage and evolve the distributed infrastructure and support its use. The innovative aspects of the project are the maintenance and performance of a collaborative (shared & common) petascale national facility over tens of autonomous computing sites, for many hundreds of users, transferring terabytes of data a day, executing tens of thousands of jobs a day, and providing robust and usable resources for scientific groups of all types and sizes. More information can be found at the OSG web site: www.opensciencegrid.org.
Schall, Mark Christopher; Cullen, Laura; Pennathur, Priyadarshini; Chen, Howard; Burrell, Keith; Matthews, Grace
Health information technology dashboards that integrate evidence-based quality indicators can efficiently and accurately display patient risk information to promote early intervention and improve overall quality of patient care. We describe the process of developing, evaluating, and implementing a dashboard designed to promote quality care through display of evidence-based quality indicators within an electronic health record. Clinician feedback was sought throughout the process. Usability evaluations were provided by three nurse pairs and one physician from medical-surgical areas. Task completion times, error rates, and ratings of system usability were collected to compare the use of quality indicators displayed on the dashboard to the indicators displayed in a conventional electronic health record across eight experimental scenarios. Participants rated the dashboard as "highly usable" following System Usability Scale (mean, 87.5 [SD, 9.6]) and Poststudy System Usability Questionnaire (mean, 1.7 [SD, 0.5]) criteria. Use of the dashboard led to reduced task completion times and error rates in comparison to the conventional electronic health record for quality indicator-related tasks. Clinician responses to the dashboard display capabilities were positive, and a multifaceted implementation plan has been used. Results suggest application of the dashboard in the care environment may lead to improved patient care.
Atkinson, D. H.; Babuscia, A.; Lazio, J.; Asmar, S.
Many Radio Science investigations, including the determinations of planetary masses, measurements of planetary atmospheres, studies of the solar wind, and solar system tests of relativistic gravity, rely heavily on precision Doppler tracking. Recent and currently proposed missions such as VERITAS, Bepi Colombo, Juno have shown that the largest error source in the precision Doppler tracking data is noise in the Doppler system. This noise is attributed to un-modeled motions of the ground antenna's phase center and is commonly referred to as "antenna mechanical noise." Attempting to reduce this mechanical noise has proven difficult since the deep space communications antennas utilize large steel structures that are already optimized for mechanical stability. Armstrong et al. (2008) have demonstrated the Time Delay Mechanical-noise Cancellation (TDMC) concept using Goldstone DSN antennas (70 m & 34 m) and the Cassinispacecraft to show that the mechanical noise of the 70 m antenna could be suppressed when two-way Doppler tracking from the 70 m antenna and the receive-only Doppler data from the smaller, stiffer 34 m antenna were combined with suitable delays. The proof-of-concept confirmed that the mechanical noise in the final Doppler observable was reduced to that of the stiffer, more stable antenna. Caltech's Owens Valley Radio Observatory (OVRO) near Bishop, CA now has six 10.4 m diameter antennas, a consequence of the closure of Combined Array for Research in Millimeter Astronomy (CARMA). In principle, a 10 m antenna can lead to an order-of-magnitude improvement for the mechanical noise correction, as the smaller dish offers better mechanical stability compared to a DSN 34-m antenna. These antennas also have existing Ka-band receiving systems, and preliminary discussions with the OVRO staff suggest that much of the existing signal path could be used for Radio Science observations.
Wegner, K.; Branch, B. D.; Smith, S. C.
The Global Learning and Observations to Benefit the Environment (GLOBE) program is a worldwide hands-on, primary and secondary school-based science and education program (www.globe.gov). GLOBE's vision promotes and supports students, teachers and scientists to collaborate on inquiry-based authentic science investigations of the environment and the Earth system working in close partnership with NASA, NOAA and NSF Earth System Science Projects (ESSP's) in study and research about the dynamics of Earth's environment. GLOBE Partners conduct face-to-face Professional Development in more than 110 countries, providing authentic scientific research experience in five investigation areas: atmosphere, earth as a system, hydrology, land cover, and soil. This presentation will provide a sample for a new framework of Professional Development that was implemented in July 2013 at Purdue University lead by Mr. Steven Smith who has tested GLOBE training materials for future training. The presentation will demonstrate how institutions can provide educators authentic scientific research opportunities through various components, including: - Carrying out authentic research investigations - Learning how to enter their authentic research data into the GLOBE database and visualize it on the GLOBE website - Learn how to access to NASA's Earth System Science resources via GLOBE's new online 'e-Training Program' - Exploring the connections of their soil protocol measurements and the history of the soil in their area through iPad soils app - LIDAR data exposure, Hydrology data exposure
For more than five years, the project ACCEPT, a subproject of a Swiss national project called e-lib.ch, analyzes the usability and usefulness of digital libraries, by using user oriented methods. Experience has shown that filters provided through faceted navigation are considered as positive and very useful by end users. Nevertheless, based on different test results, several returning mistakes have been detected and it turns out that there are some ‘unwritten standards’ concerning e.g. position, labelling or ranking which should be respected to fulfil the aim of a good usability which users do expect of such web services. In this poster we will first give an introduction to faceted navigation, actual design issues and their use in digital libraries and then present testing methods, which can be easily applied in a digital library context. Together with a list of best practices concerning faceted navigation drawn out of different test experiences, the paper should give the reader all important information to evaluate its current faceted navigation and see where improvements could be made.
Ferrari, Ester; Cavallo, Eugenio
Teleoperation has been widely applied in modern industry because of a variety of advantages, such as providing replaceable surrogates for humans in dangerous or difficult working environments over long distances. In this paper, a usability evaluation study of a teleoperation system for a compost spreader robotic machine is presented. The machine has been designed for the application of compost in small and stepping parcels of hilly vineyards. Driving and working tasks can be controlled remotely by a portable piloting unit, reducing the risk for the operator in the event of machine overturning. Participants of the study were asked to perform a series of tasks and sub-tasks and to vocalize their thoughts while working with the machine. The tasks were designed to simulate typical user experience. Once all the tasks were accomplished each participant was asked to fill a questionnaire. The evaluation considered aspects such as learnability, ease of use, understandability, controllability, frustration, mental effort, distraction, clarity of presentation, perceived usefulness, temporal efficiency and machine aesthetic. Results show that usability evaluation helped detecting design deficiencies in the teleoperated compost spreader machine.
Slootmaker, Aad; Hummel, Hans; Koper, Rob
Background . The EMERGO method and online platform enable the development and delivery of scenario-based serious games that foster students to acquire professional competence. One of the main goals of the platform is to provide a user-friendly authoring environment for creating virtual environments where students can perform authentic tasks. Aim . We present the findings of an in-depth qualitative case study of the platform's authoring environment and compare our findings on usability with those found for comparable environments in literature. Method . We carried out semi-structured interviews, with two experienced game developers who have authored a game for higher education, and a literature review of comparable environments. Findings . The analysis shows that the usability of the authoring environment is problematic, especially regarding understandability and learnability , which is in line with findings of comparable environments. Other findings are that authoring is well integrated with the EMERGO method and that functionality and reliability of the authoring environment are valued. Practical implications . The lessons learned are presented in the form of general guidelines to improve the understandability and learnability of authoring environments for serious games .
Faisal, Chaudhry Muhammad Nadeem; Shakeel Faridi, Muhammad; Javed, Zahid
Enterprise Resource Planning systems are the combination of different business IS (Information System) applications that are designed according to the organization requirements. Generally ERP systems are suffering from complex user interface issues. Recent research shows that there is a need for improvement concerning, the user interface from their perspectives. In order to design the software applications that are easy to use, memorize and apply to new problems, we must know the users philosophy and something about learning, reminiscence and problems solving. The Usability engineering is the only way to study the deeds of users while interacting with ERP (Enterprise Resource & Planning). This paper will focus on the users' experiences view of financial module in ERP system. The HCI research method, explicitly survey questionnaire method was adopted to gather users understanding in order to evaluate the selected modules for in-housed ERP system. The study involved group of users from two industries, the results can not be generalized as a whole. The study was first time successfully applied Usability evaluation on in-housed ERP in local industry (Masood Textile Mills, Interloop Ltd) in Pakistan. The results may hopefully opened-up an area of research and methodology that could provide considerable further benefits to Industry in developments of Industrial information systems.
Virtanen, Viivi; Korpelainen, Helena; Kostamo, Kirsi
Two experiments were performed to test the relevance of bryophyte (Plantae, Bryophyta) material for forensic studies. The first experiment was conducted to reveal if, and how well, plant fragments attach to footwear in general. In the test, 16 persons walked outdoors wearing rubber boots or hiking boots. After 24h of use outdoors the boots were carefully cleaned, and all plant fragments were collected. Afterwards, all plant material was examined to identify the species. In the second experiment, fresh material of nine bryophyte species was kept in a shed in adverse conditions for 18 months, after which DNA was extracted and subjected to genotyping to test the quality of the material. Both experiments give support for the usability of bryophyte material in forensic studies. The bryophyte fragments become attached to shoes, where they remain even after the wearer walks on a dry road for several hours. Bryophyte DNA stays intact, allowing DNA profiling after lengthy periods following detachment from the original plant source. Based on these experiments, and considering the fact that many bryophytes are clonal plants, we propose that bryophytes are among the most usable plants to provide botanical evidence for forensic investigations.
Gabriela Trindade Perry
Full Text Available In this paper, we present the results of a usability evaluation for Xenubi, a cell phone game about the periodic table. We describe and discuss the issues that we faced during the evaluation, which took place in a state high school. These issues are related to conflicts between the data that were gathered through video recordings and through a questionnaire. We also point to the poor performance of the game mechanics during the evaluation. This result was unexpected because the game had an excellent performance in the pilot test. Possible causes for these differences are discussed.
Calado, Alexana Vilar Soares; Soares, Marcelo Márcio
This paper refers to the comparative study of the equipment used for cooking in commercial of kitchens restaurants that use the system of traditional cooking and those ones which use the system called smart cooking (combination oven). The study investigates the usability issues concerning to the two systems, analyzing comparatively the aspects related to anthropometry, dimensional variables, the use of the product and also the product safety, as well as issues of information related to operation of the new concepts of cooking in intelligent systems.
Diebner, Hans H.; Grond, Florian
We discuss the synchronization features of a previously introduced adaptive system for dynamics recognition in more detail. We investigate the usability of synchronization for modeling and parameter estimations. It is pointed out inhowfar the adaptive system based on synchronization can become a powerful tool in modeling. The adaptive system can store modules of pre-adapted dynamics and is potentially capable of undergoing self-modification. We compare the stored modules with pre-knowledge that a modeler puts into his or her models. In this sense the adaptive system functions like an expert system
Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L
Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: email@example.com
Evidence is emerging that certain technologies such as computerized provider order entry may reduce the likelihood of patient harm. However, many technologies that should reduce medical errors have been abandoned because of problems with their design, their impact on workflow, and general dissatisfaction with them by end users. Patient safety researchers have therefore looked to human factors engineering for guidance on how to design technologies to be usable (easy to use) and useful (improving job performance, efficiency, and/or quality). While this is a necessary step towards improving the likelihood of end user satisfaction, it is still not sufficient. Human factors engineering research has shown that the manner in which technologies are implemented also needs to be designed carefully if benefits are to be realized. This paper reviews the theoretical knowledge on what leads to successful technology implementation and how this can be translated into specifically designed processes for successful technology change. The literature on diffusion of innovations, technology acceptance, organisational justice, participative decision making, and organisational change is reviewed and strategies for promoting successful implementation are provided. Given the rapid and ever increasing pace of technology implementation in health care, it is critical for the science of technology implementation to be understood and incorporated into efforts to improve patient safety.
Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L
Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the
Walsh, Louisa; Hemsley, Bronwyn; Allan, Meredith; Adams, Natalie; Balandin, Susan; Georgiou, Andrew; Higgins, Isabel; McCarthy, Shaun; Hill, Sophie
criteria. The identified violations included usability issues with the reading levels used within My Health Record, the graphic design elements, the layout of web pages, and a lack of images and audiovisual tools to support learning. Other important usability issues included a lack of translated resources, difficulty using accessibility tools, and complexity of the registration processes. My Health Record is an important piece of technology that has the potential to facilitate better communication between consumers and their health providers. However, this heuristic evaluation demonstrated that many usability-related elements of My Health Record cater poorly to users at risk of having low e-health literacy. Usability issues have been identified as an important barrier to use of personal health records internationally, and the findings of this heuristic evaluation demonstrate that usability issues may be substantial barriers to the uptake and use of My Health Record.
Hamerlinck, J. D.
In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.
Scotch, Matthew; Parmanto, Bambang; Monaco, Valerie
Increasingly sophisticated technologies, such as On-Line Analytical Processing (OLAP) and Geospatial Information Systems (GIS), are being leveraged for conducting community health assessments (CHA). Little is known about the usability of OLAP and GIS interfaces with respect to CHA. We conducted an iterative usability evaluation of the Spatial OLAP Visualization and Analysis Tool (SOVAT), a software application that combines OLAP and GIS. A total of nine graduate students and six community health researchers were asked to think-aloud while completing five CHA questions using SOVAT. The sessions were analyzed after every three participants and changes to the interface were made based on the findings. Measures included elapsed time, answers provided, erroneous actions, and satisfaction. Traditional OLAP interface features were poorly understood by participants and combined OLAP-GIS features needed to be better emphasized. The results suggest that the changes made to the SOVAT interface resulted in increases in both usability and user satisfaction.
Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin
Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets
Brinkman, W.P.; Haakma, R.; Bouwhuis, D.G.; Jacob, R.J.K.; Limbourg, Q; Vanderdonckt, J.
Component-based Software Engineering (CBSE) is concerned with the development of systems from reusable parts (components), and the development and maintenance of these parts. This study addresses the issue of usability testing in a CBSE environment, and specifically automatically measuring the
Bhowmick, Tanuka; Robinson, Anthony C; Gruver, Adrienne; MacEachren, Alan M; Lengerich, Eugene J
The Pennsylvania Cancer Atlas (PA-CA) is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi). In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability assessment strategy, we find that our distributed, web
MacEachren Alan M
Full Text Available Abstract Background The Pennsylvania Cancer Atlas (PA-CA is an interactive online atlas to help policy-makers, program managers, and epidemiologists with tasks related to cancer prevention and control. The PA-CA includes maps, graphs, tables, that are dynamically linked to support data exploration and decision-making with spatio-temporal cancer data. Our Atlas development process follows a user-centered design approach. To assess the usability of the initial versions of the PA-CA, we developed and applied a novel strategy for soliciting user feedback through multiple distributed focus groups and surveys. Our process of acquiring user feedback leverages an online web application (e-Delphi. In this paper we describe the PA-CA, detail how we have adapted e-Delphi web application to support usability and utility evaluation of the PA-CA, and present the results of our evaluation. Results We report results from four sets of users. Each group provided structured individual and group assessments of the PA-CA as well as input on the kinds of users and applications for which it is best suited. Overall reactions to the PA-CA are quite positive. Participants did, however, provide a range of useful suggestions. Key suggestions focused on improving interaction functions, enhancing methods of temporal analysis, addressing data issues, and providing additional data displays and help functions. These suggestions were incorporated in each design and implementation iteration for the PA-CA and used to inform a set of web-atlas design principles. Conclusion For the Atlas, we find that a design that utilizes linked map, graph, and table views is understandable to and perceived to be useful by the target audience of cancer prevention and control professionals. However, it is clear that considerable variation in experience using maps and graphics exists and for those with less experience, integrated tutorials and help features are needed. In relation to our usability
Cervenec, J. M.; Hitzhusen, G.; Ward, S.; Foster, C.
In 2009, the Byrd Polar Research Center (BPRC) and Ohio Interfaith Power and Light (OhIPL) collaborated on a climate change education summit for scientists and clergy. Since that first program, a robust partnership has been nurtured where researchers at the center regularly contribute to events within the faith community. In 2014 alone, BPRC supported OhIPL in hosting a Teach-In event on climate change before a live audience that was simultaneously broadcast to three remote sites across Ohio; a State of the Climate event at the Ohio Statehouse that featured presentations by a scientist, a policymaker, and a member of the faith community; and an Earthkeeping Summit to bring together members of the faith community from across Ohio. OhIPL has helped BPRC fulfill one of our mission objectives of communicating science to a broad community. OhIPL engages houses of worship of all denominations through faith and education with a goal of moving them towards actions that reduce energy consumption. Houses of worship take actions for various reasons - including creation care, concerns of social justice related to climate change, or a desire to save money through building efficiency.
Full Text Available Introduction : Human capital is regarded as an important tool for development. In fact, human talents involve one of the important human resources in Iran sporadically in higher education and research institutions. Within the measures taken in this regard in Iran, establishing the Office of Gifted and Talented can be mentioned aiming to identify the top talents. Therefore, the role of university as an organization, in which scholars are engaged in scientific activities, is taken significantly in to account. The present study aims to investigate the barriers and factors motivating the students are in Kerman University of Medical Sciences. Method : This qualitative cross-sectional study was conducted in 2013. The study Sample was via convenience sampling method and the study data was gleaned by a semi-structured interview with 30 persons. Moreover, the study data was analyzed by framework analysis. Results : The findings of this study involve the two original codes of motivational barriers as well as motivational factors. In the first section motivational barriers with three codes including structural problems, poor communication, performance problems as well as 8 minor codes were proposed. Moreover, in The second secti o n of this study, motivational strategies were mentioned intended to ameliorate the functioning of the Office in terms of the individuals, attitude participating in this study. Conclusion : The Talented Office necessitates to be reformed identify the top talents and to alter such talents into elite talents.
Parker, A.; Dosemagen, S.
As a collaborative and open approach to science, citizen science has the potential make science more actionable, applicable, and usable, especially when designed with scientists, communities and decision-makers as partners. In response to recent interest in citizen science from the US Environmental Protection Agency, the National Advisory Council for Environmental Policy and Technology provided EPA with advice and recommendations on how to integrate citizen science into the core work of EPA. The Council's 28 members—representatives of academia; business and industry; nongovernmental organizations; and state, local and tribal governments—identifies citizen science as an invaluable opportunity for EPA to strengthen public support for EPA's mission and the best approach for the Agency to connect with the public on environmental protection. The report recommends that EPA embrace citizen science as a core tenet of environmental protection, invest in citizen science for communities, partners, and the Agency, enable the use of citizen science data at the Agency, integrate citizen science into the full range of work of EPA. This presentation will outline principles and strategy for integrating citizen science into science and policy at the national level, increasing the usability of citizen science data for decision-making and policy, and leveraging citizen science for environmental protection.
Sandor, Aniko; Holden, Kritina L.
The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.
as relevant and strategic human–computer interaction (HCI) activities in the software development process, there are obstacles that limit the complete, effective and efficient integration of this kind of testing into the software development process. Two main obstacles are the cost of usability evaluations...... and the software developers' resistance to accepting users’ opinions regarding the lack of usability in their software systems. The ‘cost obstacle’ refers to the constraint of conducting usability evaluations in the software process due to the significant amount of resources required by this type of testing. Some......This thesis addresses the integration of usability evaluations into the software development process. The integration here is contextualized in terms of how to include usability evaluation as an activity in the software development lifecycle. Even though usability evaluations are considered...
Yunus, U.; Anindito; Tanuar, E.; Maryani
Indonesian tourism has been viewed as one of the source of foreign exchange, therefore visit Indonesia campaign through Wonderful Indonesia should be given attention. This research aims to test the usability of web http://www.indonesia.travel/en, at the end can give input to the Tourism Ministry of the Republic of Indonesia. The concept used based on usabilitygeek.com which mentions the three main categories for usability testing, i. e. explorative, assessment and comparative with the users are three classes of Communication Department students of Bina Nusantara University with a total of 120 students, however finally only 22 students were elected because of the criteria are the students should be like travelling and access to the tourism website more than 12 times. The methodology used is qualitative descriptive and experiments, with data collection techniques through observation and interviews after participants’ access to the web: Due to their one-on-one nature, interviews enable the observer to ask direct questions to the user and the participants posted their opinion in online discussion forum. The results mentioned that the elements web of Wonderful Indonesia has a high learning ability and memorability but less efficiency and satisfaction, as well as several times errors when used. In conclusion, to maximize about the visit of tourism to Indonesia, this web is only able to learn and impress the visitor, but do not give satisfaction to users.
Business-Intelligence-Systeme stehen im Spannungsfeld zwischen Usability und Sicherheit. Die Gefahren und Sicherheitsmaßnahmen für Informationssysteme werden ermittelt und ökonomisch in Bezug zur Gebrauchstauglichkeit gesetzt. Es entsteht ein Sicherheitsprofil für Business-Intelligence-Systeme. Business-Intelligence-Systems are in tension between Usability and IT-Security. Risks and safety measures of informationsystems are defined and set in (economic) regard to Usability. A security prof...
Rouillon, Marek; Harvey, Paul J; Kristensen, Louise J; George, Steven G; Taylor, Mark P
The extent of metal contamination in Sydney residential garden soils was evaluated using data collected during a three-year Macquarie University community science program called VegeSafe. Despite knowledge of industrial and urban contamination amongst scientists, the general public remains under-informed about the potential risks of exposure from legacy contaminants in their home garden environment. The community was offered free soil metal screening, allowing access to soil samples for research purposes. Participants followed specific soil sampling instructions and posted samples to the University for analysis with a field portable X-ray Fluorescence (pXRF) spectrometer. Over the three-year study period, >5200 soil samples, primarily from vegetable gardens, were collected from >1200 Australian homes. As anticipated, the primary soil metal of concern was lead; mean concentrations were 413 mg/kg (front yard), 707 mg/kg (drip line), 226 mg/kg (back yard) and 301 mg/kg (vegetable garden). The Australian soil lead guideline of 300 mg/kg for residential gardens was exceeded at 40% of Sydney homes, while concentrations >1000 mg/kg were identified at 15% of homes. The incidence of highest soil lead contamination was greatest in the inner city area with concentrations declining towards background values of 20-30 mg/kg at 30-40 km distance from the city. Community engagement with VegeSafe participants has resulted in useful outcomes: dissemination of knowledge related to contamination legacies and health risks; owners building raised beds containing uncontaminated soil and in numerous cases, owners replacing all of their contaminated soil. Copyright © 2016 Elsevier Ltd. All rights reserved.
The purpose of this paper is to provide educators with a course model and pedagogy to teach a computer information systems usability course. This paper offers a case study based on an honors student project titled "Web Usability: Phases of Developing an Interactive Event Database." Each individual phase--creating a prototype along with…
Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja
Usability should be considered already by the procuring organizations when selecting future systems. In this paper, we present a framework for usability evaluation during electronic health record (EHR) system procurement. We describe the objectives of the evaluation, the procedure, selected usability attributes and the evaluation methods to measure them. We also present the emphasis usability had in the selection process. We do not elaborate on the details of the results, the application of methods or gathering of data. Instead we focus on the components of the framework to inform and give an example to other similar procurement projects.
The cultural diversity of users of technology challenges our methods for usability testing. This article suggests templates for cross-culturally and culturally specific usability testing, based on studies of usability testing in companies in Mumbai, Beijing, and Copenhagen. Study 1 was a cross...... tests. The result was the construction of templates for usability testing. The culturally specific templates were in Mumbai “user-centered evaluation,” Copenhagen “client-centered evaluation,” and Beijing “evaluator-centered evaluation.” The findings are compared with related research...
Bias, Randolph G; Bias, Randolph G
You just know that an improvement of the user interface will reap rewards, but how do you justify the expense and the labor and the time-guarantee a robust ROI!-ahead of time? How do you decide how much of an investment should be funded? And what is the best way to sell usability to others? In this completely revised and new edition, Randolph G. Bias (University of Texas at Austin, with 25 years' experience as a usability practitioner and manager) and Deborah J. Mayhew (internationally recognized usability consultant and author of two other seminal books including The Usability Enginee
Stephanie Bettina Linek
Full Text Available The usability of Web sites and online services is of rising importance. When creating a completely new Web site, qualitative data are adequate for identifying the most usability problems. However, changes of an existing Web site should be evaluated by a quantitative benchmarking process. The proposed paper describes the creation of a questionnaire that allows a quantitative usability benchmarking, i.e. a direct comparison of the different versions of a Web site and an orientation on general standards of usability. The questionnaire is also open for qualitative data. The methodology will be explained by the digital library services of the ZBW.
Carroll, John M.; Jiang, Hao; Borge, Marcela
Teams of students in an upper-division undergraduate Usability Engineering course used a collaborative environment to carry out a series of three distributed collaborative homework assignments. Assignments were case-based analyses structured using a jigsaw design; students were provided a collaborative software environment and introduced to a…
Mobile technologies are emerging as a valuable tool to collect and assess dietary intake. Adolescents readily accept and adopt new technologies, hence, a food record application (FRapp) may provide an accurate mechanism to monitor dietary intake. We examined the usability of a FRapp in 17 free-livin...
Full Text Available , and then also evaluated the usability and direct accessibility support provided by the Digital Doorway, a non-standard computer system deployed amongst underprivileged communities in South Africa with the aim of promoting computer literacy. This paper discusses...
Fleury, Alexandre; Pedersen, Jakob Schou; Larsen, Lars Bo
As ubiquitous media is developing rapidly, new HCI challenges emerge. In this paper, we address usability issues related to the transfer of content between fixed and mobile devices, as well as channel switching delays on mobile devices. We first provide an extensive review of the field. We...
The purposes of this article are to describe usability testing and introduce designs and methods of usability testing research as it relates to upper-limb prosthetics. This article defines usability, describes usability research, discusses research approaches to and designs for usability testing, and highlights a variety of methodological considerations, including sampling, sample size requirements, and usability metrics. Usability testing is compared with other types of study designs used in prosthetic research.
van der Weegen S
Full Text Available Sanne van der Weegen,1 Renée Verwey,1,2 Huibert J Tange,3 Marieke D Spreeuwenberg,1 Luc P de Witte1,2 1Department of Health Services Research, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands; 2Research Centre Technology in Care, Zuyd University of Applied Sciences, Heerlen, the Netherlands; 3Department of General Practice, CAPHRI School for Public Health and Primary Care, Faculty of Health Medicine and Life Sciences, Maastricht University, the Netherlands Introduction: A monitoring and feedback tool to stimulate physical activity, consisting of an activity sensor, smartphone application (app, and website for patients and their practice nurses, has been developed: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40–70 years, to improve the user interfaces and content of the tool. Patients and methods: The study had four phases: 1 a heuristic evaluation with six technology experts; 2 a usability test in a laboratory by five patients; 3 a pilot in real life wherein 20 patients used the tool for 3 months; and 4 a final lab test by five patients. In both lab tests (phases 2 and 4 qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ was completed for the app and the website. In the pilot test (phase 3, all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI was completed. Results: After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server
Full Text Available Poor inhaler technique is a common problem both in asthma patients and health care providers , which contributes to poor asthma control. The aim of this study was to evaluate the correctness of metered-dose inhaler (MDI technique in a sample of physicians , pharmacists and nurses practicing in Hamadan University hospitals. A total of 176 healthcare providers (35 internists and general physicians , 138 nurses and 3 pharmacists were participated voluntary in this study. After the participants answered a questionnaire aimed at identifying their involvement in MDI prescribing and counseling , a trained observer assessed their MDI technique using a checklist of ten steps.Of the 176 participants , 35(20% were physician , and 3 subjects (2% were pharmacists , and 138 (78% were nurses. However only 6 participants (3.4% performed all steps correctly. Physicians performed significantly better than non-physicians (8.6% vs. 2.13%.The majority of healthcare providers responsible for instructing patients on the correct MDI technique were unable to perform this technique correctly ‘indicating the need for regular formal training programmes on inhaler techniques.
Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew
Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design
Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik
A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... of users’ content understanding is sometimes crucial, and thus should be carefully evaluated. Unfortunately, conventional usability evaluation techniques do not address challenges of content understanding. In a case study within eHealth, specifically the setting of a rehabilitation clinic involving...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...
Andersen, Simon Bruntse; Rasmussen, Claire Kirchert; Frøkjær, Erik
A usability evaluation technique, Cooperative Usability Testing with Questions of Understanding (CUT with QU) intended to illuminate users’ ability to understand the content information of an application is proposed. In complex application domains as for instance the eHealth domain, this issue...... the participation of four physiotherapists and four clients in a period of 3.5 months, it was demonstrated how CUT with QU can complement conventional usability testing and provide insight into users’ challenges with understanding of a new complex eHealth application. More experiments in other complex application...... domains involving different kinds of users and evaluators are needed before we can tell whether CUT with QU is an effective usability testing technique of wider applicability. Performing CUT with QU is very demanding by drawing heavily on the evaluators’ ability to respond effectively to openings...
Morak, Jürgen; Kollmann, Alexander; Schreier, Günter
Utilization of mobile information and communication technologies in home monitoring applications is becoming more and more common. The mobile phone, acting as a patient terminal for patients suffering from chronic diseases, provides an active link to the caregiver to transmit health status information and receive feedback. In such a concept the usability is still limited by the necessity of entering the values via the mobile phone's small keypad. The near field communication technology (NFC), a touch-based wireless interface that became available recently, may improve the usability level of such applications significantly. The focus of this paper is to describe the development of a prototype application based on this technology embedded in a home monitoring system. The feasibility and usability of this approach are evaluated and compared with concepts used in previous approaches. The high quantifier with respect to overall usability indicates that NFC may be the technology of choice for some tasks in home monitoring applications.
Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes
Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.
Boudreaux, Edwin D; Fischer, Andrew Christopher; Haskins, Brianna Lyn; Saeed Zafar, Zubair; Chen, Guanling; Chinai, Sneha A
The administration of health screeners in a hospital setting has traditionally required (1) clinicians to ask questions and log answers, which can be time consuming and susceptible to error, or (2) patients to complete paper-and-pencil surveys, which require third-party entry of information into the electronic health record and can be vulnerable to error and misinterpretation. A highly promising method that avoids these limitations and bypasses third-party interpretation is direct entry via a computerized inventory. To (1) computerize medical and behavioral health screening for use in general medical settings, (2) optimize patient acceptability and feasibility through iterative usability testing and modification cycles, and (3) examine how age relates to usability. A computerized version of 15 screeners, including behavioral health screeners recommended by a National Institutes of Health Office of Behavioral and Social Sciences Research collaborative workgroup, was subjected to systematic usability testing and iterative modification. Consecutive adult, English-speaking patients seeking treatment in an urban emergency department were enrolled. Acceptability was defined as (1) the percentage of eligible patients who agreed to take the assessment (initiation rate) and (2) average satisfaction with the assessment (satisfaction rate). Feasibility was defined as the percentage of the screening items completed by those who initiated the assessment (completion rate). Chi-square tests, analyses of variance, and Pearson correlations were used to detect whether improvements in initiation, satisfaction, and completion rates were seen over time and to examine the relation between age and outcomes. Of 2157 eligible patients approached, 1280 agreed to complete the screening (initiation rate=59.34%). Statistically significant increases were observed over time in satisfaction (F3,1061=3.35, P=.019) and completion rates (F3,1276=25.44, PUsability testing revealed several critical
Mote, P.; Lach, D.; Hartmann, H.; Abatzoglou, J. T.; Stevenson, J.
NOAA's northwest RISA, the Climate Impacts Research Consortium, emphasizes the transformation of data into usable knowledge. This effort involves physical scientists (e.g., Abatzoglou) building web-based tools with climate and hydrologic data and model output, a team performing data mining to link crop loss claims to droughts, social scientists (eg., Lach, Hartmann) evaluating the effectiveness of such tools at communicating with end users, and two-way engagement with a wide variety of audiences who are interested in using and improving the tools. Unusual in this effort is the seamless integration across timescales past, present, and future; data mining; and the level of effort in evaluating the tools. We provide examples of agriculturally relevant climate variables (e.g. growing degree days, day of first fall freeze) and describe the iterative process of incorporating user feedback.
possibilities for, for example, precise control of the chemical environment, 3D cultures, controlled co-culture of different cell types or automated, individual control of up to 96 cell culture chambers in one integrated system. Despite the great new opportunities to perform novel experimental designs......Microfluidic cell culture has been a research area with great attention the last decade due to its potential to mimic the in vivo cellular environment more closely compared to what is possible by conventional cell culture methods. Many exciting and complex devices have been presented providing......, these devices still lack general implementation into biological research laboratories. In this project, the usability and applicability of microfluidic cell culture systems have been investigated. The tested systems display good properties regarding optics and compatibility with standard laboratory equipment...
Johnson, Matthew; Stajano, Frank
Within the scenario of a Smart Home, we discuss the issues involved in allowing limited interaction with the environment for unidentified principals, or guests. The challenges include identifying and authenticating guests on one hand and delegating authorization to them on the other. While the technical mechanisms for doing so in generic distributed systems have been around for decades, existing solutions are in general not applicable to the smart home because they are too complex to manage. We focus on providing both security and usability; we therefore seek simple and easy to understand approaches that can be used by a normal computer-illiterate home owner, not just by a trained system administrator. This position paper describes ongoing research and does not claim to have all the answers.
Escarfullet, Krystle; Moore, Cantera; Tucker, Shari; Wei, June
Mobile health (m-health) comprises the concept of utilising mobile devices to carry out the task of viewing electronic medical records, reserving medical appointments with a patient's medical provider and electronically refilling prescriptions. This paper aims at developing a m-health system to improve usability from a user's perspective. Specifically, it first developed a m-health model by logically linking characteristics of the m-health system together based on information flows. Then, the system requirements were collected by using a developed questionnaire. These requirements were structured and further in-depth analysis was conducted by using an object-oriented approach based on unified modelling language, such as use-case, sequence and analysis class diagrams. This research will be beneficial to decision makers and developers in the mobile healthcare industry.
Veland, Oeystein; Kaarstad, Magnhild; Seim, Lars Aage; Foerdestroemmen, Nils T.
This document describes the result of a study on alarm systems conducted by IFE in Halden. The study was initiated by the Norwegian Petroleum Directorate. The objective was to identify and formulate a set of important properties for useful and usable alarm systems. The study is mainly based on review of the latest international recognised guidelines and standards on alarm systems available at the time of writing, with focus on realistic solutions from research and best practice from different industries. In addition, IFE experiences gathered through specification and design of alarm systems and experimental activities in HAMMLAB and bilateral projects, have been utilized where relevant. The document presents a total of 43 recommendations divided into a number of general recommendations and more detailed recommendations on alarm generation, structuring, prioritisation, presentation and handling. (Author)
Benzel, T.; Cho, Y. H.; Deschon, A.; Gullapalli, S.; Silva, F.
In recent years, advances in sensor network technology have shown great promise to revolutionize environmental data collection. Still, wide spread adoption of these systems by domain experts has been lacking, and these have remained the purview of the engineers who design them. While there are many data logging options for basic data collection in the field currently, scientists are often required to visit the deployment sites to retrieve their data and manually import it into spreadsheets. Some advanced commercial software systems do allow scientists to collect data remotely, but most of these systems only allow point-to-point access, and require proprietary hardware. Furthermore, these commercial solutions preclude the use of sensors from other manufacturers or integration with internet based database repositories and compute engines. Therefore, scientists often must download and manually reformat their data before uploading it to the repositories if they wish to share their data. We present an open-source, low-cost, extensible, turnkey solution called Sensor Processing and Acquisition Network (SPAN) which provides a robust and flexible sensor network service. At the deployment site, SPAN leverages low-power generic embedded processors to integrate variety of commercially available sensor hardware to the network of environmental observation systems. By bringing intelligence close to the sensed phenomena, we can remotely control configuration and re-use, establish rules to trigger sensor activity, manage power requirements, and control the two-way flow of sensed data as well as control information to the sensors. Key features of our design include (1) adoption of a hardware agnostic architecture: our solutions are compatible with several programmable platforms, sensor systems, communication devices and protocols. (2) information standardization: our system supports several popular communication protocols and data formats, and (3) extensible data support: our
Information professionals are increasingly responsible not only for running traditional information and library services but also for providing an online presence for their organisation. This book shows how best practice in delivering online information services should be based on actual user needs and behaviour. A series of case studies provide real life examples of how social science information is being used in the community. The book then draws on these case studies to outline the main issues facing service providers: such as usability, metadata and management. The book concludes with a lo
Comeaux, David J.
Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…
Koohang, Alex; Ondracek, James
This study examined users' views about the usability of digital libraries' current and perceived importance. Age, gender, prior experience with the Internet, college status, and digital library proficiency are the independent variables. Users' current views about the usability of digital libraries and users perceived importance of digital library…
Barlach, Anders; Hertzum, Morten; Simonsen, Jesper
This chapter reports on the usability-engineering work performed throughout the pilot implementation of an Electronic Healthcare Record (EHR). The case describes and analyzes the use of pilot implementations to formatively evaluate whether the usability of the EHR meets the effects specified for ...
Wijnhoven, Alphonsus B.J.M.; Heerkens, Johannes M.G.
This article analyzes the usability of a multi-criteria decision analysis based on a real options AHP (ROAHP) method for IT-investment decisions. The study presents ROAHP to Chief Information Officers (CIO’s) and collects their opinions on prerequisites for usability, strengths and weaknesses. To
Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)
Jameson, Daphne A.
The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…
Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi; Oudkerk, Matthijs; van Ooijen, Peter
Objective To evaluate the usability of a radiology workstation after deployment in a hospital. Significance In radiology, it is difficult to perform valid pre-deployment usability evaluations due to the heterogeneity of the user group, the complexity of the radiological workflow, and the complexity
Nielsen, Lene; Madsen, Sabine
This paper contributes to the HCI literature on usability practice with insights about the empirical challenges and global emerging practices caused by the advent of agile software development (ASD). In the paper we report from a worldwide study involving 12 usability professionals from 12 differ...
Chowdhury, G G
Gives an overview of the necessary issues relating to information users and the usability of information services in the digital world, including user-centred design, and the characteristics and behaviour of information users. This book helps readers understand why information users and the usability of information services are important.
Skov, Mikael Brasholt; Stage, Jan
Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…
Nowadays, many users experience usability issues with their electronic products. It does not work as they expect or otherwise irritates the user, so he becomes dissatisfied about the product and may even complain about it. Th ese numbers of complaints to companies and usability issues are high and
Schultz, Nette; Kirk Sørensen, Jannick; Sørensen, Lene
Internal report of WP1 task 4 activities from August 2006 to December 2006. This report describes the setup of a usability evaluation framework for evaluating core MAGNET concepts in terms of usability. Initially, these core concepts are identified and modes of operation involving...
Cruz Zapata, Belén; Fernández-Alemán, José Luis; Toval, Ambrosio; Idri, Ali
One of the key factors for the adoption of mobile technologies, and in particular of mobile health applications, is usability. A usable application will be easier to use and understand by users, and will improve user's interaction with it. This paper proposes a software requirements catalog for usable mobile health applications, which can be used for the development of new applications, or the evaluation of existing ones. The catalog is based on the main identified sources in literature on usability and mobile health applications. Our catalog was organized according to the ISO/IEC/IEEE 29148:2011 standard and follows the SIREN methodology to create reusable catalogs. The applicability of the catalog was verified by the creation of an audit method, which was used to perform the evaluation of a real app, S Health, application created by Samsung Electronics Co. The usability requirements catalog, along with the audit method, identified several usability flaws on the evaluated app, which scored 83%. Some flaws were detected in the app related to the navigation pattern. Some more issues related to the startup experience, empty screens or writing style were also found. The way a user navigates through an application improves or deteriorates user's experience with the application. We proposed a reusable usability catalog and an audit method. This proposal was used to evaluate a mobile health application. An audit report was created with the usability issues identified on the evaluated application.
Chow, Anthony S.; Croxton, Rebecca A.
This study examined the usability of five virtual reference services--instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing--by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study's results suggest that user preference and…
Jorritsma, Wiard; Cnossen, Fokie; Dierckx, Rudi A.; Oudkerk, Matthijs; Van Ooijen, Peter M. A.
Objectives: To determine the number, nature and severity of usability issues radiologists encounter while using a commercially available radiology workstation in clinical practice, and to assess how well the results of a pre-deployment usability evaluation of this workstation generalize to clinical
Marcilly, Romaric; Peute, Linda
This paper discusses how and why to build evidence-based knowledge on usability evaluation methods. At each step of building evidence, requisites and difficulties to achieve it are highlighted. Specifically, the paper presents how usability evaluation studies should be designed to allow capitalizing
Campbell, Nicole; Walbridge, Sharon; Chisman, Janet; Diller, Karen R.
This interview focuses on usability testing, one method for evaluating whether library Web sites are useful for users. Discussion includes: benefits and drawbacks of usability testing; why it is important; lessons learned from testing; advice for someone interested in doing a study; and recommendations. (AEF)
Thyvalikakath, Thankam Paul; Monaco, Valerie; Thambuganipalle, Himabindu; Schleyer, Titus
Usability methods, such as heuristic evaluation, cognitive walk-throughs and user testing, are increasingly used to evaluate and improve the design of clinical software applications. There is still some uncertainty, however, as to how those methods can be used to support the development process and evaluation in the most meaningful manner. In this study, we compared the results of a heuristic evaluation with those of formal user tests in order to determine which usability problems were detected by both methods. We conducted heuristic evaluation and usability testing on four major commercial dental computer-based patient records (CPRs), which together cover 80% of the market for chairside computer systems among general dentists. Both methods yielded strong evidence that the dental CPRs have significant usability problems. An average of 50% of empirically-determined usability problems were identified by the preceding heuristic evaluation. Some statements of heuristic violations were specific enough to precisely identify the actual usability problem that study participants encountered. Other violations were less specific, but still manifested themselves in usability problems and poor task outcomes. In this study, heuristic evaluation identified a significant portion of problems found during usability testing. While we make no assumptions about the generalizability of the results to other domains and software systems, heuristic evaluation may, under certain circumstances, be a useful tool to determine design problems early in the development cycle.
Advancing Climate Literacy through Investment in Science Education Faculty, and Future and Current Science Teachers: Providing Professional Learning, Instructional Materials, and a Model for Locally-Relevant and Culturally-Responsive Content
Halversen, C.; Apple, J. K.; McDonnell, J. D.; Weiss, E.
The Next Generation Science Standards (NGSS) call for 5th grade students to "obtain and combine information about ways individual communities use science ideas to protect Earth's resources and environment". Achieving this, and other objectives in NGSS, will require changes in the educational system for both students and teachers. Teachers need access to high quality instructional materials and continuous professional learning opportunities starting in pre-service education. Students need highly engaging and authentic learning experiences focused on content that is strategically interwoven with science practices. Pre-service and early career teachers, even at the secondary level, often have relatively weak understandings of the complex Earth systems science required for understanding climate change and hold alternative ideas and naïve beliefs about the nature of science. These naïve understandings cause difficulties in portraying and teaching science, especially considering what is being called for in NGSS. The ACLIPSE program focuses on middle school pre-service science teachers and education faculty because: (1) the concepts that underlie climate change align well with the disciplinary core ideas and practices in NGSS for middle grades; and (2) middle school is a critical time for capturing students interest in science as student engagement by eighth grade is the most effective predictor of student pursuit of science in high school and college. Capturing student attention at this age is critical for recruitment to STEM careers and lifelong climate literacy. THE ACLIPSE program uses cutting edge research and technology in ocean observing systems to provide educators with new tools to engage students that will lead to deeper understanding of the interactions between the ocean and climate systems. Establishing authentic, meaningful connections between indigenous and place-based, and technological climate observations will help generate a more holistic perspective
Toombs, Elaine; Unruh, Anita; McGrath, Patrick
This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N = 18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.
Arnott, James C. [Aspen Global Change Inst., Basalt, CO (United States)
The Aspen Global Change Institute hosted a technical science workshop entitled, “Impact Relevance and Usability of High-Resolution Climate Modeling and Datasets,” on August 2-7, 2015 in Aspen, CO. Kate Calvin (Pacific Northwest National Laboratory), Andrew Jones (Lawrence Berkeley National Laboratory) and Jean-François Lamarque (NCAR) served as co-chairs for the workshop. The meeting included the participation of 29 scientists for a total of 145 participant days. Following the workshop, workshop co-chairs authored a meeting report published in Eos on April 27, 2016. Insights from the workshop directly contributed to the formation of a new DOE-supported project co-led by workshop co-chair Andy Jones. A subset of meeting participants continue to work on a publication on institutional innovations that can support the usability of high resolution modeling, among other sources of climate information.
Full Text Available Usability of medical devices is one of the main determining factors in preventing use errors in treatment and strongly correlates to patient safety and quality of treatment. This thesis demonstrates the usability testing and evaluation of a prototype for locomotor therapy of infants. Therefore, based on the normative requirements of the EN 62366, a concept combined of evaluation procedures and assessing methods was created to enable extensive testing and analysis of the different aspects of usability. On the basis of gathered information weak points were identified and appropriate measures were presented to increase the usability and operating safety of the locomotor prototype. The overall outcome showed an usability value of 77.4% and an evaluation score of 6.99, which can be interpreted as “satisfactory”.
Gabbard, Joseph; Swan, J. E., II; Hix, Deborah; Lanzagorta, Marco O.; Livingston, Mark; Brown, Dennis B.; Julier, Simon J.
This paper discusses our usability engineering process for the Battlefield Augmented Reality System (BARS). Usability engineering is a structured, iterative, stepwise development process. Like the related disciplines of software and systems engineering, usability engineering is a combination of management principals and techniques, formal and semi- formal evaluation techniques, and computerized tools. BARS is an outdoor augmented reality system that displays heads- up battlefield intelligence information to a dismounted warrior. The paper discusses our general usability engineering process. We originally developed the process in the context of virtual reality applications, but in this work we are adapting the procedures to an augmented reality system. The focus of this paper is our work on domain analysis, the first activity of the usability engineering process. We describe our plans for and our progress to date on our domain analysis for BARS. We give results in terms of a specific urban battlefield use case we have designed.
With the proliferation of digital technologies, scientists are exploring various methods for the integration of data to produce scientific discoveries. To maximize the potential of data for science advancement, proper stewardship must be provided to ensure data integrity and usability both for the short- and the long-term. In order to assist…
Warkentin, H [Cross Cancer Institute, Edmonton, AB (Canada); Bubric, K [Alberta Health Services, Calgary, AB (Canada); Giovannetti, H [Jack Ady Cancer Centre, Lethbridge, AB (Canada); Graham, G [Tom Baker Cancer Centre, Calgary, AB (Canada); Clay, C [Central Alberta Cancer Centre, Red Deer, AB (Canada)
Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment. A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document
Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder
Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be
Warkentin, H; Bubric, K; Giovannetti, H; Graham, G; Clay, C
Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment. A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document
Norros, L.; Savioja, P.
In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In there view the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant's safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems. (orig.)
This is an unrefined proposal for a study that could form part of the exploratory phase of the Cultural Usability project. The proposed study compares three cultures (Chinese, Danish, and Indian) and two stakeholder groups (users and developers) with respect to their conceptions of usability....
Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis
Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.
Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier
We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.
Full Text Available Elaborating an efficient and usable mapping between input commands and output movements is still a key challenge for the design of robotic arm prostheses. In order to address this issue, we present and compare three different control modes, by assessing them in terms of performance as well as general usability. Using an isometric force transducer as the command device, these modes convert the force input signal into either a position or a velocity vector, whose magnitude is linearly or quadratically related to force input magnitude. With the robotic arm from the open source 3D-printed Poppy Humanoid platform simulating a mobile prosthesis, an experiment was carried out with eighteen able-bodied subjects performing a 3-D target-reaching task using each of the three modes. The subjects were given questionnaires to evaluate the quality of their experience with each mode, providing an assessment of their global usability in the context of the task. According to performance metrics and questionnaire results, velocity control modes were found to perform better than position control mode in terms of accuracy and quality of control as well as user satisfaction and comfort. Subjects also seemed to favor quadratic velocity control over linear (proportional velocity control, even if these two modes did not clearly distinguish from one another when it comes to performance and usability assessment. These results highlight the need to take into account user experience as one of the key criteria for the design of control modes intended to operate limb prostheses.
Menon, Anita; Korner-Bitensky, Nicol; Chignell, Mark; Straus, Sharon
Rigorous usability testing of e-learn-ing resources is an important prerequisite to their wide-spread use among clinicians. This study demonstrates the application of an evidence-based approach to usability testing of two stroke-related e-learning resources (StrokEngine). 14 stroke rehabilitation clinicians (occupational therapists and physiotherapists) from Ontario, Canada participated in a 1.5 h in-person testing session. Clinicians navigated StrokEngine in search of information to answer questions on stroke assessment/intervention. Their search patterns were observed and clinicians provided verbal/written feedback about StrokEngine. Content analysis was used to generate themes and categorize them under two broad categories: facilitators and barriers to use. Five key facilitators and three key barriers to Strok-Engine use were identified and related to screen format, layout/organization, ease of navigation, quality of content, likelihood of using StrokEngine in the future, and system dysfunctions. All 14 clinicians were very or extremely satisfied with the layout/organization, quality and clinical relevance of the content, stating that they were likely to use StrokEngine in the future. All identified barriers from this study were addressed with website modifications in order to maximize the usability and navigability of StrokEngine. This rigorous methodology for usability testing can be applied during the design process of any e-learning resource.
Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola
The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.
Garfin, G. M.
Actionable science, defined as 'data, analysis, and forecasts that are sufficiently predictive, accepted and understandable to support decision-making,' is the holy grail for climate scientists engaged in working with decision makers, to provide the scientific basis for adaptation planning and decisions. The literature on boundary organizations and science translation offers guidelines and best practices for the generation of climate information that is useful and usable for policy and operational decisions. Guidelines emphasize understanding decision contexts and constraints, trust building, development of a shared vision of usable science, co-production of knowledge, iterative and sustained engagement, and the development and leveraging of knowledge networks and communities of practice. Some studies offer the advice that climate change is fraught with irreducible or slowly reducible uncertainties; hence, the adoption of adaptive risk management approaches is more valuable in the near-term than scientific effort to reduce uncertainty or combine data in novel ways. Nevertheless, many water resource managers still seek science that reduces uncertainties, assurance that the range of projections will not change, evidence of cause and effect (e.g., atmospheric circulation patterns linked to regional precipitation anomalies) and information that is as close to deterministic as possible. So, how does the scientific community move forward on initiatives that integrate paleoclimate, observations, and model projections, to inform water resource management? There are no simple answers, because the uses of climate and hydrological data and information are context dependent. Scientists have products -- data and information -- and they need to research characteristics of the consumers of their product. What is the consumer's operating procedure, and world view? How does the consumer handle uncertainty? What is their tolerance for risk? What social and political factors
Nazan Özenç Uçak; Tolga Çakmak
Today, information is produced increasingly in electronic form and retrieval of information is provided via web pages. As a result of the rise of the number of web pages, many of them seem to comprise similar contents but different designs. In this respect, presenting information over the web pages according to user expectations and specifications is important in terms of effective usage of information. This study provides an insight about web usability studies that are executed for measuring...
Full Text Available Near Field Communication (NFC as relatively new wireless communication technology pushes new challenges to application developers to make their applications easier to use and simpler to operate. This point of view known as usability element. Usability is one of the elements for creating good quality applications. This study aims to analyse the usability of mobile-based application embeds with NFC. We also try to evaluate usability in applications used by children. We developed an application called Receptionist which has a primary function as a communication tool between students, teachers and parents at a middle school. To know the impact of the NFC, the Receptionist input system is designed with two methods, via conventional navigation (using buttons and via NFC. To understand the usability of each method, we do user testing and questioners on students. The results show, using the NFC there is a significant increase in usability attributes: efficiency, effectiveness, and learnability. On the other hand, there is decreases of user satisfaction comparing to conventional method. In general, this study demonstrates the potential of new input device technologies that can improve the usability of mobile-based applications.
Full Text Available “Reusable learning objects” oriented towards increasing their potential reusability are required to satisfy concerns about their granularity and their independence of concrete contexts of use. Such requirements also entail that the definition of learning object “usability,” and the techniques required to carry out their “usability evaluation” must be substantially different from those commonly used to characterize and evaluate the usability of conventional educational applications. In this article, a specific characterization of the concept of learning object usability is discussed, which places emphasis on “reusability,” the key property of learning objects residing in repositories. The concept of learning object reusability is described as the possibility and adequacy for the object to be usable in prospective educational settings, so that usability and reusability are considered two interrelated – and in many cases conflicting – properties of learning objects. Following the proposed characterization of two characteristics or properties of learning objects, a method to evaluate usability of specific learning objects will be presented.
. This paper presents a comprehensive literature study of research conducted in this area, where 129 papers are analyzed in terms of research focus, empirical basis, types of training participants and training costs. Findings show a need for further empirical research regarding long term effects of training...... to fund usability specialists or comprehensive consultancy. Training of non-usability personnel in critical usability engineering methods has the potential of easing these challenges. It is, however, unknown how much and what kind of research that has been committed to novice training in UE methods......, training costs and training in user based evaluation methods....
Clemmensen, Torkil; Ørngreen, Rikke; Roese, Kerstin
it into interaction design. The workshop will present current research into cultural usability and human work interaction design. Cultural usability is a comprehensive concept, which adheres to all kinds of contexts in which humans are involved (private family, work, public and private organizations, nature......, Workplace observation, Think-Aloud Usability Test, etc. These techniques often give - seemingly - similar results when applied in diverse cultural settings, but experience shows that we need a deep understanding of the cultural, social and organizational context to interpret the results, and to transform...
Teka, Degif; Dittrich, Y.; Kifle, Mesfin
be adapted and integrated into the Scrum-agile development with especial emphasis on the Ethiopian context. The research aims at adapting software engineering and ICT development methods to the specific situation and integrating user-centered design (UCD) and lightweight usability methods into agile...... end users and developers. Culturally adapted user pair testing and heuristic evaluation supported usability testing and supported developers in getting early feedback. Integrated approach of discount usability with the Scrum process has been developed and evaluated first with the involved...
Wang, Chih-Jau; Chaovalit, Pimwadee; Pongnumkul, Suporn
Breastfeeding is proven to have lasting health benefits for both mothers and infants; however, 6-month exclusive breastfeeding rate remains below 20% in Thailand. Although the number of research literature and commercial apps for breastfeeding women is significantly growing, they are country-specific and restricted to English-speaking users. There exists a major knowledge gap on how mobile health apps could support breastfeeding in Thailand. To address these gaps, MoomMae has been developed with the intention to support Thai women in breastfeeding outside of their homes and in keeping their feeding records. The aim of this study was to evaluate the usability and usefulness of MoomMae, a mobile phone app designed to support breastfeeding women. Our study was reviewed and approved by Thailand's National Science and Technology Development Agency (NSTDA) ethics committee. A total of 21 breastfeeding women with at least one Android phone or tablet were recruited via convenience and snowball sampling. The study process for each participant was as follows: the participant was requested to attend a preuse interview and given the app to use for 4 weeks. Following this period, a postuse interview was conducted to examine the usability and usefulness of the app. Both sessions were held individually and audiorecorded for qualitative analysis. The mean scores of usability and usefulness from the postuse survey were 4.33 (SD 0.87; range 1-5) and 4.60 (SD 0.74; range 2-5). Our qualitative analysis revealed a total of 137 feedbacks: 71 related to usability and 66 associated with usefulness. A further sentimental analysis showed that comments on usability were generally negative (59 negative, 11 positive, and 1 neutral), and comments on usefulness were relatively positive (56 positive, 9 negative, and 1 neutral). We discovered 26 unique design issues and proposed recommendations for future improvement. Our usability and usefulness assessment of MoomMae demonstrated that MoomMae has
Granata, C; Pino, M; Legouverneur, G; Vidal, J-S; Bidaud, P; Rigaud, A-S
Socially assistive robotics for elderly care is a growing field. However, although robotics has the potential to support elderly in daily tasks by offering specific services, the development of usable interfaces is still a challenge. Since several factors such as age or disease-related changes in perceptual or cognitive abilities and familiarity with computer technologies influence technology use they must be considered when designing interfaces for these users. This paper presents findings from usability testing of two different services provided by a social assistive robot intended for elderly with cognitive impairment: a grocery shopping list and an agenda application. The main goal of this study is to identify the usability problems of the robot interface for target end-users as well as to isolate the human factors that affect the use of the technology by elderly. Socio-demographic characteristics and computer experience were examined as factors that could have an influence on task performance. A group of 11 elderly persons with Mild Cognitive Impairment and a group of 11 cognitively healthy elderly individuals took part in this study. Performance measures (task completion time and number of errors) were collected. Cognitive profile, age and computer experience were found to impact task performance. Participants with cognitive impairment achieved the tasks committing more errors than cognitively healthy elderly. Instead younger participants and those with previous computer experience were faster at completing the tasks confirming previous findings in the literature. The overall results suggested that interfaces and contents of the services assessed were usable by older adults with cognitive impairment. However, some usability problems were identified and should be addressed to better meet the needs and capacities of target end-users.
Peute, L W; Knijnenburg, S L; Kremer, L C; Jaspers, M W M
The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.
Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas
As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on
Full Text Available Joan Vermeulen,1 Jacques CL Neyens,1 Marieke D Spreeuwenberg,1 Erik van Rossum,1,2 Walther Sipers,3 Herbert Habets,3 David J Hewson,4 Luc P de Witte1,2 1School for Public Health and Primary Care (CAPHRI, Maastricht University, Maastricht, The Netherlands; 2Research Center for Technology in Care, Zuyd University of Applied Sciences, Heerlen, The Netherlands; 3Expertise Center for Elderly Care, Orbis Medical Center, Sittard, The Netherlands; 4Institute Charles Delaunay, Université de Technologie de Troyes, Troyes, France Purpose: To involve elderly people during the development of a mobile interface of a monitoring system that provides feedback to them regarding changes in physical functioning and to test the system in a pilot study. Methods and participants: The iterative user-centered development process consisted of the following phases: (1 selection of user representatives; (2 analysis of users and their context; (3 identification of user requirements; (4 development of the interface; and (5 evaluation of the interface in the lab. Subsequently, the monitoring and feedback system was tested in a pilot study by five patients who were recruited via a geriatric outpatient clinic. Participants used a bathroom scale to monitor weight and balance, and a mobile phone to monitor physical activity on a daily basis for six weeks. Personalized feedback was provided via the interface of the mobile phone. Usability was evaluated on a scale from 1 to 7 using a modified version of the Post-Study System Usability Questionnaire (PSSUQ; higher scores indicated better usability. Interviews were conducted to gain insight into the experiences of the participants with the system. Results: The developed interface uses colors, emoticons, and written and/or spoken text messages to provide daily feedback regarding (changes in weight, balance, and physical activity. The participants rated the usability of the monitoring and feedback system with a mean score of 5
Bentley, Richard S
.... This research effort seeks to establish an understanding of how well common practice usability design principles and government mandated accessibility guidelines are followed by Air Force intranet web sites...
Skov, Mikael B.; Stage, Jan
is based on an empirical study where 36 teams with a total of 234 first-year university students on software development and design educations were trained in a simple approach for user-based website usability testing that was taught in a 40 hour course. This approach supported them in planning, conducting......Many improvements of the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both approaches involve...... a complete division of work between developers and evaluators, which is an undesirable complexity for many software development projects. This paper takes a different approach by exploring to what extent software developers and designers can be trained to carry out their own usability evaluations. The paper...
Haan, de G.; Terken, J.M.B.
This paper discusses usability research concerning a wearable system for spoken advice: a field experiment to investigate key concepts, a laboratory experiment to investigate interaction design, and field trials to evaluate the system. Conclusions are drawn about designing wearable appliances.
The reliability and usability of district health information software: case studies from Tanzania. ... The District Health Information System (DHIS) software from the Health Information System ... EMAIL FREE FULL TEXT EMAIL FREE FULL TEXT
U.S. Department of Health & Human Services — Availability and Usability of Behavioral Health Organization Encounter Data in MAX 2009, published in Volume 4, Issue 2 of Medicare and Medicaid Research Review,...
Hornbæk, Kasper Anders Søren; Effie Lai Chong, Law
are generally low: effectiveness measures (e.g., errors) and efficiency measures (e.g., time) has a correlation of .247 ± .059 (Pearson's product-moment correlation with 95% confidence interval), efficiency and satisfaction (e.g., preference) one of .196 ± .064, and effectiveness and satisfaction one of .164......Understanding the relation between usability measures seems crucial to deepen our conception of usability and to select the right measures for usability studies. We present a meta-analysis of correlations among usability measures calculated from the raw data of 73 studies. Correlations...... ± .062. Changes in task complexity do not influence these correlations, but use of more complex measures attenuates them. Standard questionnaires for measuring satisfaction appear more reliable than homegrown ones. Measures of users' perceptions of phenomena are generally not correlated with objective...
... has ever used the API; hence, no analysis was accomplished with respect to usability attributes, The project sponsor desires public release of the API, especially within the Department of Defense (DoD...
Mathew, Gloriya; Thomas, Shiney
User authentication is one of the most important part of information security. Computer security most commonly depends on passwords to authenticate human users. Password authentication systems will be either been usable but not secure, or secure but not usable. While there are different types of authentication systems available alphanumeric password is the most commonly used authentication mechanism. But this method has significant drawbacks. An alternative solution to the text based authenti...
Tracking user activities online can be done in order to improve systems usability, understand user behaviour or to increase monetary prot, to mention a few things. The software tools for this purpose can vary, for example in terms of usability of the tool itself, features, security, price, accessibility and support options. In this study I have developed a methodology to evaluate a selection of modern tools and map them depending on various properties. I have also analysed learning theories t...
Nicholas Kipkurui Kiget; Professor G. Wanyembi; Anselemo Ikoha Peters
The use of e-learning systems has increased significantly in the recent times. E-learning systems are supplementing teaching and learning in universities globally. Kenyan universities have adopted e-learning technologies as means for delivering course content. However despite adoption of these systems, there are considerable challenges facing the usability of the systems. Lecturers and students have different perceptions in regard to the usability of e-learning systems. The aim of this study ...
Daniela Couto Carvalho Barra
Full Text Available OBJECTIVE To analyze the usability of Computerized Nursing Process (CNP from the ICNP® 1.0 in Intensive Care Units in accordance with the criteria established by the standards of the International Organization for Standardization and the Brazilian Association of Technical Standards of systems. METHOD This is a before-and-after semi-experimental quantitative study, with a sample of 34 participants (nurses, professors and systems programmers, carried out in three Intensive Care Units. RESULTS The evaluated criteria (use, content and interface showed that CNP has usability criteria, as it integrates a logical data structure, clinical assessment, diagnostics and nursing interventions. CONCLUSION The CNP is a source of information and knowledge that provide nurses with new ways of learning in intensive care, for it is a place that provides complete, comprehensive, and detailed content, supported by current and relevant data and scientific research information for Nursing practices.
Full Text Available Nowadays there are different evaluation methods focused in the assessment of the usability of telematic methods. The assessment of 3rd generation web environments evaluates the effectiveness and usability of application with regard to the user needs. Wireless usability and, specifically in mobile phones, is concentrated in the validation of the features and tools management using conventional interactive environments. There is not a specific and suitable criterion to evaluate created environments and m-learning platforms, where the restricted and sequential representation is a fundamental aspect to be considered.The present paper exposes the importance of the conventional usability methods to verify both: the employed contents in wireless formats, and the possible interfaces from the conception phases, to the validations of the platform with such characteristics.The development of usability adapted inspection could be complemented with the Remote’s techniques of usability testing, which are being carried out these days in the mobile devices field and which pointed out the need to apply common criteria in the validation of non-located learning scenarios.
Judith T. Matthews
Full Text Available Health care providers typically rely on family caregivers (CG of persons with dementia (PWD to describe difficult behaviors manifested by their underlying disease. Although invaluable, such reports may be selective or biased during brief medical encounters. Our team explored the usability of a wearable camera system with 9 caregiving dyads (CGs: 3 males, 6 females, 67.00 ± 14.95 years; PWDs: 2 males, 7 females, 80.00 ± 3.81 years, MMSE 17.33 ± 8.86 who recorded 79 salient events over a combined total of 140 hours of data capture, from 3 to 7 days of wear per CG. Prior to using the system, CGs assessed its benefits to be worth the invasion of privacy; post-wear privacy concerns did not differ significantly. CGs rated the system easy to learn to use, although cumbersome and obtrusive. Few negative reactions by PWDs were reported or evident in resulting video. Our findings suggest that CGs can and will wear a camera system to reveal their daily caregiving challenges to health care providers.
Als, Benedikte Skibsted; Jensen, Janne Jul; Skov, Mikael B.
Constructive interaction provides natural thinking-aloud as test subjects collaborate to solve tasks. Since children may face difficulties in following instructions for a standard think-aloud test, constructive interaction has been suggested as evaluation method when usability testing with childr......, the acquainted pairs reported that they had to put less effort into the testing than the think-aloud and non-acquainted children....
Garcia Arriola, Alfonso
In the last twenty years in US science education, professional development has emphasized the need to change science instruction from a direct instruction model to a more participatory and constructivist learning model. The result of these reform efforts has seen an increase in science education professional development that is focused on…
Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang
Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.
Satwicz, T.; Bharadwaj, A.; Evans, J.; Dirks, J.; Clark Cole, K.
Transforming geological data into information that has broad scientific and societal impact is a process fraught with barriers. Data sets and tools are often reported to have poor user experiences (UX) that make scientific work more challenging than it needs be. While many other technical fields have benefited from ongoing improvements to the UX of their tools (e.g., healthcare and financial services) scientists are faced with using tools that are labor intensive and not intuitive. Our research team has been involved in a multi-year effort to understand and improve the UX of scientific tools and data sets. We use a User-Centered Design (UCD) process that involves naturalistic behavioral observation and other qualitative research methods adopted from Human-Computer Interaction (HCI) and related fields. Behavioral observation involves having users complete common tasks on data sets, tools, and websites to identify usability issues and understand the severity of the issues. We measure how successfully they complete tasks and diagnosis the cause of any failures. Behavioral observation is paired with in-depth interviews where users describe their process for generating results (from initial inquiry to final results). By asking detailed questions we unpack common patterns and challenges scientists experience while working with data. We've found that tools built using the UCD process can have a large impact on scientist work flows and greatly reduce the time it takes to process data before analysis. It is often challenging to understand the organization and nuances of data across scientific fields. By better understanding how scientists work we can create tools that make routine tasks less-labor intensive, data easier to find, and solve common issues with discovering new data sets and engaging in interdisciplinary research. There is a tremendous opportunity for advancing scientific knowledge and helping the public benefit from that work by creating intuitive, interactive
This paper studies heuristic usability evaluation of user interfaces. The literature review distinguishes characteristics of augmented reality and smartphones, presents heuristic evaluation, PACMAD usability model, personal navigation assistants, video games, augmented reality and J. Nielsen usability heuristics. In research part, usability heuristics of related subject fields and design guidelines are combined. Created heuristics and control questionnaire are used for evaluation of augmented...
Ako-Arrey, Denis E; Brouwers, Melissa C; Lavis, John N; Giacomini, Mita K
Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability. This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed. Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains. The final
Give us the tools: science and technology for development. Ottawa, ...... altered technical rela- tionships among the factors used in the process of production, and the en- .... to ourselves only the rights of audit and periodic substantive review." If a ...... and destroying scarce water reserves, recreational areas and a generally.
Full Text Available Distributed technologies and ubiquitous computing now support users who may be detached or decoupled from traditional interactions. In order to investigate the potential usability of speech and manual input devices, an evaluation of speech input across different user groups and a usability assessment of independent-user and collaborative-user interactions was conducted. Whilst the primary focus was on a formative usability evaluation, the user group evaluation provided a formal basis to underpin the academic rigor of the exercise. The results illustrate that using a speech interface is important in understanding user acceptance of such technologies. From the usability assessment it was possible to translate interactions and make them compatible with innovative input devices. This approach to interaction is still at an early stage of development, and the potential or validity of this interfacing concept is still under evaluation; however, as a concept demonstrator, the results of these initial evaluations demonstrate the potential usability issues of both input devices as well as highlighting their suitability for advanced virtual applications.
Paul, Celeste Lyn
A review of case studies about usability in eight Free/Libre/Open Source Software (FLOSS) projects showed that an important issue regarding a usability initiative in the project was the lack of user research. User research is a key component in the user-centered design (UCD) process and a necessary step for creating usable products. Reasons why FLOSS projects suffered from a lack of user research included poor or unclear project leadership, cultural differences between developer and designers, and a lack of usability engineers. By identifying these critical issues, the FLOSS usability community can begin addressing problems in the efficacy of usability activities and work towards creating more usable FLOSS products.
This report discusses the generally accepted successes and shortcomings of the various computer and hardware-based control systems at the Los Alamos Meson Physics Facility (LAMPF) from an operator's standpoint. LAMPF currently utilizes three separate control rooms that, although critically co-dependent, use distinct operating methods. The first, the Injector Control Room, which is responsible for the operation of the three ion sources, the 750 keV transport lines and the 201.25 MHz portion of the linac, uses a predominantly hardware-based control system. The second, the LANSCE Control Room, which is responsible for the operation of the Los Alamos Neutron Scattering Center, uses a graphical touch-panel interface with single-application screens as its control system. The third, the LAMPF Central Control Room, which is responsible for the overall operation of LAMPF, primarily uses a text-oriented keyboard interface with multiple applications per screen. Though each system provides generally reliable human interfacing to the enormously complex and diverse machine known as LAMPF, the operational requirements of speed, usability, and reliability are increasingly necessitating the use of a standard control system that incorporates the positive aspects of all three control systems. (orig.)
Zhang, Yin; Chase, Steve M
Brain-computer interfaces are in the process of moving from the laboratory to the clinic. These devices act by reading neural activity and using it to directly control a device, such as a cursor on a computer screen. An open question in the field is how to map neural activity to device movement in order to achieve the most proficient control. This question is complicated by the fact that learning, especially the long-term skill learning that accompanies weeks of practice, can allow subjects to improve performance over time. Typical approaches to this problem attempt to maximize the biomimetic properties of the device in order to limit the need for extensive training. However, it is unclear if this approach would ultimately be superior to performance that might be achieved with a nonbiomimetic device once the subject has engaged in extended practice and learned how to use it. Here we approach this problem using ideas from optimal control theory. Under the assumption that the brain acts as an optimal controller, we present a formal definition of the usability of a device and show that the optimal postlearning mapping can be written as the solution of a constrained optimization problem. We then derive the optimal mappings for particular cases common to most brain-computer interfaces. Our results suggest that the common approach of creating biomimetic interfaces may not be optimal when learning is taken into account. More broadly, our method provides a blueprint for optimal device design in general control-theoretic contexts.
Patricia A. Abbott
Full Text Available Clinical environments are complex, stressful, and safety critical—heightening the demand for technological solutions that will help clinicians manage health information efficiently and safely. The industry has responded by creating numerous, increasingly compact and powerful health IT devices that fit in a pocket, hook to a belt, attach to eyeglasses, or wheel around on a cart. Untethering a provider from a physical “place” with compact, mobile technology while delivering the right information at the right time and at the right location are generally welcomed in clinical environments. These developments however, must be looked at ecumenically. The cognitive load of clinicians who are occupied with managing or operating several different devices during the process of a patient encounter is increased, and we know from decades of research that cognitive overload frequently leads to error. “Technology crowding,” enhanced by the plethora of mobile health IT, can actually become an additional millstone for busy clinicians. This study was designed to gain a deeper understanding of clinicians’ interactions with a mobile clinical computing appliance (Motion Computing C5 designed to consolidate numerous technological functions into an all-in-one device. Features of usability and comparisons to current methods of documentation and task performance were undertaken and results are described.
Gertman, D.I.; Blackman, H.S.; Hinton, M.F.
This chapter reviews data collected at the Idaho National Engineering Laboratory for three DOE-owned reactors (the Advanced Test Reactor, the Power Burst Facility, and the Loss of Fluids Test Reactor) in order to identify usable Probabilistic Risk Assessment (PRA) input. Task analytic procedures involve the determination of manning and skill levels as a means of determining communication requirements, in assessing job performance aids, and in assessing the accuracy and completeness of emergency and maintenance procedures. The least understood aspect in PRA and plant reliability models is the human factor. A number of examples from the data base are discussed and offered as a means of providing more meaningful data than has been available to PRA analysts in the past. It is concluded that the plant hardware-procedures-personnel interfaces are essential to safe and efficient plant operations and that task analysis is a reasonably sound way of achieving a qualitative method for identifying those tasks most strongly associated with task difficulty, severity of consequence, and error probability
Haidar, Ali N.; Zasada, Stefan J.; Coveney, Peter V.; Abdallah, Ali E.; Beckles, Bruce; Jones, Mike A. S.
We present applications of audited credential delegation (ACD), a usable security solution for authentication, authorization and auditing in distributed virtual physiological human (VPH) project environments that removes the use of digital certificates from end-users' experience. Current security solutions are based on public key infrastructure (PKI). While PKI offers strong security for VPH projects, it suffers from serious usability shortcomings in terms of end-user acquisition and management of credentials which deter scientists from exploiting distributed VPH environments. By contrast, ACD supports the use of local credentials. Currently, a local ACD username–password combination can be used to access grid-based resources while Shibboleth support is underway. Moreover, ACD provides seamless and secure access to shared patient data, tools and infrastructure, thus supporting the provision of personalized medicine for patients, scientists and clinicians participating in e-health projects from a local to the widest international scale. PMID:22670214
Haidar, Ali N; Zasada, Stefan J; Coveney, Peter V; Abdallah, Ali E; Beckles, Bruce; Jones, Mike A S
We present applications of audited credential delegation (ACD), a usable security solution for authentication, authorization and auditing in distributed virtual physiological human (VPH) project environments that removes the use of digital certificates from end-users' experience. Current security solutions are based on public key infrastructure (PKI). While PKI offers strong security for VPH projects, it suffers from serious usability shortcomings in terms of end-user acquisition and management of credentials which deter scientists from exploiting distributed VPH environments. By contrast, ACD supports the use of local credentials. Currently, a local ACD username-password combination can be used to access grid-based resources while Shibboleth support is underway. Moreover, ACD provides seamless and secure access to shared patient data, tools and infrastructure, thus supporting the provision of personalized medicine for patients, scientists and clinicians participating in e-health projects from a local to the widest international scale.
Brown, Benjamin; Balatsoukas, Panos; Williams, Richard; Sperrin, Matthew; Buchan, Iain
identification from a figure (both population-level and patient-level); (3) Disagreement with a system recommendation. By contextualising our findings within the wider literature on health information system usability, we provide recommendations for the design of e-A&F system interfaces relating to their four key components, in addition to how they may be integrated within a system. Copyright © 2016. Published by Elsevier Ireland Ltd.
Wanderer, Jonathan P; Rao, Anoop V; Rothwell, Sarah H; Ehrenfeld, Jesse M
Anesthesia information management systems (AIMS) have been developed by multiple vendors and are deployed in thousands of operating rooms around the world, yet not much is known about measuring and improving AIMS usability. We developed a methodology for evaluating AIMS usability in a low-fidelity simulated clinical environment and used it to compare an existing user interface with a revised version. We hypothesized that the revised user interface would be more useable. In a low-fidelity simulated clinical environment, twenty anesthesia providers documented essential anesthetic information for the start of the case using both an existing and a revised user interface. Participants had not used the revised user interface previously and completed a brief training exercise prior to the study task. All participants completed a workload assessment and a satisfaction survey. All sessions were recorded. Multiple usability metrics were measured. The primary outcome was documentation accuracy. Secondary outcomes were perceived workload, number of documentation steps, number of user interactions, and documentation time. The interfaces were compared and design problems were identified by analyzing recorded sessions and survey results. Use of the revised user interface was shown to improve documentation accuracy from 85.1% to 92.4%, a difference of 7.3% (95% confidence interval [CI] for the difference 1.8 to 12.7). The revised user interface decreased the number of user interactions by 6.5 for intravenous documentation (95% CI 2.9 to 10.1) and by 16.1 for airway documentation (95% CI 11.1 to 21.1). The revised user interface required 3.8 fewer documentation steps (95% CI 2.3 to 5.4). Airway documentation time was reduced by 30.5 seconds with the revised workflow (95% CI 8.5 to 52.4). There were no significant time differences noted in intravenous documentation or in total task time. No difference in perceived workload was found between the user interfaces. Two user interface
Sukardjo, Moch.; Sugiyanta, Lipur
Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is
Full Text Available The Big Ten Academic Alliance (BTAA Geospatial Data Project is a collaboration between twelve member institutions of the consortium and works towards providing discoverability and access to geospatial data, scanned maps, and web mapping services. Usability tests and heuristic evaluations were chosen as methods of evaluation, as they have had a long standing in measuring and managing website engagement and are essential in the process of iterative design. The BTAA project hopes to give back to the community by publishing the results of our usability findings with the hope that it will benefit other portals built with GeoBlacklight.
Eberle, J.; Gerlach, R.; Hese, S.; Schmullius, C.
To provide earth observation products in the area of Siberia, the Siberian Earth System Science Cluster (SIB-ESS-C) was established as a spatial data infrastructure at the University of Jena (Germany), Department for Earth Observation. This spatial data infrastructure implements standards published by the Open Geospatial Consortium (OGC) and the International Organizsation for Standardization (ISO) for data discovery, data access, data processing and data analysis. The objective of SIB-ESS-C is to faciliate environmental research and Earth system science in Siberia. The region for this project covers the entire Asian part of the Russian Federation approximately between 58°E - 170°W and 48°N - 80°N. To provide discovery, access and analysis services a webportal was published for searching and visualisation of available data. This webportal is based on current web technologies like AJAX, Drupal Content Management System as backend software and a user-friendly surface with Drag-n-Drop and further mouse events. To have a wide range of regular updated earth observation products, some products from sensor MODIS at the satellites Aqua and Terra were processed. A direct connection to NASA archive servers makes it possible to download MODIS Level 3 and 4 products and integrate it in the SIB-ESS-C infrastructure. These data can be downloaded in a file format called Hierarchical Data Format (HDF). For visualisation and further analysis, this data is reprojected, converted to GeoTIFF and global products clipped to the project area. All these steps are implemented as an automatic process chain. If new MODIS data is available within the infrastructure this process chain is executed. With the link to a MODIS catalogue system, the system gets new data daily. With the implemented analysis processes, timeseries data can be analysed, for example to plot a trend or different time series against one another. Scientists working in this area and working with MODIS data can make use
Full Text Available In this research, an E-learning environment is developed for the teacher candidates taking the course on Scientific Research Methods. The course contents were adapted to one of the constructivist approach models referred to as 5E, and an expert opinion was received for the compliance of this model. An usability analysis was also performed to determine the usability of the e-learning environment. The participants of the research comprised 42 teacher candidates. The mixed method was used in the research. 3 different data collection tools were used in order to measure the three basic concepts of usability analyses, which are the dimensions of effectiveness, efficiency and satisfaction. Two of the data collection tools were the scales developed by different researchers and were applied with the approval received from the researchers involved. On the other hand, the usability test as another data tool was prepared by the researchers who conducted this study for the purpose of determining the participants’ success in handling the twelve tasks assigned to them with respect to the use of elearning environment, the seconds they spent on that environment and the number of clicks they performed. Considering the results of the analyses performed within the data obtained, the usability of the developed e-learning environment proved to be at a higher rate.
Nathan, Shelena Soosay; Hussain, Azham; Hashim, Nor Laily; Omar, Mohd Adan
This paper discuss on the dimensions that has been derived for the hearing-impaired mobile applications usability model. General usability model consist of general dimension for evaluating mobile application however requirements for the hearing-impaired are overlooked and often scanted. This led towards mobile application developed for the hearing-impaired are left unused. It is also apparent that these usability models do not consider accessibility dimensions according to the requirement of the special users. This complicates the work of usability practitioners as well as academician that practices research usability when application are developed for the specific user needs. To overcome this issue, dimension chosen for the hearing-impaired are ensured to be align with the real need of the hearing-impaired mobile application. Besides literature studies, requirements for the hearing-impaired mobile application have been identified through interview conducted with hearing-impaired mobile application users that were recorded as video outputs and analyzed using Nvivo. Finally total of 6 out of 15 dimensions gathered are chosen for the proposed model and presented.
Abdul Ghani Aida Affina
Full Text Available With more than 200 number of shopping centre in Klang Valley itself, we the consumer actually have vast of choices. Instead of the machineries varieties from the lower class product till the posh one, each of those shopping centres eventually offers the typical product same as others. Those shopping centers are competing with each other and in great endeavour to attract more consumers, to visit and spend. As for the visitor, the typical product and boring ambience seems similar in all malls, and is looking something beyond the standard. Something that promising quality embedded in shopping centre which evokes the various emotions of the user along their journey in malls. This quality is known as usability. Usability; as defined generally is a global user’s experience response with product, environment, service or facilities. It is an assessment in extracting the qualities of shopping centre design. In mapping it, there are a few synthesizing methods to implement it. Therefore, this paper purposely to review the method that been used in usability of Malaysia’s shopping centre research with a few references on previous research done in usability assessment by predecessor’s scholars. With the accentuation on three elements that anchoring what the usability is: effectiveness, efficient and satisfaction, it is hope that this overview can lead other researcher in portraying its relationship with the quality and ‘user friendly’ design of shopping centre.
Li, Alice C; Kannry, Joseph L; Kushniruk, Andre; Chrimes, Dillon; McGinn, Thomas G; Edonyabo, Daniel; Mann, Devin M
Usability evaluations can improve the usability and workflow integration of clinical decision support (CDS). Traditional usability testing using scripted scenarios with think-aloud protocol analysis provide a useful but incomplete assessment of how new CDS tools interact with users and clinical workflow. "Near-live" clinical simulations are a newer usability evaluation tool that more closely mimics clinical workflow and that allows for a complementary evaluation of CDS usability as well as impact on workflow. This study employed two phases of testing a new CDS tool that embedded clinical prediction rules (an evidence-based medicine tool) into primary care workflow within a commercial electronic health record. Phase I applied usability testing involving "think-aloud" protocol analysis of 8 primary care providers encountering several scripted clinical scenarios. Phase II used "near-live" clinical simulations of 8 providers interacting with video clips of standardized trained patient actors enacting the clinical scenario. In both phases, all sessions were audiotaped and had screen-capture software activated for onscreen recordings. Transcripts were coded using qualitative analysis methods. In Phase I, the impact of the CDS on navigation and workflow were associated with the largest volume of negative comments (accounting for over 90% of user raised issues) while the overall usability and the content of the CDS were associated with the most positive comments. However, usability had a positive-to-negative comment ratio of only 0.93 reflecting mixed perceptions about the usability of the CDS. In Phase II, the duration of encounters with simulated patients was approximately 12 min with 71% of the clinical prediction rules being activated after half of the visit had already elapsed. Upon activation, providers accepted the CDS tool pathway 82% of times offered and completed all of its elements in 53% of all simulation cases. Only 12.2% of encounter time was spent using the
Winkler, Sabune J.; Bierer, Barbara E.; Wolf, Delia
Abstract The Food and Drug Administration (FDA) regulations require sponsors of clinical investigations involving an investigational drug or device to submit an Investigational New Drug (IND) or Investigational Device Exemption (IDE) application. Strict adherence to applicable regulations is vital to the success of clinical research. Unlike most major pharmaceutical sponsors, investigator sponsors often do not fully appreciate their regulatory obligations nor have resources to ensure compliance. As a result they can place themselves and their institutions at risk. Nevertheless, investigator‐initiated clinical trials are vital to the further development of innovative drugs, biologics, and medical devices. The IND/IDE Subcommittee under the Regulatory Knowledge and Support Program at Harvard Catalyst, The Harvard Clinical and Translational Science Center worked in collaboration with Harvard and Harvard affiliated institutions to create and launch an IND/IDE Consult Service in a decentralized network of collaborating Academic Healthcare Centers (AHC). The IND/IDE Consult Service offers expertise, resources, and shared experiences to assist sponsor‐investigators and IRBs in meeting regulatory requirements for conducting and reviewing investigator‐initiated IND/IDE studies. The scope of the services provided by the Harvard Catalyst IND/IDE Consult Service are described, including the specifics of the service, lessons learned, and challenges faced, in a scalable model that builds inter‐institutional capacity. PMID:24455986
Kim, Min J; Winkler, Sabune J; Bierer, Barbara E; Wolf, Delia
The Food and Drug Administration (FDA) regulations require sponsors of clinical investigations involving an investigational drug or device to submit an Investigational New Drug (IND) or Investigational Device Exemption (IDE) application. Strict adherence to applicable regulations is vital to the success of clinical research. Unlike most major pharmaceutical sponsors, investigator sponsors often do not fully appreciate their regulatory obligations nor have resources to ensure compliance. As a result they can place themselves and their institutions at risk. Nevertheless, investigator-initiated clinical trials are vital to the further development of innovative drugs, biologics, and medical devices. The IND/IDE Subcommittee under the Regulatory Knowledge and Support Program at Harvard Catalyst, The Harvard Clinical and Translational Science Center worked in collaboration with Harvard and Harvard affiliated institutions to create and launch an IND/IDE Consult Service in a decentralized network of collaborating Academic Healthcare Centers (AHC). The IND/IDE Consult Service offers expertise, resources, and shared experiences to assist sponsor-investigators and IRBs in meeting regulatory requirements for conducting and reviewing investigator-initiated IND/IDE studies. The scope of the services provided by the Harvard Catalyst IND/IDE Consult Service are described, including the specifics of the service, lessons learned, and challenges faced, in a scalable model that builds inter-institutional capacity. © 2014 Wiley Periodicals, Inc.
Kilsdonk, Ellen; Peute, Linda W.; Riezebos, Rinke J.; Kremer, Leontien C.; Jaspers, Monique W. M.
To assess whether a user-centred prototype clinical decision support system (CDSS) providing patient-specific advice better supports healthcare practitioners in terms of (a) types of usability problems detected and (b) effective and efficient retrieval of childhood cancer survivor's follow-up
Keijzers, J.; Ouden, den P.H.; Lu, Y.; Hofte, ter G.H.; Mulder, I.
The upcoming of smart phones are the result of consumers' preference for high-feature products: manufacturers are lured into integration of a growing number of technologies and features to provide attractive and competitive models. At the same time usability of such complex products becomes an
Teka, Degif; Dittrich, Yvonne; Kifle, Mesfin
Usability and user centered design (UCD) are central to software development. In developing countries, the gap between IT development and the local use situation is larger than in western countries. However, usability is neither well addressed in software practice nor at the policy making level...... in Ethiopia. Software practitioners focus on functional requirements, meeting deadlines and budget. The software development industry in Ethiopia is in its early stage. The article aims at understanding usability practices in an Ethiopian software development company. Developers, system analysts, product...... configuration, their experience, cultural knowledge and common sense regarding the users' situation guided the design. Prototypes and fast delivery of working versions helped in getting user feedback even if early user focus proved to be a challenge as communication between developers and users suffered from...
Background: In complex buildings with many types of users it can be difficult to satisfy the numerous, often contradictory requirements. Research in usability mostly focuses on evaluating products or facilities with users, after they were built. This paper is part of a PhD project “Usability...... with various users/stakeholders, using creative boundary objects at workshops. Practical Implications: The research results have relevance to researchers, client organisations, facility managers and architects planning new complex facilities. Research limitations: The proposed model is theoretical and needs...... briefing for hospitals”, where methods for capturing user needs and experiences at hospital facilities are investigated in order to feed into design processes and satisfy the users’ needs and maximise the effectiveness of facilities. Purpose: This paper introduces the concept of usability briefing...
Zahra, Fatima; Hussain, Azham; Mohd, Haslina
The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.
Hermawati, Setia; Lawson, Glyn
Heuristics evaluation is frequently employed to evaluate usability. While general heuristics are suitable to evaluate most user interfaces, there is still a need to establish heuristics for specific domains to ensure that their specific usability issues are identified. This paper presents a comprehensive review of 70 studies related to usability heuristics for specific domains. The aim of this paper is to review the processes that were applied to establish heuristics in specific domains and identify gaps in order to provide recommendations for future research and area of improvements. The most urgent issue found is the deficiency of validation effort following heuristics proposition and the lack of robustness and rigour of validation method adopted. Whether domain specific heuristics perform better or worse than general ones is inconclusive due to lack of validation quality and clarity on how to assess the effectiveness of heuristics for specific domains. The lack of validation quality also affects effort in improving existing heuristics for specific domain as their weaknesses are not addressed. Copyright © 2016 Elsevier Ltd. All rights reserved.
Jody Condit Fagan
Full Text Available Discovery tools are emerging in libraries. These tools offer library patrons the ability to concurrently search the library catalog and journal articles. While vendors rush to provide feature-rich interfaces and access to as much content as possible, librarians wonder about the usefulness of these tools to library patrons. In order to learn about both the utility and usability of EBSCO Discovery Service, James Madison University conducted a usability test with eight students and two faculty members. The test consisted of nine tasks focused on common patron requests or related to the utility of specific discovery tool features. Software recorded participants’ actions and time on task, human observers judged the success of each task, and a post-survey questionnaire gathered qualitative feedback and comments from the participants. Overall, participants were successful at most tasks, but specific usability problems suggested some interface changes for both EBSCO Discovery Service and JMU’s customizations of the tool. The study also raised several questions for libraries above and beyond any specific discovery tool interface, including the scope and purpose of a discovery tool versus other library systems, working with the large result sets made possible by discovery tools, and navigation between the tool and other library services and resources. This article will be of interest to those who are investigating discovery tools, selecting products, integrating discovery tools into a library web presence, or performing evaluations of similar systems.
Cruz Zapata, Belén; Hernández Niñirola, Antonio; Idri, Ali; Fernández-Alemán, José Luis; Toval, Ambrosio
Mobile Personal Health Records (PHRs) have achieved a particularly strong market share since the appearance of more powerful mobile devices and popular worldwide mobile application markets such as Apple's App Store and Android's Google Play. However, Android and Apple have a set of recommendations on design and usability targeted towards developers who wish to publish apps in their stores: Android Design Guidelines and iOS Human Interface Guidelines. This paper aims to evaluate compliance with these guidelines by assessing the usability recommendations of a set of 24 selected mobile PHR applications. An analysis process based on a well-known Systematic Literature Review (SLR) protocol was used. The results show that the 24 mobile PHR applications studied are not suitably structured. 46 % of these applications do not use any of the recommended patterns, using instead lists or springboards, which are deprecated patterns for top-level menus. 70 % of the PHRs require a registration to be able to test the application when these interactions should be delayed. Our study will help both PHR users to select user-friendly mobile PHRs and PHR providers and developers to identify the good usability practices implemented by the applications with the highest scores.
Full Text Available Digital publishing is one of the national key programs. Different from traditional digital publishing models, consumers could create personal digital publications with the editing program provided by businesses and combine it with web-to-print to output solid publications. Nevertheless, the usability of online publishing software is related to consumers’ acceptance or intention of product purchase. In this case, Focus Group is utilized to screen representative online publishing software (including TinTint, Photobook, and Hypo for evaluating interface usability, investigating users’ Subjective Satisfaction, and further proposing suggestions for interface modification. Learnability and the number of user errors are set as the evaluation indicators of usability. Within the evaluation indicators in Learnability, the results show that nine typical tasks, except for Storing, show significant difference between various online publishing software. Typical tasks of basic information of works, appending pictures, adjusting pictures, changing type version, and changing pages in the number of user errors reveal significant difference on distinct online publishing software. Regarding the evaluation of overall Subjective Satisfaction with interface, TinTint and Hypo outperform Photobook, and no significant difference appears between TinTint and Hypo. It is expected that the research model could be the application reference of interface development and evaluation in digital content industries.
Ankem, Kalyani; Cho, Sookyung; Simpson, Diana
The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.
Full Text Available Digital technologies have opened a large set of opportunities for new electronic services (e-commerce, e-health, e-studies etc.. There are many considerations that need to be made when programmers are building new application software or system software. The software needs to be attractive enough that people want to look at it. It also needs to contain all necessary information that developers want to share with their readers (customers, users in order to help them achieve the objective for which they came to their website, use their software, or interact with their teaching packages. The oversupply of e-services products has created a need for usability research and development. “Usability means making products and systems easier to use, and matching them more closely to user needs and requirements”. Usability is a key concept of the human-computer interface and is concerned with making computer systems easy to learn and easy to use through a user-centered design process. The in-depth understanding of usability concepts and processes are critical for large-scale acceptance of new e-services and knowledge productivity. Poorly designed software can be extremely annoying to users. Smith and Mayes state that „usability is now recognised as a vital determining factor in the success of any new computer system or computer-based service”. Studies have shown that the main health problems of computer users are repetitive strain injuries, visual discomfort and stress-related disorders. Beside other risk factors, such as poor workstation design, uncomfortable work postures, long hours of computer use every day, stress, etc., also poor design and usability of the computer systems, as well as computer technical problems, add to the pressure felt by the user, which may in turn cause stress-related disorders.
The threat of nuclear weapons proliferation is a problem of world wide concern. Safeguards are the key to nuclear nonproliferation and data is the key to safeguards. The safeguards community has access to a huge and steadily growing volume of data. The advantages of this data rich environment are obvious, there is a great deal of information which can be utilized. The challenge is to effectively apply proven and developing technologies to find and extract usable information from that data. That information must then be assessed and evaluated to produce the knowledge needed for crucial decision making. Efficient and effective analysis of safeguards data will depend on utilizing technologies to interpret the large, heterogeneous data sets that are available from diverse sources. With an order-of-magnitude increase in the amount of data from a wide variety of technical, textual, and historical sources there is a vital need to apply advanced computer technologies to support all-source analysis. There are techniques of data warehousing, data mining, and data analysis that can provide analysts with tools that will expedite their extracting useable information from the huge amounts of data to which they have access. Computerized tools can aid analysts by integrating heterogeneous data, evaluating diverse data streams, automating retrieval of database information, prioritizing inputs, reconciling conflicting data, doing preliminary interpretations, discovering patterns or trends in data, and automating some of the simpler prescreening tasks that are time consuming and tedious. Thus knowledge discovery technologies can provide a foundation of support for the analyst. Rather than spending time sifting through often irrelevant information, analysts could use their specialized skills in a focused, productive fashion. This would allow them to make their analytical judgments with more confidence and spend more of their time doing what they do best
Nawaz, Ather; Clemmensen, Torkil
As the number of website users in Asia grows, there is an increasing need to gain an overview of human–computer interaction (HCI) research about users and websites in that context. This article presents an overview of HCI research on website usability in Asia “from within,” which outlines...... discusses the results and the need for a greater sensitivity to what is “local” and “from within” in HCI research and what this can add to the existing literature on website usability....
Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew
Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.
Acton, Charles H., Jr.
The Navigation Ancillary Information Facility (NAIF), acting under the direction of NASA's Office of Space Science and Applications, and with substantial participation of the planetary science community, is designing and implementing an ancillary data system - called SPICE - to assist scientists in planning and interpreting scientific observations taken from spaceborne instruments. The principal objective of the implemented SPICE system is that it will hold the essential geometric and related ancillary information needed to recover the full value of science instrument data, and that it will facilitate correlations of individual instrument datasets with data obtained from other instruments on the same or other spacecraft.
Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth
The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.
Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y
Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also
Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild
Serious games (SGs) are a type of simulation technology that may provide nursing students with the opportunity to practice their clinical reasoning and decision-making skills in a safe and authentic environment. Despite the growing number of SGs developed for healthcare professionals, few SGs are video based or address the domain of home health care. This paper aims to describe the design, development, and usability evaluation of a video based SG for teaching clinical reasoning and decision-making skills to nursing students who care for patients with chronic obstructive pulmonary disease (COPD) in home healthcare settings. A prototype SG was developed. A unified framework of usability called TURF (Task, User, Representation, and Function) and SG theory were employed to ensure a user-centered design. The educational content was based on the clinical decision-making model, Bloom's taxonomy, and a Bachelor of Nursing curriculum. A purposeful sample of six participants evaluated the SG prototype in a usability laboratory. Cognitive walkthrough evaluations, a questionnaire, and individual interviews were used for the usability evaluation. The data were analyzed using qualitative deductive content analysis based on the TURF framework elements and related usability heuristics. The SG was perceived as being realistic, clinically relevant, and at an adequate level of complexity for the intended users. Usability issues regarding functionality and the user-computer interface design were identified. However, the SG was perceived as being easy to learn, and participants suggested that the SG could serve as a supplement to traditional training in laboratory and clinical settings. Using video based scenarios with an authentic COPD patient and a home healthcare registered nurse as actors contributed to increased realism. Using different theoretical approaches in the SG design was considered an advantage of the design process. The SG was perceived as being useful, usable, and
Nawaz, Ather; Skjæret, Nina; Lægdheim Helbostad, Jorunn
Serious games (exergames) have the potential to be effective for postural balance and increasing muscle strength. Several games have been developed to increase physical fitness and balance among older adults. However, it is unclear to which degree usability and acceptability of exergames for olde...
We aimed to assess the level of microbial contamination of re-usable laryngoscope blades at a public hospital in South Africa. Setting. The theatre complex of a secondary-level public hospital in Johannesburg. Methods. Blades from two different theatres were sampled twice daily, using a standardised technique, over a ...
Hornbæk, K.; Stage, Jan
of the workshop are motivated and an outline of the contents of the papers that were presented in the workshop is given. In addition we summarize some challenges to the interplay between usability evaluation and user interface design agreed upon at the workshop, as well as some solutions that were debated....
Andersen, Malene Hjortboe; Khalid, Md. Saifuddin; Brooks, Eva Irene
of these methods is that they are designed for adults and are not necessarily appropriate to investigations including children. The guiding questions for this systematic literature review are (1) the motivation for conducting usability tests with children, and (2) the kind of methodological, practical, and ethical...
Williams, Sarah C.; Foster, Anita K.
Discovery tools are the next phase of library search systems. Illinois State University's Milner Library implemented EBSCO Discovery Service in August 2010. The authors conducted usability studies on the system in the fall of 2010. The aims of the study were twofold: first, to determine how Milner users set about using the system in order to…
Upitis, Rena; Boese, Karen; Abrami, Philip C.; Anwar, Zaeem
The Digital Resource Exchange About Music (DREAM) is a virtual space for exchanging information about digital learning tools. The purpose of the present study was to determine how users responded to DREAM in the first four months after its public release. This study is the second phase of usability research on DREAM, and was conducted to guide…
Full Text Available To protect users from numerous password inference attacks, we invent a novel context aware privacy enhancing keyboard (PEK for Android touch-based devices. Usually PEK would show a QWERTY keyboard when users input text like an email or a message. Nevertheless, whenever users enter a password in the input box on his or her touch-enabled device, a keyboard will be shown to them with the positions of the characters shuffled at random. PEK has been released on the Google Play since 2014. However, the number of installations has not lived up to our expectation. For the purpose of usable security and privacy, we designed a two-stage usability test and performed two rounds of iterative usability testing in 2016 and 2017 summer with continuous improvements of PEK. The observations from the usability testing are educational: (1 convenience plays a critical role when users select an input method; (2 people think those attacks that PEK prevents are remote from them.
André H. du Plessis
Full Text Available In the development of the metalexicography, the primary focus of metalexicographers was on the development of printed dictionaries. As technology advances, the focus now shifts towards online and electronic products. Tarp (2009:23–24 posits that this shift results in metalexicographic shortcomings. This means that the theories used to create and evaluate dictionaries are not sufficient anymore. Bergenholtz and Bothma (2011:54 show that dictionaries as data carriers are now not only limited to the field of lexicography, but also to information technological fields. For current lexicographers to be successful in the digital age, the theories used in designing, developing and critiquing dictionaries must adapt with regards to current information technological trends, norms and practices. One aspect that must be addressed is the usability of dictionaries and other electronic lexicographic tools. By using usability theories and standards, current metalexicographical principles can be adapted for the digital age in a streamlined fashion. This study aims to show how usability theories and standards can be advantageous for metalexicography and that future electronic metalexicographic endeavours should not be undertaken without considering the usability as part of the theoretical framework.
Full Text Available Various studies have shown that the wine consumption decline in young generation could be influenced by the perception of wine as intimidating and difficult to understand, and by the lack of adaptability of the product’s communication strategy and packaging design to their lifestyle. Information available on the packaging is often complex and confusing for novice wine consumers and sometimes even irrelevant in regards to the intrinsic characteristics of the product. Furthermore, wine is seen by young adult consumers as old fashion, formal and mostly not associated with their relaxed attitude and “on the move” lifestyle. The objective of this paper is to analyse the usability key principles and heuristic and their applicability in wine marketing as a mean to improve the perception and increase understanding of wine for the young and/or novice consumers. The paper aims to review the existing knowledge and findings about the concept of usability (with special emphasis on Usability Engineering and Human Computer Interaction (HCI, in order to explore the aspects applicable in wine marketing. The usability concept proves useful in wine marketing to simplify the decision process, to make the meeting with the product less intimidating and more engaging, and to decrease the risk perception for the inexperienced wine consumers.
Razak, Mohd Nur Faiz Abd; Hussain, Azham; Hamdi, Mohd Maizan Fishol
Nowadays, YouTube is the 3rd most visited website in the world. It was created for users to search, watch and share video. Statistics show that YouTube run in more than 88 countries and support 76 different languages which covered almost 95% of Internet population globally. Therefore, a usability study is for specific type of users such as based on gender, range of age and country is considered a must for this kind of top website. In this study, we focus on YouTube website usability for Malaysian teenagers that are currently schooling in boarding school with limited access of Internet. It was done in a controlled lab environment with proper devices and software as MacBook, LCD Monitor, and WhatPulse heat map tracker. The evaluation was made based on usability metrics: ease of use, usefulness and satisfaction of users with combination of recording videos, mouse and keyboard heat map and questionnaires. Findings show that most of the respondents just use YouTube for video watching only while ignoring other features in the same time. There are difficulties in using it at the first moment but could catch up in short time. It shows how usable YouTube website especially in the learnability and memorability aspects.
Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work ...... research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined......Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work...... on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win-lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss...
Lautenbach, M.A.E.; Schegget, I.E. ter; Schoute, A.E.; Witteman, C.L.M.
An evaluation of the Utrecht University website was carried out with 240 students. New criteria were drawn from the literature and operationalized for the study. These criteria are surveyability and findability. Web pages can be said to satisfy a usability criterion if their efficiency and
Thiruvenkadam, G.; Brombacher, A.C.; Lu, Y.; Ouden, den P.H.
In this paper we report the findings of a study intended to assess the usability of consumer related information sources in order to improve the design processes of innovative electronic products. Specifically, an evaluation is done of the quality and content of information that would help product
Sørensen, Morten; Franek, Ondrej; Christensen, Søren K.; Pedersen, Gert Frølund; Ebert, Hans
The workbench Faraday Cage method (WBFC) is a time efficient module pre-compliance test regarding radiated emission. This work investigates the method’s usability and credibility and concludes that for this particular case the WBFC perform a tolerable compliance test for frequencies below 360 MHz while it is essentially useless for higher frequencies.
As the popularity of online banking Websites has increased, the security of these sites has become increasingly critical as attacks against these sites are on the rise. However, the design decisions made during construction of the sites could make usability more difficult, where the user has difficulty making good security decisions. This study…
Liu, Min; Traphagan, Tomoko; Huh, Jin; Koh, Young Ihn; Choi, Gilok; McGregor, Allison
The purpose of this paper is to report on a usability study for ESL websites conducted to gain insights from learners of English as a second language (ESL) as they interacted with specific sites. Five carefully selected ESL sites were tested by 10 different users generating a total of fifty testing sessions. Two major research questions guided the…
Meng, Liqiu; Winter, Stephan; Popovich, Vasily
This book reports the newest research and technical achievements on the following theme blocks: Design of mobile map services and its constraints; Typology and usability of mobile map services; Visualization solutions on small displays for time-critical tasks; Mobile map users; Interaction and adaptation in mobile environments; and Applications of map-based mobile services.
Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.
This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…
Møller, Margrethe Hansen
Based on experience from the research project “User Manuals for Older Adults”, this paper discusses whether there are special ethical concerns with older adults as test persons in a usability test involving the think-aloud method. In this context, older adults are defined as individuals with normal...
Full Text Available The Digital Doorway (DD) is a non-standard computer system deployed to promote computer literacy amongst underprivileged communities in South Africa. Since its inception there has been no usability evaluation of the software installed on the DD...
Sørensen, Morten; Franek, Ondrej; Christensen, Søren K.
The workbench Faraday Cage method (WBFC) is a time efficient module pre-compliance test regarding radiated emission. This work investigates the method’s usability and credibility and concludes that for this particular case the WBFC perform a tolerable compliance test for frequencies below 360 MHz...
Briesch, Amy M.; Briesch, Jacquelyn M.; Chafouleas, Sandra M.
Although teachers are often asked to implement classroom interventions to address student behavior, little is known about their perceived usability of many evidence-based strategies. One thousand five elementary schoolteachers completed the Usage Rating Profile-Intervention-Revised (URP-IR) with regard to the use of one of five evidence-based…
Discusses the need for an intuitive library information gateway to meet users' information needs and describes the process involved in redesigning a library Web site based on experiences at Roger Williams University. Explains usability testing methods that were used to discover how users were interacting with the Web site interface. (Author/LRW)
Ana Castillo-Díaz, Ph. D.
Full Text Available In an increasingly competitive environment in which Internet occupies a prominent place, transferring a brand from the offline to the online environment has become a vital issue for companies. Usability and accessibility have become crucial to enable adequate online brand communication. Ensuring websites are usable and accessible will facilitate web navigation, will improve the company’s image, and will favour loyalty towards the brand.This article presents the results of an investigation measuring the extent to what small and medium enterprises (SMEs employ usability and accessibility as supporting pillars of brand in the online environment to communicate with their audiences. The results indicate that usability is in fact taken into account by SMEs, but it is seen more as a technological element than as a promotion tool for the brand. Accessibility, on the other hand, is of secondary concern in the design of websites analysed, since they are not certified by any standard and are not fully accessible. Thus, it can be argued that the concern to transmit the brand online is incipient but, currently, SMEs do not take advantage of all the potential offered by the Web.
Full Text Available Mobile laser scanning is an emerging technology capable of capturing three-dimensional data from surrounding objects. With state-of-the-art sensors, the achieved point clouds capture object details with good accuracy and precision. Many of the applications involve civil engineering in urban areas, as well as traffic and other urban planning, all of which serve to make 3D city modeling probably the fastest growing market segment in this field. This article outlines multiplatform mobile laser scanning solutions such as vehicle- and trolley-operated urban area data acquisition, and boat-mounted equipment for fluvial environments. Moreover, we introduce a novel backpack version of mobile laser scanning equipment for surveying applications in the field of natural sciences where the requirements include precision and mobility in variable terrain conditions. In addition to presenting a technical description of the systems, we discuss the performance of the solutions in the light of various applications in the fields of urban mapping and modeling, fluvial geomorphology, snow-cover characterization, precision agriculture, and in monitoring the effects of climate change on permafrost landforms. The data performance of the mobile laser scanning approach is described by the results of an evaluation of the ROAMER on a permanent MLS test field. Furthermore, an in situ accuracy assessment using a field of spherical 3D targets for the newly-introduced Akhka backpack system is conducted and reported on.
Ratwani, Raj M; Fairbanks, Rollin J; Hettinger, A Zachary; Benda, Natalie C
The usability of electronic health records (EHRs) continues to be a point of dissatisfaction for providers, despite certification requirements from the Office of the National Coordinator that require EHR vendors to employ a user-centered design (UCD) process. To better understand factors that contribute to poor usability, a research team visited 11 different EHR vendors in order to analyze their UCD processes and discover the specific challenges that vendors faced as they sought to integrate UCD with their EHR development. Our analysis demonstrates a diverse range of vendors' UCD practices that fall into 3 categories: well-developed UCD, basic UCD, and misconceptions of UCD. Specific challenges to practicing UCD include conducting contextually rich studies of clinical workflow, recruiting participants for usability studies, and having support from leadership within the vendor organization. The results of the study provide novel insights for how to improve usability practices of EHR vendors. © The Author 2015. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: firstname.lastname@example.org.
Atta Idrawani Zaini
Full Text Available Virtual reality (VR is widely being researched within various aspects of real-world applications. As architecture and urban design are very much adhered to evaluating and designing space, physical representations are deemed as incompetent to deliver a full-scale depiction of a space. Similarly, digital models are very much also limited in that sense. VR can deliver a full-scale virtual environment (VE, tricking users to be immersed in the replicated environment. This is an advantage for the aforementioned design disciplines, as more relatable and realistic depiction of a space can be modelled. The notion of its usability has become important to be understood from the perspective of architecture and urban design. This paper measured the respondents’ perceptions of VR’s usability through measuring its quality of use based on several criteria. The criteria established were the ease of use, usefulness, and satisfaction. Different levels of architectural details were decided as a form of control. A total of N=96 randomly selected respondents from various backgrounds participated in the survey as they were divided into four different group of treatments. Each group experienced a different VE with different level of architectural details. The first section of analysis is a one-sample analysis and the second is a group difference analysis. From the first analysis, it was found that the respondents perceived VR as a usable tool for architectural or territorial representation. Using Kruskal-Wallis test, it was found that there was no statistically significant difference between groups, suggesting that the respondents perceived VR as usable regardless of the level of architectural details. As this paper used perception data based on the quality of use alone, the efficiency of VR system was not measured. Thus, this paper recommends further studies to be conducted on the system’s efficiency to reflect its usability in full extent.
Spaeth, J; Schweizer, T; Schmutz, A; Buerkle, H; Schumann, S
The anaesthesia ventilator represents the key equipment for intraoperative respiratory care. Improper operation of this device may threaten a patient's health. A self-explanatory interface facilitates handling and decreases the risk of operating errors. This study systematically evaluates the usability of user interfaces in four modern anaesthesia ventilators. Twenty naïve operators were asked to execute 20 tasks on each of four different anaesthesia ventilators (Avance CS2™, GE Healthcare; Flow-i™, Maquet; and Perseus™ and Primus™, Dräger) in a randomized order. The success of task execution, frequency of requests for assistance, and processing times were recorded. During the tasks, the operators' visual focus was measured via eye-tracking. Additionally, subjective assessments of usability were evaluated by a standardized questionnaire. For comparison, six experienced operators undertook the same protocol. The overall rate of falsely executed tasks was low. Naïve operators requested assistance least when using the Perseus (26). Pooled processing times were shortest for the Perseus (222 s), followed by the Primus (223 s), the Avance (238 s), and the Flow-i (353 s). Task-specific processing times differed considerably between the devices. Eye-tracking analyses revealed associated interface issues that impeded the operators' performance. Operators rated usability best for the Perseus [mean (sd): 67 (17) arbitrary units] and worst for the Flow-i [50 (16) arbitrary units]. Results from experienced operators support these findings by trend. The usability of modern anaesthesia ventilators differs considerably. Interface issues of specific tasks impair the operator's efficiency. Eliminating the specific usability issues might improve the operator's performance and, as a consequence, the patient's safety. © The Author 2017. Published by Oxford University Press on behalf of the British Journal of Anaesthesia. All rights reserved. For Permissions, please
Shyr, Casper; Kushniruk, Andre; Wasserman, Wyeth W
dramatically accelerate clinician analysis and interpretation of patient genomic data. We present the first application of usability methods to evaluate software interfaces in the context of exome analysis. Our results highlight how the study of user responses can lead to identification of usability issues and challenges and reveal software reengineering opportunities for improving clinical next-generation sequencing analysis. While the evaluation focused on two distinctive software tools, the results are general and should inform active and future software development for genome analysis software. As large-scale genome analysis becomes increasingly common in healthcare, it is critical that efficient and effective software interfaces are provided to accelerate clinical adoption of the technology. Implications for improved design of such applications are discussed. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.
Wozney, Lori; Baxter, Pamela; Newton, Amanda S
Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for
Kapoor, Akshat; Nambisan, Priya
The specific objective of this research is to design and develop a personalized Web application to support breast cancer survivors after treatment, as they deal with post-treatment challenges, such as comorbidities and side effects of treatment. A mixed-methods approach, utilizing a combination of think-aloud analysis, personal interviews, and surveys, was adopted for user acceptance and usability testing among a group of breast cancer survivors. User feedback was gathered on their perceived value of the application, and any user-interface issues that may hinder the overall usability were identified. The application's portability and capability of organizing their entire breast cancer-related medical history as well as tracking various quality of life indicators were perceived to be valuable features. The application had an overall high usability; however, certain sections of the application were not as intuitive to locate. Visual elements of the website were appreciated; however, overall experience would benefit from incorporating more sociable elements that exhibit positive re-enforcement within the end user and provide a friendlier experience. The results of the study showcase the need for more personalized tools and resources to support survivors in self-management. It also demonstrates the ability to integrate breast cancer survivorship care plans from diverse providers and paves the way to add further value-added features in consumer health applications, such as personal decision support. Using a personal decision support-based tool can serve as a training tool and resource, providing these patients with pertinent information about the various aspects of their long-term health, while educating them about any related side effects and symptoms. It is hoped that making such tools more accessible could help in engaging survivors to play an active role in managing their health and encourage shared decision-making with their providers.
Hernandez, Belinda F; Peskin, Melissa F; Shegog, Ross; Gabay, Efrat K; Cuccaro, Paula M; Addy, Robert C; Ratliff, Eric; Emery, Susan T; Markham, Christine M
Diffusion of sexual health evidence-based programs (EBPs) in schools is a complex and challenging process. iCHAMPSS ( CHoosing And Maintaining effective Programs for Sex education in Schools) is an innovative theory- and Web-based decision support system that may help facilitate this process. The purpose of this study was to pilot-test iCHAMPSS for usability and short-term psychosocial impact. School district stakeholders from across Texas were recruited ( N = 16) and given access to iCHAMPSS for 3 weeks in fall 2014. Pre- and posttests were administered to measure usability parameters and short-term psychosocial outcomes. Data were analyzed using descriptive statistics and the Wilcoxon signed-rank test. Most participants reported that iCHAMPSS was easy to use, credible, helpful, and of sufficient motivational appeal. iCHAMPSS significantly increased participants' self-efficacy to obtain approval from their board of trustees to implement a sexual health EBP. Positive, though nonsignificant, trends included increased knowledge to locate EBPs, skills to prioritize sexual health education at the district level, and ability to choose an EBP that best meets district needs. iCHAMPSS is an innovative decision support system that could accelerate uptake of EBPs by facilitating diffusion and advance the field of dissemination and implementation science for the promotion of sexual health EBPs.
The reality in businesses nowadays is the easy access to big amount of data that is being transferred into information. Reliable and useful information provide a competitive advantage in turbulent waters on all fields of business activities. Information is the foundation for all important business decisions. That means that on the informational foundation entire business structure is based. Information is needed at each stage of business operations, from enterprise’s entrance into the market,...
Verkuyl, Margaret; Romaniuk, Daria; Mastrilli, Paula
Providing safe and realistic virtual simulations could be an effective way to facilitate the transition from the classroom to clinical practice. As nursing programs begin to include virtual simulations as a learning strategy; it is critical to first assess the technology for ease of use and usefulness. A virtual gaming simulation was developed, and a usability study was conducted to assess its ease of use and usefulness for students and faculty. The Technology Acceptance Model provided the framework for the study, which included expert review and testing by nursing faculty and nursing students. This study highlighted the importance of assessing ease of use and usefulness in a virtual game simulation and provided feedback for the development of an effective virtual gaming simulation. The study participants said the virtual gaming simulation was engaging, realistic and similar to a clinical experience. Participants found the game easy to use and useful. Testing provided the development team with ideas to improve the user interface. The usability methodology provided is a replicable approach to testing virtual experiences before a research study or before implementing virtual experiences into curriculum. Copyright © 2018 Elsevier Ltd. All rights reserved.
Pulantara, I Wayan; Parmanto, Bambang; Germain, Anne
supplement the subjective assessment of patient sleep patterns. The iREST app was developed from the mobile logical architecture of Just in Time Adaptive Intervention. It consists of a cross-platform smartphone app, a clinician portal, and secure 2-way communications platform between the app and the portal. The usability study comprised 19 Active Duty Service Members and Veterans between the ages of 18 and 60. Descriptive statistics based on in-app questionnaires indicate that on average, 12 (mean 12.23, SD 8.96) unique devices accessed the clinician portal per day for more than two years, while the app was rated as "highly usable", achieving a mean System Usability Score score of 85.74 (SD 12.37), which translates to an adjective rating of "Excellent". The participants also gave high scores on "ease of use and learnability" with an average score of 4.33 (SD 0.65) on a scale of 1 to 5. iREST provides a feasible platform for the implementation of Just in Time Adaptive Intervention in mHealth-based and remote intervention settings. The system was rated highly usable and its cross-platformness made it readily implemented within the heavily segregated smartphone market. The use of wearables to track sleep is promising; yet the accuracy of this technology needs further improvement. Ultimately, iREST demonstrates that mHealth-based Just in Time Adaptive Intervention is not only feasible, but also works effectively. ©I Wayan Pulantara, Bambang Parmanto, Anne Germain. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 17.05.2018.
Mohammed, Naitullah; Syed.Mohammed, Mahamood Ur Rahman
The relationship between the perceived usability of a beautiful interface and of an ugly interface is analyzed in this study. This study correlates the visual aesthetics of the website with perceived usability. This research is performed to know the significance of visual aesthetics on perceived usability. A website is designed with two interfaces. One interface is designed by following design guidelines with respect to usability and the other interface is designed without following guideline...
Riddick, Andrew; Glaves, Helen; Marelli, Fulvio; Albani, Mirko; Tona, Calogera; Marketakis, Yannis; Tzitzikas, Yannis; Guarino, Raffaele; Giaretta, David; Di Giammatteo, Ugo
The capability for long term preservation of earth science data is a key requirement to support on-going research and collaboration within and between many earth science disciplines. A number of critically important current research directions (e.g. understanding climate change, and ensuring sustainability of natural resources) rely on the preservation of data often collected over several decades in a form in which it can be accessed and used easily. In many branches of the earth sciences the capture of key observational data may be difficult or impossible to repeat. For example, a specific geological exposure or subsurface borehole may be only temporarily available, and deriving earth observation data from a particular satellite mission is clearly often a unique opportunity. At the same time such unrepeatable observations may be a critical input to environmental, economic and political decision making. Another key driver for strategic long term data preservation is that key research challenges (such as those described above) frequently require cross disciplinary research utilising raw and interpreted data from a number of earth science disciplines. Effective data preservation strategies can support this requirement for interoperability, and thereby stimulate scientific innovation. The SCIDIP-ES project (EC FP7 grant agreement no. 283401) seeks to address these and other data preservation challenges by developing a Europe wide e-infrastructure for long term data preservation comprising appropriate software tools and infrastructure services to enable and promote long term preservation of earth science data. Because we define preservation in terms of continued usability of the digitally encoded information, the generic infrastructure services will allow a wide variety of data to be made usable by researchers from many different domains. This approach will enable the cost for long-term usability across disciplines to be shared supporting the creation of strong
U.S. Department of Health & Human Services — The Hospice Utilization and Payment Public Use File provides information on services provided to Medicare beneficiaries by hospice providers. The Hospice PUF...
Tupputi, S A; Girolamo, A Di; Kouba, T; Schovancová, J
The automation of ATLAS Distributed Computing (ADC) operations is essential to reduce manpower costs and allow performance-enhancing actions, which improve the reliability of the system. In this perspective a crucial case is the automatic handling of outages of ATLAS computing sites storage resources, which are continuously exploited at the edge of their capabilities. It is challenging to adopt unambiguous decision criteria for storage resources of non-homogeneous types, sizes and roles. The recently developed Storage Area Automatic Blacklisting (SAAB) tool has provided a suitable solution, by employing an inference algorithm which processes history of storage monitoring tests outcome. SAAB accomplishes both the tasks of providing global monitoring as well as automatic operations on single sites. The implementation of the SAAB tool has been the first step in a comprehensive review of the storage areas monitoring and central management at all levels. Such review has involved the reordering and optimization of SAM tests deployment and the inclusion of SAAB results in the ATLAS Site Status Board with both dedicated metrics and views. The resulting structure allows monitoring the storage resources status with fine time-granularity and automatic actions to be taken in foreseen cases, like automatic outage handling and notifications to sites. Hence, the human actions are restricted to reporting and following up problems, where and when needed. In this work we show SAAB working principles and features. We present also the decrease of human interactions achieved within the ATLAS Computing Operation team. The automation results in a prompt reaction to failures, which leads to the optimization of resource exploitation.
Intradermal adapter device technology minimizes the complexity of the Mantoux technique, thereby providing predictable, reproducible intradermal (ID) injections and removing the concerns regarding the ease and reliability of Mantoux technique when using conventional needle and syringe. The technology employs a simple device with geometry designed to gently deform the skin surface and the subcutaneous tissue, providing the ideal angle and depth of needle insertion for consistently successful intradermal injections. The results of this development were presented at the First, Second and Third Skin Vaccination Summits in 2011, 2013 and 2015 respectively [1,2,3]. The current publication addresses the performance of intradermal adapters (IDA) evaluated in three preclinical studies. The evaluations were based on the assessment of bleb formation in a skin model, an accepted indicator of ID injection success. All evaluated devices share the same proprietary dermal interface technology. Devices instituting this design are easy to use, require minimal training, and employ conventionally molded parts and cannula. These studies evaluated IDAs of initial design integral with luer lock needles, IDAs for use with conventional syringes, and intradermal adapters for use with auto disable syringes (ADID adapters). The evaluated ID adapters were intended to consistently place the lancet of the needle at a depth of 0.75mm from the skin's surface. This placement depth addresses the variation in the skin thickness at immunization sites for the majority of patients independent of many other variables. Most participants preferred the intradermal adapter method over the traditional Mantoux and identified a need for the adapter at their workplace. Evaluation of IDAs by registered nurses indicated these devices increase success of bleb formation. The use of IDA increased the success of forming blebs by about 30%. Nurses felt the injections were much easier to perform, in particular by
policy changes and improve general health. Parallels in environmental sciences might be TER1 (translational environmental research 1), basic insights regarding environmental processes and relationships between environmental changes and their causes. TER2, applied environmental research, development of best practices, and development of decision support tools. TER3, might include usability and impact evaluation, effective outreach and implementation of best practices, and application of research insights to public policy and institutional change. According to the medical literature, and in anecdotal evidence from end-to-end environmental science, decision-maker and public involvement in these various forms of engaged research decreases the lag between scientific discovery and implementation of discoveries in operational practices, information tools, and organizational and public policies.
Jaspers, Monique W. M.
OBJECTIVE: Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the