Tag: Usability

We Are All Designers

May 4, 2021

By KIM BELLARD

Raise your hand if you had to go through the Hunger Games labyrinth to score a COVID-19 vaccine earlier this year – figuring out which phone number(s)/website(s) to try, navigating it, answering all the questions, searching for available appointments within reasonable distances, and, usually, having to try all over again. Or, raise your hand if you’ve had trouble figuring out how to use an Electronic Health Record (EHR) or an associated Patient Portal.

Maybe you thought it was you. Maybe you thought you weren’t tech-savvy enough. But, a trio of usability experts reassure us, it’s not: it’s just bad design. And we should speak up.

“Everyone everywhere: A distributed and embedded paradigm for usability,” by Professors Michael B. Twidale, David M. Nichols, and Christopher P. Lueg, was published in Journal of the Association for Information Science and Technology (JASIST) in March, but I didn’t see it until the University of Illinois School of Information Sciences (where Dr. Twidale is on faculty) put out a press release a few days ago.

The authors believe that bad design has costs — to users and to society — yet: “The total costs of bad usability over the life of a product are rarely computed. It is almost like we as a society do not want to know how much money has been wasted and how much irritation and misery caused.”

Whatever the numbers are, they’re too high.

As Dr. Twidale said:

Making a computer system easier to use is a tiny fraction of the cost of making the computer system work at all. So why aren’t things fixed? Because people put up with bad interfaces and blame themselves. We want to say, ‘No, it’s not your fault! It is bad design.'”

He specifically referenced the vaccine example: “When hard to use software means a vulnerable elderly person cannot book a vaccination, that’s a social justice issue. If you can’t get things to work, it can further exclude you from the benefits that technology is bringing to everyone else.”

2015: The Year Well-Designed Interfaces Will Transform Health IT?

Jan 2, 2015• 10

By THCBist

What else could lie in store? We talked with Nuance’s Nick Van Terheyden, who remains optimistic.

Nick van Terheyden, MD, CMIO, Nuance Communications

2015 will be the year well-designed interfaces will transform health IT legacy systems into sleeker, more intuitive, and cost-effective technology.

We know that good usability works hand-in-hand with accessibility to remove the burden from the end user, allowing her to focus on more important tasks— and nowhere is this more important than in healthcare. In the coming year, we will see a major uptick in the availability of secure health IT access on mobile devices that better support physicians in their natural, fast-paced environment, whether it is through clinical speech recognition technology, gestures, or touch. Physicians are consumers, too, and want and need the convenience of anywhere, anytime access to information.

We will also start to see the breakdown of silos in patient and physician technologies. The devices we rely on to track our vitals and help us stay active will begin to integrate in meaningful ways with clinical data, providing us with more awareness about our health and supplying our physicians with useful information about our health trends. Wearables will become a staple, leading to a healthier population and reducing overall healthcare costs. After all, what good is having a smart watch track all this data if it can’t help keep you healthier?

All I Want For Health IT Week Is An EHR Overhaul

Sep 16, 2014• 28

Robert W. Wah, MD

If I had to capture the main shortcoming of electronic health record (EHR) technology in one word, this would be it: Usability.

As we’re observing National Health IT Week through Friday, I can’t think of a better time to call for EHR systems that better serve physicians and our patients. That’s why the AMA just released a new framework for improving EHR usability.

As a chief medical officer for a health IT company and a former deputy national coordinator in the Office of the National Coordinator for Health Information Technology, I understand the complexities of what’s required to make EHRs first and foremost usable systems for the medical practice. When I say “all” I want for Health IT Week is an EHR overhaul, I realize that’s no simple request.

But it is a basic request. Usability should be the driving quality of all health IT. Unless health IT functions in a way that makes our practices more efficient and facilitates improvements in our patient care, it isn’t doing what it was intended to do.

Killer Features of the Next EMR

Jun 29, 2014• 18

By CRAIG MONSEN

I was absent-mindedly playing with my iPhone today and took special notice of a feature I have rarely used before. If you swipe all the way to the left on the home screen, you will get a search bar to search all of your iPhone. This includes contacts, iMessages, and apps. I’ve never needed to use this before—a testament to the iPhone’s ease of use. Just prior to this, I was working on some patient notes using my hospital’s electronic medical record (EMR). In contrast, each task I performed required a highly-regimented, multi-click process to accomplish.

Criticizing EMR interfaces is a well-loved pastime among clinicians. Here, however, I am going to take an oblique approach and reflect instead on what has made good interfaces (all outside of medicine, it turns out) recognized as such.

Speed

The Google Algorithm often gets credit for Google winning the Great Search Engine War. Indeed, there are whole teams dedicated to improving it. However, if you compare algorithms today, even 5 years ago, the differences in results have been only marginal. How does Google stay ahead? Speed. Google has done extensive research to determine what keeps users coming back and it is unequivocally speed of results. It has been much of the motivation for creating their own browser (Chrome) and operating system (Android). Speed means more searches and more searches means more money for Google.

Search

With EMRs, wait times to store and retrieve data can be extremely long. Moreover, it frequently takes multiple clicks to get to the precise page you want, further compounding the problem. But how slow is slow? Research in web user behavior indicates that 47% of consumers expect a web page to load in 2 seconds or less and that 40% of people abandon a website that takes more than 3 seconds to load. It regularly takes over 3 seconds to retrieve an important piece of data from an EMR. That makes the experience constantly frustrating; I wish there was another EMR I could switch to. (As a fun aside, I often find myself logging into two computers side-by-side in the hospital to save precious seconds waiting for the computer to load.)

The Data Entry Paradox

Oct 4, 2012• 16

By William Hersh, MD

Everyone, including this blog writer, has been touting the virtues of the vast troves of data already or soon to be available in the electronic health record (EHR), which will usher in the learning healthcare system [1, 2]. There is sometimes unbridled enthusiasm that the data captured in clinical systems, perhaps combined with research data such as gene sequencing, will effortlessly provide us knowledge of what works in healthcare and how new treatments can be developed [3, 4]. The data is unstructured? No problem, just apply natural language processing [5].

I honestly share in this enthusiasm, but I also realize that it needs to be tempered, or at least given a dose of reality. In particular, we must remember that our great data analytics and algorithms will only get us so far. If we have poor underlying data, the analyses may end up misleading us. We must be careful for problems of data incompleteness and incorrectness.

There are all sorts of reasons for inadequate data in EHR systems. Probably the main one is that those who enter data, i.e., physicians and other clinicians, are usually doing so for reasons other than data analysis. I have often said that clinical documentation can be what stands between a busy clinician and going home for dinner, i.e., he or she has to finish charting before ending the work day.

I also know of many clinicians whose enthusiasm for entering correct and complete data is tempered by their view of the entry of it as a data blackhole. That is, they enter data in but never derive out its benefits. I like to think that most clinicians would relish the opportunity to look at aggregate views of their patients in their practices and/or be able to identify patients who are outliers in one measure or another. Yet a common complaint I hear from clinicians is that data capture priorities are more driven by the hospital or clinic trying to maximize their reimbursement than to aid clinicians in providing better patient care.

(Over)Simplifying EHR Usability

May 2, 2011• 32

By MARGALIT GUR-ARIE

Dr. P patted the middle aged patient on the back, helped him off the elevated exam table and guided him to the chair by the sink. He picked up the chart and using the exam table as his desk he flipped through the chart, pulling out several pieces of paper, spreading them to his right, while making small talk with his patient. He reached into his pocket and pulled out a battered silver recorder and without any warning started dictating: “Mr. H is a 60 year old mildly obese gentleman presenting with…..“.

He had a pen now in his right hand, and as he was talking into his recorder, shuffling the various papers in front of him, he was also writing orders and prescriptions as fast as he was dictating. “….follow up in two weeks” was the last thing he said. He didn’t write that one down, but turned around, handed the patient a bunch of scripts, told him to stop by the front desk and make an appointment two weeks out and stop by the lab on the fourth floor to pick up a container for the urine test. Two minutes, tops, including the small talk. It was my turn now and I was sweating bullets because I knew exactly what he is about to say. “Can I do this in the EMR?”

EHR usability has finally arrived to Washington as the guest of honor at the most recent ONC HIT Policy Committee hearing. ONC seems to be considering the regulation and certification of EHR usability. NIST has created a testing procedure and just like its Meaningful Use testing procedures, it is superficial and doesn’t really test anything of any consequence. Those who represented “providers” and patients argued for the need to improve usability and those who represented academia and grant funded research argued for more funded research. Predictably, usability experts, argued for hiring more usability experts. Large vendors eloquently stated their objections to government mandating what EHRs should look like and small vendors argued that the more mandates, the better, since this will automatically remove the built-in competitive advantage of those with larger budgets and larger usability departments. As is customary, EHRs were compared to ATM machines, cars, iPhones, Google and a variety of “other industries” that are all so much more advanced than health care when it comes to usability.Continue reading…

EHR Usability

Jun 4, 2010• 41

By MARGALIT GUR-ARIE

A few days ago, I wrote about Innovation, a term being overused in the EHR industry to the point where it lost all meaning. Here is another such term: Usability

Just like Innovation, Usability is the weapon du jour against the large and/or established EHR vendors. After all, it is common knowledge that these “legacy” products all look like old Windows applications and lack usability to the point of endangering patients’ lives. On the other hand, the new and innovative EHRs, anticipated to make their debut any day now, will have so much usability that users will intuitively know how to use them before even laying their eyes on the actual product. With this new generation of EHR technology, users will be up and running their medical practice in 5 minutes and everybody in the office will be able to complete their tasks in a fraction of the time it took with the clunky, legacy EMRs built in the 90s. And all this because the new EHRs have Usability, not functionality, a.k.a. bloat, not analytical business intelligence and definitely not massive integration, a.k.a. monolithic. No, this is the minimalist age of EHR haiku. Less is better, as long as it has Usability.

Usability, according to the Usability Professionals Association, is “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use [ISO 9241-11]”. Based on this definition, it stands to reason that any EHR prospective buyer should want a product with lots of Usability. Everybody wants to be effective, efficient and satisfied. So how does one go about finding such EHR?

Well, as always, CCHIT picked up the glove, and as always, CCHIT will be criticized for doing so. The 2011 Ambulatory EHR Certification includes Usability Ratings from 1 to 5 stars. The ratings are based on a Usability Testing Guide. Jurors are instructed to assess Usability of the product during and after the certification testing based on three criteria: Effectiveness, Efficiency and the subjective Satisfaction, as required by the ISO standard. The tools for this assessment consist of 3 types of questionnaires:

After Scenario Questionnaire (ASQ) –jurors rate perceived efficiency (time and effort), learnability, and confidence after viewing scenarios

4 questions after each scenario –16 overall

Perceived Usability Questionnaire (PERUSE)–jurors rate screen-level design attributes based on reasonably observable characteristics

20 questions divided among each of the scenarios;

System Usability Survey (SUS) –jurors rate the assessment of usability, and satisfaction with the application

10 questions after all four scenarios have been demonstrated

The questions range from general subjective assessments in the ASQ, to very specific inquiries in PERUSE, like whether table headers are clearly indicative of the table columns content. Following the certification testing, results from all jurors are combined and weighted with more weight to specific answers and less to subjective overall impressions. The final result is the star rating, ranging from 1 to 5 Usability stars.

As of this writing, 19 Ambulatory EHRs have obtained CCHIT 2011 certification and all of them have been rated for Usability presumably according to the model described above. Of those, 12 achieved 5 stars, 6 have 4 stars and 1 has 3 stars. Amongst the 5 stars winners, one can find such “legacy” products as Epic, Allscripts and NextGen. The 4 and 3 stars awardees are rather obscure. So what can we learn from these results?

The futuristic EHR movement will probably dismiss these rankings as the usual CCHIT bias towards large vendors. Having gone through a full CCHIT certification process a couple of years ago, I can attest that the only large vendor bias I observed was in the functionality criteria, which seemed tailored to large products. Big problem. However, the testing and the jurors seemed very fair and competent. Looking at the CCHIT Usability Testing Guide, I cannot detect any bias towards any type of software. I would encourage folks to read the guide and form their own unbiased opinions. Are we then to assume that the 5 Stars EHRs have high Usability and therefore will provide satisfaction?

I don’t have a clear answer to this question. Obviously these EHRs have all their buttons and labels and text conforming to the Usability industry standards, and obviously a handful of jurors watching a vendor representative go through a bunch of preset tasks on a Webex screen felt comfortable that they understand and could use the system themselves without too much trouble. Many physicians feel the same way during vendor sales demos. However, efficiency and effectiveness can only be measured by repetitive use of the software in real life settings, for long periods of time and by a variety of users. Measuring satisfaction, the third pillar of Usability, is a different story altogether. There isn’t much satisfaction about anything in the physician community nowadays and when one is overwhelmed with patients, contemplating pay cuts every 30 days or so and bracing for unwelcome intrusion of regulators into one’s business, it’s hard to find joy in a piece of software, no matter how well aligned the checkboxes are.

The bottom line for doctors looking for EHRs remains unchanged: caveat emptor. The footnote is that the bigger EHRs are as usable as the Usability standards dictate, just like they are as meaningful as the Meaningful Use standards dictate and when all is said and done it is still up to the individual physician user to pick the best EHR for his/her own Satisfaction.

Margalit Gur-Arie is COO at GenesysMD (Purkinje), an HIT company focusing on web based EHR/PMS and billing services for physicians. Prior to GenesysMD, Margalit was Director of Product Management at Essence/Purkinje and HIT Consultant for SSM Healthcare, a large non-profit hospital organization.

assetto corsa mods