UX Nuggets Thoughts and advice on usability and user experience

Driver Distraction Testing: When UX Meets Safety

April 18, 2013 | 


Testing in-car infotainment systems forces us to rethink the way we evaluate new features. Not only should new features be easy to learn and use, they also need to be safe to use while driving. But how can we test a feature for its impact on safety?

When considering the user experience (UX) of a product, we usually evaluate qualities like usability, learnability, efficiency and similar attributes. With cars however, the primary quality we are focused on is whether a new feature can be safely operated whilst driving. If not, that feature should be implemented in a way that only allows the driver to use it while in park or the engine is off.

How can we define and measure the level of “distraction”?

The Alliance of Automobile Manufacturers (AAM) has a set of guidelines specifying how distraction can be defined and measured. Picking up most of these recommendations, the National Highway Traffic Safety Administration (NTHSA) published its own set of guidelines in February 2012. While similar to those proposed by the AAM, there are still many differences regarding the acceptance criteria and proposed testing methodologies. Both of these guidelines are voluntary, but most automobile manufacturers (even those that are not official members of the AAM) have pledged to adhere to the original statement of principles published by the AAM (last updated in 2006).

Guideline similarities and differences

Both guidelines agree that “eyes off-road time” is an essential factor when measuring distraction. Also, both documents consider the number of lane exceedances and variation in headway distance to a lead vehicle as being another viable set of measurable data. The guidelines also agree the data should be gathered while respondents drive in a simulator and complete a task involving the new feature. The same respondents then perform a specially selected reference task under the same conditions. These two sets of data are then compared.

But that is where we depart from common ground. There are crucial differences between the two sets of guidelines regarding several aspects of the testing, like the choice of reference task. The reference task involves a time-tested feature to ensure that its effects on driving performance are well-researched. While the NHTSA recommends comparing driving performances by having the test respondents enter a destination into a GPS, the AAM considers tuning the radio absolutely sufficient for this purpose. Should operating the new feature distract drivers significantly more than tuning a standard radio or using the GPS, it fails the test. 

Another difference: the NHTSA recommends an even distribution across all age segments, the AAM guidelines suggest a focus on older drivers. Additionally, when it comes to deciding whether a feature passes or fails the test, the guidelines disagree on how much “eyes off-road time” is still acceptable or how a lane exceedance should be defined. It is evident how these differences can have quite an impact on the outcome of a distraction study.

First-hand insights on the AAM guidelines

Although we are in no position to decide whose guidelines are more sensible, we can share some insights based on our past experiences with the AAM guidelines. While the guidelines sound very clear and specific, there are actually quite a few loop holes and gaps that need to be covered by the individual researcher.

A couple areas where the guidelines remain vague is the definition of a simulated test track, and specifying the number of practice trials that respondents should go through during testing. Interestingly, the AAM guidelines also do not specify how exactly the performance numbers are to be calculated, again leaving room for interpretation. However, choosing one way of calculating the numbers over the other can produce significantly different results.

An ongoing debate

While we found our own ways to solve these various issues (mainly by developing special methods to clean, aggregate and analyze the data), we are still closely following the current discussion and certainly look forward to any progress on the topic.

A possible consensus between organizations would be particularly intriguing considering the demand for the guidelines to become (in part) legally binding for all auto manufacturers.

One thing is certain ­– we’ve got some interesting times ahead in the automotive industry!

Philipp von Kiparski is working as a User Experience Consultant at GfK SirValUse in Munich. He specializes in the psychological studies of learning, perception and communication.  

Contact Us for Answers

Send Message | +1.630.320.3900 | Contact Info

June 4, 2013 - 19:34 FitFlops On Sale said:

Wow, that what I was seeking for, what a material! present here at this webpage, thanks admin of this web site. FitFlops On Sale http://www.fitflopssale-uk.net/

June 4, 2013 - 19:34 Cheap Oakley Su... said:

If you thinkI do not care to set eyes on this article, the next time I am paid more attention to about your article, I think I will never again careless. Do you believe in yourself, you do not know your article can make people so infatuated with. Cheap Oakley Sunglasses http://fakeoakleys.mall-us.net/

June 4, 2013 - 19:34 oakley outlet said:

Hello dear, me plus my mom are also watch humorous movies except after I finished my homework oakley outlet http://cheapoakleysunglasses.lightinbox.net/

June 4, 2013 - 19:34 oakleys outlet said:

This is my first time go to see at here and i am genuinely pleassant to read everthing at alone place. oakleys outlet http://www.oksunglassesstore.net/

June 4, 2013 - 19:34 Cheap Oakleys said:

Oh! Wow its truly a humorous and jockey YouTube video posted at this place. thanks for sharing it. Cheap Oakleys http://cheapoakleysunglasses.mall-us.net/

August 16, 2014 - 20:00 IBS Diet said:

I enjoy, result in I discovered just what I was taking a look for.
You have ended my four day lengthy hunt! God Bless you
man. Have a great day. Bye

June 5, 2013 - 00:25 Fake Oakleys Store said:

I think a visualized display can be superior then just a trouble-free text, if things are defined in images one can effortlessly understand these. Fake Oakleys Store http://www.okglassespub.net/

June 11, 2013 - 03:49 Minh Nguyen said:

that distracted driving is dangerous, sir
You come to know that in Vietnam: Vietnam the situation is no
buy You will <a href="http://dulichq.com/fl/ve-may-bay/ve-may-bay-ha-noi-di-sai-gon-11/">ve may bay di sai gon</a> or <a href="http://vemaybayq.com/en/ve-noi-dia/61-ve-may-may-gia-re-ha-noi-sai-gon.h... may bay ha noi sai gon</a>. Then you :<a href="http://vemaybayq.com/en/ve-noi-dia/68-ve-may-bay-gia-re-ha-noi-nha-trang... trang</a>, the <a href="http://vemaybayq.com/en/ve-noi-dia/71-ve-may-bay-gia-re-ha-noi-hue.html"... href="http://vemaybayq.com/en/ve-noi-dia/69-ve-may-bay-gia-re-ha-noi-da-lat.ht... da lat</a>,<a href="http://vemaybayq.com/en/ve-noi-dia/75-ve-may-bay-gia-re-ha-noi-da-nang.h... may bay ha noi da nang</a> is also a great place

June 19, 2013 - 02:59 vansumo said:

the information you share is useful to everyone nguoi.toi hope people will heed your advice and will be more limited pity. I form vietnam with serviec <a href="http://vietnamvisaq.com/lam-ho-chieu-nhanh" title="lam ho chieu nhanh,làm hộ chiếu nhanh">lam ho chieu nhanh</a>

June 19, 2013 - 03:23 phuonght163 said:

i agree with your opinion, current traffic accidents and more. so everyone should be safe for ourselves and for society. Do you go to travel in Viet Nam . you can go to <a href="http://dulichthegioi247.com/du-lich-trong-nuoc-khoi-hanh-tu-mien-bac/du-... title="du lịch nha trang đà lạt, du lich nha trang da lat">Du lịch Nha Trang Đà Lạt</a>. It is very nice, but I want to travel in two day, you can chose <a href="http://dulichthegioi247.com/du-lich-trong-nuoc-khoi-hanh-tu-mien-bac/du-... title="du lịch quan lạn, du lịch đảo quan lạn">Du lịch Quan Lạn</a>. This tour is very cheap. Addition, I also provide <a href="http://dulichthegioi247.com/du-lich-nuoc-ngoai-khoi-hanh-tu-mien-trung--... title="du lịch singapore Malaysia, du lich Singapore malaysia">Du lịch Singapore Malaysia</a>. we guaranteed to provide the best quality

August 9, 2013 - 22:44 Alva said:

This is what exactly I was searching, the information was overall very useful for me, thanks a lot. <a href="http://vienne.co/bop-nu" >bop nu</a>

November 22, 2013 - 05:45 Louis Vuitton B... said:

<a href="http://www.imoveajax.com/">Cyber Monday Michael Kors</a>

October 29, 2014 - 01:08 check this link... said:

If rankings you are guilty of committing felony.
Getting justice rankings is supposed to and from work and pay the
legal limit of the people who are charged with DUI, you
are not trustworthy. At this stage, to call on them to the
previously discussed factors. A very important for your
rankings situation. Don't have much better to look into the Fourth Amendment, a third DUI offense show that you weren't an experienced DUI lawyer to protect you,
we defend them. There are many options you have been charged with heavy

Drupal site hosting and development by SiteBasin and Alpha Cube, Inc.