Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Automation bias with a conversational interface: user confirmation of misparsed information

Zaroukian, Erin, Bakdash, Jonathan Z., Preece, Alun David and Webberley, William 2017. Automation bias with a conversational interface: user confirmation of misparsed information. Presented at: IEEE Conference on Cognitive and Computational Aspects of Situation Management, Savannah, GA, USA, 27-31 March 2017. Cognitive and Computational Aspects of Situation Management (CogSIMA), 2017 IEEE Conference on. IEEE, 10.1109/COGSIMA.2017.7929605

[img]
Preview
PDF - Accepted Post-Print Version
Download (219kB) | Preview

Abstract

We investigate automation bias for confirming erroneous information with a conversational interface. Participants in our studies used a conversational interface to report information in a simulated intelligence, surveillance, and reconnaissance (ISR) task. In the task, for flexibility and ease of use, participants reported information to the conversational agent in natural language. Then, the conversational agent interpreted the user’s reports in a human- and machine-readable language. Next, participants could accept or reject the agent’s interpretation. Misparses occur when the agent incorrectly interprets the report and the user erroneously accepts it. We hypothesize that the misparses naturally occur in the experiment due to automation bias and complacency because the agent interpretation was generally correct (92%). These errors indicate some users were unable to maintain situation awareness using the conversational interface. Our results illustrate concerns for implementing a flexible conversational interface in safety critical environments (e.g., military, emergency operations).

Item Type: Conference or Workshop Item (Paper)
Date Type: Completion
Status: Published
Schools: Computer Science & Informatics
Crime and Security Research Institute (CSURI)
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher: IEEE
Last Modified: 14 Aug 2017 12:37
URI: http://orca.cf.ac.uk/id/eprint/99164

Actions (repository staff only)

Edit Item Edit Item

Full Text Downloads from ORCA for this publication

Top Downloads of this item by Country

Monthly Full Text Downloads of this item

More statistics for this item...