Unsupervised Learning of Assistive Camera Views by an Aerial Co-robot in Augmented Reality Multitasking Environments.

Abstract

This paper presents a novel method by which an assistive aerial robot can learn the relevant camera views within a task domain through tracking the head motions of a human collaborator. The human’s visual field is modeled as an anisotropic spherical sensor, which decays in acuity towards the periphery, and is integrated in time throughout the domain. This data is resampled and fed into an expectation maximization solver in order to estimate the environment’s visual interest as a mixture of Gaussians. A dynamic coverage control law directs the robot to capture camera views of the peaks of these Gaussians which is broadcast to an augmented reality display worn by the human operator. An experimental study is presented that assesses the influence of the assitive robot on reflex time, head motion, and task completion time.

Bib

@inproceedings{DBLP:conf/icra/BentzDP19,
  author       = {William Bentz and
                  Sahib Dhanjal and
                  Dimitra Panagou},
  title        = {Unsupervised Learning of Assistive Camera Views by an Aerial Co-robot
                  in Augmented Reality Multitasking Environments},
  booktitle    = {International Conference on Robotics and Automation, {ICRA} 2019,
                  Montreal, QC, Canada, May 20-24, 2019},
  pages        = {3003--3009},
  publisher    = {{IEEE}},
  year         = {2019},
  url          = {https://doi.org/10.1109/ICRA.2019.8793587},
  doi          = {10.1109/ICRA.2019.8793587},
  timestamp    = {Wed, 16 Oct 2019 14:14:51 +0200},
  biburl       = {https://dblp.org/rec/conf/icra/BentzDP19.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}