Jump to Content
  1. Queen's
  2. Smith Eng.
  3. ECE

Estimation, Search, and Planning (ESP) Research Group

Multimotion Visual Odometry (MVO): Simultaneous estimation of camera and third-party motions

Authors
  1. Kevin M. Judd
  2. Jonathan D. Gammell
  3. Paul Newman
Publication Date
Abstract

Estimating motion from images is a well-studied problem in computer vision and robotics. Previous work has developed techniques to estimate the motion of a moving camera in a largely static environment (e.g., visual odometry) and to segment or track motions in a dynamic scene using known camera motions (e.g., multiple object tracking).

It is more challenging to estimate the unknown motion of the camera and the dynamic scene simultaneously. Most previous work requires a priori object models (e.g., tracking-by-detection), motion constraints (e.g., planar motion), or fails to estimate the full SE(3) motions of the scene (e.g., scene flow). While these approaches work well in specific application domains, they are not generalizable to unconstrained motions.

This paper extends the traditional visual odometry (VO) pipeline to estimate the full SE(3) motion of both a stereo/RGB-D camera and the dynamic scene. This multimotion visual odometry (MVO) pipeline requires no a priori knowledge of the environment or the dynamic objects. Its performance is evaluated on a real-world dynamic dataset with ground truth for all motions from a motion capture system.

VideoVideo
Publication Details
Type
Full-Paper-Refereed Conference Paper
Conference
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Location
Madrid, Spain
Pages
3949–3956
Digital Object IdentifierDOI
10.1109/IROS.2018.8594213
arXiv Identifier
1808.00274 [cs.RO]
Manuscript
Open-Access PDF (Recommended)PDF
https://arxiv.org/pdf/1808.00274 (corrected version)
Google ScholarGoogle Scholar
Google Scholar
BibTeX Entry
@inproceedings{judd_iros18,
author = {Kevin M Judd and Jonathan D Gammell and Paul Newman},
title = {Multimotion {Visual} {Odometry} ({MVO}): Simultaneous estimation of camera and third-party motions},
booktitle = {Proceedings of the {IEEE/RSJ} International Conference on Intelligent Robots and Systems ({IROS})},
year = {2018},
pages = {3949--3956},
address = {Madrid, Spain},
month = {1--5 } # oct,
doi = {10.1109/IROS.2018.8594213},
}