Jump to Content
  1. Queen's
  2. Smith Eng.
  3. ECE

Estimation, Search, and Planning (ESP) Research Group

Multimotion Visual Odometry (MVO)

Authors
  1. Kevin M. Judd
  2. Jonathan D. Gammell
Publication Date
Abstract

Visual motion estimation is a well-studied challenge in autonomous navigation. Recent work has focused on addressing multimotion estimation in highly dynamic environments. These environments not only comprise multiple, complex motions but also tend to exhibit significant occlusion.

Estimating third-party motions simultaneously with the sensor egomotion is difficult because an object’s observed motion consists of both its true motion and the sensor motion. Most previous works in multimotion estimation simplify this problem by relying on appearance-based object detection or application-specific motion constraints. These approaches are effective in specific applications and environments but do not generalize well to the full multimotion estimation problem (MEP).

This paper presents Multimotion Visual Odometry (MVO), a multimotion estimation pipeline that estimates the full SE(3) trajectory of every motion in the scene, including the sensor egomotion, without relying on appearance-based information. MVO extends the traditional visual odometry (VO) pipeline with multimotion segmentation and tracking techniques. It uses physically founded motion priors to extrapolate motions through temporary occlusions and identify the reappearance of motions through motion closure. Evaluations on real-world data from the Oxford Multimotion Dataset (OMD) and the KITTI Vision Benchmark Suite demonstrate that MVO achieves good estimation accuracy compared to similar approaches and is applicable to a variety of multimotion estimation challenges.

VideoVideo
PlaylistPlaylist
Publication Details
Type
Journal Paper
Journal
The International Journal of Robotics Research (IJRR)
Volume
43
Number
8
Pages
1250–1278
Digital Object IdentifierDOI
10.1177/02783649241229095
arXiv Identifier
2110.15169 [cs.RO]
Manuscript
Open-Access PDF (Recommended)PDF
https://arxiv.org/pdf/2110.15169 (original formatting)
Google ScholarGoogle Scholar
Google Scholar
BibTeX Entry
@article{judd_ijrr24,
author = {Kevin M Judd and Jonathan D Gammell},
title = {Multimotion {Visual} {Odometry} ({MVO})},
journal = {The International Journal of Robotics Research ({IJRR})},
year = {2024},
volume = {43},
number = {8},
pages = {1250--1278},
month = jul,
doi = {10.1177/02783649241229095},
}