Virtual reality for animal navigation with camera-based optical flow tracking

  • Background: Virtual reality combined with a spherical treadmill is used across species for studying neural circuits underlying navigation and learning. New method: We developed an optical flow-based method for tracking treadmill ball motion in real time using a single high-resolution camera. Results: Tracking accuracy and timing were determined using calibration data. Ball tracking was performed at 500 Hz and integrated with an open source game engine for virtual reality projection. The projection was updated at 120 Hz with a latency with respect to ball motion of 30 ± 8 ms. The system was tested for behavior with fruit flies. The application and source code are available at https://github.com/ivan-vishniakou/neural-circuits-vr. Comparison with existing method(s): Optical flow-based tracking of treadmill motion is typically achieved using optical mice. The camera-based optical flow tracking system developed here is based on off-the-shelf components and offers control over the image acquisition and processing parameters. This results in flexibility with respect to tracking conditions – such as ball surface texture, lighting conditions, or ball size – as well as camera alignment and calibration. Conclusions: A fast system for rotational ball motion tracking suitable for virtual reality behavior with fruit flies was developed and characterized.

Export metadata

Additional Services

Share in Twitter Search Google Scholar Availability
Metadaten
Document Type:Article
Language:English
Author:Ivan Vishniakou, Paul G. Plöger, Johannes D. Seelig
Parent Title (English):Journal of Neuroscience Methods
Volume:327
First Page:108403
ISSN:0165-0270
DOI:https://doi.org/10.1016/j.jneumeth.2019.108403
Pubmed Id:http://www.ncbi.nlm.nih.gov/pubmed?term=31449825
Publisher:North-Holland Biomedical Press
Date of first publication:2019/08/23
Tag:Ball tracking; Drosophila; Navigation; Optical flow; Real-time image processing; Spherical treadmill; Virtual reality
Departments, institutes and facilities:Fachbereich Informatik
Entry in this database:2019/09/18