Virtual reality for animal navigation with camera-based optical flow tracking
- Background: Virtual reality combined with spherical treadmills is used across species for studying neural circuits underlying navigation. New Method: We developed an optical flow-based method for tracking treadmil ball motion in real-time using a single high-resolution camera. Results: Tracking accuracy and timing were determined using calibration data. Ball tracking was performed at 500 Hz and integrated with an open source game engine for virtual reality projection. The projection was updated at 120 Hz with a latency with respect to ball motion of 30 ± 8 ms. Comparison: with Existing Method(s) Optical flow based tracking of treadmill motion is typically achieved using optical mice. The camera-based optical flow tracking system developed here is based on off-the-shelf components and offers control over the image acquisition and processing parameters. This results in flexibility with respect to tracking conditions – such as ball surface texture, lighting conditions, or ball size – as well as camera alignment and calibration. Conclusions: A fast system for rotational ball motion tracking suitable for virtual reality animal behavior across different scales was developed and characterized.
Document Type: | Preprint |
---|---|
Language: | English |
Author: | Ivan Vishniakou, Paul G. Plöger, Johannes D. Seelig |
URN: | urn:nbn:de:hbz:1044-opus-44783 |
DOI: | https://doi.org/10.1101/579813 |
Publisher: | bioRxiv |
Publishing Institution: | Hochschule Bonn-Rhein-Sieg |
Date of first publication: | 2019/03/16 |
Publication status: | Final version published in: J Neurosci Methods. 2019 Nov 1;327:108403. doi: 10.1016/j.jneumeth.2019.108403 |
Copyright: | The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license. |
Keyword: | Ball Tracking; Drosophila; Navigation; Optical Flow; Real-Time Image Processing; Spherical Treadmill; Virtual Reality |
Departments, institutes and facilities: | Fachbereich Informatik |
Dewey Decimal Classification (DDC): | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 006 Spezielle Computerverfahren |
Entry in this database: | 2019/05/09 |
Licence (German): | ![]() |