MNIST-DVS and FLASH-MNIST-DVS Databases

and

Instituto de Microelectrónica de Sevilla, IMSE-CNM (CSIC & Univ. of Sevilla), Sevilla, SPAIN.

We present 2 MNIST datasets recorded with a DVS sensor:

MNIST-DVS

The MNIST-DVS database consists of a set of 30,000 DVS recordings of different handwritten digits. A total of 10,000 original 28x28 pixel handwritten digit images from MNIST (http://yann.lecun.com/exdb/mnist) were upscaled using smoothing interpolation algorithms to three different scales. Each upscaled digit was then displayed on an LCD monitor with slow motion and a 128x128 pixel DVS (Dynamic Vision Sensor) was used to record the moving digits. The DVS used is a high-sensitive DVS described in:

T. Serrano-Gotarredona and B. Linares-Barranco, "A 128x128 1.5% Contrast Sensitivity 0.9% FPN 3us Latency 4mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance Amplifiers," IEEE J. Solid-State Circuits, vol.48, No. 3, pp. 827-838, March 2013 (available from:

http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6407468).

Recorded files can be displayed with jAER (available from: http://sourceforge.net/p/jaer/wiki/Home). Matlab^TM scripts are provided to transfer files from/to jAER format to matlab.

This database can be downloaded free of charge, provided it is used for non-commercial purposes and the original source is credited in publications and reports.

To download it go to http://imse-cnm.csic.es/caviar/MNIST_DVS.

We also include a Matlab^TM script "process_mnist.m" that generates a parallel dataset with (a) removed 75Hz timestamp harmonic produced by the LCD screen, (b) stabilizes the moving digits on the center of the screen, and/or (c) removes the polarity bit from the recordings. Further explanations are available within the script.

MNIST-FLASH-DVS

The MNIST-DVS above has moving digits highlighting the edges. This makes the dataset challenging for recognition. MNIST-FLASH-DVS provides DVS recordings by flashing static MNIST digits on an LCD monitor. Each digit is flashed 5 times. Dataset is available in jAER format or in Matlab format.

To download it go to http://imse-cnm.csic.es/caviar/MNIST_FLASH_DVS.

You may also be interested in the POKER-DVS database: http://www.imse-cnm.csic.es/caviar/POKERDVS.html