https://github.com/Microsoft/CNTK
Revision 1fb5918b13d040e64f286a28e4c2f9c406642651 authored by Marko Radmilac on 01 July 2015, 20:15:29 UTC, committed by Marko Radmilac on 15 July 2015, 18:57:06 UTC
This change implements a read-ahead (prefetch) of one minibatch on a separate thread to ensure that main thread always has enough work. This is done through coarse-level parallelism, where GetMinibatch is called from a separate thread and result is cached for main thread to consume. The synchronization is a simple producer/consumer model with a single mutex and a conditional variable.

This change also modifies how we measure time it takes to read and compute a minibatch worth of data.
1 parent cf4dc2a
History
Tip revision: 1fb5918b13d040e64f286a28e4c2f9c406642651 authored by Marko Radmilac on 01 July 2015, 20:15:29 UTC
Implement minibatch prefetching
Tip revision: 1fb5918
File Mode Size
CheckInSuites
Common
DataReader
Demos
Documentation
ExampleSetups
MachineLearning
Math
Scripts
license
.gitignore -rw-r--r-- 2.6 KB
CNTK.sln -rw-r--r-- 19.3 KB
CppCntk.vssettings -rw-r--r-- 10.0 KB
Makefile -rw-r--r-- 9.1 KB
Makefile_kaldi.cpu -rw-r--r-- 8.2 KB
Makefile_kaldi.gpu -rw-r--r-- 9.4 KB
Makefile_kaldi2.cpu -rw-r--r-- 8.1 KB
Makefile_kaldi2.gpu -rw-r--r-- 9.1 KB
README -rw-r--r-- 5.0 KB
kaldi_vars.mk -rw-r--r-- 927 bytes

README

back to top