https://github.com/Microsoft/CNTK
Revision c8cd19cb0d40bf027c66a86df641057738de603d authored by KeDengMS on 12 July 2017, 21:31:06 UTC, committed by KeDengMS on 12 July 2017, 21:31:06 UTC
1.	Allow gradient aliasing for plus/minus/reshape if child only has single parent
2.	Allow gradient overwrite for child with multiple parents, for the first parent in revese eval order
3.	More nodes with gradient optimization enabled: Pooling, LogPlus, Minus, ElementTimes, Reshape, ReduceElements, ReconcileDynamicAxis, ToSequence, Dropout, BatchNormalization
This optimization brings about 5-7% speedup in ResNet50 and some other models
1 parent 53cfb13
History
Tip revision: c8cd19cb0d40bf027c66a86df641057738de603d authored by KeDengMS on 12 July 2017, 21:31:06 UTC
Gradient optimization to reduce memory and computation in backprop
Tip revision: c8cd19c
File Mode Size
Dependencies
Documentation
Examples
Manual
Scripts
Source
Tests
Tools
Tutorials
bindings
.clang-format -rw-r--r-- 931 bytes
.gitattributes -rw-r--r-- 3.1 KB
.gitignore -rw-r--r-- 6.1 KB
.gitmodules -rw-r--r-- 211 bytes
CNTK.Common.props -rw-r--r-- 1.5 KB
CNTK.Cpp.props -rw-r--r-- 8.0 KB
CNTK.sln -rw-r--r-- 194.7 KB
CONTRIBUTING.md -rw-r--r-- 210 bytes
CppCntk.vssettings -rw-r--r-- 10.0 KB
LICENSE.md -rw-r--r-- 4.6 KB
Makefile -rw-r--r-- 56.1 KB
README.md -rw-r--r-- 4.6 KB
configure -rwxr-xr-x 34.5 KB

README.md

back to top