https://github.com/Microsoft/CNTK
Revision 13a4f80fcb9998d8ec70345d5923c915e55100a9 authored by Momcilo Vasilijevic on 16 September 2016, 16:20:56 UTC, committed by Momcilo Vasilijevic on 31 October 2016, 17:23:19 UTC
There are two types of problems with reporting mean IOU error
1) Final error in CNTK is calculated as average of mini-batch errors.
Since mean IOU is calculated by accumulating intersection and union,
result for the last mini batch should be used instead of average.
2) Reported error is averged with number of processed samples (minibatch
size) which causes problems when working with minibatch size bigger than
1. In that case, reported error will be smaller <minibatch_size> times.
Adding logic that decides whether evaluation nodes accumulated error based
on network topology.
In case of distributed calculation, average of aggregate errors calculated
on different nodes will be reported.
Refactor criteria accumulation. Criteria now knows if evaluation node
is accumulating error or not.
1 parent 2bc795c
History
Tip revision: 13a4f80fcb9998d8ec70345d5923c915e55100a9 authored by Momcilo Vasilijevic on 16 September 2016, 16:20:56 UTC
Fix error reporting for mean IOU
Tip revision: 13a4f80
File Mode Size
Dependencies
Documentation
Examples
Scripts
Source
Tests
Tools
bindings
contrib
.clang-format -rw-r--r-- 931 bytes
.gitattributes -rw-r--r-- 2.2 KB
.gitignore -rw-r--r-- 3.5 KB
.gitmodules -rw-r--r-- 96 bytes
CNTK.Cpp.props -rw-r--r-- 7.9 KB
CNTK.sln -rw-r--r-- 207.1 KB
CONTRIBUTING.md -rw-r--r-- 199 bytes
CppCntk.vssettings -rw-r--r-- 10.0 KB
LICENSE.md -rw-r--r-- 4.6 KB
Makefile -rw-r--r-- 43.2 KB
README.md -rw-r--r-- 6.7 KB
configure -rwxr-xr-x 28.2 KB

README.md

back to top