Skip to main content

Browse the archive

https://github.com/Microsoft/CNTK
03 November 2020, 07:30:59 UTC
Revision 5ca4bb3a93170896fa6bc3d71d284139dd7fb7ce authored by Bowen Bao on 16 June 2018, 01:07:43 UTC, committed by Bowen Bao on 11 July 2018, 04:10:33 UTC 
Add Sequential Convolution.
 
adding convolution over sequential axis related tests.

adding convolution over sequential axis.
currently additional supported parameters:
  auto padding
  strides
  groups
support for dilation needs to be tested on GPU.

updating PrimitiveOpType SerializationTests that is missing from other commits ..

convert tabs to spaces.

Refine cpp convolution unit tests. Add dilation tests to python convolution unit tests.

more detailed comments on shape change for 1d seq conv with reduction rank 0. And other minor tweaks.

add EndToEndTests of sequential convolution on MNIST

add init_bias tests for seq conv

minor change in comments

rename ConvolutionOverSequenceAxisNode. Add comment on cudnn failed new test.

add more comments, trim spaces

add more comments, remove magic number, add more boundary checks.

remove the last SetValue for outputSeqAxisDimValue as TensorView Unary Op has already updated the value.

fix bug in python seqconv default bias shape, and add related unit tests.

small tweak in seq conv to avoid additional gpu memory allocation and increase performance.

Example: seq MNIST, and profiling

adjust conv c++ value unit test channel size.

small update on python seq mnist

Sequential convolution v2.
* re-designed ConvolutionSequenceShapeNode: refactored to separate out computing output sequence length from v1 node design. And refactored ConvolutionNodeBaseExtended as their common base class. (Since "ConvolutionNodeBase" is not only base class of ConvolutionNode but also PoolingNode).
* Performance increase against v1.
- compute sequence length by MBLayout instead of mask output from unpack. Avoiding the unnecessary cpu/gpu memory copy.

not include py sequence example for now .. need to find they a correct location.

add check for truncated sequences in sequential convolution

improve code style.

Moving sequential convolution in python to a new high level api, to maintain compatibility with previous implementation (special case 1d sequential convolution).

Add ConvolutionSequenceShape OP.

nit

update conv_attribute test for updated convolution parameter
move sequential parameter to the last
update test shortcircuit for CPU convolution dilation.

update endtoendtest - unittest baseline file for new convolution unittests.

update makefile to include new unittest file for linux

nit

Update ConvolutionNode initialization code to handle TransformerNode Initialization.

nit

nit
1 parent 8bd0459
Raw File
Tip revision: 5ca4bb3a93170896fa6bc3d71d284139dd7fb7ce authored by Bowen Bao on 16 June 2018, 01:07:43 UTC
Add Sequential Convolution.
Tip revision: 5ca4bb3
.gitattributes 
*.ini text
*.simple text
*.counts text
*.labels text
*.feats text
*.ctf text
*.post text
*.cpu text
*.gpu text
*.rst text

.gitattributes text
.gitignore text
.gitmodules text

.clang-format text

*.md text
*.txt text
*.TXT text
*.html text
*.lyx text
*.bib text
*.json text
.gitkeep text
KaldiReaderReadme text
Readme text

*.bat text
*.cmd text
*.py text
*.ipynb text
*.pl text
*.ps1 text
*.psm1 text
*.ps text
*.i text
*.cmake text
*.patch text

*.sh text eol=lf
*.awk text eol=lf
build-and-test text eol=lf
configure text eol=lf
generate_build_info text eol=lf
run-test text eol=lf
run-test-common text eol=lf
run-timit-test-common text eol=lf
run-boost-test-common text eol=lf
make_binary_drop_linux text eol=lf

# Used from Unix / Cygwin 'md5sum -c', needs to have LF line endings:
Tests/EndToEndTests/Examples/Speech/TIMIT/WriteBottleneck/expected_output_md5sum.*.txt eol=lf
Tests/EndToEndTests/Examples/Speech/TIMIT/WriteScaledLogLike/expected_output_md5sum.*.txt eol=lf

# Used by reader unit test, needs to keep LF line endings.
Tests/UnitTests/ReaderTests/Data/CNTKTextFormatReader/invalid_inputs.txt eol=lf

Makefile text
*.sln text
*.pyproj text
*.vcxproj text
*.vcxproj.filters text
*.vssettings text
*.csproj text
*.props text
*.asax text

*.h text
*.hpp text
*.cpp text
*.cc text
*.cu text
*.cuh text
*.proto text

*.cs text
*.java text
*.yml text
*.yml.bak text

*.config text
*.cntk text
*.bs text
*.ndl text
*.mel text
*.xml text
*.m text
*.mlf text
*.scp text
*.list text

*.log text
*.prototxt text

Dockerfile* text
.dockerignore text

# Speech data
mean.363 text
var.363 text
prior.132 text

# dot (graph description language) file 
*.dot text 

# AMI-specific
Results text
40fbank.conf text
80fbank.conf text

# SLU-specific
atis.*.simple

# TIMIT-specific
*.fbank24_zda text
TIMIT*.100 text
TIMIT*.20 text
TIMIT*.arpa text
TIMIT*.cntk text
TIMIT*.dnn_map text
TIMIT*.fbank text
TIMIT*.fullpath text
TIMIT*.lookahead text
TIMIT*.rnn text
TIMIT*.statelist text
TIMIT*.tfsa text
TIMIT*.transitions text

Examples/Evaluation/UWPImageRecognition/ImageRecognizerLib/utils.inl text
Examples/LanguageUnderstanding/ATIS/Data/ATIS.* text
Examples/LanguageUnderstanding/ATIS/BrainScript/*.wl text
Examples/SequenceToSequence/CMUDict/Data/cmudict-0.7b* text
Examples/Text/LightRNN/test/word-0.location text

*.xaml text
*.appxmanifest text

# Binary extensions:
*.ark binary
*.chunk binary
*.cmf binary
*.docx binary
*.jpg binary
*.pdf binary
*.png binary
*.pptx binary
*.snk binary
*.vsdm binary
*.zip binary
*.dnn binary
Examples/Image/Detection/FastRCNN/BrainScript/fastRCNN/*/*.pyd binary
Examples/Image/Detection/FastRCNN/BrainScript/fastRCNN/*/*.so binary
Examples/Image/Detection/utils/cython_modules/*.pyd binary
Examples/Image/Detection/utils/cython_modules/*.so binary
Tests/UnitTests/V2LibraryTests/data/*.bin binary
Tests/UnitTests/ReaderTests/Data/CNTKBinaryReader/*.bin binary
Tests/EndToEndTests/ParallelTraining/AsynchronousSGD/ASGD_Resnet.model.1 binary
Examples/Extensibility/BinaryConvolution/BinaryConvolutionLib/halide/halide_convolve.a binary
Examples/Extensibility/BinaryConvolution/BinaryConvolutionLib/halide/halide_convolve.lib binary
Examples/Extensibility/BinaryConvolution/BinaryConvolutionLib/halide/halide_convolve_nofeatures.a binary
Examples/Extensibility/BinaryConvolution/BinaryConvolutionLib/halide/halide_convolve_nofeatures.lib binary
external/gsl text
Source/CNTKv2LibraryDll/proto/onnx/onnx_repo text
#certificates
*.pfx binary
back to top