Revision 0535d452dd426ba62d6d312766906ddd1230c7eb authored by Andrey Zhavoronkov on 02 November 2023, 15:59:39 UTC, committed by GitHub on 02 November 2023, 15:59:39 UTC
This PR speeds up the preparation of chunks by: 
1. loading images once instead of twice in each writer,
2. as well as by allowing simultaneous preparation of more than 1 chunk
using multithreading.
This allows to reduce the time for preparation of chunks for 4895 images
from 0:04:36 to 0:01:20 in case of preparation of 3 chunks in parallel
and 0:02:46 in case of 1 chunk in my environment.

Co-authored-by: Maria Khrustaleva <maya17grd@gmail.com>
1 parent 1f8d5d3
History
File Mode Size
.github
.vscode
changelog.d
components
cvat
cvat-canvas
cvat-canvas3d
cvat-cli
cvat-core
cvat-data
cvat-sdk
cvat-ui
dev
helm-chart
serverless
site
supervisord
tests
utils
.bandit -rw-r--r-- 208 bytes
.codacy.yml -rw-r--r-- 122 bytes
.coveragerc -rw-r--r-- 748 bytes
.dockerignore -rw-r--r-- 83 bytes
.editorconfig -rw-r--r-- 406 bytes
.eslintignore -rw-r--r-- 100 bytes
.eslintrc.js -rw-r--r-- 3.0 KB
.gitattributes -rw-r--r-- 664 bytes
.gitignore -rw-r--r-- 993 bytes
.gitmodules -rw-r--r-- 97 bytes
.nycrc -rw-r--r-- 353 bytes
.prettierignore -rw-r--r-- 81 bytes
.prettierrc -rw-r--r-- 666 bytes
.pylintrc -rw-r--r-- 30.9 KB
.remarkignore -rw-r--r-- 53 bytes
.remarkrc.js -rw-r--r-- 731 bytes
.stylelintrc.json -rw-r--r-- 319 bytes
CHANGELOG.md -rw-r--r-- 109.5 KB
CITATION.cff -rw-r--r-- 978 bytes
Dockerfile -rw-r--r-- 6.3 KB
Dockerfile.ci -rw-r--r-- 1.2 KB
Dockerfile.ui -rw-r--r-- 1.1 KB
LICENSE -rw-r--r-- 1.1 KB
README.md -rw-r--r-- 16.7 KB
SECURITY.md -rw-r--r-- 803 bytes
backend_entrypoint.sh -rwxr-xr-x 1.1 KB
docker-compose.ci.yml -rw-r--r-- 544 bytes
docker-compose.dev.yml -rw-r--r-- 3.0 KB
docker-compose.external_db.yml -rw-r--r-- 871 bytes
docker-compose.https.yml -rw-r--r-- 1.3 KB
docker-compose.yml -rw-r--r-- 9.6 KB
lint-staged.config.js -rw-r--r-- 1.6 KB
manage.py -rwxr-xr-x 628 bytes
package.json -rw-r--r-- 5.2 KB
rqscheduler.py -rw-r--r-- 455 bytes
wait-for-it.sh -rwxr-xr-x 4.0 KB
yarn.lock -rw-r--r-- 617.4 KB

README.md

back to top