Revision 0535d452dd426ba62d6d312766906ddd1230c7eb authored by Andrey Zhavoronkov on 02 November 2023, 15:59:39 UTC, committed by GitHub on 02 November 2023, 15:59:39 UTC
This PR speeds up the preparation of chunks by: 
1. loading images once instead of twice in each writer,
2. as well as by allowing simultaneous preparation of more than 1 chunk
using multithreading.
This allows to reduce the time for preparation of chunks for 4895 images
from 0:04:36 to 0:01:20 in case of preparation of 3 chunks in parallel
and 0:02:46 in case of 1 chunk in my environment.

Co-authored-by: Maria Khrustaleva <maya17grd@gmail.com>
1 parent 1f8d5d3
History
File Mode Size
analytics-report.ts -rw-r--r-- 5.3 KB
annotation-formats.ts -rw-r--r-- 2.7 KB
annotations-collection.ts -rw-r--r-- 42.4 KB
annotations-filter.ts -rw-r--r-- 3.6 KB
annotations-history.ts -rw-r--r-- 2.3 KB
annotations-objects.ts -rw-r--r-- 112.6 KB
annotations-saver.ts -rw-r--r-- 8.4 KB
annotations.ts -rw-r--r-- 15.2 KB
api-implementation.ts -rw-r--r-- 15.6 KB
api.ts -rw-r--r-- 13.4 KB
cloud-storage.ts -rw-r--r-- 14.8 KB
comment.ts -rw-r--r-- 2.7 KB
common.ts -rw-r--r-- 4.5 KB
config.ts -rw-r--r-- 393 bytes
core-types.ts -rw-r--r-- 1.1 KB
download.worker.js -rw-r--r-- 757 bytes
enums.ts -rw-r--r-- 5.5 KB
exceptions.ts -rw-r--r-- 4.2 KB
frames.ts -rw-r--r-- 24.7 KB
guide.ts -rw-r--r-- 2.8 KB
issue.ts -rw-r--r-- 8.0 KB
labels.ts -rw-r--r-- 6.9 KB
lambda-manager.ts -rw-r--r-- 7.0 KB
log.ts -rw-r--r-- 5.4 KB
logger-storage.ts -rw-r--r-- 7.4 KB
ml-model.ts -rw-r--r-- 4.7 KB
object-state.ts -rw-r--r-- 19.5 KB
object-utils.ts -rw-r--r-- 10.6 KB
organization.ts -rw-r--r-- 14.1 KB
plugins.ts -rw-r--r-- 3.9 KB
project-implementation.ts -rw-r--r-- 5.0 KB
project.ts -rw-r--r-- 10.8 KB
quality-conflict.ts -rw-r--r-- 3.6 KB
quality-report.ts -rw-r--r-- 4.1 KB
quality-settings.ts -rw-r--r-- 5.2 KB
server-proxy.ts -rw-r--r-- 75.1 KB
server-response-types.ts -rw-r--r-- 6.0 KB
session-implementation.ts -rw-r--r-- 29.9 KB
session.ts -rw-r--r-- 43.7 KB
statistics.ts -rw-r--r-- 1.1 KB
storage.ts -rw-r--r-- 1.1 KB
user.ts -rw-r--r-- 3.1 KB
webhook.ts -rw-r--r-- 11.3 KB

back to top