swh:1:snp:973504f75325e1c705c39106a2685791af62e9e3
Revision 48ab12b6bc584a9b2dcb86ef734f4fb7b99fa768 authored by Roman Donchenko on 19 December 2023, 13:33:56 UTC, committed by GitHub on 19 December 2023, 13:33:56 UTC
<!-- Raise an issue to propose your change
(https://github.com/opencv/cvat/issues).
It helps to avoid duplication of efforts from multiple independent
contributors.
Discuss your ideas with maintainers to be sure that changes will be
approved and merged.
Read the [Contribution
guide](https://opencv.github.io/cvat/docs/contributing/). -->

<!-- Provide a general summary of your changes in the Title above -->

### Motivation and context
<!-- Why is this change required? What problem does it solve? If it
fixes an open
issue, please link to the issue here. Describe your changes in detail,
add
screenshots. -->
These types of data have different characteristics and we have different
expectations on them:

* job queues are small and we'd rather not lose them (although losing
them is not fatal);

* cached chunks are large and we don't care if we lose them.

We currently store both in KeyDB, which has shown itself to not be
especially reliable. A few times we've had to clear the KeyDB store due
to data corruption, which destroyed the queues as well. While we'll
probably end up replacing KeyDB with something else, it would still be
useful to have the ability to just clear the cache volume without taking
out the job queues in the process.

As a solution to this, add a Redis service to be used only for the
queues (and potentially for other small data items). Using the original
Redis instead of KeyDB should also help with reliability (at least as
far as the job queues are concerned).

### How has this been tested?
<!-- Please describe in detail how you tested your changes.
Include details of your testing environment, and the tests you ran to
see how your change affects other areas of the code, etc. -->
I checked the CVAT can still start using the development environment
instructions, the Compose file and the Helm chart.

### Checklist
<!-- Go over all the following points, and put an `x` in all the boxes
that apply.
If an item isn't applicable for some reason, then ~~explicitly
strikethrough~~ the whole
line. If you don't do that, GitHub will show incorrect progress for the
pull request.
If you're unsure about any of these, don't hesitate to ask. We're here
to help! -->
- [x] I submit my changes into the `develop` branch
- [x] I have created a changelog fragment <!-- see top comment in
CHANGELOG.md -->
- ~~[ ] I have updated the documentation accordingly~~
- ~~[ ] I have added tests to cover my changes~~
- ~~[ ] I have linked related issues (see [GitHub docs](

https://help.github.com/en/github/managing-your-work-on-github/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword))~~
- ~~[ ] I have increased versions of npm packages if it is necessary

([cvat-canvas](https://github.com/opencv/cvat/tree/develop/cvat-canvas#versioning),

[cvat-core](https://github.com/opencv/cvat/tree/develop/cvat-core#versioning),

[cvat-data](https://github.com/opencv/cvat/tree/develop/cvat-data#versioning)
and

[cvat-ui](https://github.com/opencv/cvat/tree/develop/cvat-ui#versioning))~~

### License

- [x] I submit _my code changes_ under the same [MIT License](
https://github.com/opencv/cvat/blob/develop/LICENSE) that covers the
project.
  Feel free to contact the maintainers if that's a concern.
1 parent 80e1212
History
Tip revision: c5d8a16c880017993557d86f203630f6eadfcd3c authored by Yeek Sheng on 19 April 2024, 12:10:45 UTC
[GSoC2024] Fix import of outside track shapes in Datumaro-based formats (#7669)
Tip revision: c5d8a16
File Mode Size
.github
.vscode
changelog.d
components
cvat
cvat-canvas
cvat-canvas3d
cvat-cli
cvat-core
cvat-data
cvat-sdk
cvat-ui
dev
helm-chart
serverless
site
supervisord
tests
utils
.bandit -rw-r--r-- 208 bytes
.codacy.yml -rw-r--r-- 122 bytes
.coveragerc -rw-r--r-- 748 bytes
.dockerignore -rw-r--r-- 83 bytes
.editorconfig -rw-r--r-- 406 bytes
.eslintignore -rw-r--r-- 100 bytes
.eslintrc.cjs -rw-r--r-- 3.4 KB
.gitattributes -rw-r--r-- 664 bytes
.gitignore -rw-r--r-- 993 bytes
.gitmodules -rw-r--r-- 97 bytes
.nycrc -rw-r--r-- 353 bytes
.prettierignore -rw-r--r-- 81 bytes
.prettierrc -rw-r--r-- 666 bytes
.pylintrc -rw-r--r-- 30.9 KB
.remarkignore -rw-r--r-- 53 bytes
.remarkrc.js -rw-r--r-- 731 bytes
.stylelintrc.json -rw-r--r-- 319 bytes
CHANGELOG.md -rw-r--r-- 116.8 KB
CITATION.cff -rw-r--r-- 979 bytes
Dockerfile -rw-r--r-- 6.3 KB
Dockerfile.ci -rw-r--r-- 1.2 KB
Dockerfile.ui -rw-r--r-- 1.1 KB
LICENSE -rw-r--r-- 1.1 KB
README.md -rw-r--r-- 16.7 KB
SECURITY.md -rw-r--r-- 803 bytes
backend_entrypoint.sh -rwxr-xr-x 1.1 KB
docker-compose.ci.yml -rw-r--r-- 499 bytes
docker-compose.dev.yml -rw-r--r-- 3.1 KB
docker-compose.external_db.yml -rw-r--r-- 871 bytes
docker-compose.https.yml -rw-r--r-- 1.1 KB
docker-compose.yml -rw-r--r-- 10.6 KB
lint-staged.config.js -rw-r--r-- 1.6 KB
manage.py -rwxr-xr-x 628 bytes
package.json -rw-r--r-- 5.2 KB
rqscheduler.py -rw-r--r-- 455 bytes
wait-for-it.sh -rwxr-xr-x 4.0 KB
wait_for_deps.sh -rwxr-xr-x 693 bytes
yarn.lock -rw-r--r-- 618.4 KB

README.md

back to top