301 Commits (f18b1cb82dba366502e481a00900390337051372)

Author SHA1 Message Date
Dmitry Kalinin 879deb5a52
Projects (#2255)
Initial implementation of Projects feature to group similar tasks into one group (aka Dataset UI in the future).
5 years ago
Maria Khrustaleva f2d0b71b72
Fixed saving of relative paths in dummy chunks instead of absolute (#2424)
* Fixed saving of relative paths in dummy chunks instead of absolute

* Updated CHANGELOG
5 years ago
Maya d2e186a647 Renaming 5 years ago
Dmitry Kalinin 8c2200356d Merge remote-tracking branch 'origin/develop' into dk/user-search 5 years ago
Maya 7309d99074 Fixed typo 5 years ago
Maya f5421998c6 Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Anastasia Yasakova 3b29621c72
Add ImageNet format (#2376)
* Add ImageNet format

* Add ImageNet to documentation
5 years ago
Maria Khrustaleva bbfa880d1f
Added ability to correct upload video with a rotation record in the metadata (#2218)
* Added ability to correct upload video with a rotation record in the metadata

* fix sizes of rotated preview

* fix sizes of rotated frame

* Added tests for uploaded video with rotation record in metadata

* Used OpenCV instead of PIL

* Fixed tests

* Update CHANGELOG

* fix

* Moved function

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Maya 0bf3153265 Added tests 5 years ago
Maya fb8f5fffcb fix 5 years ago
Dmitry Kalinin 88d4c1798b Fixed server tests 5 years ago
Maya 6e5648f458 Added some test 5 years ago
Maya a1b32b406d temp 5 years ago
Maya b97a6cda10 Added location of uploaded data 5 years ago
Dmitry Kalinin 9e584b4191 Added user search filed for assignee 5 years ago
Vitaliy Nishukov 00f6486f80
Z-Order flag in creation task process (#2294)
* Z-Order flag in creation task process has been removed
5 years ago
Andrey Zhavoronkov 2dcb9056e0
reduced the preparation time of the user list on the backend (#2334) 5 years ago
Andrey Zhavoronkov 7543f5ef6f
fixed linter issues (#2305) 5 years ago
Maxim Zhiltsov d4129f2868
Add MOTS png format (#2198)
* Add mots format

* fix upload

* update docs

* update changelog

* Update datumaro dependency

* fix header

* update dm dependency

* Support importing with outside property in mot and mots

* fix track exporting

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
JK-97 2d23911d33
Fix task model updated_date field: auto_now = True (#2233)
* Fix task model updated_date field: auto_now = True

* update migrations file
5 years ago
Maxim Zhiltsov 84b8a85a20
Raw image copying in dataset export (#2229)
* Raw image copying in dataset export

* use byteimage

* use opencv, swith frame data type for videos

* Fix image reading

* update dm dependency
5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Maxim Zhiltsov e9552f84f3
Update media extractors (#2154)
* Fix PDF reading

* Fixes

* update changelog

* t

* fix len

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Dmitry Agapov f2c84a2653
Nuclio as a plugin in CVAT, improved system to check installed plugins (#2192)
* allow to run cvat without nuclio

* fix new line

* fix comments

* Updated core version

* refactoring

* minor refactoring, fixed eslint issues, added documentation to cvat-core, updated ui version, updated changelog

* move plugins to serverViewSet

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Dmitry Agapov 59b338994d
delete task data after delete task (#2179)
* delete task data after delete task

* fix pylint

* fix pyflakes

* fix flake8

* add test test_api_v1_tasks_delete_task_data_after_delete_task

* update change log

* pyflake fix
6 years ago
Nikita Manovich 5d0963934f Add missed migration. 6 years ago
Maxim Zhiltsov 8d3c95a764
Fix PDF reading (#2141)
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maxim Zhiltsov 0933ee2362
Fix CVAT format import for frame stepped tasks (#2151)
* Fix cvat format import with frame step

* update changelog
6 years ago
Andrey Zhavoronkov 87d76c9a1a
Update Django 2->3 (#2121)
* used ubuntu 20.04 as base image

* updated CI image

* Fixed indent

* updated contributing guide and changelog

* update django

* Fixed migration:
this migration contains several "duplicates" (for example, it changes the id field and then changes the tarck_id field of the related table).
Since version 3.x, Django cannot apply such migrations and throws an exception.
Also checked the auto-generated migration: it doesn't contain those double changes.
In both cases, the schemas of these tables are the same.
6 years ago
Maya e7df942f6d Refactoring 6 years ago
Maya fb383c71e2 Deleted unnecessary 6 years ago
Maya d29f4cb6e0 Added tests 6 years ago
Maya 761c83f3ab Fix migration 6 years ago
Maya 3fdf065511 Merge branch 'upstream/develop' into cache 6 years ago
Maya a46bba2df5 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Maya 7bb5e02ff1 Added license headers 6 years ago
Maya 2144c4aadd Refactoring 6 years ago
Maya 43c2c6ea87 Merged migrations into one file 6 years ago
Dmitry Kalinin bee4c3799f
Label color (#2014)
* added color to django app and cvat-core

* temp

* temp

* Added label color to mask dump

* Fixed UI for label color picker

* npm packages and CHANGELOG

* fixed models and migrations

* Fixed default background color and using normalization

* Added setting label color with hash

* fixed error

* Added close icon to color picker

* Fixed CHANGELOG

* requested changes

* fixed menu visibility

* Fixed label hashing and algorithm

* Added wheel package to CI

* Fixed dockerfile

* moved wheel package from dockerfile to requirements

* fixed requirements

* Fixed requirements

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maya ff62baab99 Changed paths 6 years ago
Maya 1520dcc605 Deleted ArchiveReader/get_path 6 years ago
Dmitry Kalinin 582e23bf88
Batch of fixes (#2031) 6 years ago
Maya 3236546907 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Maya ade215399c Fix 6 years ago
Maya f3630aa4b5 Some additions:
* moved cache implementation
 * fixed start, stop, step for tasks that created on the fly
 * changed frame provider
6 years ago
Maya 94bb3659c9 Added data migration 6 years ago
Maya e947a8252c Added ability to select using cache or no in task creating form & some fixes 6 years ago
Maya 5fa50be1fa Added most of video processing & cache implementation 6 years ago
Maya 0f7f14a1ef Merge branch 'cache' of https://github.com/Marishka17/cvat into origin/cache 6 years ago
Nikita Manovich 634ca17958
Remove old UI (#1964)
* Removed outdated code

* Revert changes in .gitignore

* Fix docker build

* Remove karma + some dummy code

* Fix a type in Dockerfile.ci

* Fix swagger and remove dispatch_request.

* Update CHANGELOG.md
6 years ago
Andrey Zhavoronkov 0d0749f4ec
fixed swagger API documentation for POST /tasks/{id}/data endpoint (#1963) 6 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Maya 08b195f05f Added preparation of meta information 6 years ago
Priya4607 6a1e7af5c5
Display of Annotation Type (#1192) 6 years ago
Nikita Manovich 0b7c5eaf97 Add missing migration 6 years ago
Andrey Zhavoronkov f678b66d8b
removed redundant call of av.dataset in VideoReader class (#1899) 6 years ago
zhiltsov-max fc2fb6156a
Don't export outside annotations (#1729)
* Add option to omit outside annotations

* update changelog

* Fix mot format and test

* Fix outside in mot

* fix repo problem

* t

* Update CHANGELOG.md

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 962f61fa27
Add attributes in VOC format (#1792)
* Add voc attributes

* Allow any values for voc pose

* update changelog

* Add attribute conversion

* linter

* fix tests
6 years ago
zhiltsov-max f646589bfa
Allow import of single boxes in MOT format (#1764)
* Allow single boxes in MOT format

* update changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Andrey Zhavoronkov 97b1005456
compatibility with python 3.6 and lower (#1780) 6 years ago
Andrey Zhavoronkov b706546435
Added clamav integration (#1712)
* added clamav integration

* updated license headers and changelog
6 years ago
zhiltsov-max da3fa34ce0
Add tf import checks and tests (#1567)
* Add tf import checks and tests

* implement disabled formats on server

* python 3.5 compatibility

* add checks to dm tests

* fix tests

* Support for disabled formats in UI

* add sorting for formats, mark grey disabled items

* update changelog

* advance package versions
6 years ago
Nikita Manovich 79c39ad35c
Remove information about the email from the basic user information (#1627)
* Remove information about the email from the basic user information.
6 years ago
Andrey Zhavoronkov 7c800f7f7d
Fixed task creation for videos with uneven dimensions. (#1594)
* used yuv420p format for compressed and original chunks

* updated changelog
6 years ago
Andrey Zhavoronkov 380be58edc
Ability to configure user agreements for the register user form (#1464) 6 years ago
Andrey Zhavoronkov ccd2fbdf51
fixed linter issues (#1538) 6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
Andrey Zhavoronkov 227ab05e73
Fixed uploading track annotations for multi-segment tasks (#1396)
* fixed uploading annotation for overlapped segments

* fixed dump of tracks for multisegment task

* Update CHANGELOG.md

* fixed comments

* fixed comments

* Update cvat/apps/engine/data_manager.py

Co-Authored-By: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>

* drop start shapes with outside==True for splitted track

* code cleanup

* fixed typo

* fix

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Thomas Albrecht 9344b067b1
fix: OSError:broken data stream (#1430) 6 years ago
Andrey Zhavoronkov 73346b3c2f
Az/fix remote files (#1392)
* fixed task creation from remote files

* Update CHANGELOG.md
6 years ago
zhiltsov-max 557e308a73
Add chunk iterator cache to frame provider (#1367)
* Add chunk iterator cache

* fix
6 years ago
Boris Sekachev 1d78c54029
Batch of fixes (#1370)
* Some margins were change to paddings

* Removed extra selected

* Fix: added outside shapes when merge polyshapes

* Fixed double scroll bars

* Updated canvas table

* Fixed setup methodf

* Disabled change frame during drag, resize and editing

* Fixed: hidden points are visible

* Fixed: Merge is allowed for points, but clicks on points conflict with frame dragging logic

* Fixed: do not filter removed objects

* Updated CHANGELOG.md

* Couple of headers updated
6 years ago
zhiltsov-max 457454821f
Refactor frame provider (#1355)
* Refactor frame provider

* fix
6 years ago
Nikita Manovich 87784fa97e Increase preview size till 256, 256.
Previous preview size was not optimal and led to a blurred image
due to too small size.
6 years ago
zhiltsov-max 66c6e7e919
Fix point interpolation (#1344)
* Extend formats tests with different track types

* Add unordered list comparison

* Skip empty list comparison

* fix

* fix

* Reproduce problem

* Fix point interpolation for single point

* undo rest api refactor
6 years ago
Andrey Zhavoronkov 9c443db5a1
Az/fix migration (#1333)
* fixed migration because readers interface changed

* fixed tests
6 years ago
zhiltsov-max 887c6f0432
Move annotation formats to dataset manager (#1256)
* Move formats to dataset manager

* Unify datataset export and anno export implementations

* Add track_id to TrackedShape, export tracked shapes

* Replace MOT format

* Replace LabelMe format

* Add new formats to dm

* Add dm tests

* Extend TrackedShape

* Enable dm test in CI

* Fix tests

* Add import

* Fix tests

* Fix mot track ids

* Fix mot format

* Update attribute logic in labelme tests

* Use common code in yolo

* Put datumaro in path in settings

* Expect labels file in MOT next to annotations file

* Add MOT format description

* Add import

* Add labelme format description

* Linter fix

* Linter fix2

* Compare attributes ordered

* Update docs

* Update tests
6 years ago
Andrey Zhavoronkov e87ec38476
Small preview and progress (#1331)
* Reduce preview size (untested)

* Fix tests

* Improve media readers (untested)

* fixed migration

* fixed frame provider

* fixed preview save

* fixed stop frame

* handle duration == None

* codacy

* added missed import

* unified iteration over frames for media readers and fixed corner case when user specify stop_frame = 0

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
zhiltsov-max 731b8967c0
Fix LabelMe format (#1260)
* Fix labelme filenames

* Change module path

* Add tests for LabelMe

* Update test

* Fix test

* Add line in changelog
6 years ago
zhiltsov-max b3f7f5b8bc
Add tags support for VOC (#1201)
* Extend voc format test with tags

* Add import and export of voc labels

* Fix voc and yolo format version numbers
6 years ago
zhiltsov-max a058765d29
Add tags to cvat xml (#1200)
* Extend cvat format test

* Add tags to cvat for images

* Add tags to cvat format in dm

* Add import of tags from datumaro
6 years ago
Boris Sekachev 5659a0a0e1
Updated svg.js version (#1212) 6 years ago
Boris Sekachev 93d57131c3
Fixed lags (#1197) 6 years ago
zhiltsov-max cd8ef2aca4
Replace VOC format support in CVAT with Datumaro (#1167)
* Add image meta reading to voc

* Replace voc support in cvat

* Bump format version

* Materialize lazy transforms in voc export

* Store voc instance id as group id

* Add flat format import

* Add documentation

* Fix format name in doc
6 years ago
zhiltsov-max 8caa1695c5
Replace mask format support with Datumaro (#1163)
* Add box to mask transform

* Fix 'source' labelmap mode in voc converter

* Import groups

* Replace mask format support

* Update mask format documentation

* codacy

* Fix tests

* Fix dataset

* Fix segments grouping

* Merge instances in mask export
6 years ago
Tritin Truong 0bb92f27c1
Cuboid annotation (#678)
* Cuboid feature

* migration files

* Refactored cuboidShape
Fixed a bug where coloring by label would not update cuboids properly
Fixed a bug where the select points would not scale properly on initialization

* Removed math.js dependency
Implemented custom line intersection function

* new cvat formatting with labelled points

* Added MIT License to js files that were missing it

* Added simple constraints to the cuboids

* reverted commit for settings for vscode to hide local path

* fixed locking for cuboids

* fixed cuboid View when locked

* fixed occlusion view for cuboids

* Allow cuboid points to be outside the frame dimensions.

Signed-off-by: Tritin Truong <truongtritin98@gmail.com>

* Added stricter constraints on cuboid edges.

* Slightly stricter restrictions for edge case

* Cleaned up unused imports

* removed dashed lines on cuboids

* Moved projection lines to settings tab

* Fixed Cuboid shape buffer \

* Fix migrations (two 022 migrations after merge with the develop branch).

* Fix compatibility issues with auto segmentation.

* Grab points and update control scheme

* Greatly improved control scheme, fixed shape merging
Fixed Cuboid upload

* Fixed slight visual bug when dragging faces

* Some optimizations

* Hiding the grab point on creation
Small refactoring

* Fixed some cases where cuboid breaks

* Fixed upload for videos

* Removed perspective effects

* Made left back edge editable

* left back edge resizable

* fix statistics bug

* added toggles for the back edges

* Constraints for the back edges

* Fix creation bug

* Tightened creation constraints

* Fixing the code style

* updated message for invalid cuboids

* Code style

* More style fixes

* Codacy fixes

* added shift control for edges

* More Codacy fixes

* More Codacy fixes

* Double arrows for cursor

* Fix Drag bug

* More Codacy fixes

* Fix double quotes

* Fix camel case

* More camelcase fixes

* Generic object sink fixes

* Various codacy fixes

* Codacy

* Double quotes

* Fix migrations

* Updated shape creation
Fix jittering

* Adjusted constraints

* Codacy fixes

* Codacy fixes again

* Drawing cuboids from the top and bottom

* Codacy

* Resetting perspective on cuboids

* Choosing orientation of cuboids.

* Codacy fix

* Merge cleanup

* revert vs-code settings

* Update settings.json

Co-authored-by: timbowl <54648082+timbowl@users.noreply.github.com>
Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Jijoong Kim 7f8b96d4e8
Add extreme clicking feature to draw box by 4 points (#1111)
* Add extreme clicking feature to draw box by 4 points

* Add documentation for extreme clicking
6 years ago
Andrey Zhavoronkov e062c2309e
fixed dump of interpolation points object && statistics calculation (#1108) 6 years ago
Andrey Zhavoronkov 7cf755fd38 align serializer max length of attribute value with the model (#1074) 6 years ago
Boris Sekachev 25164fe8b6 Fixed: Uncaught TypeError: Cannot read property 'nodeValue' of undefined (#1068) 6 years ago
Boris Sekachev 43c5fd0088 Changed CharField(64) -> CharField(4096) for attribute value (#1048) 6 years ago
Boris Sekachev 67239b6148 Trim possible attribute values like attribute values setup by a user (#1044) 6 years ago
Boris Sekachev b6d2e45d23 Improved feature: common borders (#1016)
* Auto borders -> common borders, invisible when do not edit or draw, don't reset state

* Reset sticker after clicking outside
6 years ago
zhiltsov-max 4d730c756d Fix timezone bug (#1010) 6 years ago
Boris Sekachev c407874a52 Fixed comparison of shapes (#1000) 6 years ago
Boris Sekachev f7df747cdf Automatic bordering feature during drawing/editing (#997) 6 years ago
Boris Sekachev c7052842a7 Fixed issue: Unknown shape type found (#998) 6 years ago
Boris Sekachev 2e8af445db Resolved performance bottleneck in merge function (#999) 6 years ago