63 Commits (54c15830a9c52de54f636fc8e22eafb65ce9f0a9)

Author SHA1 Message Date
Maria Khrustaleva 54c15830a9
Add support for source & target storages (#28) 4 years ago
Boris Sekachev f960da9117
Added ability to delete frames (#10)
Co-authored-by: Dmitry Kalinin <dmitry.kalinin@intel.com>
Co-authored-by: Nikita Manovich <nikita.manovich@gmail.com>
Co-authored-by: Boris Sekachev <b.sekachev@yandex.ru>
4 years ago
Maria Khrustaleva 2a05316496
Add REST API GET, POST, PATCH tests for cloud storage (#4353)
Co-authored-by: kirill.sizov <kirill.sizov@intel.com>
4 years ago
Kirill Lakhov bceae228a7
Tus for project dataset (#4485) 4 years ago
Kirill Sizov 6dd73b0576
Improve REST API testing system (#4403) 4 years ago
Kirill Lakhov 1fa2676a56
Tus for task annotations import (#4327)
* add data_type to tus mixin

* added tus for task annotations import

* added tus for jobs annotations import

* applied comments

* fix test

* fix incorrect upload endpoint

* add location creation based on origin

* remove unused import

* remove data_type

* remove unused comment

* update changelog to new release

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Nikita Manovich e8f294f673
REST API /api/jobs/<id>/commits (#4368) 4 years ago
Maria Khrustaleva d098e42c45
Migration to drf_spectacular (#4210) 4 years ago
Nikita Manovich e9ef925b4b
Removed training app (#4330) 4 years ago
Boris Sekachev b85a4ad77c
Added support of ellipses (#4062) 4 years ago
Nikita Manovich 4708b5ecf8
IAM: Open Policy Agent integration (#3788)
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
Co-authored-by: Dmitry Kruchinin <dmitryx.kruchinin@intel.com>
4 years ago
Kirill Lakhov cc057a7a77
Large files uploads (#3692) 4 years ago
Maria Khrustaleva 68fbcdec43
Added sorting methods (#3937) 4 years ago
Maria Khrustaleva f59d1f57f3
Support GCS (#3919)
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
4 years ago
Boris Sekachev 7bab58e1a6
Added rotated bounding boxes (#3832)
Co-authored-by: Maxim Zhiltsov <maxim.zhiltsov@intel.com>
4 years ago
Jaesun Park edb3df0190
Update project updated_time (#3810) (#3814) 4 years ago
Maria Khrustaleva fa15f78802
Extension of cloud storage server part (#3386)
* Add preview && some fixes

* Fix case with sub dirs on cloud storage

* Move server part from ui_support_cloud_storage && fix missing id field

* Add support_key_secret_key_pair

* Fix several moments

* Add index resetting

* Fix pylint errors

* Remove excess migration

* tmp

* Some fixes

* Fixes

* fix

* [server] Add cloud storage status && fixes

* Remove unused import

* Add manifest set_index method

* Implement status support for Azure blob container

* Move specific attributes parsing into utils

* Fix missing in migration

* Fix error display

* some fix

* Update migration dependency

* Update google cloud storage status

* Update migrtaions

* Update CHANGELOG
5 years ago
Jason Wu 6a29b344c7
Support of Google Cloud Storage for cloud storage (#3561)
* Support Google Cloud Storage for cloud provider

Implement GoogleCloudStorage and add KEY_FILE_PATH to
CredentialsTypeChoice, and key_file_path in Credentials

* Handle cloud storage key contains path seperator

* Update changelog

* Add the migration file for engine_cloud_provider table
5 years ago
MashaSS 0c524c6d14
Update to Django 3.1.12. (#3378)
* Update to Django 3.1.12.

* Update changelog and add comment.
5 years ago
Maria Khrustaleva 1a86efe65e
Fixes cloud storage (#3336)
* Fixes:
- exception with getting content when specific_attributes=''
- no deletion of temporary index for  temporary manifest

* Fix getting owner structure instead of id

* Delete :=

* Fix creating task with cloud storage: preview && nonexistent field

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich b18482b42c
Support cloud storage on server (#3326)
Co-authored-by: Maya <maya17grd@gmail.com>
5 years ago
Dmitry Agapov d2a1d12fba
Integration with an internal training server (#2785)
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Maria Khrustaleva 6c38ad0701
Manifest (#2763)
* Added support for manifest file
* Added data migration
* Updated tests
* Update CHANGELOG
* Update manifest documentation
* Fix case with 3d data

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Dmitry Kalinin e43707d779
Project task subsets (#2774)
* Added task project subsets

* Added components list key

* Added subset field resetting and subset header

* Added CHANGELOG and increased npm package version

* Added replacing camelcase to snake
5 years ago
manasars 069fadc053
CVAT-3D: support lidar data on the server side (#2534)
* CVAT-3D Updated the Mime Types with Bin Support, added dependency of open3D
* CVAT-3D Added additional column as Dimension for engine_task table and created a relatedfiles table for PCD to Image mapping.
* Added Support for 3D file Upload in BIN and PCD.
* Added Dimension attribute defaulting to 2D for importer and exporter.
* Added props passing for dimension attribute, filtering of import, Migration Scripts and Dimension attribute for MpegChunk Writers

Co-authored-by: cdp <cdp123>
5 years ago
Boris Sekachev fcc15ced82 Merged develop 5 years ago
Boris Sekachev f2fb053bb6
Simple Review Pipeline (Server) (#2338) 5 years ago
Maya c1da108f6c Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Dmitry Kalinin 879deb5a52
Projects (#2255)
Initial implementation of Projects feature to group similar tasks into one group (aka Dataset UI in the future).
5 years ago
Maya d2e186a647 Renaming 5 years ago
Maya b97a6cda10 Added location of uploaded data 5 years ago
Vitaliy Nishukov 00f6486f80
Z-Order flag in creation task process (#2294)
* Z-Order flag in creation task process has been removed
5 years ago
JK-97 2d23911d33
Fix task model updated_date field: auto_now = True (#2233)
* Fix task model updated_date field: auto_now = True

* update migrations file
5 years ago
Maya a46bba2df5 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Dmitry Kalinin bee4c3799f
Label color (#2014)
* added color to django app and cvat-core

* temp

* temp

* Added label color to mask dump

* Fixed UI for label color picker

* npm packages and CHANGELOG

* fixed models and migrations

* Fixed default background color and using normalization

* Added setting label color with hash

* fixed error

* Added close icon to color picker

* Fixed CHANGELOG

* requested changes

* fixed menu visibility

* Fixed label hashing and algorithm

* Added wheel package to CI

* Fixed dockerfile

* moved wheel package from dockerfile to requirements

* fixed requirements

* Fixed requirements

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maya 3236546907 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Maya f3630aa4b5 Some additions:
* moved cache implementation
 * fixed start, stop, step for tasks that created on the fly
 * changed frame provider
6 years ago
Maya e947a8252c Added ability to select using cache or no in task creating form & some fixes 6 years ago
Maya 5fa50be1fa Added most of video processing & cache implementation 6 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Priya4607 6a1e7af5c5
Display of Annotation Type (#1192) 6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
Tritin Truong 0bb92f27c1
Cuboid annotation (#678)
* Cuboid feature

* migration files

* Refactored cuboidShape
Fixed a bug where coloring by label would not update cuboids properly
Fixed a bug where the select points would not scale properly on initialization

* Removed math.js dependency
Implemented custom line intersection function

* new cvat formatting with labelled points

* Added MIT License to js files that were missing it

* Added simple constraints to the cuboids

* reverted commit for settings for vscode to hide local path

* fixed locking for cuboids

* fixed cuboid View when locked

* fixed occlusion view for cuboids

* Allow cuboid points to be outside the frame dimensions.

Signed-off-by: Tritin Truong <truongtritin98@gmail.com>

* Added stricter constraints on cuboid edges.

* Slightly stricter restrictions for edge case

* Cleaned up unused imports

* removed dashed lines on cuboids

* Moved projection lines to settings tab

* Fixed Cuboid shape buffer \

* Fix migrations (two 022 migrations after merge with the develop branch).

* Fix compatibility issues with auto segmentation.

* Grab points and update control scheme

* Greatly improved control scheme, fixed shape merging
Fixed Cuboid upload

* Fixed slight visual bug when dragging faces

* Some optimizations

* Hiding the grab point on creation
Small refactoring

* Fixed some cases where cuboid breaks

* Fixed upload for videos

* Removed perspective effects

* Made left back edge editable

* left back edge resizable

* fix statistics bug

* added toggles for the back edges

* Constraints for the back edges

* Fix creation bug

* Tightened creation constraints

* Fixing the code style

* updated message for invalid cuboids

* Code style

* More style fixes

* Codacy fixes

* added shift control for edges

* More Codacy fixes

* More Codacy fixes

* Double arrows for cursor

* Fix Drag bug

* More Codacy fixes

* Fix double quotes

* Fix camel case

* More camelcase fixes

* Generic object sink fixes

* Various codacy fixes

* Codacy

* Double quotes

* Fix migrations

* Updated shape creation
Fix jittering

* Adjusted constraints

* Codacy fixes

* Codacy fixes again

* Drawing cuboids from the top and bottom

* Codacy

* Resetting perspective on cuboids

* Choosing orientation of cuboids.

* Codacy fix

* Merge cleanup

* revert vs-code settings

* Update settings.json

Co-authored-by: timbowl <54648082+timbowl@users.noreply.github.com>
Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Boris Sekachev 43c5fd0088 Changed CharField(64) -> CharField(4096) for attribute value (#1048) 6 years ago
zhiltsov-max 0f5cf2064d [Datumaro] Added tf detection api tfrecord import and export (#894)
* Added tf detection api tfrecord import and export
* Added export button in dashboard
* Add tf to requirements
* Extend test
* Add tf dependency
* Require images in tfrecord export
* Add video task case handling
* Maintain image order in CVAT export
* Fix Task image id-path conversions
* Update tfrecord tests
* Extend image utilities
* Update tfrecord format
* Fix image loading bug
* Add some logs
* Add 'copy' option to project import command
* Reduce default cache size
6 years ago
zhiltsov-max 74f720a3d2 Add dataset export facility (#813)
* Add datumaro django application
* Add cvat task datumaro bindings
* Add REST api for task export
* Add scheduler service
* Updated CHANGELOG.md
6 years ago
Andrey Zhavoronkov befe5efba0 Fix upload anno for COCO (#788)
* COCO: load bbox as rectangle if segmentation field is empty
* added unit test for coco format (case: object segment field is empty)
6 years ago
Nikita Manovich ff1f6cfc5c
Projects (server only, REST API) (#754)
* Initial version of projects
* Added tests for Projects REST API.
* Added information about projects into CHANGELOG
6 years ago
Boris Sekachev 0c33055311 Different fixes for Release 0.5.0 (#667) 7 years ago
Andrey Zhavoronkov 5733423b13 Az/multiformat downloader (#551) 7 years ago