73 Commits (1a86efe65e5fbb4ea8e2455b9374eeff1520711d)

Author SHA1 Message Date
Maria Khrustaleva 1a86efe65e
Fixes cloud storage (#3336)
* Fixes:
- exception with getting content when specific_attributes=''
- no deletion of temporary index for  temporary manifest

* Fix getting owner structure instead of id

* Delete :=

* Fix creating task with cloud storage: preview && nonexistent field

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Boris Sekachev a17b82390f
Fixed django exception when get data for unknown task (#3344)
* Fixed django exception when get data for unknown task

* Remove redundant code

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich b18482b42c
Support cloud storage on server (#3326)
Co-authored-by: Maya <maya17grd@gmail.com>
5 years ago
Andrey Zhavoronkov 43967d4bdf
Fix meta request performance (#3269)
* improved performance of data/meta request

* updated license

* updated changelog

* fix

* fixed tests
5 years ago
Andrey Zhavoronkov 72fdef4335
Az/import export tasks (#3056)
* initial version of task export/import feature

* fixed tests

* CLI

* fix comments

* updated license headers

* fix eslint issues

* fix comments

* fixed comments

* reverted changes in *.md files

* fixed comments

* fix pylint issues

* fix import for share case

* improved unit tests

* updated changelog

* fixed Maria's comments

* fixed comments

* Fixed position of create new task button

* Fixed span position

* fixed comments

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
5 years ago
Jijoong Kim 573bdbe32c
Add is_active field in UserFilter (#3235)
* Add is_active field in UserFilter

* Update changelog

* Add is_active as a default searchParam to get user list

* Fix url search query

* Update CHANGELOG.md

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Boris Sekachev 6f52ef30e4
Support of context images for 2D tasks (#3122) 5 years ago
Dmitry Agapov d2a1d12fba
Integration with an internal training server (#2785)
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Dmitry Kalinin 7f214c92e8
Added description for some params (#3007) 5 years ago
Maxim Zhiltsov 2c5188f5b6
Add label check on import (#2935)
* Add label check on import

* include annotation type

* update changelog

* Make the message prettier
5 years ago
Dmitry Kalinin e43707d779
Project task subsets (#2774)
* Added task project subsets

* Added components list key

* Added subset field resetting and subset header

* Added CHANGELOG and increased npm package version

* Added replacing camelcase to snake
5 years ago
manasars 5c67846c20
CVAT-3D Milestone2 (#2645)
* CVAT-3D Updated the Mime Types with Bin Support, added dependency of open3D

* CVAT-3D Added additional column as Dimension for engine_task table and created a relatedfiles table for PCD to Image mapping.

* Added Support for 3D file Upload in BIN and PCD.

* Added Dimension attribute defaulting to 2D for importer and exporter.

* Added props passing for dimension attribute, filtering of import, Migration Scripts and Dimension attribute for MpegChunk Writers

* Modified code as per review comments

* Updated Unit test cases for 3D task creation

* Refactored Dimension Enum in UI and backend code

* Resolving conflicts

* Updated Unit Test Case

* Refactored TaskDimension to DimensionType, Simplified usage of Dimension accross classes

* Removing manually created test files

* Removing old pcd mime-type mapping

* Added test files generated by synthetic data using open3d

* Merged with develop branch latest changes

* Added libraries required for open3d

* Added files

* Added synthethic pcd,bin and img test files

* Modified test file name

* Trigger travis ci

* Modified test case to ignore 3D preview images

* Trigger notification

* Deleting DS Store files

* Modified test cases as per review comments

* Checking pre-commit hook

* Fixed Lint issues - precommit hook verification

* Added changes for CVAT-3D Milestone2 changes - Frame Navigation, photo context hide and show

* Modified changes

* Added canvas3D for 3D Perspective

* Added missing files

* Added code to get image context for 3D view

* Codacy check for stylesheet

* Modified frame navigantion for 3D View

* Modified style for context-image

* Trigger notification

* Added Support for 3D file Upload in BIN and PCD.

* Added props passing for dimension attribute, filtering of import, Migration Scripts and Dimension attribute for MpegChunk Writers

* Modified code as per review comments

* Refactored Dimension Enum in UI and backend code

* Merged with develop branch latest changes

* Added files

* Added changes for CVAT-3D Milestone2 changes - Frame Navigation, photo context hide and show

* Modified changes

* Added canvas3D for 3D Perspective

* Added missing files

* Added code to get image context for 3D view

* Codacy check for stylesheet

* Modified frame navigantion for 3D View

* Modified style for context-image

* Changed cvat-data lint issues

* Modified to use opencv as per review comments

* Removed unwanted imports

* Fixed css and added usage of hooks

* Merged Develop branch code

* Removed unused data structures

* Removed unused data structures

* Refactored unused data structures

* Added three js dependency in cvat ui package-lock.json

* Merged develop branch code and refactored code

* Fixed snyk issue

* Modified Camera Icon in photo-context

* Update icons.tsx

* Remove unused svg file

* Modified changelog file

Co-authored-by: cdp <cdp123>
5 years ago
manasars 069fadc053
CVAT-3D: support lidar data on the server side (#2534)
* CVAT-3D Updated the Mime Types with Bin Support, added dependency of open3D
* CVAT-3D Added additional column as Dimension for engine_task table and created a relatedfiles table for PCD to Image mapping.
* Added Support for 3D file Upload in BIN and PCD.
* Added Dimension attribute defaulting to 2D for importer and exporter.
* Added props passing for dimension attribute, filtering of import, Migration Scripts and Dimension attribute for MpegChunk Writers

Co-authored-by: cdp <cdp123>
5 years ago
Boris Sekachev fcc15ced82 Merged develop 5 years ago
Boris Sekachev f2fb053bb6
Simple Review Pipeline (Server) (#2338) 5 years ago
Maya d52d5baab4 Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Andrey Zhavoronkov b40863f1a3 updated changelog 5 years ago
Andrey Zhavoronkov 3e336237ab fixed getTaskPreview exception handling, slightly improved the backend exception handling 5 years ago
Maya c1da108f6c Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Maya ddf22686f6 Fix: server returns a response with 404 code 5 years ago
Dmitry Kalinin 879deb5a52
Projects (#2255)
Initial implementation of Projects feature to group similar tasks into one group (aka Dataset UI in the future).
5 years ago
Maya d2e186a647 Renaming 5 years ago
Maya fb8f5fffcb fix 5 years ago
Maya a1b32b406d temp 5 years ago
Dmitry Kalinin 9e584b4191 Added user search filed for assignee 5 years ago
Andrey Zhavoronkov 2dcb9056e0
reduced the preparation time of the user list on the backend (#2334) 5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Dmitry Agapov f2c84a2653
Nuclio as a plugin in CVAT, improved system to check installed plugins (#2192)
* allow to run cvat without nuclio

* fix new line

* fix comments

* Updated core version

* refactoring

* minor refactoring, fixed eslint issues, added documentation to cvat-core, updated ui version, updated changelog

* move plugins to serverViewSet

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Maya fb383c71e2 Deleted unnecessary 6 years ago
Maya 2144c4aadd Refactoring 6 years ago
Maya 3236546907 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Maya f3630aa4b5 Some additions:
* moved cache implementation
 * fixed start, stop, step for tasks that created on the fly
 * changed frame provider
6 years ago
Maya e947a8252c Added ability to select using cache or no in task creating form & some fixes 6 years ago
Maya 5fa50be1fa Added most of video processing & cache implementation 6 years ago
Nikita Manovich 634ca17958
Remove old UI (#1964)
* Removed outdated code

* Revert changes in .gitignore

* Fix docker build

* Remove karma + some dummy code

* Fix a type in Dockerfile.ci

* Fix swagger and remove dispatch_request.

* Update CHANGELOG.md
6 years ago
Andrey Zhavoronkov 0d0749f4ec
fixed swagger API documentation for POST /tasks/{id}/data endpoint (#1963) 6 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Andrey Zhavoronkov b706546435
Added clamav integration (#1712)
* added clamav integration

* updated license headers and changelog
6 years ago
zhiltsov-max da3fa34ce0
Add tf import checks and tests (#1567)
* Add tf import checks and tests

* implement disabled formats on server

* python 3.5 compatibility

* add checks to dm tests

* fix tests

* Support for disabled formats in UI

* add sorting for formats, mark grey disabled items

* update changelog

* advance package versions
6 years ago
Andrey Zhavoronkov 380be58edc
Ability to configure user agreements for the register user form (#1464) 6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
Andrey Zhavoronkov e87ec38476
Small preview and progress (#1331)
* Reduce preview size (untested)

* Fix tests

* Improve media readers (untested)

* fixed migration

* fixed frame provider

* fixed preview save

* fixed stop frame

* handle duration == None

* codacy

* added missed import

* unified iteration over frames for media readers and fixed corner case when user specify stop_frame = 0

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
zhiltsov-max 4d730c756d Fix timezone bug (#1010) 6 years ago
zhiltsov-max 7c9043974b [Datumaro] Fix TFrecord converter constructor (#993) 6 years ago
Nikita Manovich 8edfe0dcb4
Swagger documentation (#978)
* Fix swagger problems (exceptions, /api/swagger.json, /api/docs/)
6 years ago
Maya 4587afe09a Added documentation for swagger page (#936) 6 years ago
Boris Sekachev 72517557d3 Fixed some issues with dump (#904)
* Changed method for downloading annotations

* Initial commit

* Initial commit

* Updated download method for dataset

* fixed eslint error
6 years ago
Boris Sekachev 171a9202ed React & Antd: Dashboard migration (#892)
* Removed old dashboard
* Getting all users
* Updated changelog
* Reimplemented login decorator
* Implicit host, scheme in docker-compose
* Fixed issue with pagination
* Implicit page size parameter for tasks
* Fixed linkedin icon, added links to tasks in notifications
* Configurable method for check plugin
6 years ago
zhiltsov-max 0bab60b7a0 Add cvat cli to datumaro project export (#870) 6 years ago