107 Commits (388237720a5a10f173e5dc6c52d9be830f73d9a8)

Author SHA1 Message Date
Maxim Zhiltsov fd4a1307b5
CLI package (#59) 4 years ago
Maxim Zhiltsov 3e230126ab
Update pylint config (#63) 4 years ago
Maxim Zhiltsov b50b275e0b
Add progressbar to task import and create in CLI (#51) 4 years ago
Maxim Zhiltsov dfa71badb5
Add progressbar to cli (#46) 4 years ago
Maxim Zhiltsov 2fda97cd5d
Improve logging shutdown (#40)
* Add proper logger resources release
* Track opened loggers
4 years ago
Dmitry Kalinin d22b12df6e
EXIF orientation support (#4529)
Co-authored-by: Andrey Zhavoronkov <andrey.zhavoronkov@intel.com>
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
Co-authored-by: Maria Khrustaleva <maya17grd@gmail.com>
4 years ago
dependabot[bot] c3608526c7
Bump pillow from 9.0.0 to 9.0.1 in /utils/dicom_converter (#4446)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.0.0 to 9.0.1.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/9.0.0...9.0.1)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 years ago
dependabot[bot] 09e90845bd
Bump pillow from 9.0.0 to 9.0.1 in /utils/dataset_manifest (#4447)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.0.0 to 9.0.1.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/9.0.0...9.0.1)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 years ago
Kirill Lakhov 1fa2676a56
Tus for task annotations import (#4327)
* add data_type to tus mixin

* added tus for task annotations import

* added tus for jobs annotations import

* applied comments

* fix test

* fix incorrect upload endpoint

* add location creation based on origin

* remove unused import

* remove data_type

* remove unused comment

* update changelog to new release

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Nikita Manovich ca98857d57 Changed the version and updated CHANGELOG 4 years ago
Maria Khrustaleva 83126c7b5a
API versioning using accept header (#4239) 4 years ago
dependabot[bot] 4cdd21b171
Bump numpy from 1.20.2 to 1.21.0 in /utils/dicom_converter (#4243)
Bumps [numpy](https://github.com/numpy/numpy) from 1.20.2 to 1.21.0.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst.txt)
- [Commits](https://github.com/numpy/numpy/compare/v1.20.2...v1.21.0)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
dependabot[bot] 5dc99ae9eb
Bump pillow from 7.2.0 to 9.0.0 in /utils/dataset_manifest (#4242)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 7.2.0 to 9.0.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/7.2.0...9.0.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 years ago
dependabot[bot] 631a32fab4
Bump pillow from 8.2.0 to 9.0.0 in /utils/dicom_converter (#4241)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 8.2.0 to 9.0.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/8.2.0...9.0.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
4 years ago
Timur Osmanov 129584b99e
Update documentation. Update CLI section (#4056) 4 years ago
Maria Khrustaleva c7fcd3ac1a
Fixed bug: Error in Create project from backup for Standard 3D Annotation (#4160) 4 years ago
AetherBreeze c83d17007b
Add several flags to task_create CLI (#4119)
* Add serveral flags to CLI & generalize CLI code

definition.py:
	- Add use_zip_chunks, start_frame, stop_frame, and chunk_size
	  as CLI flags
	- Rename --bug to --bug_tracker to be consistent with website
	  and API
	- No longer include optional kwargs in all requests
core.py:
	- Add a single loop to handle all kwargs for extensibility
	- Lump optional task_create args into kwargs for brevity

* Add --bug as alias for --bug_tracker

- Add back old --bug flag for backwards compatability

* Update licence header

Update licence header for core.py

* Remove redundant parameter assignment

- Remove hardcoded `image_quality` default value, as this is already
  handled by the argparse default value.

* CHANGELOG entry for new CLI flags

* CLI linting fixes

- Several linting fixes for CLI

* Fix CLI test

- Re-add default image_quality in case task_create is called manually

* Resolve changelog merge conflict

* Update CHANGELOG.md

Co-authored-by: Andrey Zhavoronkov <andrey.zhavoronkov@intel.com>
4 years ago
Maria Khrustaleva 5281e7938c
Support any name for a manifest (#4041)
* Initial version

* Fix support 2 versions && fix case for cloud storages

* Fix eslint errors

* tmp

* Fix manifest validation when data hasn't been copied yet

* fix

* Update changelog
4 years ago
Andrey Zhavoronkov 32d9fb09be
Project backups (#3852) 4 years ago
Maria Khrustaleva 68fbcdec43
Added sorting methods (#3937) 4 years ago
Andrey Zhavoronkov 6e49f1b36b
fix (#3859) 4 years ago
Maria Khrustaleva b657113b99
Fix iterating over manifest (#3792)
* Fix

* Update CHANGELOG

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Maria Khrustaleva 0faba29b71
Fix manifest removing (#3791) 4 years ago
Maria Khrustaleva 5b890b1785
Manifest optimization (#3712) 4 years ago
Timur Osmanov ced1bc8cb3
Documentation update, added info about the cloud storage UI and add AWS-S3 tutorial (#3745)
* added info about cloud storage ui

* fixed linter errors, improved list spacing

* fixed linter errors v2

* fixed mistakes & indentation

* Apply suggestions from code review

Co-authored-by: Timur Osmanov <54434686+TOsmanov@users.noreply.github.com>

* fixed errors & indentation issues

* fixed errors & indentation issues v2

* fix mistakes in attach-cloud-storage.md

* apply suggestions v2

* add aws-s3 tutorial

* fix linter errors

* update attach-cloud-storage.md

* fix mistakes

* update attach-cloud-storage.md

* update image

* fix link

* update attach cloud storage section

* fix markup

* fix mistake

* fix mistake

* update the example manifest

* apply suggestions

Co-authored-by: Motov <alexeyx.motov@intel.com>
Co-authored-by: amotovx <87861362+amotovx@users.noreply.github.com>
4 years ago
Maria Khrustaleva 9551fea4cc
Display more user understandable exception message (#3721)
* fix

* Update CHANGELOG

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Jan Hünnemeyer d91ba56622
Fix incorrect comparison (#3674)
* Fix incorrect comparison
* Add changelog entry
4 years ago
Maria Khrustaleva fa15f78802
Extension of cloud storage server part (#3386)
* Add preview && some fixes

* Fix case with sub dirs on cloud storage

* Move server part from ui_support_cloud_storage && fix missing id field

* Add support_key_secret_key_pair

* Fix several moments

* Add index resetting

* Fix pylint errors

* Remove excess migration

* tmp

* Some fixes

* Fixes

* fix

* [server] Add cloud storage status && fixes

* Remove unused import

* Add manifest set_index method

* Implement status support for Azure blob container

* Move specific attributes parsing into utils

* Fix missing in migration

* Fix error display

* some fix

* Update migration dependency

* Update google cloud storage status

* Update migrtaions

* Update CHANGELOG
5 years ago
Chris 589dc91d2d
Add arguments to cli to allow disabling of copying image data from share mount (#3544) 5 years ago
Dmitry Kalinin 472d53596e
Fixed task creating CLI parameter (#3519)
* Fixed CLI parameter

* Adjusted docs

* Added CHANGELOG
5 years ago
Timur Osmanov 7cf6c7a08e
Update documentation sorting (#3320)
* update documentation sorting

* update README.md and documentation

* fix linter errors

* update name sections

* fix links

* fix linter errors

* update developing section

* fix link and mistake

* rename developing and contributing section

* fix incorrect links

* fix link on cvat.jpg

* Update site/content/en/docs/_index.md

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich b18482b42c
Support cloud storage on server (#3326)
Co-authored-by: Maya <maya17grd@gmail.com>
5 years ago
Andrey Zhavoronkov 72fdef4335
Az/import export tasks (#3056)
* initial version of task export/import feature

* fixed tests

* CLI

* fix comments

* updated license headers

* fix eslint issues

* fix comments

* fixed comments

* reverted changes in *.md files

* fixed comments

* fix pylint issues

* fix import for share case

* improved unit tests

* updated changelog

* fixed Maria's comments

* fixed comments

* Fixed position of create new task button

* Fixed span position

* fixed comments

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
5 years ago
Diego Cesar 3f8bc9db3d
fix json output of CLI command ls (#3298)
Co-authored-by: Diego Cesar <dcesar@krakenrobotik.de>
5 years ago
André Aquilina 140489dccc
Fix cli create git fail (#3267)
* Fix issue of infinite loop due to incorrect status comparison.

* Update CHANGELOG.md

* Fix PEP8.

* Update failure case to break from infinite loop.

* Update utils/cli/core/core.py

Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>

* Add check for unknown failure.

* Fix logging in failure case.

* Update CHANGELOG.md

Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
Co-authored-by: André Aquilina <andre.aquilina@dysismedical.com>
5 years ago
qztseng 11d967d208
add cli kwargs for image_quality and frame_step when creating task (#3176)
* add cli kwargs for image_quality and frame_step when creating task

* add **kwargs to the tasks_data function call

* add the corresponding options into argument parser

* Update core.py

update license header

* update license header

* fix definition.py help text
5 years ago
Timur Osmanov 9615436ecc
Website with documentation (#3039) 5 years ago
Boris Sekachev e0f10d7b7f
Support of context images for 2D tasks (Missed commits) (#3213)
* Fixed bug with not filtering file itself in some 3D cases

* Added else branch to avoid dublication context images in some cases
5 years ago
Boris Sekachev 6f52ef30e4
Support of context images for 2D tasks (#3122) 5 years ago
Maria Khrustaleva e7cca0ec64
Manifest fixes (#3146)
* Add logger, reverse func
* Fix image filtering
* Fix upload video manifest

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Adam Harvey d9f1798684
add --project_id argument for create task (#3090) 5 years ago
Boris Sekachev f267f8aed3
Added DICOM conversion script (#3095)
* Added DICOM conversion script

* Updated changelog

* Fixed strip to rstrip

* Fixed some detected issues

* Removed extra variable, updated README.md
5 years ago
André Aquilina 61e112e2f2
Add dataset URI to Task from CLI (#2983)
* Add option to include git repository for annotation synchronisation.

* Add arge parser for git dataset repository in task create.

* Update changelog.

* Add API for git.

* Add verification procedure for dataset repository creation.

Co-authored-by: André Aquilina <andre.aquilina@dysismedical.com>
5 years ago
Maria Khrustaleva 6c38ad0701
Manifest (#2763)
* Added support for manifest file
* Added data migration
* Updated tests
* Update CHANGELOG
* Update manifest documentation
* Fix case with 3d data

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Ali Jahani f8ce8c13c0
CLI- Task list improvement (#2863)
* cli - task list now returns list of current tasks

* updated changelog

* fixed formatting
5 years ago
Vitaliy Nishukov 7512fd6883
Reformatted (#2349) 5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Maxim Zhiltsov f138859c1a
Add auto inference of host scheme in CLI (#2240)
* Add auto inference of host scheme in CLI

* update changelog
5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago