87 Commits (2de4724978d904101d99d2e889a0bd3f4f5b0a70)

Author SHA1 Message Date
Andrey Zhavoronkov 6e49f1b36b
fix (#3859) 4 years ago
Maria Khrustaleva b657113b99
Fix iterating over manifest (#3792)
* Fix

* Update CHANGELOG

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Maria Khrustaleva 0faba29b71
Fix manifest removing (#3791) 4 years ago
Maria Khrustaleva 5b890b1785
Manifest optimization (#3712) 4 years ago
Timur Osmanov ced1bc8cb3
Documentation update, added info about the cloud storage UI and add AWS-S3 tutorial (#3745)
* added info about cloud storage ui

* fixed linter errors, improved list spacing

* fixed linter errors v2

* fixed mistakes & indentation

* Apply suggestions from code review

Co-authored-by: Timur Osmanov <54434686+TOsmanov@users.noreply.github.com>

* fixed errors & indentation issues

* fixed errors & indentation issues v2

* fix mistakes in attach-cloud-storage.md

* apply suggestions v2

* add aws-s3 tutorial

* fix linter errors

* update attach-cloud-storage.md

* fix mistakes

* update attach-cloud-storage.md

* update image

* fix link

* update attach cloud storage section

* fix markup

* fix mistake

* fix mistake

* update the example manifest

* apply suggestions

Co-authored-by: Motov <alexeyx.motov@intel.com>
Co-authored-by: amotovx <87861362+amotovx@users.noreply.github.com>
4 years ago
Maria Khrustaleva 9551fea4cc
Display more user understandable exception message (#3721)
* fix

* Update CHANGELOG

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Jan Hünnemeyer d91ba56622
Fix incorrect comparison (#3674)
* Fix incorrect comparison
* Add changelog entry
4 years ago
Maria Khrustaleva fa15f78802
Extension of cloud storage server part (#3386)
* Add preview && some fixes

* Fix case with sub dirs on cloud storage

* Move server part from ui_support_cloud_storage && fix missing id field

* Add support_key_secret_key_pair

* Fix several moments

* Add index resetting

* Fix pylint errors

* Remove excess migration

* tmp

* Some fixes

* Fixes

* fix

* [server] Add cloud storage status && fixes

* Remove unused import

* Add manifest set_index method

* Implement status support for Azure blob container

* Move specific attributes parsing into utils

* Fix missing in migration

* Fix error display

* some fix

* Update migration dependency

* Update google cloud storage status

* Update migrtaions

* Update CHANGELOG
5 years ago
Chris 589dc91d2d
Add arguments to cli to allow disabling of copying image data from share mount (#3544) 5 years ago
Dmitry Kalinin 472d53596e
Fixed task creating CLI parameter (#3519)
* Fixed CLI parameter

* Adjusted docs

* Added CHANGELOG
5 years ago
Timur Osmanov 7cf6c7a08e
Update documentation sorting (#3320)
* update documentation sorting

* update README.md and documentation

* fix linter errors

* update name sections

* fix links

* fix linter errors

* update developing section

* fix link and mistake

* rename developing and contributing section

* fix incorrect links

* fix link on cvat.jpg

* Update site/content/en/docs/_index.md

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich b18482b42c
Support cloud storage on server (#3326)
Co-authored-by: Maya <maya17grd@gmail.com>
5 years ago
Andrey Zhavoronkov 72fdef4335
Az/import export tasks (#3056)
* initial version of task export/import feature

* fixed tests

* CLI

* fix comments

* updated license headers

* fix eslint issues

* fix comments

* fixed comments

* reverted changes in *.md files

* fixed comments

* fix pylint issues

* fix import for share case

* improved unit tests

* updated changelog

* fixed Maria's comments

* fixed comments

* Fixed position of create new task button

* Fixed span position

* fixed comments

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
5 years ago
Diego Cesar 3f8bc9db3d
fix json output of CLI command ls (#3298)
Co-authored-by: Diego Cesar <dcesar@krakenrobotik.de>
5 years ago
André Aquilina 140489dccc
Fix cli create git fail (#3267)
* Fix issue of infinite loop due to incorrect status comparison.

* Update CHANGELOG.md

* Fix PEP8.

* Update failure case to break from infinite loop.

* Update utils/cli/core/core.py

Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>

* Add check for unknown failure.

* Fix logging in failure case.

* Update CHANGELOG.md

Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
Co-authored-by: André Aquilina <andre.aquilina@dysismedical.com>
5 years ago
qztseng 11d967d208
add cli kwargs for image_quality and frame_step when creating task (#3176)
* add cli kwargs for image_quality and frame_step when creating task

* add **kwargs to the tasks_data function call

* add the corresponding options into argument parser

* Update core.py

update license header

* update license header

* fix definition.py help text
5 years ago
Timur Osmanov 9615436ecc
Website with documentation (#3039) 5 years ago
Boris Sekachev e0f10d7b7f
Support of context images for 2D tasks (Missed commits) (#3213)
* Fixed bug with not filtering file itself in some 3D cases

* Added else branch to avoid dublication context images in some cases
5 years ago
Boris Sekachev 6f52ef30e4
Support of context images for 2D tasks (#3122) 5 years ago
Maria Khrustaleva e7cca0ec64
Manifest fixes (#3146)
* Add logger, reverse func
* Fix image filtering
* Fix upload video manifest

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Adam Harvey d9f1798684
add --project_id argument for create task (#3090) 5 years ago
Boris Sekachev f267f8aed3
Added DICOM conversion script (#3095)
* Added DICOM conversion script

* Updated changelog

* Fixed strip to rstrip

* Fixed some detected issues

* Removed extra variable, updated README.md
5 years ago
André Aquilina 61e112e2f2
Add dataset URI to Task from CLI (#2983)
* Add option to include git repository for annotation synchronisation.

* Add arge parser for git dataset repository in task create.

* Update changelog.

* Add API for git.

* Add verification procedure for dataset repository creation.

Co-authored-by: André Aquilina <andre.aquilina@dysismedical.com>
5 years ago
Maria Khrustaleva 6c38ad0701
Manifest (#2763)
* Added support for manifest file
* Added data migration
* Updated tests
* Update CHANGELOG
* Update manifest documentation
* Fix case with 3d data

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Ali Jahani f8ce8c13c0
CLI- Task list improvement (#2863)
* cli - task list now returns list of current tasks

* updated changelog

* fixed formatting
5 years ago
Vitaliy Nishukov 7512fd6883
Reformatted (#2349) 5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Maxim Zhiltsov f138859c1a
Add auto inference of host scheme in CLI (#2240)
* Add auto inference of host scheme in CLI

* update changelog
5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Young 3f6d2e9e4f
add overlap & segment_size flag for python cli task create (#1950)
Thanks you so much
6 years ago
Liron Ilouz 7679434bc2
add https flag to python cli (#1942)
* add https flag to python cli

* update changelog

Co-authored-by: Liron Ilouz <liron@tapwithus.com>
6 years ago
Eric Grinstein 3fee4cfcab
Functionality to upload annotations on task creation (#1735)
* Upload annotations on task creation

* Bulk upload v1

* Not working

* Annotation upon task creation finished

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Fix trailing whitespace

* Use status request for checking task completion

* fixed default format name

Co-authored-by: Eric Grinstein <v-ergri@microsoft.com>
Co-authored-by: Andrey Zhavoronkov <andrey.zhavoronkov@intel.com>
Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Andrey Zhavoronkov 3caae98b5b
fixed linter issues and store credentials cookie in the session object (#1526)
* fixed issues

* fixed issues and stored credentials cookies inside the session

* fixed tests
6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
Andrey Zhavoronkov f4ae611392
Remove deprecated utils (#1477)
* removed deprecated convert scripts

* updated changelog
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
Andrey Zhavoronkov fccccabe2b
updated CUDA to version 10 (#1138)
* updated CUDA to version 10

* updated tensorflow

* added comment about NVIDIA_REQUIRE_CUDA env varOF
6 years ago
zhiltsov-max 93b3c091f5 [Datumaro] CLI updates + better documentation (#1057) 6 years ago
Nikita Manovich a5c3da1235
Cleanup Dockerfiles for CVAT (#1060)
* Replaced wget by curl

* Moved CI stuff into Dockerfile.ci

* Use docker-compose to run commnands inside docker (need environment variables)

* Added patool again (to support different archive formats)

* Roll back tensorflow version: 1.15 -> 1.13.1

Fixed https://github.com/opencv/cvat/issues/982
Fixed https://github.com/opencv/cvat/issues/1017

* datumaro install tensorflow 2.x now. It breaks automatic annotation
using TF.

* Follow redirects in curl (auto_segmentation)
6 years ago
Ben Hoff 7e41893a45 pass in model name and task id to run auto annotation script (#934) 6 years ago
Seungwon Jeong ab6303f033 Add test code for cli upload function (#986) 6 years ago
dependabot[bot] 4c72bc3fda Bump tensorflow from 1.12.3 to 1.15.0 in /cvat/requirements (#968)
* Bump tensorflow from 1.12.3 to 1.15.0 in /cvat/requirements

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.12.3 to 1.15.0.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.12.3...v1.15.0)

Signed-off-by: dependabot[bot] <support@github.com>

* Update pip because tensorflow 1.15 cannot not be found.

* Fix a typo (pip -> pip3)

* Replaced pip3 by python3 -m pip.
6 years ago
dependabot[bot] 2ec4b32a59 Bump tensorflow from 1.13.1 to 1.15.0 in /utils/tfrecords (#967)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.13.1 to 1.15.0.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.13.1...v1.15.0)

Signed-off-by: dependabot[bot] <support@github.com>
6 years ago
Ben Hoff 01dd0715e2 added in label visualization to auto annotation runner (#931) 6 years ago
Seungwon Jeong a716355cdc Add upload annotation function to cli (#958)
* add upload annotation function to cli

* Update core.py

Removing whitespace
6 years ago
Nikita Manovich a2a03d2bd5
implemented adas semantic segmentation (#890) 6 years ago
himalayanZephyr 1af9105bb1 Yolov3 interpretration script fix for 'Annotation failed' and changes to mapping.json (#896) (#912) 6 years ago
Ben Hoff 36c3e2c4d9 implemented adas semantic segmentation 6 years ago
a-andre 76c0af2d66 VOC converter: Use depth from CVAT XML if available (#885) 6 years ago