64 Commits (dc589fdd5128818f0dfc6c055a6aa8e02869c90d)

Author SHA1 Message Date
Maria Khrustaleva 6c38ad0701
Manifest (#2763)
* Added support for manifest file
* Added data migration
* Updated tests
* Update CHANGELOG
* Update manifest documentation
* Fix case with 3d data

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Ali Jahani f8ce8c13c0
CLI- Task list improvement (#2863)
* cli - task list now returns list of current tasks

* updated changelog

* fixed formatting
5 years ago
Vitaliy Nishukov 7512fd6883
Reformatted (#2349) 5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Maxim Zhiltsov f138859c1a
Add auto inference of host scheme in CLI (#2240)
* Add auto inference of host scheme in CLI

* update changelog
5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Young 3f6d2e9e4f
add overlap & segment_size flag for python cli task create (#1950)
Thanks you so much
6 years ago
Liron Ilouz 7679434bc2
add https flag to python cli (#1942)
* add https flag to python cli

* update changelog

Co-authored-by: Liron Ilouz <liron@tapwithus.com>
6 years ago
Eric Grinstein 3fee4cfcab
Functionality to upload annotations on task creation (#1735)
* Upload annotations on task creation

* Bulk upload v1

* Not working

* Annotation upon task creation finished

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Functionality to upload annotations on task creation

* Fix trailing whitespace

* Use status request for checking task completion

* fixed default format name

Co-authored-by: Eric Grinstein <v-ergri@microsoft.com>
Co-authored-by: Andrey Zhavoronkov <andrey.zhavoronkov@intel.com>
Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Andrey Zhavoronkov 3caae98b5b
fixed linter issues and store credentials cookie in the session object (#1526)
* fixed issues

* fixed issues and stored credentials cookies inside the session

* fixed tests
6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
Andrey Zhavoronkov f4ae611392
Remove deprecated utils (#1477)
* removed deprecated convert scripts

* updated changelog
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
Andrey Zhavoronkov fccccabe2b
updated CUDA to version 10 (#1138)
* updated CUDA to version 10

* updated tensorflow

* added comment about NVIDIA_REQUIRE_CUDA env varOF
6 years ago
zhiltsov-max 93b3c091f5 [Datumaro] CLI updates + better documentation (#1057) 6 years ago
Nikita Manovich a5c3da1235
Cleanup Dockerfiles for CVAT (#1060)
* Replaced wget by curl

* Moved CI stuff into Dockerfile.ci

* Use docker-compose to run commnands inside docker (need environment variables)

* Added patool again (to support different archive formats)

* Roll back tensorflow version: 1.15 -> 1.13.1

Fixed https://github.com/opencv/cvat/issues/982
Fixed https://github.com/opencv/cvat/issues/1017

* datumaro install tensorflow 2.x now. It breaks automatic annotation
using TF.

* Follow redirects in curl (auto_segmentation)
6 years ago
Ben Hoff 7e41893a45 pass in model name and task id to run auto annotation script (#934) 6 years ago
Seungwon Jeong ab6303f033 Add test code for cli upload function (#986) 6 years ago
dependabot[bot] 4c72bc3fda Bump tensorflow from 1.12.3 to 1.15.0 in /cvat/requirements (#968)
* Bump tensorflow from 1.12.3 to 1.15.0 in /cvat/requirements

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.12.3 to 1.15.0.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.12.3...v1.15.0)

Signed-off-by: dependabot[bot] <support@github.com>

* Update pip because tensorflow 1.15 cannot not be found.

* Fix a typo (pip -> pip3)

* Replaced pip3 by python3 -m pip.
6 years ago
dependabot[bot] 2ec4b32a59 Bump tensorflow from 1.13.1 to 1.15.0 in /utils/tfrecords (#967)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.13.1 to 1.15.0.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.13.1...v1.15.0)

Signed-off-by: dependabot[bot] <support@github.com>
6 years ago
Ben Hoff 01dd0715e2 added in label visualization to auto annotation runner (#931) 6 years ago
Seungwon Jeong a716355cdc Add upload annotation function to cli (#958)
* add upload annotation function to cli

* Update core.py

Removing whitespace
6 years ago
Nikita Manovich a2a03d2bd5
implemented adas semantic segmentation (#890) 6 years ago
himalayanZephyr 1af9105bb1 Yolov3 interpretration script fix for 'Annotation failed' and changes to mapping.json (#896) (#912) 6 years ago
Ben Hoff 36c3e2c4d9 implemented adas semantic segmentation 6 years ago
a-andre 76c0af2d66 VOC converter: Use depth from CVAT XML if available (#885) 6 years ago
Ben Hoff 73e5327bad Mit license for pixellink and changelog (#862) 6 years ago
Ben Hoff 98e851a21e added in new interp files for pixel link v0004 (#852) 6 years ago
Ben Hoff 51cfab1a9e fix serialize bug when using AutoAnnotation runner (#810) 6 years ago
dependabot[bot] 111626d1c8 Bump pillow from 5.3.0 to 6.2.0 in /utils/cli (#807)
Bumps [pillow](https://github.com/python-pillow/Pillow) from 5.3.0 to 6.2.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/master/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/5.3.0...6.2.0)

Signed-off-by: dependabot[bot] <support@github.com>
6 years ago
Ben Hoff 310e208229 Fix Yolo: swap width, height; Change box coord order; parsing fix (#802) 6 years ago
Ben Hoff 6df3f5397e fix off by one error in mask rcnn (#801) 6 years ago
Ben Hoff a0f083d274 added in yolo auto annotation sciprt (#794) 6 years ago
Ben Hoff a435b410ed added mask RCNN script (#780) 6 years ago
Ben Hoff e9e52f35cb add in serializing check in auto annotation model runner (#770) 6 years ago
Boris Sekachev 695fc37924 User interface with react and antd (#755)
* Login page, router
* Registration
* Tasks view
6 years ago
Ben Hoff a18fb6d6ec add robust JSON handeling for auto annotation runner (#758) 6 years ago
telenachos a18e83bafe Updating string format for case missed in PR #746. (#757) 6 years ago
Nikita Manovich 73bab7bea6
Slightly enhance command line interface feature (#746)
* Slightly enhance command line interface feature.
Added README.md, run tests using travis, run CLI tests from VS code.
* Removed formatted string due to a limitation on our python version inside the container.
* Add information about command line interface to the main page.
6 years ago
telenachos db19cbfe4b New command line tool for working with tasks (#732)
* Adding new command line tool for performing common task related
operations (create, list, delete, etc.)
* Replaced @exception decorator with try/except in main()
* Replaced optional --name with positional name and removed default
* Added license text to files
* Added django units to cover future API changes
* Refactored into submodules to better support tests
6 years ago
Andrey Zhavoronkov 553731ed70 fixed label order (#669) 7 years ago
Ben Hoff 97ed2aaa28 Separate inference method in order to break django dependency (#650) 7 years ago
Ben Hoff 1334efaaf6 added in ability to visually see auto_annotation command line runner (#647) 7 years ago
mfurkancoskun a2f1824c0d TypeError Fix (#596)
Fixed: TypeError while using XML to YOLO converter #595
7 years ago
JADG14 e0b666ea9d Upgrade Numpy to avoid Arbitrary Code Execution. Upgrade Django to avoid MitM (#575) 7 years ago
Ben Hoff 6e1e063c04 added in command line auto annotation runner (#563) 7 years ago
Dustin Dorroh 5104cc08c1 Fixed '=' to '==' for numpy in requirments (#556) 7 years ago
Nikita Manovich bbdf014442
Fix mask/converter.py to show correctly background color. (#547) 7 years ago
Ben Hoff 08d7d8c130 Fixed Pixel Link interp file API issues (#544) 7 years ago