52 Commits (f7de2a2858111d37b682b05e4686b7444a10bdec)

Author SHA1 Message Date
Andrey Zhavoronkov 796a8d3f54
fixed cvat startup process (#2293)
* fixed cvat startup process

* updated readme

* updated license header

* updated CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Andrey Zhavoronkov a222741f6b
Rename git app (#2243)
* renamed application git -> git_manager

* removed _GitImportFix class

* fixed cli tests

* git_manager -> dataset_repo

* updated changelog

* fixed dataset manager tests
5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Yigit Ozen 4841f83876
Fixed LOGS_ROOT mkdir (#2244) 5 years ago
Maxim Zhiltsov 09a9509278
Install Datumaro as package (#2163)
* Remove Datumaro sources

* Install Datumaro as package

* Update Datumaro links

* fix

* remove unnecessary dependencies

* Update travis

* update coverage config
6 years ago
Nikita Manovich 4c24237e8a Merge remote-tracking branch 'origin/develop' into Marishka17-cache 6 years ago
Andrey Zhavoronkov 510191f64b
Added password reset functionality (#2058)
* added reset password functionality

* updated changelog and versions of cvat-core, cvat-ui

* fixed comments

* Update cvat-ui/src/components/reset-password-confirm-page/reset-password-confirm-form.tsx

* Fix CHANGELOG

* fixed comments

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maya 0fe2e1875c Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Andrey Zhavoronkov 2510d4d659
Added ability to configure email verification for registered user (#1929)
* Added ability to configure email verification for registered user
Removed unused code

* updated changelog

* fixed comments

* fixed swagger

* updated docs

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maya 3236546907 Merge branch 'develop' of https://github.com/opencv/cvat into upstream/develop 6 years ago
Andrey Zhavoronkov 4cb75a6a7f
Added ability to change user password (#1954)
* added ability to change user password

* Update CHANGELOG.md

* fixed comments

* fixed linter warnings

* updated version of cvat-ui and cvat-core
6 years ago
Mike Peven 737e94828e
Increase the rate of allowed requests (#1969)
* Increase the rate of allowed requests

* Update CHANGELOG.md
6 years ago
Nikita Manovich 634ca17958
Remove old UI (#1964)
* Removed outdated code

* Revert changes in .gitignore

* Fix docker build

* Remove karma + some dummy code

* Fix a type in Dockerfile.ci

* Fix swagger and remove dispatch_request.

* Update CHANGELOG.md
6 years ago
Nikita Manovich e7585b8ce9
DL models as serverless functions (#1767)
* Initial experiments with nuclio

* Update nuclio prototype

* Improve nuclio prototype for dextr.

* Dummy lambda manager

* OpenFaaS prototype (dextr.bin and dextr.xml are empty).

* Moved openfaas prototype.

* Add comments

* Add serializers and HLD for lambda_manager

* Initial version of Mask RCNN (without debugging)

* Initial version for faster_rcnn_inception_v2_coco

* Fix faster_rcnn_inception_v2_coco

* Implemented mask_rcnn_inception_resnet_v2_atrous_coco

* Implemented yolo detector as a lambda function

* Removed dextr app.

* Added types for each function (detector and interactor)

* Initial version of lambda_manager.

* Implement a couple of methods for lambda:

GET /api/v1/lambda/functions
GET /api/v1/lambda/functions/public.dextr

* First working version of dextr serverless function

* First version of dextr which works in UI.

* Modify omz.public.faster_rcnn_inception_v2_coco

- image decoding
- restart policy always for the function

* Improve omz.public.mask_rcnn_inception_resnet_v2_atrous_coco

* Improve omz.public.yolo-v3-tf function

* Implemented the initial version of requests for lambda manager.

* First working version of POST /api/v1/lambda/requests

* Updated specification of function.yaml (added labels and used annotations section).

* Added health check for containers (nuclio dashboard feature)

* Read labels spec from function.yaml.

* Added settings for NUCLIO

* Fixed a couple of typos. Now it works in most cases.

* Remove Plugin REST API

* Remove tf_annotation app (it will be replaced by serverless function)

* Remove tf_annotation and cuda components

* Cleanup docs and Dockerfile from CUDA component.

* Just renamed directories inside serverless

* Remove redundant files and code

* Remove redundant files.

* Remove outdated files

* Remove outdated code

* Delete reid app and add draft of serverless function for reid.

* Model list in UI.

* Fixed the framework name (got it from lambda function).

* Add maxRequestBodySize for functions, remove redundant code from UI for auto_annotation.

* Update view of models page.

* Unblock mapping for "primary" models.

* Implement cleanup flag for lambda/requests and labeling mapping for functions.

* Implement protection from running multiple jobs for the same task.

* Fix invocation of functions in docker container.

* Fix Dockerfile.ci

* Remove unused files from lambda_manager

* Fix codacy warnings

* Fix codacy issues.

* Fix codacy warnings

* Implement progress and cancel (aka delete) operation.

* Send annotations in batch.

* Fix UI. Now it can retrieve information about inference requests in progress.

* Update CHANGELOG.md

* Update cvat-ui version.

* Update nuclio version.

* Implement serverless/tensorflow/faster_rcnn_inception_v2_coco

* Add information how to install nuclio platform and run serverless functions.

* Add installation instructions for serverless functions.

* Update OpenVINO files which are responsible for loading network

* relocated functions

* Update dextr function.

* Update faster_rcnn function from omz

* Fix OpenVINO Mask-RCNN

* Fix YOLO v3 serverless function.

* Dummy serverless functions for a couple of more OpenVINO models.

* Protected lambda manager views by correct permissions.

* Fix name of Faster RCNN from Tensorflow.

* Implement Mask RCNN via Tensorflow serverless function.

* Minor client changes (#1847)

* Minor client changes

* Removed extra code

* Add reid serverless function (no support in lambda manager).

* Fix contribution guide.

* Fix person-reidentification-retail-300 and implement text-detection-0004

* Add semantic-segmentation-adas-0001

* Moving model management to cvat-core (#1905)

* Squached changes

* Removed extra line

* Remove duplicated files for OpenVINO serverless functions.

* Updated CHANGELOG.md

* Remove outdated code.

* Running dextr via lambda manager (#1912)

* Deleted outdated migration.

* Add name for DEXTR function.

* Fix restart policy for serverless functions.

* Fix openvino serverless functions for images with alpha channel

* Add more tensorflow serverless functions into deploy.sh

* Use ID instead of name for DEXTR (#1926)

* Update DEXTR function

* Added source "auto" inside lambda manager for automatic annotation.

* Customize payload (depends on type of lambda function).

* First working version of REID (Server only).

* Fix codacy warnings

* Avoid exception during migration (workaround)

File "/usr/local/lib/python3.5/dist-packages/django/db/utils.py", line 89, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.5/dist-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: table "engine_pluginoption" does not exist

* Add siammask serverless function (it doesn't work, need to serialize state)

* Run ReID from UI (#1949)

* Removed reid route in installation.md

* Fix a command to get lena image in CONTRIBUTION guide.

* Fix typo and crash in case a polygon is a line.

Co-authored-by: Boris Sekachev <40690378+bsekachev@users.noreply.github.com>
6 years ago
Maya 8abadaff31 Added cache integration settings 6 years ago
Andrey Zhavoronkov 4477e1777a
Added throttling policy for unauthenticated users (#1531)
* added throttling policy for unauthenticated users

* updated changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Andrey Zhavoronkov 6fd810e8a9
added settings to reduce access to analytics component (#1592)
* added settings to reduce access to analytics component

* updated CHANGELOG

* fixed typo
6 years ago
Andrey Zhavoronkov 380be58edc
Ability to configure user agreements for the register user form (#1464) 6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
Andrey Zhavoronkov ee6deba304
Fixed 'Open task' button doesn't work (#1474) 6 years ago
zhiltsov-max 887c6f0432
Move annotation formats to dataset manager (#1256)
* Move formats to dataset manager

* Unify datataset export and anno export implementations

* Add track_id to TrackedShape, export tracked shapes

* Replace MOT format

* Replace LabelMe format

* Add new formats to dm

* Add dm tests

* Extend TrackedShape

* Enable dm test in CI

* Fix tests

* Add import

* Fix tests

* Fix mot track ids

* Fix mot format

* Update attribute logic in labelme tests

* Use common code in yolo

* Put datumaro in path in settings

* Expect labels file in MOT next to annotations file

* Add MOT format description

* Add import

* Add labelme format description

* Linter fix

* Linter fix2

* Compare attributes ordered

* Update docs

* Update tests
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
LukeAI b918aeb224
Update base.py (#1099)
Modification necessary for using CVAT from remote machines when accessing with FQDNs
See https://github.com/opencv/cvat/issues/1011#issue-542817055
and https://github.com/opencv/cvat/pull/1098

"I believe the reason for this is that sometimes if the port number is :80 and the URL is not in the LAN (:port), but instead it is a Fully Qualified Domain Name (:port), the port 80 is redundant (mydomain.com:80) and the errors arise."
6 years ago
Nikita Manovich 8edfe0dcb4
Swagger documentation (#978)
* Fix swagger problems (exceptions, /api/swagger.json, /api/docs/)
6 years ago
Boris Sekachev fa8fd166b1 Updated contributing 6 years ago
Nikita Manovich c0f1854f79
Restore session id (#905)
* Restore session id when we use token authorization.
6 years ago
Boris Sekachev 171a9202ed React & Antd: Dashboard migration (#892)
* Removed old dashboard
* Getting all users
* Updated changelog
* Reimplemented login decorator
* Implicit host, scheme in docker-compose
* Fixed issue with pagination
* Implicit page size parameter for tasks
* Fixed linkedin icon, added links to tasks in notifications
* Configurable method for check plugin
6 years ago
Andrey Zhavoronkov 0e7845a1e6 set CORS_REPLACE_HTTPS_REFERER option to True (#895) 6 years ago
Nikita Manovich 454eaf92c2
page_size parameter for all REST API methods (#884)
* Added page_size parameter for all REST API methods which returns list of objects.

Also it is possible to specify page_size=all to return all elements.

* Updated changelog.md
6 years ago
zhiltsov-max 74f720a3d2 Add dataset export facility (#813)
* Add datumaro django application
* Add cvat task datumaro bindings
* Add REST api for task export
* Add scheduler service
* Updated CHANGELOG.md
6 years ago
Reza Malek d99140a0fb Auto segmentation using Mask_RCNN (#767) 6 years ago
Nikita Manovich 8359db3580
cvat-ui in docker (serve using nginx) (#658) 7 years ago
Ben Hoff eaede02824 check if keys directory exists before making secret_key (#700) 7 years ago
Boris Sekachev 7ea84d1bc7 Fixed: no such table: allauth_socialaccount (#687) 7 years ago
Andrey Zhavoronkov fbae6bbdcb added settings for setup timezone (#661)
deleting shapes triggers setting updated date field as other
actions(create & update)
7 years ago
Nikita Manovich e7bab87039
Auth for REST API (api/v1/auth/*) (#622)
* Added trivial login/logout/register
* Auth methods for REST API.

- api/v1/auth/login
- api/v1/auth/logout

For basic auth only:
- api/v1/auth/register
- api/v1/auth/password/*

* Add info about auth for REST API into CHANGELOG.md
* Add pylintrc for codacy, updated pylint and its dependecies.
* Add token authorization, renamed cvat.js to cvat-core in all places.
* Implemented register method in cvat-core
* Added first_name and last_name to RegisterSerializer.
7 years ago
Andrey Zhavoronkov 5733423b13 Az/multiformat downloader (#551) 7 years ago
Nikita Manovich ae6a4891e3
RESTful API (#389) 7 years ago
Boris Sekachev 1257a1b245 Semi Automatic Segmentation (#332) 7 years ago
Boris Sekachev e225c38092 Re-Identification application (#299) 7 years ago
Andrey Zhavoronkov 746cffb476 Model manager for DL models to preannotate images (#289) 7 years ago
Boris Sekachev 062d145fcf Hidden warning: 'Could not open connection ..' (#295) 7 years ago
Boris Sekachev 23b6b54137 Git application (#184) 7 years ago
Andrey Zhavoronkov 4387fdaf46 Auto annotation using models in OpenVINO format (#233) 7 years ago
Nikita Manovich 1a040a0608
Fix upload big xml files for tasks (#199)
* Fix #123 (Uploading large XML Files)
* Integrated SILK for profiling.
* Don't try to call save_job without objects.
7 years ago
Nikita Manovich 608253f1cc
Permissions per tasks and jobs (#185) 7 years ago
Nikita Manovich 553a171273
Create task timeout 1h -> 4h. (#136) 7 years ago
Nikita Manovich 70891f0020
Fix several problems with analytics. (#129)
- collectstatic always
- conditionally urls for cvat.apps.log_viewer
- more logs from django in production
7 years ago
Nikita Manovich 45af7bdee3
Analytics v2 (#127)
* Add revproxy dependency
* Fix formating of task.log, improve fields of server events.
* Mount kibana app into /analytics/*
* Add logs for revproxy and x-forwarded-user header.
* Added F3 shortcut for analytics/log-viewer.
7 years ago
Nikita Manovich c096c2a600
Add analytics (#118)
* ELK stack to analyze logs from client and server
* Short-live container to configure kibana. Import kibana dashboards from export.json on startup.
* Client and server logging is working throw python-logstash
* Minor polishing of events and dashboards.
* Default is discover, new visualizations.
* Make comments more readable inside logger.js.
* Added a path for backups.
7 years ago