38 Commits (4db05fd93bb8a663e77165412dab3bd95a20e179)

Author SHA1 Message Date
kirill.sizov cbcb62048a fix incorrect solution 5 years ago
kirill.sizov d7be0429fd fix import dm annotations 5 years ago
kirill.sizov fc636d2512 fix match dm item for no image frame 5 years ago
Maxim Zhiltsov 2c5188f5b6
Add label check on import (#2935)
* Add label check on import

* include annotation type

* update changelog

* Make the message prettier
5 years ago
Maxim Zhiltsov 5e6a51acf4
Fix 2827 (#2890)
* Fix 2827

* update changelog
5 years ago
Maxim Zhiltsov 44a504e16e
Add image ext in filename matching (#2778)
* Add image ext in matching

* remove dead code
5 years ago
Dmitry Kalinin 879deb5a52
Projects (#2255)
Initial implementation of Projects feature to group similar tasks into one group (aka Dataset UI in the future).
5 years ago
Maxim Zhiltsov e0afbaf507
Don't export outside frames in frame-based formats (#2345)
* Exclude outside shapes from per frame export

* update changelog
5 years ago
Vitaliy Nishukov 00f6486f80
Z-Order flag in creation task process (#2294)
* Z-Order flag in creation task process has been removed
5 years ago
Maxim Zhiltsov 84b8a85a20
Raw image copying in dataset export (#2229)
* Raw image copying in dataset export

* use byteimage

* use opencv, swith frame data type for videos

* Fix image reading

* update dm dependency
5 years ago
Dmitry Kalinin bee4c3799f
Label color (#2014)
* added color to django app and cvat-core

* temp

* temp

* Added label color to mask dump

* Fixed UI for label color picker

* npm packages and CHANGELOG

* fixed models and migrations

* Fixed default background color and using normalization

* Added setting label color with hash

* fixed error

* Added close icon to color picker

* Fixed CHANGELOG

* requested changes

* fixed menu visibility

* Fixed label hashing and algorithm

* Added wheel package to CI

* Fixed dockerfile

* moved wheel package from dockerfile to requirements

* fixed requirements

* Fixed requirements

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
zhiltsov-max 000e9c4dad
[Datumaro] Use attrs for model declaration (#2000)
* bandit fixes

* t

* refactor extractor to use attrs

* Merge branch 'develop' into zm/extractor-with-attrs

* update requirements

* restore changelog

* fix bindings
6 years ago
Priya4607 6a1e7af5c5
Display of Annotation Type (#1192) 6 years ago
zhiltsov-max cf26ef0363
Convert points to float in import (#1898)
* Convert points to float in import

* update changelog
6 years ago
zhiltsov-max fc2fb6156a
Don't export outside annotations (#1729)
* Add option to omit outside annotations

* update changelog

* Fix mot format and test

* Fix outside in mot

* fix repo problem

* t

* Update CHANGELOG.md

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 962f61fa27
Add attributes in VOC format (#1792)
* Add voc attributes

* Allow any values for voc pose

* update changelog

* Add attribute conversion

* linter

* fix tests
6 years ago
zhiltsov-max 0eb005c9f2
Support relative paths in import and export (#1463)
* Move annotations to dm

* Refactor dm

* Rename data manager

* Move anno dump and upload functions

* Join server host and port in cvat cli

* Move export templates dir

* add dm project exporter

* update mask format support

* Use decorators for formats definition

* Update formats

* Update format implementations

* remove parameter

* Add dm views

* Move annotation components to dm

* restore extension for export formats

* update rest api

* use serializers, update views

* merge develop

* Update format names

* Update docs

* Update tests

* move test

* fix import

* Extend format tests

* django compatibility for directory access

* move tests

* update module links

* fixes

* fix git application

* fixes

* add extension recommentation

* fixes

* api

* join api methods

* Add trim whitespace to workspace config

* update tests

* fixes

* Update format docs

* join format queries

* fixes

* update new ui

* ui tests

* old ui

* update js bundles

* linter fixes

* add image with loader tests

* fix linter

* fix frame step and frame access

* use server file name for annotations export

* update cvat core

* add import hack for rest api tests

* move cli tests

* fix cvat format converter args parsing

* remove folder on extract error

* print error message on incorrect xpath expression

* use own categories when no others exist

* update changelog

* really add text to changelog

* Fix annotation window menu

* fix ui

* fix replace

* update extra apps

* format readme

* readme

* linter

* Fix old ui

* Update CHANGELOG.md

* update user guide

* linter

* more linter fixes

* update changelog

* Add image attributes

* add directory check in save image

* update image tests

* update image dir format with relative paths

* update datumaro format

* update coco format

* update cvat format

* update labelme format

* update mot format

* update image dir format

* update voc format

* update mot format

* update yolo format

* update labelme test

* update voc format

* update tfrecord format

* fixes

* update save_image usage

* remove item name conversion

* fix merge

* fix export

* prohibit relative paths in labelme format

* Add test for relative name matching

* move code

* implement frame matching

* fix yolo

* fix merge

* fix merge

* prettify code

* fix methid call

* fix frame matching in yolo

* add tests

* regularize function output

* update changelog

* fixes

* fix z_order use

* fix slash replacement

* linter

* t

* t2

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 0e003157d3
Throw an error on unknown frames (#1728) 6 years ago
zhiltsov-max 5912bf0447
[Datumaro] Support relative paths (#1715)
* Support relative image paths in Datumaro

* Update bindings

* Fix merge

* linter
6 years ago
zhiltsov-max 1fb7e5bf6d
Fix frame step export for image tasks (#1615)
* use absolute frame numbers in interface

* update changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Mathis Chenuet bb69fd4fce
Show error on upload when labels are missing (#1629) 6 years ago
zhiltsov-max e2dedb2f83
Use z_order as a class property (#1589)
* Use z_order as a class property

* Fix z_order use in voc

* Update changelog
6 years ago
zhiltsov-max 61d06065ab
Fix cuboid conversion (#1577)
* Fix cuboid conversion

* update changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max fb380d9855
Include empty images in exported annotations (#1479) 6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
zhiltsov-max 557e308a73
Add chunk iterator cache to frame provider (#1367)
* Add chunk iterator cache

* fix
6 years ago
zhiltsov-max 887c6f0432
Move annotation formats to dataset manager (#1256)
* Move formats to dataset manager

* Unify datataset export and anno export implementations

* Add track_id to TrackedShape, export tracked shapes

* Replace MOT format

* Replace LabelMe format

* Add new formats to dm

* Add dm tests

* Extend TrackedShape

* Enable dm test in CI

* Fix tests

* Add import

* Fix tests

* Fix mot track ids

* Fix mot format

* Update attribute logic in labelme tests

* Use common code in yolo

* Put datumaro in path in settings

* Expect labels file in MOT next to annotations file

* Add MOT format description

* Add import

* Add labelme format description

* Linter fix

* Linter fix2

* Compare attributes ordered

* Update docs

* Update tests
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
zhiltsov-max 08688b0c3e
[Datumaro] Fix occluded and z_order attributes export (#1271)
* Fix occluded and z_order attributes export

* Add line to changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 936d3059cf
[Datumaro] Fix frame matching in video annotations import (#1274)
* Add extra frame matching way for videos

* Add line to changelog
6 years ago
zhiltsov-max b3f7f5b8bc
Add tags support for VOC (#1201)
* Extend voc format test with tags

* Add import and export of voc labels

* Fix voc and yolo format version numbers
6 years ago
zhiltsov-max a058765d29
Add tags to cvat xml (#1200)
* Extend cvat format test

* Add tags to cvat for images

* Add tags to cvat format in dm

* Add import of tags from datumaro
6 years ago
zhiltsov-max 8caa1695c5
Replace mask format support with Datumaro (#1163)
* Add box to mask transform

* Fix 'source' labelmap mode in voc converter

* Import groups

* Replace mask format support

* Update mask format documentation

* codacy

* Fix tests

* Fix dataset

* Fix segments grouping

* Merge instances in mask export
6 years ago
zhiltsov-max a376ee76fd
[Datumaro] Introduce image info (#1140)
* Employ transforms and item wrapper

* Add image class and tests

* Add image info support to formats

* Fix cli

* Fix merge and voc converte

* Update remote images extractor

* Codacy

* Remove item name, require path in Image

* Merge images of dataset items

* Update tests

* Add image dir converter

* Update Datumaro format

* Update COCO format with image info

* Update CVAT format with image info

* Update TFrecord format with image info

* Update VOC formar with image info

* Update YOLO format with image info

* Update dataset manager bindings with image info

* Add image name to id transform

* Fix coco export
6 years ago
zhiltsov-max 2848f1d14f
[Datumaro] Plugins and transforms (#1126)
* Fix model run command

* Rename annotation types, update class interfaces

* Fix random cvat format test fails

* Mask operations and dataset format fixes

* Update tests, extract format testing functions

* Add transform interface

* Implement plugin system

* Update tests with plugins

* Fix logging

* Add transfroms

* Update cvat integration
6 years ago
zhiltsov-max 93b3c091f5 [Datumaro] CLI updates + better documentation (#1057) 6 years ago
zhiltsov-max 0f5cf2064d [Datumaro] Added tf detection api tfrecord import and export (#894)
* Added tf detection api tfrecord import and export
* Added export button in dashboard
* Add tf to requirements
* Extend test
* Add tf dependency
* Require images in tfrecord export
* Add video task case handling
* Maintain image order in CVAT export
* Fix Task image id-path conversions
* Update tfrecord tests
* Extend image utilities
* Update tfrecord format
* Fix image loading bug
* Add some logs
* Add 'copy' option to project import command
* Reduce default cache size
6 years ago
zhiltsov-max 74f720a3d2 Add dataset export facility (#813)
* Add datumaro django application
* Add cvat task datumaro bindings
* Add REST api for task export
* Add scheduler service
* Updated CHANGELOG.md
6 years ago