67 Commits (ec8ebc74736ff9731547d751c33bd2fd7c4f833d)

Author SHA1 Message Date
Maxim Zhiltsov 17a5554cd5
[Datumaro] Add merge command with segment intersection (#1695)
* Add multi source merge

* update changelog

* cli update

* linter

* fixes and tests

* fix test

* fix test

* relax type requirements in annotations

* fix polylines

* Make groups more stable

* Add group checks

* add group check test
6 years ago
zhiltsov-max 000e9c4dad
[Datumaro] Use attrs for model declaration (#2000)
* bandit fixes

* t

* refactor extractor to use attrs

* Merge branch 'develop' into zm/extractor-with-attrs

* update requirements

* restore changelog

* fix bindings
6 years ago
zhiltsov-max eaeb67dc1d
[Datumaro] Add dataset statistics (#1668)
* Add statistics command

* Add tests

* Update changelog

* fix test

* handle image absence

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 0062ecdec3
[Datumaro] Fixes (#1953)
* Add absolute image path in rest api extractor

* Add default split for random split

* Fix image path in datumaro format

* Preserve bboxes in coco format

* update changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
Ilya Kochankov 7ecdcf182b
[Datumaro] Reducing nesting of tests (#1875)
* Add `Dataset.from_iterable` constructor
* Simplify creation of `Dataset` objects in common simple cases
* Refactor tests
6 years ago
zhiltsov-max f807714870
[Datumaro] Image control in converters (#1799)
* Update converter interface, add image control

* Update bindings

* update changelog

* Fix build
6 years ago
zhiltsov-max d7c9a0fd21
Refactorings (#1876) 6 years ago
zhiltsov-max 80ed45b452
Allow attributes in COCO format (#1782)
* allow attributes in coco

* update changelog

* update cli

* update coco cli
6 years ago
zhiltsov-max 962f61fa27
Add attributes in VOC format (#1792)
* Add voc attributes

* Allow any values for voc pose

* update changelog

* Add attribute conversion

* linter

* fix tests
6 years ago
zhiltsov-max ae3b06b465
[Datumaro] Add generic accuracy checker model launcher (#1661)
* Refactor inference wrapper

* Add accuracy checker launcher wrapper

* t

* rename method

* Add importer for openvino launcher

* Move openvino plugin to iecore

* add generic AC launcher

* Implement cli for AC launcher

* move ac plugin dir

* prevent tf reimport

* Fix outputs conversion

* t

* add pytorch model example

* Require config path in launcher

* Clear extra whitespace
6 years ago
zhiltsov-max 12f78559d2
[Datumaro] Mean and std for dataset (#1734)
* Add meanstd

* Add stats cli

* Update changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 5912bf0447
[Datumaro] Support relative paths (#1715)
* Support relative image paths in Datumaro

* Update bindings

* Fix merge

* linter
6 years ago
zhiltsov-max 39d3c93cfd
[Datumaro] Update model interface and OpenVino launcher (#1626)
* Refactor inference wrapper
6 years ago
zhiltsov-max e0ef2cfa70
Update coco tests (#1669) 6 years ago
zhiltsov-max 696a47b3c5
Add assets importing tests for cvat format (#1652) 6 years ago
zhiltsov-max ba309c882f
[Datumaro] Add DatasetItem attributes (#1639)
* Add DatasetItem attributes

* Update tests

* Update datumaro format
6 years ago
zhiltsov-max 727fcd50b3
[Datumaro] Remove annotation dir for cvat dataset format (#1637)
* Remove annotation dir for cvat dataset format

* fixes
6 years ago
zhiltsov-max 2044d35566
Add directory check on image save (#1636)
* Add directory check on image save

* Add tests

* change exception type

* update test
6 years ago
zhiltsov-max 306e91c3d7
[Datumaro] Add tests for dataset examples (#1648)
* add dataset examples

* update docs

* update yolo tests

* join voc format test classes

* remplace voc extractor tests with import test

* update tfrecord format tests

* update mot tests

* update labelme tests

* update image dir tests
6 years ago
zhiltsov-max d1b2960b3d
[Datumaro] Add dataset examples (#1640)
* add dataset examples
6 years ago
zhiltsov-max da3fa34ce0
Add tf import checks and tests (#1567)
* Add tf import checks and tests

* implement disabled formats on server

* python 3.5 compatibility

* add checks to dm tests

* fix tests

* Support for disabled formats in UI

* add sorting for formats, mark grey disabled items

* update changelog

* advance package versions
6 years ago
zhiltsov-max ac922e33a5
Add default colors for masks (#1549)
* Use default colors for masks

* do not change labels in voc converter

* update tests

* add backgound color handling

* consider case with existing source colormap

* update changelog

* fix file name

* fix insert

* move color table colors to beginning
6 years ago
zhiltsov-max e2dedb2f83
Use z_order as a class property (#1589)
* Use z_order as a class property

* Fix z_order use in voc

* Update changelog
6 years ago
zhiltsov-max 42c5637ddd
[Datumaro] Fix mask to polygons warning (#1581)
* Fix message, add test
* update changelog
6 years ago
zhiltsov-max 4c603504b7
Add VOC grayscale masks test and documentation (#1576)
* Add a test for unpainted masks
* Update format documentation
6 years ago
zhiltsov-max 98a9718e63
[Datumaro] Change alignment in mask parsing (#1547) 6 years ago
zhiltsov-max 42990906b9
[Datumaro] Fix coco import conflict with labels (#1548) 6 years ago
zhiltsov-max 5ab549956f
Merge annotations and dataset_manager apps (#1352) 6 years ago
zhiltsov-max c78db45d9a
[Datumaro] Fix duplicating keypoints in COCO export (#1435) 6 years ago
zhiltsov-max 819b81d7f3
Fix label comparison in voc format (#1382) 6 years ago
zhiltsov-max bd659246e9
[Datumaro] Fix COCO keypoint export bug (#1388) 6 years ago
zhiltsov-max 887c6f0432
Move annotation formats to dataset manager (#1256)
* Move formats to dataset manager

* Unify datataset export and anno export implementations

* Add track_id to TrackedShape, export tracked shapes

* Replace MOT format

* Replace LabelMe format

* Add new formats to dm

* Add dm tests

* Extend TrackedShape

* Enable dm test in CI

* Fix tests

* Add import

* Fix tests

* Fix mot track ids

* Fix mot format

* Update attribute logic in labelme tests

* Use common code in yolo

* Put datumaro in path in settings

* Expect labels file in MOT next to annotations file

* Add MOT format description

* Add import

* Add labelme format description

* Linter fix

* Linter fix2

* Compare attributes ordered

* Update docs

* Update tests
6 years ago
zhiltsov-max fe862b4abc
[Datumaro] Update LabelMe format (#1296)
* Little refactoring

* Add LabelMe format

* Add usernames

* Update tests

* Add extractor test
6 years ago
zhiltsov-max c91e8957df
[Datumaro] LabelMe format (#1293)
* Little refactoring

* Add LabelMe format
6 years ago
zhiltsov-max 0744c6ae16
[Datumaro] MOT format (#1289)
* Add mot format base

* Add mot format

* Extract common code
6 years ago
zhiltsov-max 9545132097
[Datumaro] Allow empty COCO dataset export (#1272)
* Allow empty dataset export in coco

* Add line to changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 2ebca5bb5a
[Datumaro] Dataset format auto detection (#1242)
* Add dataset format detection

* Add auto format detection for import

* Split VOC extractor
6 years ago
Nikita Manovich 24130cda41
[Datumaro] Optimize mask operations (#1232)
* Optimize mask to rle

* Optimize mask operations

* Fix dm format cmdline

* Use RLE masks in datumaro format
6 years ago
Nikita Manovich be5577d013
[Datumaro] Label remapping transform (#1233)
* Add label remapping transform

* Apply transforms before project saving

* Refactor voc converter
6 years ago
zhiltsov-max 0d873a3de6
Fix remainder logic for subset splitting (#1222) 6 years ago
zhiltsov-max a058765d29
Add tags to cvat xml (#1200)
* Extend cvat format test

* Add tags to cvat for images

* Add tags to cvat format in dm

* Add import of tags from datumaro
6 years ago
zhiltsov-max da69a40b96
Add random split transform (#1213) 6 years ago
zhiltsov-max cd8ef2aca4
Replace VOC format support in CVAT with Datumaro (#1167)
* Add image meta reading to voc

* Replace voc support in cvat

* Bump format version

* Materialize lazy transforms in voc export

* Store voc instance id as group id

* Add flat format import

* Add documentation

* Fix format name in doc
6 years ago
zhiltsov-max 8caa1695c5
Replace mask format support with Datumaro (#1163)
* Add box to mask transform

* Fix 'source' labelmap mode in voc converter

* Import groups

* Replace mask format support

* Update mask format documentation

* codacy

* Fix tests

* Fix dataset

* Fix segments grouping

* Merge instances in mask export
6 years ago
zhiltsov-max b36f402f9c
[Datumaro] Add masks to tfrecord format (#1156)
* Employ transforms and item wrapper

* Add image class and tests

* Add image info support to formats

* Fix cli

* Fix merge and voc converte

* Update remote images extractor

* Codacy

* Remove item name, require path in Image

* Merge images of dataset items

* Update tests

* Add image dir converter

* Update Datumaro format

* Update COCO format with image info

* Update CVAT format with image info

* Update TFrecord format with image info

* Update VOC formar with image info

* Update YOLO format with image info

* Update dataset manager bindings with image info

* Add image name to id transform

* Fix coco export

* Add masks support for tfrecord

* Refactor coco

* Fix comparison

* Remove dead code

* Extract common code for instances
6 years ago
zhiltsov-max a376ee76fd
[Datumaro] Introduce image info (#1140)
* Employ transforms and item wrapper

* Add image class and tests

* Add image info support to formats

* Fix cli

* Fix merge and voc converte

* Update remote images extractor

* Codacy

* Remove item name, require path in Image

* Merge images of dataset items

* Update tests

* Add image dir converter

* Update Datumaro format

* Update COCO format with image info

* Update CVAT format with image info

* Update TFrecord format with image info

* Update VOC formar with image info

* Update YOLO format with image info

* Update dataset manager bindings with image info

* Add image name to id transform

* Fix coco export
6 years ago
zhiltsov-max 15dc61dd38
Add offline subset remapping and bbox conversion (#1147) 6 years ago
zhiltsov-max 29d65b0cda
Fix tensorflow installation (#1129)
* Make tf dependency optional

* Reduce opencv dependency

* Import tf eagerly as it is a plugin

* Do not install TF with Datumaro
6 years ago
zhiltsov-max 2848f1d14f
[Datumaro] Plugins and transforms (#1126)
* Fix model run command

* Rename annotation types, update class interfaces

* Fix random cvat format test fails

* Mask operations and dataset format fixes

* Update tests, extract format testing functions

* Add transform interface

* Implement plugin system

* Update tests with plugins

* Fix logging

* Add transfroms

* Update cvat integration
6 years ago
zhiltsov-max 04c7669cf5 Optimize mask conversions (#1097) 6 years ago