32 Commits (3c128b2a73ce265ff3c30e0f93251cc17294ba2b)

Author SHA1 Message Date
zhiltsov-max 9545132097
[Datumaro] Allow empty COCO dataset export (#1272)
* Allow empty dataset export in coco

* Add line to changelog

Co-authored-by: Nikita Manovich <40690625+nmanovic@users.noreply.github.com>
6 years ago
zhiltsov-max 2ebca5bb5a
[Datumaro] Dataset format auto detection (#1242)
* Add dataset format detection

* Add auto format detection for import

* Split VOC extractor
6 years ago
Nikita Manovich 24130cda41
[Datumaro] Optimize mask operations (#1232)
* Optimize mask to rle

* Optimize mask operations

* Fix dm format cmdline

* Use RLE masks in datumaro format
6 years ago
Nikita Manovich be5577d013
[Datumaro] Label remapping transform (#1233)
* Add label remapping transform

* Apply transforms before project saving

* Refactor voc converter
6 years ago
zhiltsov-max 0d873a3de6
Fix remainder logic for subset splitting (#1222) 6 years ago
zhiltsov-max a058765d29
Add tags to cvat xml (#1200)
* Extend cvat format test

* Add tags to cvat for images

* Add tags to cvat format in dm

* Add import of tags from datumaro
6 years ago
zhiltsov-max da69a40b96
Add random split transform (#1213) 6 years ago
zhiltsov-max cd8ef2aca4
Replace VOC format support in CVAT with Datumaro (#1167)
* Add image meta reading to voc

* Replace voc support in cvat

* Bump format version

* Materialize lazy transforms in voc export

* Store voc instance id as group id

* Add flat format import

* Add documentation

* Fix format name in doc
6 years ago
zhiltsov-max 8caa1695c5
Replace mask format support with Datumaro (#1163)
* Add box to mask transform

* Fix 'source' labelmap mode in voc converter

* Import groups

* Replace mask format support

* Update mask format documentation

* codacy

* Fix tests

* Fix dataset

* Fix segments grouping

* Merge instances in mask export
6 years ago
zhiltsov-max b36f402f9c
[Datumaro] Add masks to tfrecord format (#1156)
* Employ transforms and item wrapper

* Add image class and tests

* Add image info support to formats

* Fix cli

* Fix merge and voc converte

* Update remote images extractor

* Codacy

* Remove item name, require path in Image

* Merge images of dataset items

* Update tests

* Add image dir converter

* Update Datumaro format

* Update COCO format with image info

* Update CVAT format with image info

* Update TFrecord format with image info

* Update VOC formar with image info

* Update YOLO format with image info

* Update dataset manager bindings with image info

* Add image name to id transform

* Fix coco export

* Add masks support for tfrecord

* Refactor coco

* Fix comparison

* Remove dead code

* Extract common code for instances
6 years ago
zhiltsov-max a376ee76fd
[Datumaro] Introduce image info (#1140)
* Employ transforms and item wrapper

* Add image class and tests

* Add image info support to formats

* Fix cli

* Fix merge and voc converte

* Update remote images extractor

* Codacy

* Remove item name, require path in Image

* Merge images of dataset items

* Update tests

* Add image dir converter

* Update Datumaro format

* Update COCO format with image info

* Update CVAT format with image info

* Update TFrecord format with image info

* Update VOC formar with image info

* Update YOLO format with image info

* Update dataset manager bindings with image info

* Add image name to id transform

* Fix coco export
6 years ago
zhiltsov-max 15dc61dd38
Add offline subset remapping and bbox conversion (#1147) 6 years ago
zhiltsov-max 29d65b0cda
Fix tensorflow installation (#1129)
* Make tf dependency optional

* Reduce opencv dependency

* Import tf eagerly as it is a plugin

* Do not install TF with Datumaro
6 years ago
zhiltsov-max 2848f1d14f
[Datumaro] Plugins and transforms (#1126)
* Fix model run command

* Rename annotation types, update class interfaces

* Fix random cvat format test fails

* Mask operations and dataset format fixes

* Update tests, extract format testing functions

* Add transform interface

* Implement plugin system

* Update tests with plugins

* Fix logging

* Add transfroms

* Update cvat integration
6 years ago
zhiltsov-max 04c7669cf5 Optimize mask conversions (#1097) 6 years ago
zhiltsov-max 93b3c091f5 [Datumaro] CLI updates + better documentation (#1057) 6 years ago
zhiltsov-max e5b4c194bb [Datumaro] Dataset annotations filter (#1053)
* Fix deprecation message

* Update launcher interface

* Add dataset entity, anno filter, remove filter from project config, update transform

* Update project and source cli

* Fix help message

* Refactor tests
6 years ago
zhiltsov-max e0bcc4652b [Datumaro] Instance polygon-mask conversions in COCO format (#1008)
* Microoptimizations

* Mask conversion functions

* Add mask-polygon conversions

* Add mask-polygon conversions in coco

* Add mask-polygon conversions in coco

* Update requirements

* Option to disable crop

* Fix cli parameter passing

* Fix test

* Fixes in COCO
6 years ago
zhiltsov-max 8da20b38d5 [Datumaro] Add cvat format export (#1034)
* Add cvat format export

* Remove wrong items in test
6 years ago
zhiltsov-max 337f7a0018 [Datumaro] Fix project loading (#1013)
* Fix occasional infinite loop in project loading

* Fix project import source options saving

* Fix project import .git dir placement

* Make code aware of grayscale images
6 years ago
zhiltsov-max 7c9043974b [Datumaro] Fix TFrecord converter constructor (#993) 6 years ago
zhiltsov-max 36b1e9c1ce [Datumaro] CVAT format import (#974)
* Add label-specific attributes
* Add CVAT format import
* Register CVAT format
* Add little more logs
* Little refactoring for tests
* Cvat format checks
* Add missing check
* Refactor datumaro format
* Little refactoring
* Regularize dataset importer logic
* Fix project import issue
* Refactor coco extractor
* Refactor tests
* Codacy
6 years ago
zhiltsov-max c84daaf2ef [Datumaro] VOC labelmap support (#957)
* Add import result checks and options to skip
* Add label-specific attributes
* Overwrite option for export
* Add labelmap file support in voc
* Add labelmap tests
* Little refactoring
6 years ago
zhiltsov-max 32254530cf [Datumaro] Fix voc colormap (#945)
* Add polygon merging option to coco converter

* Add test, refactor coco, add support for cli args

* Drop colormap application in datumaro format

* Add cli support in voc converter

* Add cli support in yolo converter

* Add converter cli options in project cli

* Add image data type conversion in image saving

* Add image data type conversion in image saving

* Update mask support in voc

* Replace null with quotes in coco export

* Improve cli

* Enable Datumaro intellisense in vs cde

* Adjust fields in voc detection export
6 years ago
zhiltsov-max 944d85370d [Datumaro] COCO 'merge instance polygons' option (#938)
* Add polygon merging option to coco converter
* Add test, refactor coco, add support for cli args
* Drop colormap application in datumaro format
* Add cli support in voc converter
* Add cli support in yolo converter
* Add converter cli options in project cli
* Add image data type conversion in image saving
6 years ago
zhiltsov-max 0f5cf2064d [Datumaro] Added tf detection api tfrecord import and export (#894)
* Added tf detection api tfrecord import and export
* Added export button in dashboard
* Add tf to requirements
* Extend test
* Add tf dependency
* Require images in tfrecord export
* Add video task case handling
* Maintain image order in CVAT export
* Fix Task image id-path conversions
* Update tfrecord tests
* Extend image utilities
* Update tfrecord format
* Fix image loading bug
* Add some logs
* Add 'copy' option to project import command
* Reduce default cache size
6 years ago
zhiltsov-max 5458de7464 [Datumaro] Add YOLO converter (#906)
* Add YOLO converter
* Added yolo extractor
* Added YOLO format test
* Add YOLO export in UI
6 years ago
zhiltsov-max 59df0dfabc [Datumaro] Pip installation (#881)
* Add version file
* Remove unnecessary dependencies
* Add lxml use motivation
* Add pip setup script
* Reduce opencv dependency
* Fix cli command
* Codacy
6 years ago
zhiltsov-max 9cb48ef2c2 [Datumaro] Disable lazy image caching by default (#876)
* Disable lazy image caching by default
* Deterministic cache test
* Add displacing image cache
6 years ago
zhiltsov-max c3d464c9a0 [Datumaro] Fix coco images export (#875)
* Update test
* Fix export
* Support several image paths in coco extractor
6 years ago
zhiltsov-max 50c40ba70d Coco converter updates (#864) 6 years ago
zhiltsov-max 74f720a3d2 Add dataset export facility (#813)
* Add datumaro django application
* Add cvat task datumaro bindings
* Add REST api for task export
* Add scheduler service
* Updated CHANGELOG.md
6 years ago