70 Commits (6fad1764efd922d99dbcda28c4ee72d071aa5a07)

Author SHA1 Message Date
Andrey Zhavoronkov 6fad1764ef
Added validation for URLs which used as remote data source (#4387) 4 years ago
Nikita Manovich e8f294f673
REST API /api/jobs/<id>/commits (#4368) 4 years ago
Maria Khrustaleva 83126c7b5a
API versioning using accept header (#4239) 4 years ago
Maria Khrustaleva c7fcd3ac1a
Fixed bug: Error in Create project from backup for Standard 3D Annotation (#4160) 4 years ago
Maria Khrustaleva 5281e7938c
Support any name for a manifest (#4041)
* Initial version

* Fix support 2 versions && fix case for cloud storages

* Fix eslint errors

* tmp

* Fix manifest validation when data hasn't been copied yet

* fix

* Update changelog
4 years ago
Dmitry Kalinin 579bfb38c3
Project import simple implementation (#3790) 4 years ago
Maria Khrustaleva cde33acf5d
Fix issue: Original pdf file is deleted (#3967) 4 years ago
Maria Khrustaleva 68fbcdec43
Added sorting methods (#3937) 4 years ago
Maria Khrustaleva 5b890b1785
Manifest optimization (#3712) 4 years ago
Maria Khrustaleva 9551fea4cc
Display more user understandable exception message (#3721)
* fix

* Update CHANGELOG

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
4 years ago
Maria Khrustaleva fa15f78802
Extension of cloud storage server part (#3386)
* Add preview && some fixes

* Fix case with sub dirs on cloud storage

* Move server part from ui_support_cloud_storage && fix missing id field

* Add support_key_secret_key_pair

* Fix several moments

* Add index resetting

* Fix pylint errors

* Remove excess migration

* tmp

* Some fixes

* Fixes

* fix

* [server] Add cloud storage status && fixes

* Remove unused import

* Add manifest set_index method

* Implement status support for Azure blob container

* Move specific attributes parsing into utils

* Fix missing in migration

* Fix error display

* some fix

* Update migration dependency

* Update google cloud storage status

* Update migrtaions

* Update CHANGELOG
5 years ago
Dmitry Kalinin f18b1cb82d
Project: export as a dataset (#3365) 5 years ago
Boris Sekachev 4fd57a8950
Fixed combined image and directory extractors (#3424)
* Fixed combined image and directory extractors

* Updated changelog

* Updated CHANGELOG
5 years ago
Maria Khrustaleva 1a86efe65e
Fixes cloud storage (#3336)
* Fixes:
- exception with getting content when specific_attributes=''
- no deletion of temporary index for  temporary manifest

* Fix getting owner structure instead of id

* Delete :=

* Fix creating task with cloud storage: preview && nonexistent field

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich b18482b42c
Support cloud storage on server (#3326)
Co-authored-by: Maya <maya17grd@gmail.com>
5 years ago
Andrey Zhavoronkov 72fdef4335
Az/import export tasks (#3056)
* initial version of task export/import feature

* fixed tests

* CLI

* fix comments

* updated license headers

* fix eslint issues

* fix comments

* fixed comments

* reverted changes in *.md files

* fixed comments

* fix pylint issues

* fix import for share case

* improved unit tests

* updated changelog

* fixed Maria's comments

* fixed comments

* Fixed position of create new task button

* Fixed span position

* fixed comments

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
Co-authored-by: Boris Sekachev <boris.sekachev@intel.com>
5 years ago
Roman Donchenko d15a3199c2
Fix many spelling errors (#3244)
* Fix spelling errors

* Bump version numbers after the spelling fixes

* Fix OSX build (os.mknod requires super-priviligies)

* Fixed eslint warnings.

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Boris Sekachev 6f52ef30e4
Support of context images for 2D tasks (#3122) 5 years ago
Maria Khrustaleva 6c38ad0701
Manifest (#2763)
* Added support for manifest file
* Added data migration
* Updated tests
* Update CHANGELOG
* Update manifest documentation
* Fix case with 3d data

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Nikita Manovich d33daa1669
Fallback to libx264 encoder if libopenh264 isn't available (#2875)
* Fallback to libx264 encoder if libopenh264 isn't available

* Unified ChunkWriters interfaces: quality setting from 0..100 range for both writers (#2895)

* Fix bandit warning.

Co-authored-by: Andrey Zhavoronkov <andrey.zhavoronkov@intel.com>
5 years ago
manasars 069fadc053
CVAT-3D: support lidar data on the server side (#2534)
* CVAT-3D Updated the Mime Types with Bin Support, added dependency of open3D
* CVAT-3D Added additional column as Dimension for engine_task table and created a relatedfiles table for PCD to Image mapping.
* Added Support for 3D file Upload in BIN and PCD.
* Added Dimension attribute defaulting to 2D for importer and exporter.
* Added props passing for dimension attribute, filtering of import, Migration Scripts and Dimension attribute for MpegChunk Writers

Co-authored-by: cdp <cdp123>
5 years ago
Maya c1da108f6c Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Maria Khrustaleva f2d0b71b72
Fixed saving of relative paths in dummy chunks instead of absolute (#2424)
* Fixed saving of relative paths in dummy chunks instead of absolute

* Updated CHANGELOG
5 years ago
Maya d2e186a647 Renaming 5 years ago
Maya f5421998c6 Merge branch 'develop' into mk/share_without_copying_ 5 years ago
Maria Khrustaleva bbfa880d1f
Added ability to correct upload video with a rotation record in the metadata (#2218)
* Added ability to correct upload video with a rotation record in the metadata

* fix sizes of rotated preview

* fix sizes of rotated frame

* Added tests for uploaded video with rotation record in metadata

* Used OpenCV instead of PIL

* Fixed tests

* Update CHANGELOG

* fix

* Moved function

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Maya fb8f5fffcb fix 5 years ago
Maya a1b32b406d temp 5 years ago
Maria Khrustaleva 072482ffe8
Changed "prepare data on the fly" functionality (#2217)
* Added ability to upload meta information with video & some fixes

* Added documentation for data on the fly preparation

* Added ability to prepare meta information for video manually

* fix

* style: fix codacy issues

* Refactoring

* docs: add optional parameter

* Add test

* Add license header

* Update CHANGELOG

Co-authored-by: Boris Sekachev <boris.sekachev@yandex.ru>
5 years ago
Maxim Zhiltsov e9552f84f3
Update media extractors (#2154)
* Fix PDF reading

* Fixes

* update changelog

* t

* fix len

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
5 years ago
Maxim Zhiltsov 8d3c95a764
Fix PDF reading (#2141)
Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Maya 2144c4aadd Refactoring 6 years ago
Maya ff62baab99 Changed paths 6 years ago
Maya ade215399c Fix 6 years ago
Maya f3630aa4b5 Some additions:
* moved cache implementation
 * fixed start, stop, step for tasks that created on the fly
 * changed frame provider
6 years ago
Maya e947a8252c Added ability to select using cache or no in task creating form & some fixes 6 years ago
Maya 5fa50be1fa Added most of video processing & cache implementation 6 years ago
Maya 08b195f05f Added preparation of meta information 6 years ago
Andrey Zhavoronkov b706546435
Added clamav integration (#1712)
* added clamav integration

* updated license headers and changelog
6 years ago
Andrey Zhavoronkov e87ec38476
Small preview and progress (#1331)
* Reduce preview size (untested)

* Fix tests

* Improve media readers (untested)

* fixed migration

* fixed frame provider

* fixed preview save

* fixed stop frame

* handle duration == None

* codacy

* added missed import

* unified iteration over frames for media readers and fixed corner case when user specify stop_frame = 0

Co-authored-by: Nikita Manovich <nikita.manovich@intel.com>
6 years ago
Andrey Zhavoronkov e7808cfb03
Data streaming using chunks (#1007)
Huge feature (200+ commits from different developers). It completely changes layout of data (please expect very long DB migration process if you have a lot of tasks). The primary idea is to send data as zip chunks (e.g. 36 images in one chunk) or encoded video chunks and decode them on the client side. It helps to solve the problem with latency  when you try to view a separate frame in the UI quickly (play mode).
Another important feature of the patch is to provide access to the original images. Thus for annotations the client uses compressed chunks but if you want to export a dataset Datumaro will use original chunks (but video will be decoded with original quality and encoded with maximum/optimal quality in any case).
6 years ago
Boris Sekachev 3b6961f4db React & Antd UI: Create task (#840)
* Separated component user selector
* Change job assignee
* Basic create task window
* Bug fixes and refactoring
* Create task connected with a server
* Loading status for a button
* Reset loading on error response
* UI improvements
* Github/feedback/share window
6 years ago
Nikita Manovich f537236e11
Fix the problem with duplicated frames in case of "share" (#735)
* Fix the problem with duplicated frames in case of "share".
* Fix a case when the code works incorrectly

/a/b/c
/a/b/c0

Previously only /a/b/c will be in output but should be both.
6 years ago
Nikita Manovich 1ec89b5f6a
Selecting non images leads to 400 error (#734)
* Fix HTTP 400 error if together with vision data the user submit non-vision data (e.g. text files)
* Ignore SVG images because Pillow doesn't work with them.
6 years ago
Andrey Zhavoronkov b48d59b5ec Ability to create custom extractors (#434)
* ability to add custom extractors
* added configurable mimetypes
* added a note to changelog
7 years ago
zliang7 076562321e URLs as source data for a task (#483)
* Update CHANGELOG.md
7 years ago
Boris Sekachev 923bcacd77 CVAT.js (part 1) (#463) 7 years ago
zliang7 4298166403 Support frame selection when create from video (#437) 7 years ago
Nikita Manovich ae6a4891e3
RESTful API (#389) 7 years ago
Happyzippy af1101bdb7 Adding support for 16bit grayscale images for annotation (#342) 7 years ago