Fix manifest removing (#3791)

CHANGELOG.md

@@ -35,6 +35,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Exception `DataCloneError: The object could not be cloned` (<https://github.com/openvinotoolkit/cvat/pull/3733>)
 - Fixed extension comparison in task frames CLI (<https://github.com/openvinotoolkit/cvat/pull/3674>)
 - Incorrect work when copy job list with "Copy" button (<https://github.com/openvinotoolkit/cvat/pull/3749>)
+- Manifest removing (<https://github.com/openvinotoolkit/cvat/pull/3791>)
 
 ### Security
 

utils/dataset_manifest/core.py

@@ -379,8 +379,8 @@ class _ManifestManager(ABC):
 
     def remove(self):
         self.reset_index()
-        if os.path.exists(self.path):
-            os.remove(self.path)
+        if os.path.exists(self.manifest.path):
+            os.remove(self.manifest.path)
 
     @abstractmethod
     def create(self, content=None, _tqdm=None):