CostlyOstrich36 I just use the command to check the folder in the terminal ( both ls
And du -h <folder> ) , it shows that the datasets are still here! Also, I can still download file even when it is deleted via WebUI.
I guess there is some method to delete the files in the self-hosted clearml-fileserver like async_delete? 🥲
result in 【 tasks.delete_many API 】
"meta": {
"id": "c836e23d3308421fa8eb84e67217b0dc",
"trx": "c836e23d3308421fa8eb84e67217b0dc",
"endpoint": {
"name": "tasks.delete_many",
"requested_version": "2.28",
"actual_version": "1.0"
},
"result_code": 200,
"result_subcode": 0,
"result_msg": "OK",
"error_stack": "",
"error_data": {}
},
"data": {
"succeeded": [
{
"id": "127388d22df945d2a0ab59b47a7ebca9",
"deleted": true,
"updated_children": 0,
"updated_models": 0,
"deleted_models": 0,
"urls": {
"model_urls": [],"event_urls": [],
"artifact_urls": [
" http://myip:8081/1234/upload.127388d22df945d2a0ab59b47a7ebca9/artifacts/conf/data.zip "
]
}
}
],
"failed": []
}
I can do anything ( create,add,upload,delete,publish ) project/datasets successfully using CLI ( including information in DB and files in the local directory ) , However when I delete them via WebUI, all files can't not be removed from the local directory.
How did you verify that the files are still there? Not just you can see the folder name itself but are there contents? If you use the same links through the web UI, can you still download files even when task/dataset is deleted?
Hi BlushingHedgehong95 , I would suggest the following few tests:
- Run some mock task that uploads an artifact to the files server. Once done, verify you can download the artifact via the web UI - there should be a link to it. Save that link. Then delete the task and mark to delete all artifacts. Test the link again to see that it fails to delete
- Please repeat the same with a dataset
Cany anyone help me 🥲
It seems like WebUI didn't trigger the delete event ( fileserver ) but only delete the information recorded in mongo ( like datasets/artifacts name , version...... etc )