ConfusedGoat3

2 Questions, 6 Answers

Active since 01 October 2024

Last activity 2 months ago

Reputation

Badges 1

6 × Eureka!

Questions 2
Answers 6

0 Votes

7 Answers

185 Views

0 Votes 7 Answers 185 Views

Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Modify File Path From Artifacts? The File Server Ip Changed After Server Migration And Previously Generated Artifacts Are No Longer Reachable Due To File

Hi. I am using ClearML server on premises to manage ML data and tasks/experiments. Is it possible to modify FILE PATH from ARTIFACTS? The file server IP chan...

clearml

2 months ago

0 Votes

4 Answers

170 Views

0 Votes 4 Answers 170 Views

Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Re-Create/Upload From Disk A Final Dataset? One Dataset Part Is Corrupted On Disk At The File Server And Cannot Longer Be Downloaded. Thanks In Advance!

Hi. I am using ClearML server on premises to manage ML data and tasks/experiments. Is it possible to re-create/upload from disk a FINAL dataset? One dataset ...

clearml

2 months ago

0 Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Modify File Path From Artifacts? The File Server Ip Changed After Server Migration And Previously Generated Artifacts Are No Longer Reachable Due To File

Follow-up: although the FILE PATH from ARTIFACTS has the new IP and the MongoDB document looks fine, I get INTERNAL SERVER ERROR on download. Is HASH based on FILE PATH and fails a server check on download? Do you know what could be the issue? Thanks, again, in advance!

2 months ago

OK, thanks. Could you point me to a working example in ClearML/MongoDB? I don't have prior experience with ClearML/MongoDB.

2 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36> , thanks for the prompt response. Do you know how/where to find such script and a guideline to run it? Thanks a again.

2 months ago

Thanks, after reading documentation online and checking the DB with MongoDB Compass, I solved the issue with a Python script. Best wishes!

2 months ago

0 Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Re-Create/Upload From Disk A Final Dataset? One Dataset Part Is Corrupted On Disk At The File Server And Cannot Longer Be Downloaded. Thanks In Advance!

Hi @<1523701070390366208:profile|CostlyOstrich36> . It seems at least one artifact from the dataset task (i.e., a .zip part) is damaged on disk. I can access both the File Server storage and I do have a separate copy of the dataset outside ClearML that I could use to re-create/upload from disk. Do you know if there is a way to re-create/upload from disk using the backup copy I have outside ClearML? Thanks a lot in advance for your support!

2 months ago

Thanks again, @<1523701070390366208:profile|CostlyOstrich36> . I understand, but the copy is not a backup of ClearML .zip parts rather a single .zip file. Is there a way to re-create/upload from disk ClearML .zip parts? For example, trying to split the single .zip using ClearML .zip parts size? Could the HASH be an issue? Can dataset 'synchronize' help in this case?

2 months ago