Unanswered
In My Current Project I Generate The Data From An Sql Query. Is The Only Way To Register The Dataset With Clearml To Write The Files To Disk First Or Is There Another Method?
This Leads Into The Second Issue I Have, Which Is What Happens When I Store The
Thanks for the reply @<1523701070390366208:profile|CostlyOstrich36> !
It says in the documentation that:
Add a folder into the current dataset. calculate file hash, and compare against parent, mark files to be uploaded
It seems to recognize the dataset as another version of the data but doesn't seem to be validating the hashes on a per file basis. Also, if you look at the photo, it seems like some of the data does get recognized as the same as the prior data. It seems like it's the correct operation but I'm happy to be wrong.
But if you have a suggestion of a better approach. update_changed_files doesn't seem to quite do it either because you need to add the directory first.
113 Views
0
Answers
one year ago
one year ago