Some wierd bug with get_local_copy?
I have:
Dataset C (100x a.png, 100x b.json, 100x c.json)
Dataset B (5x a.png, 5x b.json, 5x c.json, 10x new.json)
Dataset A (5x a.png)
When doing get_local_copy() it starts downloading Dataset C which is 1.5TB. This should not be happening, it should only donwload Dataset A files. We manually checked and Dataset A state.json only contains 5x a.png and no other files from parents.
clearml==1.16.3
We noticed this behaviour on multiple machines
This behaviour in not observed in 1.14.4 1.15.1 1.16.2
So it looks like the bug was introduced in 1.16.3
AmiableSeaturtle81 , its best to open a GitHub issue in that case to follow up on this 🙂
CostlyOstrich36 It it still needed since Eugene thinks there is a bug?
Hi AmiableSeaturtle81 , can you provide a snippet that reproduces this and also the flow of how you registered the data?
Hi AmiableSeaturtle81 , I think you are right. We will try to look into this asap
