Unanswered
Hi Guys!
Is There Any Way To Get Full State Of Dataset From Somewhere, Except My S3 Bucket?
I Need A Mapping Of Files And Batches That Were Uploaded As A Dataset. Maybe This Information Is Also Available In One Of The Clearml Databases?
Hi @<1523701070390366208:profile|CostlyOstrich36> . Thank you for your advise, it definitely makes sense. Regarding to the first point, each dataset has a file state.json
. In this file there os a key artifact_name
e.g., data
, data_001
, etc, and relative path of a file. I thought I can map this key with the chunk number. So, if I pull this file from s3 bucket, I can conclude which chunk I should download to get a specific file. Am I wrong?
179 Views
0
Answers
one year ago
one year ago