Hi everyone! I discovered that uploading model artifacts at each checkpoint to the clearml server significantly slows down training. So I set output_uri to s...
one year ago
SweetCat82
1
Question,
3
Answers
Active since 15 June 2023
Last activity
one year ago
Reputation
0
Badges 1
3 × Eureka!
0
Hi Everyone!
I Discovered That Uploading Model Artifacts At Each Checkpoint To The Clearml Server Significantly Slows Down Training. So I Set
Thank you for your help, @<1576381444509405184:profile|ManiacalLizard2> ! I tried it and got an error "Invalid task status: expected=created, status=completed ...".
I'm a bit confused about this... How to add an artifact to this task? Is it safe to call task.init() again?
one year ago
0
Hi Everyone!
I Discovered That Uploading Model Artifacts At Each Checkpoint To The Clearml Server Significantly Slows Down Training. So I Set
Will it be recognized as a model?
Though I will try it anyway, thank you!
one year ago
0
Hi Everyone!
I Discovered That Uploading Model Artifacts At Each Checkpoint To The Clearml Server Significantly Slows Down Training. So I Set
@<1523701070390366208:profile|CostlyOstrich36> That's literally one of my first experiments ☺ . I trained a model in Jupyter and after the training stopped, ran 'task.upload_artifact' in the next cell.
one year ago