
Reputation
Badges 1
50 × Eureka!I'm afraid I just had an improper indentation somewhere, no harms done. Thanks for the reply.
AgitatedDove14 , after some more pronging, the error seem to stem from the clearML server. The upload from client side does not seem to occur, or the server is not registering the uploads.
I've attempted to restart the server and pull the latest image, same error.
Got it to work now. Suspect something to do with a hydra issue, as both clearML hosted nor self-hosted option presented the same issue. Will update as I get a chance.
I am able to register that the image exists, however, the push towards the clearML server just does not happen
Oh okay, so youāre saying the UI will always use plotly to display the data? I guess I got confused since the color choices in https://allegro.ai/docs/examples/frameworks/pytorch/pytorch_tensorboard/ made it look like the TensorBoard graphs.
Hi Martin, thanks for the swift response.
Yes, the artifacts, as backing up the full database would not resolve the question of capacity. Unless Iām missing something
I guess I could do a backup of the DB and flush the data, but what Iām looking for is more of a āSelect X experiments -> Send to blob storageā to free up space.
Looks like weāre up and running
Hi AgitatedDove14 , thanks for your reply.
I basically follow the example to use the SummaryWriter to add plots to the dashboard, however, the plots added are Plotly plots and not the tensorboard equivalent.
No, but I am able to delete other folder with experiements
Noted. Thanks SuccessfulKoala55 - I was aware of this, yet I didnāt think it would also compare in the comparison window - It does. My god, I love your product.
Yes, the login details to the Trains UI
Not sure if you've tried this, but would click work? Otherwise the simplest thing I know is possible in Click, is to send the Dict of arguments further down the pipeline for the Allegro callback listener.
And another detail, upon running the same code in a notebook session, everything gets stored as intended (to clearML dashboard)
Thank you š Very much
Additionally -
Are there any clever functionality for dumping experiment data to external storage to avoid filling up the server?
It seems there is some async behavior going on. After ending a run, this prompt just hangs for a long time:
2021-04-18 22:55:06,467 - clearml.Task - INFO - Waiting to finish uploads
And there's no sign of updates on the dashboard.
I'm manually executing on a local machine
Hi AgitatedDove14 , I am also unable to archive the individual experiments in it.
It's not a major issue, but it would be nice to remove as some users may get confused.
I'll see if I can get time to do a reproducible example.
The issue only arises upon sending Images. (Both numpy, mpl and PIL)
You were absolutely right
Can I force the login window?
Hang on, It was the static - No auto update AMI:ami-0d6f44a1a7145a9f8