Still having the same issue I'm afraid

I see, no i do not get anything. I either get pop-ups when trying to capture the mpl figure, and otherwise nothing happens when using report_image .

I should mention this is run within a TF v1 session context

Yes, I am aware of this. None of the values are being reported, neither the scalar, images in debug-samples, nor in the plots tab.

Likely related to: https://github.com/allegroai/clearml/issues/321 - clearML waits indefinitely on logs from TF v1

Hi AgitatedDove14 , I am also unable to archive the individual experiments in it.

It's not a major issue, but it would be nice to remove as some users may get confused.

I'm running in the command line with Hydra and TFv1

I'm manually executing on a local machine

I am able to register that the image exists, however, the push towards the clearML server just does not happen

Not sure if you've tried this, but would click work? Otherwise the simplest thing I know is possible in Click, is to send the Dict of arguments further down the pipeline for the Allegro callback listener.

I’d like to create an animated gif

Ahh excellent! Thanks AgitatedDove14 🙂

I'll see if I can get time to do a reproducible example.

The issue only arises upon sending Images. (Both numpy, mpl and PIL)

Oh god

Oh okay, so you’re saying the UI will always use plotly to display the data? I guess I got confused since the color choices in https://allegro.ai/docs/examples/frameworks/pytorch/pytorch_tensorboard/ made it look like the TensorBoard graphs.

Got it to work now. Suspect something to do with a hydra issue, as both clearML hosted nor self-hosted option presented the same issue. Will update as I get a chance.

Hi Martin, thanks for the swift response.

Yes, the artifacts, as backing up the full database would not resolve the question of capacity. Unless I’m missing something

Yes, exactly, from a previously executed run. Essentially, I write a grid of images which are supposed to learn a generative task, i’d like to download all images and generate a gif from the collection of images.

I guess I could do a backup of the DB and flush the data, but what I’m looking for is more of a “Select X experiments -> Send to blob storage” to free up space.

Hang on, It was the static - No auto update AMI:
ami-0d6f44a1a7145a9f8

I might add, this error only started to occur upon upgrading from trains to clearmL

However in this case the option is grayed out

And another detail, upon running the same code in a notebook session, everything gets stored as intended (to clearML dashboard)

No, but I am able to delete other folder with experiements

Upon removing the phase loop the epoch was detected automatically again.

Can I force the login window?

AgitatedDove14 , after some more pronging, the error seem to stem from the clearML server. The upload from client side does not seem to occur, or the server is not registering the uploads.

I've attempted to restart the server and pull the latest image, same error.

Looks like we’re up and running

That’s embarassing