I'm afraid I just had an improper indentation somewhere, no harms done. Thanks for the reply.

Hi SuccessfulKoala55 , I believe I was only given one option in my region (EU Stockholm) which was the 0.16.1 version with the AMI location:

aws-marketplace/allegroai-trains-server-0.16.1-320-273-c5c210e4-5094-4eb9-a613-a32c0378de31-ami-06f5e9f4dfa499dca.4

I used the Trains AMI, and I am not sure whether it was the auto-updated or static one

Can I force the login window?

Additionally -

Are there any clever functionality for dumping experiment data to external storage to avoid filling up the server?

That’s embarassing

Looks like we’re up and running

Yes, I am aware of this. None of the values are being reported, neither the scalar, images in debug-samples, nor in the plots tab.

Hi AgitatedDove14 - I used the Tensorboard writer.scalars function. Haven't tried the Plotly natively, but I guess its the same, since I imagine you're just doing a passthrough.

according to https://plotly.com/python/v3/LaTeX/ plotly should support Latex in labels since 3.6.0

Yes, exactly, from a previously executed run. Essentially, I write a grid of images which are supposed to learn a generative task, i’d like to download all images and generate a gif from the collection of images.

I guess I could do a backup of the DB and flush the data, but what I’m looking for is more of a “Select X experiments -> Send to blob storage” to free up space.

Please don’t ping people here.

And another detail, upon running the same code in a notebook session, everything gets stored as intended (to clearML dashboard)

Hi AgitatedDove14 , thanks for your reply.

I basically follow the example to use the SummaryWriter to add plots to the dashboard, however, the plots added are Plotly plots and not the tensorboard equivalent.

Likely related to: https://github.com/allegroai/clearml/issues/321 - clearML waits indefinitely on logs from TF v1

However in this case the option is grayed out

Thank you 😅 Very much

AgitatedDove14 , after some more pronging, the error seem to stem from the clearML server. The upload from client side does not seem to occur, or the server is not registering the uploads.

I've attempted to restart the server and pull the latest image, same error.

Yes, the login details to the Trains UI

Upon removing the phase loop the epoch was detected automatically again.

Many thanks! Got to say; You’ve made and are making a killer of a product!

Hi AgitatedDove14

Turns out my double loop caused some issues.

for e in range(num_epochs): for phase in ['train','valid']: for batch in dataloader:

Noted. Thanks SuccessfulKoala55 - I was aware of this, yet I didn’t think it would also compare in the comparison window - It does. My god, I love your product.

Oh god

Still having the same issue I'm afraid

I'm manually executing on a local machine