Hi Martin, thanks for the swift response.

Yes, the artifacts, as backing up the full database would not resolve the question of capacity. Unless I’m missing something

Additionally -

Are there any clever functionality for dumping experiment data to external storage to avoid filling up the server?

Noted. Thanks SuccessfulKoala55 - I was aware of this, yet I didn’t think it would also compare in the comparison window - It does. My god, I love your product.

However in this case the option is grayed out

Hi AgitatedDove14

Turns out my double loop caused some issues.

for e in range(num_epochs): for phase in ['train','valid']: for batch in dataloader:

I'm afraid I just had an improper indentation somewhere, no harms done. Thanks for the reply.

Please don’t ping people here.

Hi AgitatedDove14 , I am also unable to archive the individual experiments in it.

It's not a major issue, but it would be nice to remove as some users may get confused.

No, but I am able to delete other folder with experiements

Not sure if you've tried this, but would click work? Otherwise the simplest thing I know is possible in Click, is to send the Dict of arguments further down the pipeline for the Allegro callback listener.

Hang on, It was the static - No auto update AMI:
ami-0d6f44a1a7145a9f8

Hi AgitatedDove14 - I used the Tensorboard writer.scalars function. Haven't tried the Plotly natively, but I guess its the same, since I imagine you're just doing a passthrough.

according to https://plotly.com/python/v3/LaTeX/ plotly should support Latex in labels since 3.6.0

Oh god

Yes, the login details to the Trains UI

A lot of bad requests and connection refused

And now it works

Looks like we’re up and running

That’s embarassing

I just changed the login details prior the restarting of the server, could this be at fault? I changed the trains-user to a different one

I guess I could do a backup of the DB and flush the data, but what I’m looking for is more of a “Select X experiments -> Send to blob storage” to free up space.

Ahh excellent! Thanks AgitatedDove14 🙂

Hi SuccessfulKoala55 , I believe I was only given one option in my region (EU Stockholm) which was the 0.16.1 version with the AMI location:

aws-marketplace/allegroai-trains-server-0.16.1-320-273-c5c210e4-5094-4eb9-a613-a32c0378de31-ami-06f5e9f4dfa499dca.4

I used the Trains AMI, and I am not sure whether it was the auto-updated or static one

Thank you 😅 Very much

Yes, exactly, from a previously executed run. Essentially, I write a grid of images which are supposed to learn a generative task, i’d like to download all images and generate a gif from the collection of images.