okay, I will open an issue

does this mean that setting initial iteration to 0 should help?

I assume, temporary fix is to switch to trains-server?

I've already pulled new images from trains-server, let's see if the initial issue occurs again. thank for the fast response guys!

1 - yes, of course =) but it would be awesome if you could customize the content - to include key metrics and hyperparameters, for example
3 - hooooooraaaay

I don’t connect anything explicitly, I’m using argparse, it used to work before the update

same here, no live logs

for me, increasing shm-size usually helps. what does this RC fix?

perhaps I need to do task.set_initial_iteration(0)?

problem is solved. I had to replace /opt/trains/data/fileserver to /opt/clearml/data/fileserver in Agent configuration, and replace trains to clearml in Requirements

from the experiment log

there is no method for setting last iteration , which is used for reporting when continuing the same task. maybe I could somehow change this value for the task?

standalone-mode gives me "Could not freeze installed packages"

I'm not sure it's related to the domain switch since we upgraded to the newest ClearML server version at the same time

yeah, I think this is what I need!

well, the server wouldn't work without them?

magic

SuccessfulKoala55 grrrrr it keeps happening, I have no idea what's wrong

it prints an empty dict

I’m doing Task.init() in the script, maybe it somehow resets connected parameters… but it used to work before, weird

this would be great. I could just then pass it as a hyperparameter

nice! exactly what I need, thank you!

hmmm allegroai/trains:latest whatever it is

LOL
wow 😃
I was trying to find how to create a queue using CLI 😃

it might be that there is not enough space on our SSD, experiments cache a lot of preprocessed data during the first epoch...

kind of

if you click on the experiment name here, you get 404 because link looks like this:
https://DOMAIN/projects/PROJECT_ID/EXPERIMENT_ID
when it should look like this:
https://DOMAIN/projects/PROJECT_ID/experiments/EXPERIMENT_ID

another stupid question - what is the proper way to delete a worker? so far I've been using pgrep to find the relevant PID 😃

we are working on the medical projects, so probably images of the different body parts 😃

it will probably screw up my resource monitoring plots, but well, who cares 😃

wow, thanks, just updated our server!
can't seem to find these metrics snapshot plots =) how do I plot one?