docker mode
different ids

hard to say, maybe just “related experiments” in experiment info would be enough. I’ll think about it

awesome, thank you

tags are somewhat fine for this, I guess, but there will be too many of them eventually, and they do not reflect sequential nature of the experiments

okay, give me a sec

some of the POST requests "tasks.get_all_ex" fail as far as I can see

nope, the only changes to config that we made are adding web-auth and non-responsive tasks watchdog

just in case, this warning disappeared after I https://stackoverflow.com/questions/49638699/docker-compose-restart-connection-pool-full

I get "The connection has timed out" when I'm trying to reach 8081 port

nice idea, thanks

I’ll let you know 😃

yeah, I am aware of trains-agent, we are planning to start using it soon, but still, copying original training command would be useful

copy-pasting entire training command into command line 😃

yes

I've done it many times, using different devices. sometimes it works, sometimes it doesn't

btw, there are "[2020-09-02 15:15:40,331] [9] [WARNING] [urllib3.connectionpool] Connection pool is full, discarding connection: elasticsearch" in the apiserver logs again

btw, are there any examples of exporting metrics using Python client? I could only find last_metrics attribute of the task

I updated the version in the Installed packages section before starting the experiment

0.16.1

sorry that I keep bothering you, I love ClearML and try to promote it whenever I can, but this thing is a real pain in the ass 😃

give me a sec

awesome!

just DMed you a screenshot where you can see a part of the token

we often do ablation studies with more than 50 experiments, and it was very convenient to compare their dynamics at the different epochs

I added the link just in case anyway 😃

also, is there any way to install a repo that we clone as a package. we often use absolute imports and do "pip install -e ." to utilize it
sorry there are so many questions, we just really want to migrate to trains-agent)

we've already restarted everything, so I don't have any logs on hands right now. I'll let you know if we face any problems 😃 slack bot works though! 🎉

I use the following Base Docker image setting: my-docker-hub/my-repo:latest -v /data/project/data:/data

self-hosted ClearML server 1.2.0
SDK version 1.1.6

I updated S3 credentials, I'll check if they work later

it doesn't explain inability to delete logged images and texts though

after the very first click, there is a popup with credentials request. nothing happens after that

isn't this parameter related to communication with ClearML Server? I'm trying to make sure that checkpoint will be downloaded from AWS S3 even if there are temporary connection problems

there's https://boto3.amazonaws.com/v1/documentation/api/latest/reference/customizations/s3.html#boto3.s3.transfer.TransferConfig parameter in boto3, but I'm not sure if there's an easy way to pass this parameter to StorageManager