Can you provide a code snippet that makes agent hang?
A sample dummy code
from clearml import Task
from Point import Point
import numpy as np
task = Task.init(project_name="project_demo", task_name="name")
parameters = {
"A": 3,
"B": 0.5
}
task.connect(parameters)
p = Point(2,3)
conf_yaml = task.connect_configuration(
name = "my yaml",
configuration = "config_yaml.yaml"
)
task.upload_artifact("Arti", np.zeros((10,10)))
What if you remove the Point package? Does it run then?
What is interesting, it works when using virtual environment setup
But stucks at the same moment when using docker
CostlyOstrich36 have you ever seen something like my case maybe?
Not really. This is strange. Can you try running the agent with --debug tag? This might give us more insights
clearml-agent daemon --docker --foreground --debug
usage: clearml-agent [-h] [--help] [--version] [--config-file CONFIG_FILE] [--debug]
{execute,build,list,daemon,config,init} ...
clearml-agent: error: unrecognized arguments: --debug
Try it as the first option after clearml-agent: clearml-agent --debug daemon --docker --foreground
WARNING: You are using pip version 20.1.1; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip'
command.
Retrying (Retry(total=239, connect=239, read=240, redirect=240, status=240)) after co
nnection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at
0x7faf9da78400>: Failed to establish a new connection: [Errno 111] Connection refused
',)': /auth.login
Do you maybe have blocks on some ports locally?
It looks like it's hanging on the connection to the ClearML server
when is server created on my local machine, when I do clearml-init
?
Are you running on a self hosted ClearML server or the SaaS?
no, it is everything on my local machine
I think something might be block ports on your local machine. Did you change ports mapping for the ClearML dockers?