I had initially just pasted the new credentials in place of the existing ones in my conf file;
Running clearml-init now fails at verifying credentials
i dont know if it will help but here is what i would test :
remove temporary the task init in the controller use name and project parameters that dont have spaces in their name dont use services as a default queue
Configuration completed now; I t was a proxy issue from my end
However running my pipeline from a different m achine still gives me a problem
I replaced local host with the host name of the server in the credentials
Tried all three solutions right now;
Oddly enough it doesn't work :(
(without the actual credentials, of course)
How do I access the logs of the init process?
can you also check that you can access the servers ?
try to do curl http://<my server>:port
for your different servers ? and share the results 🙂
So I'm trying to run my pipeline file that runs a pipeline locally and logs metrics and stuff to the clearml server
That aside, adding mock doesn't really change the error above though
can you share some code ? about how you build the pipeline
Yes they have been set up as per the new credentials created on the server
This issue was due to a wsl proxy problem; wsl’s host name couldn't be resolved by the server and that became a problem for running agents. It works fine on Linux machines so far, however.
So no worries :D
SuccessfulKoala55 Any leads f or the above error i n running the script?
When the pipeline or any step is executed, a task is created, and it name will be taken from the decorator parameters. Additionally, for a step, the name parameter is optional : if not provided, the function name will be used instead.
It seems to me that your script fails creating the pipeline controller task because it fails pulling the name parameter. which is weird ... Weird because in the last error line, we can see that name !
2022-07-12 13:41:39,309 - clearml.Task - ERROR - Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})
Traceback (most recent call last):
File "main.py", line 189, in <module>
executing_pipeline(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 3253, in internal_decorator
a_pipeline = PipelineDecorator(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 2531, in _ init
super(PipelineDecorator, self).__init__(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 181, in _ init
self._task = Task.init(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 574, in init
task = cls._create_dev_task(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 2955, in _create_dev_task
task = cls(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 175, in _ init
super(Task, self).__init__(**kwargs)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 169, in _ init
http://self.id = self._auto_generate(project_name=project_name, task_name=task_name, task_type=task_type)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 343, in _auto_generate
res = self.send(req)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 109, in send
return self._send(session=self.session, req=req, ignore_errors=ignore_errors, raise_on_errors=raise_on_errors,
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 103, in _send
raise SendError(res, error_msg)
clearml.backend_interface.session.SendError: Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})
those are the credentials you got from your self hosted server ?
what about the logs before the error ? i think it relevant to have them all. i try to isolate the error, and to understand if it comes from the cred, the servers addresses, a file error or a network error
I see some points that you should fix
in the train step, you return 2 items but you have only one in its decorator: add mock do you really need to init a task in the pipeline controller ? you will automatically get one when executing the pipeline
just the error messages you get when clearml-init fails