I had initially just pasted the new credentials in place of the existing ones in my conf file;
Running clearml-init now fails at verifying credentials
can you also check that you can access the servers ?
try to do curl http://<my server>:port
for your different servers ? and share the results 🙂
I see some points that you should fix
in the train step, you return 2 items but you have only one in its decorator: add mock do you really need to init a task in the pipeline controller ? you will automatically get one when executing the pipeline
How do I access the logs of the init process?
So I'm trying to run my pipeline file that runs a pipeline locally and logs metrics and stuff to the clearml server
Yes they have been set up as per the new credentials created on the server
i dont know if it will help but here is what i would test :
remove temporary the task init in the controller use name and project parameters that dont have spaces in their name dont use services as a default queue
I replaced local host with the host name of the server in the credentials
When the pipeline or any step is executed, a task is created, and it name will be taken from the decorator parameters. Additionally, for a step, the name parameter is optional : if not provided, the function name will be used instead.
It seems to me that your script fails creating the pipeline controller task because it fails pulling the name parameter. which is weird ... Weird because in the last error line, we can see that name !
That aside, adding mock doesn't really change the error above though
(without the actual credentials, of course)
Tried all three solutions right now;
Oddly enough it doesn't work :(
We're initialising a task to ensure it appears on the experiments page;
Also not doing so gave us issues of ‘Missing parent pipeline task’ for a set of experiments we had done earlier
SuccessfulKoala55 Any leads f or the above error i n running the script?
2022-07-12 13:41:39,309 - clearml.Task - ERROR - Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})
Traceback (most recent call last):
File "main.py", line 189, in <module>
executing_pipeline(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 3253, in internal_decorator
a_pipeline = PipelineDecorator(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 2531, in _ init
super(PipelineDecorator, self).__init__(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 181, in _ init
self._task = Task.init(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 574, in init
task = cls._create_dev_task(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 2955, in _create_dev_task
task = cls(
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 175, in _ init
super(Task, self).__init__(**kwargs)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 169, in _ init
http://self.id = self._auto_generate(project_name=project_name, task_name=task_name, task_type=task_type)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 343, in _auto_generate
res = self.send(req)
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 109, in send
return self._send(session=self.session, req=req, ignore_errors=ignore_errors, raise_on_errors=raise_on_errors,
File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 103, in _send
raise SendError(res, error_msg)
clearml.backend_interface.session.SendError: Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})
WickedElephant66 can you share an example?
can you share some code ? about how you build the pipeline
those are the credentials you got from your self hosted server ?
what about the logs before the error ? i think it relevant to have them all. i try to isolate the error, and to understand if it comes from the cred, the servers addresses, a file error or a network error
Configuration completed now; I t was a proxy issue from my end
However running my pipeline from a different m achine still gives me a problem
just the error messages you get when clearml-init fails