Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Need

Need a little help here;
I have a clearml server set up on another machine and clearml configured on my laptop(running in wsl) for some reason I can't seem to get the agents turning up on my server’s workers page

  
  
Posted 2 years ago
Votes Newest

Answers 32


Yes they have been set up as per the new credentials created on the server

  
  
Posted 2 years ago

When the pipeline or any step is executed, a task is created, and it name will be taken from the decorator parameters. Additionally, for a step, the name parameter is optional : if not provided, the function name will be used instead.

It seems to me that your script fails creating the pipeline controller task because it fails pulling the name parameter. which is weird ... Weird because in the last error line, we can see that name !

  
  
Posted 2 years ago

We're initialising a task to ensure it appears on the experiments page;
Also not doing so gave us issues of ‘Missing parent pipeline task’ for a set of experiments we had done earlier

  
  
Posted 2 years ago

SuccessfulKoala55 Any leads f or the above error i n running the script?

  
  
Posted 2 years ago

those are the credentials you got from your self hosted server ?
what about the logs before the error ? i think it relevant to have them all. i try to isolate the error, and to understand if it comes from the cred, the servers addresses, a file error or a network error

  
  
Posted 2 years ago

This issue was due to a wsl proxy problem; wsl’s host name couldn't be resolved by the server and that became a problem for running agents. It works fine on Linux machines so far, however.
So no worries :D

  
  
Posted 2 years ago

How do I access the logs of the init process?

  
  
Posted 2 years ago

I had initially just pasted the new credentials in place of the existing ones in my conf file;
Running clearml-init now fails at verifying credentials

  
  
Posted 2 years ago

can you describe the issue ?

  
  
Posted 2 years ago

can you share some code ? about how you build the pipeline

  
  
Posted 2 years ago

Configuration completed now; I t was a proxy issue from my end
However running my pipeline from a different m achine still gives me a problem

  
  
Posted 2 years ago

Simple doubt

  
  
Posted 2 years ago

Here's the code we're testing

  
  
Posted 2 years ago

This is the error that I get:

  
  
Posted 2 years ago

image

  
  
Posted 2 years ago

image

  
  
Posted 2 years ago

I see some points that you should fix
in the train step, you return 2 items but you have only one in its decorator: add mock do you really need to init a task in the pipeline controller ? you will automatically get one when executing the pipeline

  
  
Posted 2 years ago

can you also check that you can access the servers ?
try to do curl http://<my server>:port for your different servers ? and share the results 🙂

  
  
Posted 2 years ago

Tried all three solutions right now;
Oddly enough it doesn't work :(

  
  
Posted 2 years ago

2022-07-12 13:41:39,309 - clearml.Task - ERROR - Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})

Traceback (most recent call last):

File "main.py", line 189, in <module>

executing_pipeline( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 3253, in internal_decorator

a_pipeline = PipelineDecorator( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 2531, in _ init

super(PipelineDecorator, self).__init__( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/automation/controller.py", line 181, in _ init

self._task = Task.init( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 574, in init

task = cls._create_dev_task( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 2955, in _create_dev_task

task = cls( 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/task.py", line 175, in _ init

super(Task, self).__init__(**kwargs) 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 169, in _ init

 http://self.id  = self._auto_generate(project_name=project_name, task_name=task_name, task_type=task_type) 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/task/task.py", line 343, in _auto_generate

res = self.send(req) 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 109, in send

return self._send(session=self.session, req=req, ignore_errors=ignore_errors, raise_on_errors=raise_on_errors, 

File "/home/mbz1kor/viper/lib/python3.8/site-packages/clearml/backend_interface/base.py", line 103, in _send

raise SendError(res, error_msg) 

clearml.backend_interface.session.SendError: Action failed <400/12: tasks.create/v1.0 (Validation error (error for field 'name'. field is required!))> (name=custom pipeline logic, system_tags=['development'], type=controller, comment=Auto-generated at 2022-07-12 08:11:38 UTC by mbz1kor@BMH1125053, project=2ecfc7efcda448a6b6e7de61c8553ba1, input={'view': {}})


  
  
Posted 2 years ago

That's alright?

  
  
Posted 2 years ago

So I'm trying to run my pipeline file that runs a pipeline locally and logs metrics and stuff to the clearml server

  
  
Posted 2 years ago

just the error messages you get when clearml-init fails

  
  
Posted 2 years ago

can you show the logs ?

  
  
Posted 2 years ago

WickedElephant66 can you share an example?

  
  
Posted 2 years ago

That aside, adding mock doesn't really change the error above though

  
  
Posted 2 years ago

I have hidden the host name as well

  
  
Posted 2 years ago

I replaced local host with the host name of the server in the credentials

  
  
Posted 2 years ago

i dont know if it will help but here is what i would test :
remove temporary the task init in the controller use name and project parameters that dont have spaces in their name dont use services as a default queue

  
  
Posted 2 years ago

What exact ly does the error mean

  
  
Posted 2 years ago
20K Views
32 Answers
2 years ago
7 months ago
Tags
Similar posts