Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I'M Encountering A Problem While Setting Up The Clearml-Agent I'Ve Installed Clearml-Server On A Remote Machine, And Made 3 Url (Eg,

Hi, I'm encountering a problem while setting up the clearml-agent
I've installed clearml-server on a remote machine, and made 3 url (eg, http://myclearmlfiles.com , http://myclearmlapi.com , http://myclearmlapp.com ) I'm using nginx to map the url to it's ports.
But when I try to setup clearml-agent the key verification fails, what can be the possible solution ?

  
  
Posted 3 years ago
Votes Newest

Answers 30


I wanted to enable HTTPS. exposing the ports would disable the ssl nginx was providing.

  
  
Posted 3 years ago

Here is one log from the API

[2021-05-24 09:04:46,311] [9] [WARNING] [clearml.service_repo] Returned 400 for in 0ms, msg=Invalid request path /

For what?

  
  
Posted 3 years ago

It was

  
  
Posted 3 years ago

What is CLEARML_HOST_IP actually signify ?

  
  
Posted 3 years ago

In the case of agent-services, it's the base host name used for calculating  CLEARML_WEB_HOSTCLEARML_API_HOST  and  CLEARML_FILES_HOST

  
  
Posted 3 years ago

What do you mean? What are you trying to protect against?

  
  
Posted 3 years ago

Here is one log from the API
[2021-05-24 09:04:46,311] [9] [WARNING] [clearml.service_repo] Returned 400 for in 0ms, msg=Invalid request path /

  
  
Posted 3 years ago

Do you thing putting it behind nginx will be an useful feature ? Then i'll open a feature request issue.

  
  
Posted 3 years ago

I'm not sure it's working using curl since you're not doing anything using the credentials - for all I know you might be reaching the demo server 🙂

  
  
Posted 3 years ago

I'm not sure - it can be a simple mechanism, but obviously it will take some time to make it work 🙂

  
  
Posted 3 years ago

Got it exposing the ports should work, I'm guessing. How do you suggest to secure the port in that case ?

  
  
Posted 3 years ago

I get this response

  
  
Posted 3 years ago

Since the traffic are routed through nginx for 3 url (eg,  http://myclearmlfiles.comhttp://myclearmlapi.comhttp://myclearmlapp.com ) to different port, what should be the value of CLEARML_HOST_IP

  
  
Posted 3 years ago

I assumed this was the error when clear-ml tried to connect. Looks like this was the curl.

  
  
Posted 3 years ago

Well, it's possible you're redirecting to the wrong place? I'm not sure the nginx redirection works - we've only used sub-domain rules

  
  
Posted 3 years ago

Redirection seems to be working with curl, as well as dashboard ie i'm able to access the dashboard with the URL.

  
  
Posted 3 years ago

There are no logs in clearml-apiserver for auth.

  
  
Posted 3 years ago

{"meta":{"id":"e1dbf2fcec864085ae05762a61594e9c","trx":"e1dbf2fcec864085ae05762a61594e9c","endpoint":{"name":"users.get_current_user","requested_version":"2.13","actual_version":"1.0"},"result_code":401,"result_subcode":22,"result_msg":"Unauthorized (invalid credentials) (failed to locate provided credentials)","error_stack":null,"error_data":{}},"data":{}}

  
  
Posted 3 years ago

So the server you're reaching (whichever server it is) does not have the credentials on record

  
  
Posted 3 years ago

Okay, let me try that out.

  
  
Posted 3 years ago

which means this is probably not the same server instance you're seeing in the WebApp (if the credentials indeed appear there)

  
  
Posted 3 years ago

was checking the clearml-apiserver logs there are no events when doing clearml-agent init

  
  
Posted 3 years ago

I used the configuration file provided as example changes the necessary things. Looks like it's somehow not able to hit the api.
clearml_agent: ERROR: Failed getting token (error 400 from https://myclearmlapi.com ): Bad Request

  
  
Posted 3 years ago

Cool I'll open an issue and see the response.

  
  
Posted 3 years ago

Yeah, well, that's exactly why we used sub-domains to support HTTPS/SSL

  
  
Posted 3 years ago

No it seems something is still going wrong, my clear-agent-services is not starting, as well as when I install clearml-agent anywhere it's not able to verify the credentials.

  
  
Posted 3 years ago

Try to see the server log while you're trying to verify the agent credentials (not agent-services)

  
  
Posted 3 years ago

if you're configuring CLEARML_WEB_HOSTCLEARML_API_HOST  and  CLEARML_FILES_HOST for the agent-services, you don't need to pass CLEARML_HOST_IP

  
  
Posted 3 years ago

Try curl -u <access_key>:<secret key> https://myclearmlapi.com/users.get_current_user and see what you get

  
  
Posted 3 years ago
659 Views
30 Answers
3 years ago
one year ago
Tags