Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey Folks, When I Run

Hey folks, when I run clearml-init on an 'on-premise' server (which can only be accessed via VPN) it gives an error and fails to create the clearml.conf file. Is there a way to get this working?

  
  
Posted 3 years ago
Votes Newest

Answers 24


And is it talking to the correct server ?

  
  
Posted 3 years ago

I see this AgitatedDove14

  
  
Posted 3 years ago

curl -vvv

  
  
Posted 3 years ago

Verifying credentials ... Error: could not verify credentials: key=xxxxxx secret=xxxxx Enter user access key:

  
  
Posted 3 years ago

The 'on-premise' server fails to connect to the ClearML server because of the VPN I think

I think you are correct.
You can quickly test it, try ti run curl http://local-server:8008 see if that works

  
  
Posted 3 years ago

SmarmyDolphin68 what's the error ?

  
  
Posted 3 years ago

Yes, copied and pasted the configuration file correctly, points to the right server (running on Azure). I created a clearml.conf file on another Azure VM (not under the VPN) and there it worked fine. The 'on-premise' server fails to connect to the ClearML server because of the VPN I think

  
  
Posted 3 years ago

Ran it, but it gave no output (but it does say ran successfully)

  
  
Posted 3 years ago

` * Trying X.Y.Z.W:8080...

  • TCP_NODELAY set
  • Connected to X.Y.Z.W (X.Y.Z.W) port 8008 (#0)

GET /debug.ping HTTP/1.1
Host: X.Y.Z.W:8080
User-Agent: curl/7.68.0
Accept: /

  • Mark bundle as not supporting multiuse
    < HTTP/1.1 302 Found
    < Location:
    < Connection: close
    < X-Frame-Options: SAMEORIGIN
    < X-XSS-Protection: 1; mode=block
    < X-Content-Type-Options: nosniff
    < Content-Security-Policy: frame-ancestors
    <
  • Closing connection 0 `
  
  
Posted 3 years ago

Which would mean the error is because of a company firewall/self-signed certificate.
The easiest solution,Disable SSL certificate check for ClearML.
Create the ~/clearml.conf manually:
` #disable SSL certificate check
api.verify_certificate: False

copy paste the credentials section from the UI

it should look something like:

api {
# web_server on port 8080
web_server: " "

# Notice: 'api_server' is the api server (default port 8008), not the web server.
api_server: " ` ` "

# file server on port 8081
files_server: " ` ` "

# Credentials are generated using the webapp,  ` ` 
credentials {"access_key": "EGRTCO8JMSIGI6S39GTP43NFWXDQOW", "secret_key": "x!XTov_G-#vspE*Y(h$Anm&DIc5Ou-F)jsl$PdOyj5wG1&E!Z8"}

} `

  
  
Posted 3 years ago

It is http btw, i don't know why it logged https://

This is odd could it be it automatically forwards to https ?
I would try the certificate check thing first

  
  
Posted 3 years ago

What if I just copy a clearml.conf file and edit out the tokens? Could that work?

It is http btw, i don't know why it logged https://

  
  
Posted 3 years ago

I assume https from the log

  
  
Posted 3 years ago

I tried it about 2-3 months ago with trains-init (same use-case as this one) and it failed that time too.

Could it be the credentials are actually incorrect?

Highly unlikely, like I said, I generated a new set of credentials from the Web-UI and it worked perfectly fine for an Azure VM (not under the VPN).

  
  
Posted 3 years ago

Could it be the credentials are actually incorrect? because it seems like you can access the server? (I assume you were able to browse to it and generate credentials. right?)

  
  
Posted 3 years ago

Hmm, Is it http or https ?

  
  
Posted 3 years ago

seems okay to me

  
  
Posted 3 years ago

2021-02-08 18:49:25,036 - clearml - WARNING - InsecureRequestWarning: Certificate verification is disabled! Adding certificate verification is strongly advised. See: Retrying (Retry(total=239, connect=240, read=239, redirect=240, status=240)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='X.Y.Z.W', port=8015): Read timed out. (read timeout=3.0)",)': /auth.loginGot this, times out after 5 tries

  
  
Posted 3 years ago

This is odd could it be it automatically forwards to https

I have to check with my IT Team if there's any forwarding

  
  
Posted 3 years ago

Seems lime someone sitting in the middle and reroutes the request (maybe both https and port) ?!

  
  
Posted 3 years ago

Yeah I noticed that too! Ports are configured properly in the conf file though

  
  
Posted 3 years ago

According to you the VPN shouldn't be a problem right?

Correct as long as all parties are on the same VPN it should work, all the connections are always http so basically trivial communication

  
  
Posted 3 years ago

AgitatedDove14 , I'll have a look at it and let you know. According to you the VPN shouldn't be a problem right?

  
  
Posted 3 years ago

This port is odd, it should be 8008
8015

  
  
Posted 3 years ago
950 Views
24 Answers
3 years ago
one year ago
Tags