The K8sIntegration can be made into a nice operator for example and deeply integrate into ClearML itself. :grinning_face_with_star_eyes:

also no authentication it seems

I want to find a good deployment framework (if exists) and integrate it into our ClearML workflow).
like get latest release with prod tag from clearml api and apply that to k8s.
something along those lines

I'll try that. How can I make it to use authentication too?

yes

of course because the tuple is valid in Python.
but there's no way I can supply a tuple in the HOCON format (of json for that matter(

Awesome info! Thanks!
What env variable should I use?
Also maybe I can block unauthenticated access to that endpoint too, I guess clearml-agent doesn’t use it!

Thanks a million SuccessfulKoala55 😍

hmm
that would be great.

https://github.com/allegroai/clearml-server/blob/babfcbb70701fc725448556d1e691cdfd1292949/apiserver/es_factory.py

https://allegro.ai/clearml/docs/docs/deploying_clearml/clearml_server_config.html

I actually got the idea to disable istio for the container. I think that'll work considering api-server doesn't need to be accessed directly from outside.

I'll test that and then your approach. If nothing works then I'll post again 😄

Thanks for your help Jake

aha got it..
I assume env vars would be configured according to this doc:
https://allegro.ai/clearml/docs/docs/deploying_clearml/clearml_server_config.html#dynamic-environment-variables

standard URI
according to:
https://elasticsearch-py.readthedocs.io/en/v7.12.1/#tls-ssl-and-authentication

SuccessfulKoala55 Hi Jake
We didn’t change anything related to gunicorn. Is there any specific thing I can check for?
Also I noticied that it’s not running the gunicorn as a command but loads it in the python code, I don’t think it’s possible to change the threading with env that way.

Ok I think I might have found the problem.

webserver deployment:

I'm using a simple pyhocon code to test it and it won't decode. So it won't reach the code to ovverride settings at all.

yes. Tuple is not valid. like json. only scalar, string, dict or array

Thanks!

wow man you're the best!
SuccessfulKoala55

It's concating them together:
[WARNING] [elasticsearch] GET http://[ https://elasti ....

I am already changing the chart, it would be no problem. But which env vars?

That's right

The login prompt doesn’t appear (I tried removing cookies and all too)

I’m using it in clearml k8s integration. So i’d rather avoid all extra stuff and bind the jupyter directly. Then use Istio, etc to secure access to it. I don’t think using ssh tunnels brings about any functionality or advantages of any sort when using kubernetes.

SuccessfulKoala55 I’m getting 405 on api calls with the configuration you proposed. (btw I think USER_KEY is right, with a single underscore)

It's still not connecting XD
but parsing is successful 😄

Oh well it doesn’t work for me then… I keep getting errors.