Reputation
Badges 1
63 × Eureka!CLEARML__SECURE__HTTP__SESSION_SECRET__APISERVER
Does this one need to be changed?
Thanks a million SuccessfulKoala55 😍
It’s probably unrelated 😬 I’ll keep you posted.
Awesome info! Thanks!
What env variable should I use?
Also maybe I can block unauthenticated access to that endpoint too, I guess clearml-agent doesn’t use it!
SuccessfulKoala55 Hi Jake
We didn’t change anything related to gunicorn. Is there any specific thing I can check for?
Also I noticied that it’s not running the gunicorn as a command but loads it in the python code, I don’t think it’s possible to change the threading with env that way.
we’re running it with the older helm chart if that matters. anyways I can’t see anything related to Gunicorn in chart or configs.
Ok I think I might have found the problem.
- name: CLEARML__APISERVER__PRE_POPULATE__ENABLED value: "false" - name: CLEARML__APISERVER__PRE_POPULATE__ZIP_FILES value: /opt/clearml/db-pre-populate - name: CLEARML_SERVER_DEPLOYMENT_TYPE value: helm-cloud
The rest are clearly credentials…
ah ok. So only solution is changing the hardcoded one…
I will be looking into docs to find the right env variable. If you know it I’d appreciate you telling me 😄 SuccessfulKoala55
I actually got the idea to disable istio for the container. I think that'll work considering api-server doesn't need to be accessed directly from outside.
I'll test that and then your approach. If nothing works then I'll post again 😄
Thanks for your help Jake
yep it was unrelated.. sorry
Thanks for your help
I want to find a good deployment framework (if exists) and integrate it into our ClearML workflow).
like get latest release with prod tag from clearml api and apply that to k8s.
something along those lines
I changed them and tried some combinations to no avail...
I assume it should change the retry pattern too. but it doesn't change.. I feel I'm missing something obvious here
yes. Tuple is not valid. like json. only scalar, string, dict or array
curl works with the same url and creds from the container...
It's still not connecting XD
but parsing is successful 😄
wow man you're the best!
SuccessfulKoala55
of course because the tuple is valid in Python.
but there's no way I can supply a tuple in the HOCON format (of json for that matter(
I’m not using templates for k8s glue. I’m using the default operation mode which uses kubectl run. Should I use templates and specify a service in there to be able to connect to the pods?
Ah I think I understand it now. 🙂
There’s a static number of pod which services are created for…
So do I have to create a template yaml to be able to use this feature?