Can you fix this or should I open a PR. I'm blocked by this.

do I have to fetch it via code? I was hoping to not modify my scripts

Also how do I provide the k8 glue agent permissions to spin up/down ec2 nodes?

Are you able to do screenshare to discuss this? I'm not sure I understand the k8 glue agent purpose.

I can open a PR

You guys are the maintainers of this repo

https://github.com/allegroai/clearml-helm-charts/pull/107

On a somewhat related note to k8s, do you know where I can change this host name? I got this error when my task is fetching a dataset.
2022-09-23 15:09:45,318 - clearml.storage - ERROR - Could not download

Would using 22.04 Ubuntu still work in the task execution?

AgitatedDove14 How do I setup a master task to do all the reporting?

so its not the files server, its every server

I can see this log message in the nginx controller
"GET / HTTP/1.1" 405 178 "-" "curl/7.79.1" 95 0.003 [clearml-clearml-fileserver-8081] [] 10.36.1.61:8081 178 0.004 405 b4f5caf7665ffa1e8823a195ae41ec26

ok yes, this is the problem

I think this is VPN related now

I think if I use the local service URL this problem is fixed

I wouldn't be able to pass in ~/.clearml/cache/storage_manager/datasets/ds_{ds_id}/my_file.json as an argument?

Sure. My git repo myProject.git does not have file.json checked into VCS. I'd like to add this file at experiment runtime or equivalent.

yes

Wouldnt that be docker mode?

perhaps the 405 is from nginx

I don't see any requests

After proving we can run our training, I would then advise we update our code base

I think the issue is the pod to pod comms can't resolve my route53 dns records

` "ipAddressV4": "165.160.15.20",
"organization": {
"asn": "19574",
"asnOrg": "CSC",
"isp": "Corporation Service Company",
"org": "Corporation Service Company"
},
"country": {
"countryName": "United States"
},
"city": {
...

Would that be under values.yaml for agent?

I got everything working using the default queue. I can submit an experiment, and a new GPU node is provisioned, all good

Important part here: Malicious IP: 165.160.15.20

Would I copy and paste this block to produce another queue and k8 glue agent?

For instance, if I wanted the default queue and gpu queue that I create, how do I do that?

So I'd create the queue in the UI, then update the helm yaml as above, and install? How would I add a 3rd queue?