Per my question above, what is the base path where the git repo is cloned?

Okay I will try the CLI thanks

Hey triggering the tasks from the CLI resolved the python pathing issues!

I guess I'm confused on venv mode vs docker mode. It seems like I'm passing in my own docker image which is then used at run time?

Does the clearml module parse the python packages? If I'm using a private pypi artifact server, would I set the PIP_INDEX_URL on the workers so they could retrieve those packages when that experiment is cloned and re-ran?

How does a task specify which docker image it needs?

Ah I see now

Was there a new release?

👍

If you look lower, it is there '/home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py'

AgitatedDove14 How do I setup a master task to do all the reporting?

You could change infrastructure or hosting, and now your data is associated with the wrong URL

It seems like https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L72-L80 doesn't actually do anything as the values set here aren't applied in the agent template

well I did something on my end, its magically working now

` "ipAddressV4": "165.160.15.20",
"organization": {
"asn": "19574",
"asnOrg": "CSC",
"isp": "Corporation Service Company",
"org": "Corporation Service Company"
},
"country": {
"countryName": "United States"
},
"city": {
...

Yes that fixed it, thanks!

Also I'd like to create the queues pragmatically, is that possible?

"additionalInfo": { "inBytes": "438", "localPort": "9134", "outBytes": "401", "unusual": "80", "value": "{\"inBytes\":\"438\",\"localPort\":\"9134\",\"outBytes\":\"401\",\"unusual\":\"80\"}", "type": "default" },

https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L61

Yea this is a bug

Its a legacy code base. There was issues around the memory not being cleared in the GPU when subprocesses were not used. At this point I refactored out the subprocess as it just adds more complexity.

Basically, when I have the clearml sdk imported into my python module and I Task.init I'm getting that error only when running the experiment in the task pod.

Not yet AgitatedDove14 Perhaps we can pair on this Monday.

it has sfi suffix and regular root

Okay, so basically the DL framework manages the master/worker relationship. I just need to use pod replicas for my k8 agents.

yea IDK, the git repo is a python library. Is it possible to run something like pip install -e . so I can utilize the setup.py?

Then it tries to curl the files API and gets a 405

AgitatedDove14 How would I install using a setup.py in a clearML task?

kubernetes cluster

yes but its limited