Thanks!

Thanks, I got that issue resolved

@<1523701070390366208:profile|CostlyOstrich36>

Hey, so I am able to spin up the GCP instance using the autoscaler, I wanted to confirm one thing does the autoscaler spins up the agent automatically in the VM or do I need to add the script for that to the bash script

I was able to set up a GCP VM manually earlier, like without the autoscaler

I don't think it has issues with this

Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

Can you tell me how clearml get access to my repo even if I didn't pass any information about it?

because when I was running both agents on my local machine everything was working perfectly fine

is there a way that there is only one environment for the whole pipeline?

I am not able to see cu117 there

It has my project ID and zone

And one more thing is there a way to make changes to the .bashrc which is present inside the docker container

So the issue I am facing is, I am running the pipeline controller task on my local system agent and the steps of the pipeline on an agent running on GCP VM, the first step of the pipeline is failing showing clearml_agent: ERROR: Failed cloning repository.

I think I got it resolved

Self hosted

Hey, @<1523701070390366208:profile|CostlyOstrich36> @<1523701087100473344:profile|SuccessfulKoala55> I would very much appreciate it if you could help me with this

I did provide the credentials, and also I am running up the autoscaler for the first time, so no it hasn't worked before

I provided the credentials while setting up the autoscaler instance, where can I look for the clearml.conf. When I ssh into the instance, spin up by the autoscaler, I am not able to see the clearml.conf

Ok I'll try that out, enable_git_ask_pass: true is not working

@<1523701205467926528:profile|AgitatedDove14> I was able to resolve that, but now I am having issues with fiftyone, it's showing me the following error

import fiftyone as fo
File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/fiftyone/init.py", line 25, in <module>
from fiftyone.public import *
File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/fiftyone/public.py", line 15, in <module>
_foo.establish_db_conn(config)
File "/root/.clearml...

Also I was facing another issue, the task is not able to clone the github repo, it's showing authentication error even though I have passed my git credentials

When the package installation is done in the task

While creating a GCP credentials using None
What values should I insert in the following step so that the autoscaler has access, as of now I left this field blank

yes same env for all the components

2023-10-03 20:46:07,100 - clearml.Auto-Scaler - INFO - Spinning new instance resource='clearml-autoscaler-vm', prefix='dynamic_gcp', queue='default'
2023-10-03 20:46:07,107 - googleapiclient.discovery_cache - INFO - file_cache is only supported with oauth2client<4.0.0
2023-10-03 20:46:07,122 - clearml.Auto-Scaler - INFO - Creating regular instance for resource clearml-autoscaler-vm
2023-10-03 20:46:07,264 - clearml.Auto-Scaler - INFO - --- Cloud instances (0):
2023-10-03 20:46:07,482 - clearm...

So funny thing I was making a typo while writing the GPU type, I was writing NVIDIA T4 instead of nvidia-tesla-t4

If you can let me know @<1576381444509405184:profile|ManiacalLizard2> @<1523701087100473344:profile|SuccessfulKoala55> how to resolve this, that would be very much helpful

So, one of my tasks requires GCP credentials json file, is there a way that I can pass in the json file and set the environment variable for that?

thanks for the help though!!