is there a way that there is only one environment for the whole pipeline?

how's that?

while we spin up the autoscaler instance

So, I am able to resolve the above issues

I don't think it has issues with this

If you can let me know @<1576381444509405184:profile|ManiacalLizard2> @<1523701087100473344:profile|SuccessfulKoala55> how to resolve this, that would be very much helpful

inside the containers that are spinning on the host machine

Still giving me the same error

This didn't work, is there a way that I can set up this environment variable in my docker container?

I am providing pillow>=8.3.1 in my req.txt and I think clearml has Pillow==10.0.0 already

I got the issue resolved, thanks though

Thanks!

File "/opt/conda/envs/bumlo/lib/python3.10/site-packages/clearml/binding/artifacts.py", line 745, in upload_artifact
pickle.dump(artifact_object, f)
_pickle.PicklingError: Can't pickle <class 'mongoengine.base.metaclasses.samples.6627e5ecc60879fe5e49cee6'>: attribute lookup samples.6627e5ecc60879fe5e49cee6 on mongoengine.base.metaclasses failed

dataset = fo.Dataset.from_dir(
labels_path=labels_path,
dataset_type=fo.types.COCODetectionDataset,
label_field="ground_truth",
use_polylines=True
)
task.upload_artifact(
name="Dataset",
artifact_object=dataset,
)

Hey, @<1523701070390366208:profile|CostlyOstrich36> @<1523701087100473344:profile|SuccessfulKoala55> I would very much appreciate it if you could help me with this

So the issue I am facing is, I am running the pipeline controller task on my local system agent and the steps of the pipeline on an agent running on GCP VM, the first step of the pipeline is failing showing clearml_agent: ERROR: Failed cloning repository.

Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

so you mean when i ssh into my VM i need to do a git clone and then spin up the agent, right?

Can you tell me how clearml get access to my repo even if I didn't pass any information about it?

Ok, it's cloning but it's asking for my github credentials

Can you explain how running two agents would help me run the whole pipeline remotely? Sorry if its a very basic question

because when I was running both agents on my local machine everything was working perfectly fine

Is there a way to change the path inside the .txt file to clearml cache, because my images are stored in clearml cache only