also, whereas the pipeline agent's log has:Executing task id [7a0ad1fb243a4ff3b9e6c477442ded4a]: repository = git@github.com:shpigi/clearml_evaluation.git branch = main version_num = e045904094cf2f4fa61ce92f7b91682f5de64ab8
The component agent's log has:Executing task id [90de043e354b4b28a84d5cc0788fe63c]: repository = branch = version_num =
Hi PanickyMoth78
My local
clearml.conf
file has agent's
git_user
and
git_pass
defined as in my
in order for the autoscaler to access your git , in the wizard you have to provide the git user/token
The component agent's log has:
Executing task id [90de043e354b4b28a84d5cc0788fe63c]: repository = branch = version_num =Hmm, how does the decorator of the component looks like ? meaning did you specify a repo/branch/commit there ?
in order for the autoscaler to access your git , in the wizard you have to provide the git user/token
git_pass has the token
Perhaps I should have mentined that I start the AWS autoscaler with the https://app.clear.ml/applications/aws-autoscaler/ .
Hmm, how does the decorator of the component looks like ? meaning did you specify a repo/branch/commit there
Neither my pipeline decorator not my component specify any repos:
# pipeline @PipelineDecorator.pipeline( name="fastai_image_classification_pipeline", project="lavi-testing", version="0.2", multi_instance_support=True, )# component @PipelineDecorator.component( return_values=["the_dataset"], cache=False, task_type=TaskTypes.data_processing, packages=[ "clearml", "tensorboard_logger", "timm", "fastai", "torch==1.11.0", "torchvision==0.12.0", "protobuf==3.19.*", "tensorboard", "google-cloud-storage>=1.13.2", ], )
Yet the agent running the pipeline task is pulling the repo just fine..
Are you saying this component should pull a specific git repo?PipelineDecorator.component( ..., )seems like there is no reference to a specific repo (arguments repo and repo_branch etc are missing) is that correct?
Yes. I thought this happened automagically with the current git repo when I send a pipeline for execution from my local python environment. Shouldn't it?
It seems to have happened with the agent running the pipeline task.
I'll try adding repo and repo_branch to the pipeline.component decorator
AgitatedDove14
Adding adding repo and repo_branch to the pipeline.component decorator worked (and I can move on to my next issue 🙂 ).
I'm still unclear on why cloning the repo in use happens automatically for the pipeline task and not for component tasks.
I'm still unclear on why cloning the repo in use happens automatically for the pipeline task and not for component tasks.
I think in the pipeline it was the original default, but it turns out for a lot of users this was not their defualt use case ...
Anyhow you can also pass repo="." which will load + detect the repo in the execution environemtn and automatically fill it in