ClearML FAQ | Hi , I Am New To Clearml , I Am Trying To Create A Pipeline That Have Multiple Steps That Run Inside A Gitlab Repo , So I Pass It Add_Function_Step With A Token Like : Repo=F"

Answered

Hi , I Am New To Clearml , I Am Trying To Create A Pipeline That Have Multiple Steps That Run Inside A Gitlab Repo , So I Pass It Add_Function_Step With A Token Like : Repo=F"

Hi ,
I am new to clearml , I am trying to create a pipeline that have multiple steps that run inside a gitlab repo , so i pass it add_function_step with a token like :
repo=f" None :{token}@gitlab.com/user/reponame.git"
where token is defined at the begging of the script of the pipeline using token = os.environ.get('GITLAB_TOKEN')
this works fine when i run the pipeline from the script directly but when i run it from the web interface it dosn't find the token.
i understand that i can define the token in clearml config but how ? i wasn't able to find instructions in the docs.

  				
Posted 
	one month ago

					More  		
  Report
		
					BlushingElephant78
				
					0

Votes Newest

Answers

Hi BlushingElephant78

have multiple steps that run inside a gitlab repo

one thing to make sure that is not missed, "inside a gitlab repo" , notice the actual pipeline is running on agents/workers/k8s gitlab will be the trigger and monitor it, but the actual execution should probably happen somewhere with proper compute

this works fine when i run the pipeline from the script directly but when i run it from the web interface

try to configure your git_user/git_pass with your user/app-key (or token)
None
it will essentially create the same link to pull the git from, i.e. None ... "

  				
Posted 
	one month ago

					More  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Write your answer

173 Views

1 Answer

one month ago

one month ago

Tags

Similar posts

Hi, I Would Like To Know From You, Maybe Someone Has Encountered The Problem That After Deploying An Agent Inside Docker, The Launch Of The Script Itself Occurs With A Delay (Lunch Pipeline Component). I Run Pipelines And Component Should Works Quickly, B

Hello Everyone, I Currently Have The Following Problem: I Have Rebuilt A Pipeline From The Example And Have Noticed That The Pipeline Is Registered Cleanly On Cearml But Is Not Executed By The Worker. In The Attachment You Can See The Pipeline From The Ex

Hi All, I Have Made A Pipeline Using Pipelinedecorator Which Runs Fine When I Run It Locally. When I Execute It Remotely, It Gets Stuck In The Queue Forever. Any Ideas? I Really Appreciate Your Help On That One

When I'M Looking At A Frames Of A Dataset Version That Is Stored In Private Blob Storage I Can'T See The Photos, It First Prompts Me To Enter A Sas Token. I Entered A Sas Token, But I Still Can'T See The Photos. I Assume This Is Because The Sas Token I En

Hi Everyone, I Have A Question On How To Disable Running Pipelines In Hybrid Mode, So That Agent Only Considers The Code From Git And Not From Local Repo While Running A Task Remotely. I Am Trying To Run A Demo Pipeline Remotely Using Clearml-Agent. Some

Hej Everyone! I'M Trying To Setup Cleraml Using K8S. Everything Went Well Until I Started My Training Pipeline. The Problem Is That My Debug Samples Aren'T Shown

Hello Everyone, I'M Working On A Flexible Machine Learning Pipeline Using Clearml, Covering Data Retrieval, Preprocessing, Training, And Evaluation. I Want To Add Hyperparameter Optimization (Hpo) As A Pipeline Step That Could Optimize The Preprocessing A

Hi Everyone. I'M New To Clearml, And I Want To Give It A Go. Does Someone Have A Link To An Elaborate Tutorial Or Guide That Shows How To Set Up A Ml Pipeline That Trains A Model That Then Is Used For Offline Inference But Also Published For Online Infere

Hi, I'M Working On Our Ml Project Using Clearml For Pipeline Management. I Have A Separate Function For Data Preparation That I'D Like To Use In The Clearml Pipeline. To Keep The Pipeline Script Clean, I Prefer Not To Define This Function Directly Within

Hi, I Would Like To Rerun Existing Pipeline With Another Set Of Parameters From Code. I See That It Is Possible From Ui. Please Help. Thank You!