ClearML FAQ | Hi All! I Am Solving The Following Issue -> File1.Py

Answered

Hi All! I Am Solving The Following Issue -> File1.Py

Hi all!
I am solving the following issue -> file1.py
task = Task.create(
task_name="XXX",
project_name='XXX',
repo="XXX",
branch='master',
script= 'XXX/task2.py',
commit='XXX',
docker_args='--network=host')
file2.py
-> there is task.init and some more code (this code is never executed). The main problem is that my agent is running in --docker mode and if run the task in "draft" mode from clearml-dashboard it has problem with git credentials. However, if i run task2.py by itself (it runs succcessfuly and also its clone). Anyone with similar problem ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Votes Newest

Answers 5

To describe the use-case. Lets say we have someapp which can export specific training script. I would like to create this as a specific "draft" task and later execute it.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Hi @<1523701181375844352:profile|ExasperatedCrocodile76> , and now the worker clones the repo correctly?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Probably i figured out everything. For me it is better to work with https and token (for git).

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Insight 2 <- repository is cloned correctly but the uncomitted changes are not.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Hi @<1523701070390366208:profile|CostlyOstrich36> , the worker cloned the repo correctly, however in the nested scipt if you use task.init it wont work / wont overwrite anything.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Write your answer

1K Views

5 Answers

one year ago

one year ago

Tags

Similar posts

Hi Guys! I'M Getting A Weird Problem. In The Latest Project I Created, Hydra Conf Is Not Logged Automatically. In The Script Hydra Is Working Correctly, And The Code For The Clearml Part Is Copied From Another Script (That Logs Hyperpars Correctly). I Al

Hello, I Am Trying To Run A Task In An Ec2 Worker With The Respective Agent In Docker Mode. I Am Using A Custom Docker Image. The Agent Is Configured To Use Ssh Authentication To Checkout The Code From Github (And It Does Check It Out In Pip/Poetry Mode)

Is There An Elegant Way Of Accessing A Specific File Entry From A Dataset Without Using Io Operations To Locate The File From The Cache Folder? The File Is Intended To Be Used To Create A Dataframe. At The Moment I'M Using The Code Below. The Problem Is T

Hey Guys, Is There A Way To Dynamically Know The Path Of A Cloned Github Project (And Task) Inside A Docker Mode Worker? I Want To Set The Pythonpath Inside My Docker Worker, So I Can Access Local Modules, And My Only Problem Is That The Path Depends On T

Hi Guys, I Have Problem Understanding To Set Requirements.Txt And Running Remotelty Using Clearml-Agent. So I Tried To Set Requirements, And Want To Execute Remotely. When In Draft Mode, The Installed Package Is Correct And Match Like Requirements.Txt, Bu

Hi, Guys! Thank You A Lot For Your Great Software, But I'Ve Got A Problem. I Have Got Two Remotes: Gitlab And Gitea. The Branch From Which I Run The Code Is Upstreamed With Gitea. However, In The Clearml Experiment, Gitlab Repository Is Automatically Sele

Hi Everybody, I Am Having An Issues With A Self-Hosted Clearml Server... I Am Having A Problem Enqueuing Experiments Whose Code Is In A Git Repository, They Are In A Pending State And Proceed... However If I Copy The Same Code Out In A Folder With No Rep

Hey, Is There An Easy Way To Retrieve The Code Used To Run An Experiment? Without Recreating The Whole Environment Etc. The Problem: I Have Ran A

Hi, I Am Experiencing Issues When Uploading Artifacts To The Dataset Task With Clearml Version V1.1.4Rc0. The Problem Is The Artifacts Are Uploaded To The Default Clearml Server, Even Though I Have Specified The Path To Our Storage Medium. The Code To Dem

Hi All, I'M Using Clearml 1.0.3 With Clearml-Server <1 (How Do I Get The Current Running Version?) In Pytorch-Lightning I Use Ddp And I See Multiple Tasks (As The Number Of Gpus) Being Created And Remaining In Draft Mode. Is It A Problem Running Clearml