ClearML FAQ | Hi All, Is There A Way To Configure Clearml On A Host Running Pytorch Training, But Not Having Access To The Clearml Server, So It Would Output Clearml Experiments On A S3 Bucket And, The Clearml Server To Have A Project Exclusively Listening To This Buck

Answered

Hi All, Is There A Way To Configure Clearml On A Host Running Pytorch Training, But Not Having Access To The Clearml Server, So It Would Output Clearml Experiments On A S3 Bucket And, The Clearml Server To Have A Project Exclusively Listening To This Buck

Hi all, is there a way to configure clearml on a host running pytorch training, but not having access to the Clearml server, so it would output clearml experiments on a s3 bucket and, the Clearml server to have a project exclusively listening to this bucket to render scalars,...

  				
Posted 
	3 months ago

					More  		
  Report
		
					LethalCoral80
				
					0
					 × 1

Votes Newest

Answers 2

Thanks CostlyOstrich36 for the hint, but what I would need is to be able to monitor live the experiment but offline mode does not allow this. Maybe the only way would be to have another Clearml server running on the remote host with the s3-bucket as the storage for clearml folders? And for the real Clearml server to mount this s3-bucket as its storage too?

  				
Posted 
	3 months ago

					More  		
  Report
		
					LethalCoral80
				
					0
					 × 1

Hi LethalCoral80 , I think what you're looking for is the offline mode - None

  				
Posted 
	3 months ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

272 Views

2 Answers

3 months ago

3 months ago

Tags

Similar posts

Hi @<1523701070390366208:profile|CostlyOstrich36> Is there a way to set the bucket access to clearml-server without setting from Clearm UI. I tried to set arn-role to pod, But still UI ask for credentials

Hi All, Quick Question About Clearml Datasets. Does Anyone Know If It Is Possible To Access (Could Just Be Paths To The Data In A Bucket) A Dataset Directly From S3, Instead Of Downloading A Local Copy? We Typically Store And Access Large Quantities Of

Hey All, I'M Running A Self Hosted K8S Cluster With Clearml Server Installed Using Helm Chart Clearml-7.2.0, And Saving My Artifacts In Self Hosted S3 Bucket. I'M Able To Upload My Artifacts Just Fine, But I Want To Be Able To Delete Those Artifacts When

Hi Clearml Community, I'M Trying To Deploy A Clearml Scheduler Via Docker. I'Ve Managed To Put Everything Together And Tested That The Scheduler In Both Local And Remote Execution Works. The Pipeline Reads Data From An S3 Bucket, This Works Fine Locally B

Hello All, I'Ve A Question On S3 Integration. I'Ve Deployed Clearml And Clearml-Agent Helm Charts In My Ovh Managed K8S Cluster. I'Ve Jupyterhub Running In Same Namespace. I Was Trying To Make Connection With My Ovh S3 Bucket From Jupyter Notebook By Fetc

Hi Guys! Is There Any Way To Get Full State Of Dataset From Somewhere, Except My S3 Bucket? I Need A Mapping Of Files And Batches That Were Uploaded As A Dataset. Maybe This Information Is Also Available In One Of The Clearml Databases?

Hi, I’M Trying To Create A Dataset On Clearml Server From My Aws S3 Bucket Via:

Hi All, I Am Running A Self Hosting Clearml Server On An Ec2 Instance. I Am Able To Run Training And Log The Data Into A Separate S3 Bucket By Specifying The

Hello, I Have A Question I Am Trying To Connect Clearml To Local Minio But For Some Reason The Host Configuration Is Dropped Out, I Tried To Go In To The Code To Print Out The Config Throughout The Different Steps And I Get This [S3Bucketconfig(Bucket='In

Hello! I Have A Hard Time Connecting To Non-Aws S3 Bucket To Use It As A Storage To Clearml Dataset. Even Though I Add Access And Secret Key In ~/Clearml.Conf File, When I Trying To Create A New Clearml Dataset: