ClearML FAQ | Hi Everyone, Qq: I Specified The Output_Uri Of The

Answered

Hi Everyone, Qq: I Specified The Output_Uri Of The

Hi everyone,
qq: I specified the output_uri of the Task instance to be an s3 bucket and any artifact logged explicitly is indeed uploaded there. However, all the plots logged automatically from matplotlib are not being logged to the s3 bucket but to the https://api.clear.ml server. How do I change this?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AttractiveHawk17
				
					0
					 × 1

Votes Newest

Answers 2

I think you need to configure api.files_server in ~clearml.conf as your s3 bucket

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

yes! thanks

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AttractiveHawk17
				
					0
					 × 1

Write your answer

1K Views

2 Answers

2 years ago

one year ago

Tags

Similar posts

Hi All, Is There A Way To Configure Clearml On A Host Running Pytorch Training, But Not Having Access To The Clearml Server, So It Would Output Clearml Experiments On A S3 Bucket And, The Clearml Server To Have A Project Exclusively Listening To This Buck

Hi, I Have A Question About The Model Registry. Here'S My Situation: I'M Using K8S_Example And Struggling With Uploading A Model. Should Models Be Uploaded To The Fileserver, Or Should I Create Another S3 Bucket As Mentioned In The Documentation?

Hi All, Quick Question About Clearml Datasets. Does Anyone Know If It Is Possible To Access (Could Just Be Paths To The Data In A Bucket) A Dataset Directly From S3, Instead Of Downloading A Local Copy? We Typically Store And Access Large Quantities Of

Hi Clearml Community, I'M Trying To Deploy A Clearml Scheduler Via Docker. I'Ve Managed To Put Everything Together And Tested That The Scheduler In Both Local And Remote Execution Works. The Pipeline Reads Data From An S3 Bucket, This Works Fine Locally B

Hello. In Which Yaml Files For Kubernetes And Where Should I Specify The Aws File_Server And Credentials For Clearml-Agent So That When Running Tasks Remotely In The Queue, The Artifacts Are Saved In The S3 Bucket?

Aws { S3 { # S3 Credentials, Used For Read/Write Access By Various Sdk Elements # The Following Settings Will Be Used For Any Bucket Not Specified Below In The "Credentials" Section # ----------------------

If Some Someone Can Hep Us To Bypass The Fileserver And Directly Upload The Artifacts To The S3 Bucket

Hello Everyone, We Have Created A Cleaml Pipeline Using Pipelinecontroller. We Use Add_Function_Step To Add Tasks To The Pipeline. So As To Upload Artifacts Etc. Directly To S3 Bucket We Assign Bucket Path To The Output_Uri Parameter In The Add_Function_

Hi Guys! Is There Any Way To Get Full State Of Dataset From Somewhere, Except My S3 Bucket? I Need A Mapping Of Files And Batches That Were Uploaded As A Dataset. Maybe This Information Is Also Available In One Of The Clearml Databases?

Hi All, I Am Running A Self Hosting Clearml Server On An Ec2 Instance. I Am Able To Run Training And Log The Data Into A Separate S3 Bucket By Specifying The