Hi All, I Wanted To Know About Saving Datasets, We Want To Specify The Path To Gs By Default, As I Understand By Default It Uses The Path To File_Server? We Tried Sdk.Development.Default_Output_Uri =

Answered

Hi all, I wanted to know about saving datasets, we want to specify the path to gs by default, as I understand by default it uses the path to file_server? We tried sdk.development.default_output_uri = None , but it didn't help for Dataset, is it possible to specify ENV or other parameter in clearml.config, rather than output_uri parameter in Dataset.create? Thanks

  				
Posted 
	4 months ago

					More
				  		
  Report
		
					LonelyKangaroo55
				
					0
					 × 1

Votes Newest

Answers 2

Hi @<1603198163143888896:profile|LonelyKangaroo55> , you can change the value of files_server in your clearml.conf to control it as well.

  				
Posted 
	4 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

I ran into trouble with this, i found for saving data you need to have it specified in the conf. even though as far as im aware setting it as par tof a task is supposed to overwrite this.

further i found that the server wasnt able to resolve itself as a destination without providing an alias to the server name in the server side docker.

finally when it comes to saving artifacts it seems this had to be set in task.output_uri and not in the create or init :man-shrugging:

  				
Posted 
	4 months ago

					More
				  		
  Report
		
					FantasticSeaurchin8
				
					0
					 × 1

Write your answer

282 Views

2 Answers

4 months ago