Unanswered

Task.Init() Takes By Default Output_Uri From Clearml.Conf Configuration File (S3 Bucket In My Case). But Underlined Task Created With Dataset.Create() Ignores It And Uploads Files By Default To

Hi SuccessfulKoala55 Here is code_snipet
` task = Task.init(project_name=PROJECT_NAME, task_name=section)
task.connect(params)
print('params', params)

dataset = Dataset.create(dataset_name=params['dataset'], dataset_project=PROJECT_NAME)
dataset_local_dir = dataset.get_local_copy()

dataset._task.output_uri = task.output_uri

KeywordProcessor(params['es_host'], params['es_port'], True, DOCS_ROOT)

dataset.add_files(DOCS_ROOT, wildcard='*.csv')
dataset.upload() `I add several files to a dataset and upload

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					HelpfulHare30
				
					0
					 × 1

159 Views

0 Answers

3 years ago

one year ago