Hello! Have Any One Tried To Convert Large Dataset To Clear Ml Format ? I Am Tryting To Convert 350Gb Dataset With ~42 Million Files And Getting

Unanswered

Nothing special

    dataset = Dataset.create(dataset_name = 'my_dataset', parent_datasets=None, use_current_task=False)
    dataset.add_files(dataset_dir, verbose=False)
    dataset.upload(output_url='

)
    dataset.finalize(verbose=True)

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TeenyBeetle18
				
					0
					 × 1

146 Views

0 Answers

one year ago