Unanswered
Hello! Have Any One Tried To Convert Large Dataset To Clear Ml Format ? I Am Tryting To Convert 350Gb Dataset With ~42 Million Files And Getting
Nothing special
dataset = Dataset.create(dataset_name = 'my_dataset', parent_datasets=None, use_current_task=False)
dataset.add_files(dataset_dir, verbose=False)
dataset.upload(output_url='
)
dataset.finalize(verbose=True)
135 Views
0
Answers
one year ago
one year ago