Hi Clearmlers, I'M Trying To Create A Dataset With Tagged Batches Of Data. I Firstly Create An Empty Dataset With Dataset_Name = 'Name_Dataset', And Then Create A Another Tagged Dataset With The First Batch And With Parent_Datasets=['Name_Dataset']. It'S

Unanswered

batches = [batch_1, batch_2, batch_3]

if name == 'main':
print("Create the dataset in ClearML")
dataset = Dataset.create(dataset_name="general_ner_es",
dataset_project='general_ner',
output_uri=' None ')

for batch in batches:

    df = pandasDF_from_annotations(bucket_name, batch_1)
     [df.to](http://df.to) _pickle('df.pkl')
    print("Add files to the dataset from " + str(batch))
    dataset = Dataset.create(dataset_name="general_ner_es",
                    dataset_project='general_ner',
                    output_uri=' [None](s3://es-ehrd-production-s3-ml-development/clearml/datasets/labelstudio/general_ner_es) ',
                    dataset_tags = [str(batch)],
                    parent_datasets=["general_ner_es"])

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					TeenyShells80
				
					0
					 × 1

98 Views

0 Answers

9 months ago