Unanswered
Hi Clearmlers, I'M Trying To Create A Dataset With Tagged Batches Of Data. I Firstly Create An Empty Dataset With Dataset_Name = 'Name_Dataset', And Then Create A Another Tagged Dataset With The First Batch And With Parent_Datasets=['Name_Dataset']. It'S
batches = [batch_1, batch_2, batch_3]
if name == 'main':
print("Create the dataset in ClearML")
dataset = Dataset.create(dataset_name="general_ner_es",
dataset_project='general_ner',
output_uri=' None ')
for batch in batches:
df = pandasDF_from_annotations(bucket_name, batch_1)
[df.to](http://df.to) _pickle('df.pkl')
print("Add files to the dataset from " + str(batch))
dataset = Dataset.create(dataset_name="general_ner_es",
dataset_project='general_ner',
output_uri=' [None](s3://es-ehrd-production-s3-ml-development/clearml/datasets/labelstudio/general_ner_es) ',
dataset_tags = [str(batch)],
parent_datasets=["general_ner_es"])
69 Views
0
Answers
6 months ago
6 months ago