Hi FierceHamster54 ,
Does squashing two datasets deletes the two original datasets ?
I don't think so. Should just create a new one.
Is it possible to edit tags using the SDK on a finalized dataset ?
I think so. I don't se a dedicated method for this on Dataset module but Datasets are basically tasks so you can fetch the dataset task and then use Task.add_tags()
https://clear.ml/docs/latest/docs/references/sdk/task#add_tags
Old tags are not deleted. When executing a Task (experiment) remotely, this method has no effect).
This description in the add_tags() doc intrigues me tho, I would like to remove a tag from a dataset and add it to another version (eg: a used_in_last_training tag) and this method seems to only add new tags.
I mean, if deleting tags in finalized datasets is possible in the GUI, it should be too in the SDK but I don't see the method
And additionally does the
When executing a Task (experiment) remotely, this method has no effect).
part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?
I think this means the add tags specifically will have no effect
And additionally does the When executing a Task (experiment) remotely, this method has no effect). part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?
This description in the
add_tags()
doc intrigues me tho, I would like to remove a tag from a dataset and add it to another version (eg: a
used_in_last_training
tag) and this method seems to only add new tags.
I see. Then I think you would need to do this via the API:
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksupdate
or
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksupdate_batch