Hi, I'm trying to upload data from my s3 bucket to clearml dataset where i can start versioning it all for my ML project. I have connected successfully to my...
2 months ago
What if i already had uploaded the data, and want to update it with new data? Wouldn't make sense to create new dataset right? And what does dataset.id represent?
try:
dataset = Dataset.get(dataset_name=dataset_name, dataset_project=dataset_project)
Logger.current_logger().report_text(f"Dataset '{dataset_name}' found, creating a new version...")
What do i modify here so that it allows for a new version to be created of the dataset everytime i rerun the script?