Hi, I'm trying to upload data from my s3 bucket to clearml dataset where i can start versioning it all for my ML project. I have connected successfully to my...
2 months ago
ShakySnake40
1
Question,
2
Answers
Active since 03 July 2024
Last activity
2 months ago
Reputation
0
Badges 1
2 × Eureka!
0
Hi, I'M Trying To Upload Data From My S3 Bucket To Clearml Dataset Where I Can Start Versioning It All For My Ml Project. I Have Connected Successfully To My S3, Correctly Configured My Clearml.Conf File, But I Am Struggling With Some Task Initialization
What if i already had uploaded the data, and want to update it with new data? Wouldn't make sense to create new dataset right? And what does dataset.id represent?
2 months ago
0
Hi, I'M Trying To Upload Data From My S3 Bucket To Clearml Dataset Where I Can Start Versioning It All For My Ml Project. I Have Connected Successfully To My S3, Correctly Configured My Clearml.Conf File, But I Am Struggling With Some Task Initialization
try:
dataset = Dataset.get(dataset_name=dataset_name, dataset_project=dataset_project)
Logger.current_logger().report_text(f"Dataset '{dataset_name}' found, creating a new version...")
What do i modify here so that it allows for a new version to be created of the dataset everytime i rerun the script?
2 months ago