How Can I Extend A Dataset? On Community Edition I Have An Existing Dataset, I Want To Add Some Files And Make A New Version. I Tried Just Doing A

Answered

How can I extend a dataset? On community edition

I have an existing dataset, I want to add some files and make a new version. I tried just doing a Dataset().get_local_copy and then dataset.add_files but I got this error saying the dataset is already completed

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AdventurousButterfly15
				
					0
					 × 1

Votes Newest

Answers 2

Thanks

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AdventurousButterfly15
				
					0
					 × 1

Hi @<1523702786867335168:profile|AdventurousButterfly15> , you need to create a new dataset and specify the previous one as a parent 🙂

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

1K Views

2 Answers

one year ago

Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Re-Create/Upload From Disk A Final Dataset? One Dataset Part Is Corrupted On Disk At The File Server And Cannot Longer Be Downloaded. Thanks In Advance!

Hi!! I Have A Question, I Have A Dataset Saved In S3 Using Clearml, Is There A Way Of Getting The Full Path Of This Dataset In S3?? Something Like

Hi Community, I'M Installing Multiple Clearml-Agent On Some Gpu Workstations, So I Have A Question: How Can I Use The Cache Of Dataset As When I Run Only 1 Clearml-Agent? I Don'T Want To Download Full Dataset Everytime When A Task Run Because Now Since I

Hi Abit Of A Crazy Question... But Is It Possible To Use Clearml In Rust, Without Writing A Wrapper. I Noticed The Api Doesnt Cover Dataset Operations But The Cli Can.

Some Wierd Bug With Get_Local_Copy? I Have: Dataset C (100X A.Png, 100X B.Json, 100X C.Json) Dataset B (5X A.Png, 5X B.Json, 5X C.Json, 10X New.Json) Dataset A (5X A.Png) When Doing Get_Local_Copy() It Starts Downloading Dataset C Which Is 1.5Tb. This Sh

Hi, I Have A Question Regarding Clearml Datasets. In The Web Ui, What Causes The "Content" Tab To Show A List Of The Files In The Dataset? It Used To Show Automatically, But Recently It Now Has "No Data To Show" Even Though All Files Are Definitely In The

Hi! I Am Currently Testing The Function Of Tags, Using Dataset.Add_Tag(). Why Do Tags Only Show On A Version Level, But Not On The Dataset-Level? (See Images) The Tag “Blaa” Has Been Added Manually In The Web-Ui. Why Do “Kophenhangen”, “Paris” Or “Vis” No

Hey Guys, If I Set File_Upload_Retries Arbitrarily High Like 1000, Should I Be Good To Upload A Large Dataset >1Gb On Spotty Connections?

Hello Everyone, I'M In A Bit Of Situation Where I Want To Optimize Getting Local Copies Of Datasets, By Making It So That If A Parent Dataset Already Exists Locally, The Child Simply Creates Symlinks To The Files It Shares With The Parent. However, I Can'