Hi, Does Anyone Know If There Is A Way To Have The Dataset Graph That Tells Us Which Dataset Was Created From Which Other Ones Without Setting The Previous Datasets As Parents? We Have Large Raw Datasets That Are Used To Create Several Smaller Ones, And I

Answered

Hi, does anyone know if there is a way to have the dataset graph that tells us which dataset was created from which other ones without setting the previous datasets as parents? we have large raw datasets that are used to create several smaller ones, and I would like to see the dependency without storing the large raw datasets with the small ones every time.

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CrookedMonkey33
				
					0
					 × 1

Votes Newest

Answers 3

@<1523701070390366208:profile|CostlyOstrich36> ?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CrookedMonkey33
				
					0
					 × 1

When creating new datasets by combinging and modifying existing datasets programmatically in python, if I add the previous datasets as "parents" I can see a nice flow graph in ClearML of how each child dataset was generated. However this means my datasets contain the content of their parents which is quite a lot, is there a way for me to have that flow graph without using the parent datasets option?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CrookedMonkey33
				
					0
					 × 1

Hi @<1523703397830627328:profile|CrookedMonkey33> , not sure I follow. Can you please elaborate more on the specific use case?

Currently you can add plots to the preview section of a dataset

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

516 Views

3 Answers

9 months ago