Hi All, I'M Starting To Use Clearml, For Experiment Management On This Step. I'M Using Voxel51 (

Answered

Hi All,
I'm starting to use ClearML, for Experiment Management on this step. I'm using Voxel51 ( https://voxel51.com/ ) for managing and selecting my datasets, and I'm not sure how to add info about Voxel dataset into ClearML. Currently I'm using two scripts - download_voxel_dataset.py and train.py. I already added "2 magical lines" into train.py, but obviously my ClearML experiment has no info about my Voxel dataset. How to add it?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AttractiveShrimp45
				
					0
					 × 1

Votes Newest

Answers 4

Thank you again! I read about task.connect in https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk and now I see how I can add that.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AttractiveShrimp45
				
					0
					 × 1

Correct 🙂
btw: my_dict_with_conf_for_data can be any object, not just dict. It will list all the properties of the object (as long as they do not start with _)

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

AgitatedDove14 thank you!
Do you mean in my train.py, after Task.init(..)?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AttractiveShrimp45
				
					0
					 × 1

Hi AttractiveShrimp45
Well, I would use the Task.connect to add a section with any configuration your are using. for example
Task.current_task().connect(my_dict_with_conf_for_data, name="dataset51")wdyt?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Write your answer

735 Views

4 Answers

one year ago