ClearML FAQ | Hi

Answered

Hi

Hi 🙂 I have two separate instances of ClearML server (small instances, no agents deployed as of now), which I want to joining into one bigger instance. Is it possible to export data out of one instance, and import it to another? How do you think is the best approach here?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AlertCamel57
				
					0
					 × 1

Votes Newest

Answers 6

Not merged

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

I will try it out thanks CostlyOstrich36

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AlertCamel57
				
					0
					 × 1

got it, was under the impression that its a join migration to an existing database so no data overwrite happens

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AlertCamel57
				
					0
					 × 1

got it, thanks

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AlertCamel57
				
					0
					 × 1

Hi AlertCamel57 ,

Exporting/Importing data between ClearML servers is not supported in the open source version from what I understand.
You can however migrate the entire database very easily by moving /opt/clearml/data (If I'm not mistaken this is where it sits) to another location. Make sure that the server is down while doing so, to avoid corruptions

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

AlertCamel57 , Please note that when I say "Migrate" it means that the the data will be replaced

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

901 Views

6 Answers

2 years ago

one year ago

Tags

Similar posts

Hello, I Am Trying To Compare Plots Of Two Experiments With The Same Name ( For Instance The Distribution Of Features When I Change A Hyperparameter). How Can I Know Which One Belongs To Which Experiment? I Know I Could Use The Name Of The Clearml Task A

Hi, I Have A Question Around The Storage Of Credentials For The Open-Source Version Of Clearml. I See From The Documentation That The Hashed Passwords For Web-Login Are Stored In One Of The Files In The Instance Where Clearml Is Hosted & That The Feature

Hey Can Anyone Explain This, My Max Number Of Instances Is 5 But Its Showing Something Like That: Its Showing 8 Instance Which Does Not Make Sense,

Bug Report? We Noticed That The Aws Autoscaler Will Lose Track Of Instances Crashing Due To No Space Left On Device, And The Ec2 Instance Will Remain Running Indefinitely.

Hey! I Have My Custom Model, That Uses Models From Populars Frameworks Inside, Such As Lgbm, Catboost Etc. Also It Have Multiple Instances Of One Models Of One Framework.

I Have A Question About The Clearml Self Hosted Instance, I Notice There Is Elastic Search, Mondodb, And Redis In The Helm Chart Are These Required Or Can We Bring Our Own? I'M Wondering What Happens If I Were To Host The Instance And One Of These Were

Hey, I'Ve Started Up A New Instance Of The Clearml Server Using One Of The Community Amis, I Copied Over The Data And Config From An Older Version (Version: 1.0.2-10) And Ran Chown As Described Here

Hi, I Have A Question Regarding The Aws_Autoscaler: It Usually Takes ~Hours To Get A Gpu Instance Nowadays. I Was Thinking, It Would Be Much More Interesting To Stop The Instances (Clearml-Agents) Instead Of Terminating Them Once They Are Inactive, So Tha

Hi, There Is Small Bug In The Web Ui When Comparing Two Experiments Scalars: If The Two Tasks Have The Same Name, Then Clicking On The “Maximize Graph” Button On One Scalar Series To Get The Bigger View On That Scalar Series, Then The Color Of Both Series

Hey Guys, I Am Trying To Plan What I Need To Do In Order To Efficiently Use Clearml With Spot Instances 1) Detecting When Spot Instance Is Down And Experiment Is Aborted 2) Extracting S3 Address Of The Latest Checkpoint From Clearml Api 3) Starting New E