Hi All, We Recently Went From A Docker Hosted Clearml To A K8S Hosted Clearml. We Migrated Our Experiments By Tarballing The Data Folder Of Mongodb And Getting It On Our Cluster. The Experiments Seem To Have Ported Fine,

Answered

Hi all, we recently went from a docker hosted clearml to a k8s hosted clearml. We migrated our experiments by tarballing the data folder of mongodb and getting it on our cluster. The experiments seem to have ported fine, but we have no record of the scalars . Is there any thing more to port over?

We loosely followed this guide .

  				
Posted 
	one year ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

Votes Newest

Answers 5

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , what you're missing is all the ElasticSearch data

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Back up the indices from the original setup and import them to the new ES

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I'm not sure it will work - you can try, though

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

which path would that be?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

how? just tar and untar?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

Write your answer

758 Views

5 Answers

one year ago

Hey, Our Elastic Search Just Randomly Crashed On Our Self-Hosted K8S Deployment. On Debugging, It Looks Like Indices Are Corrupt. Any Suggestions Of How We Might Solve This?

Hello Team, We Are Currently Utilizing A Self-Hosted Clearml For Various Projects. Our Aim Is To Implement Role-Based Access Control Across Projects. As I Understand, This Feature Is Presently Available Only On The Enterprise Plan. Is It Possible To Enab

Hi Everyone! I'M Currently Using The Free Hosted Version (Open Source) Of Clearml. I'M Mainly Using Clearml-Data At To Manage Our Datasets At The Moment, And I'Ve Already Hit The Limit For The Free Metrics Storage. Since We Didn'T Store A Lot Of Metrics (

Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)

Hello, Can Anyone Please Give Us Update On Our Self Hosted Ceph Server Not Working With Your Clearml.Conf Because We Dont Have "Region" Field?

Hey All, We Are Considering To Set Up A Self-Hosted Clearml Server For Our Team And I’M Trying To Estimate Resources We Would Need For It. Is There Any Documentation About How Clearml Utilizes The Databases In It’S Architecture (Es, Mongo, Redis). What Da

Hey All, We Have A Self-Hosted Clearml Server, Today We Launched ~40 Workers To Run Training Jobs On Our Queue, However We Started Getting Errors With Elasticsearch Connection Pool Being Full, And Subsequent Timeouts And Failed Tasks. Each Training Task

Hi All, Does Anybody Happen To Have Any Recent Experience Spinning Up Service Workers (Via Clearml Agent) With A Limited Number Of Instances/Workers? We'D Like To Use This Functionality To Prevent Our Self-Hosted Server From Being Overloaded However We

Hi Everyone, I Have Been Using Clearml Self Hosted For Experiment Visualisation - Logging Loss And Uploading Debug Samples Etc. Our Clearml Server Is Running On A Aws Instance, With The Fileserver And Databases (Mongo, Redis Etc) On That Instance. We Run