Hi All, We Recently Went From A Docker Hosted Clearml To A K8S Hosted Clearml. We Migrated Our Experiments By Tarballing The Data Folder Of Mongodb And Getting It On Our Cluster. The Experiments Seem To Have Ported Fine,

Answered

Hi all, we recently went from a docker hosted clearml to a k8s hosted clearml. We migrated our experiments by tarballing the data folder of mongodb and getting it on our cluster. The experiments seem to have ported fine, but we have no record of the scalars . Is there any thing more to port over?

We loosely followed this guide .

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

Votes Newest

Answers 5

I'm not sure it will work - you can try, though

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Back up the indices from the original setup and import them to the new ES

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

how? just tar and untar?

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , what you're missing is all the ElasticSearch data

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

which path would that be?

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					PerplexedRaccoon19
				
					0
					 × 1

Write your answer

434 Views

5 Answers

8 months ago

Hi Everyone! I'M Currently Using The Free Hosted Version (Open Source) Of Clearml. I'M Mainly Using Clearml-Data At To Manage Our Datasets At The Moment, And I'Ve Already Hit The Limit For The Free Metrics Storage. Since We Didn'T Store A Lot Of Metrics (

Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)

Hello, Can Anyone Please Give Us Update On Our Self Hosted Ceph Server Not Working With Your Clearml.Conf Because We Dont Have "Region" Field?

Hey All, We Are Considering To Set Up A Self-Hosted Clearml Server For Our Team And I’M Trying To Estimate Resources We Would Need For It. Is There Any Documentation About How Clearml Utilizes The Databases In It’S Architecture (Es, Mongo, Redis). What Da

Hey All, We Have A Self-Hosted Clearml Server, Today We Launched ~40 Workers To Run Training Jobs On Our Queue, However We Started Getting Errors With Elasticsearch Connection Pool Being Full, And Subsequent Timeouts And Failed Tasks. Each Training Task

Hi All, Does Anybody Happen To Have Any Recent Experience Spinning Up Service Workers (Via Clearml Agent) With A Limited Number Of Instances/Workers? We'D Like To Use This Functionality To Prevent Our Self-Hosted Server From Being Overloaded However We

Hi Everyone, I Have Been Using Clearml Self Hosted For Experiment Visualisation - Logging Loss And Uploading Debug Samples Etc. Our Clearml Server Is Running On A Aws Instance, With The Fileserver And Databases (Mongo, Redis Etc) On That Instance. We Run

Yesterday I Executed An Experiment In Our Hosted Clearml Cluster. After The Experiment Was Finished, We Got An Aws Guard Duty Notification About Suspicious Outbound Traffic From The Ec2 That Executed The Job. It Looks Like The Tag Being Used Is Hardcoded

I Have A Question About The Clearml Self Hosted Instance, I Notice There Is Elastic Search, Mondodb, And Redis In The Helm Chart Are These Required Or Can We Bring Our Own? I'M Wondering What Happens If I Were To Host The Instance And One Of These Were