ClearML FAQ | Hello Everyone, I'M Trying To Transfer Datasets From One Server To Another. Since In The Old Format The Server Was Deployed In K8S And In The New One In Docker Compose, Unfortunately, The Data Storage Format Is Different And You Cannot Directly Copy The M

Answered

Hello Everyone, I'M Trying To Transfer Datasets From One Server To Another. Since In The Old Format The Server Was Deployed In K8S And In The New One In Docker Compose, Unfortunately, The Data Storage Format Is Different And You Cannot Directly Copy The M

Hello everyone, I'm trying to transfer datasets from one server to another. Since in the old format the server was deployed in k8s and in the new one in docker compose, unfortunately, the data storage format is different and you cannot directly copy the meta date from one storage to another. Must be transferred manually. Are there any examples of how to transfer data from one remote server to another in a simplified mode?

Remote_server_v1 -> local -> Remote_server_v2

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					MammothParrot39
				
					0
					 × 1

Votes Newest

Answers

Hi @<1524560082761682944:profile|MammothParrot39> , datasets are represented by tasks, and in both cases this data is stored in MongoDB, so the format is actually the same - what exactly were you trying to copy?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Write your answer

2K Views

1 Answer

2 years ago

2 years ago

Tags

Similar posts

Hi! How Can I Correctly Export Data (Datasets, Artifacts, Etc.) From One Clearml Server Docker Compose ( Local File Servrer) To Another Clear Ml Server Docker Compose, Where The Data Will Be Stored In S3 Minio? Thank You For Your Reply!

Hi Everyone! Each Clearml Task Has Its Own Info Tab In Ui, Which Contains Additional Information About Resources, Workers, Queues Etc. When One Restarts Task On Another Queue, Old Information Disappears (And New Information About New Queue Appears Accord

Hi, What Would Be The Correct Way To Move An Existing Self-Hosted Clearml Environment (In Our Case Only Experiments. With Artifacts, Models, Debug Samples Etc.) From One Server To Another, With A Different Url And Possibly Different Port Numbers? Is Such

Hello Everyone! Is It Possible To Transfer Data (Datasets, Models) From One Clearml Instance To Another? How Can I Do This? I Store My Data In S3 And Clearml Tracks This Data. I Want To Migrate This Data From One Clearml Instance To Another, That Is, Tran

Hello Everyone! Is It Possible To Transfer Data (Datasets, Models) From One Clearml Instance To Another? How Can I Do This?

Another Question, Is It Possible To Visualize Bboxes When Uploading The Dataset In Yolo Format? Thanks

Hi All, What Would Cause A Clearml Autoscaler Instance Which Is Running Enqueued Tasks One After Another To Eventually Get Stuck In A 'Running' State While Emitting No Logs? For Context, The Issue Happens Earlier On (Fewer Tasks Into The Loop) For A G4D

Hello Community, I'M Having A Problem With My Clearml Account. I Try To Recover The Password But No Email Is Sent (I Checked Spam And I'M Sure That The Email Is The Right One Since I'M Logged In In Another Computer) What Can I Do?

Hi, I Have A Small Question Regarding K8S Clearml-Serving Behavior. I Have In My Cluster One Gpu Of 16Gb Ram, And Another One Of 24 Gb Ram. I Have A Llm Model Fitting The 24Gb But Not The 16Gb Gpu. When I Call The Endpoint, How Will I Know To Which Gpu I

Hi! I'M Running A Clearml Task Remotely. It Runs A Python Machine Learning Evaluation Script In Repo A. The Script Depends On A Module Which Is Defined In Another One Of My Company'S Repos: Repo B. The File Structure Of The Module In Repo B Is As Follows