Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi

Hi 🙂
We have clearml running on GCP compute engine for like 2 years (not k8s managed, running with docker-compose). lately i successfully created new server of clearml in our gcp k8s cluster, deployed with clearml helm chart.
I want to migrate the data from the old instance to the new one, but not sure what is the best and the right way to do it.
Your assistance will be appreciated, thanks!

  
  
Posted 3 months ago
Votes Newest

Answers 8


Hi @<1736194540286513152:profile|DeliciousSeaturtle82> , basically all the data is stored in /opt/clearml/data as long as you migrate that to the input of the k8s deployment you should be good.

  
  
Posted 3 months ago

thanks @<1523701070390366208:profile|CostlyOstrich36> , the big challenge is the versions of the databases in the docker compose and the versions in the sub charts of mongo and elastic in the helm chart im using. in the helm chart mongo is in version 5 and the newest docker compose still using mongo4.4 and while trying to migrate data from mongo4.4 to mongo 5 its got broken. while trying to change the mongo version in the chart to 4.4 its still got broken. so im kinda lost at the moment, im keep looking for solutions

  
  
Posted 3 months ago

@<1736194540286513152:profile|DeliciousSeaturtle82> the data folder for mongo4 and mongo5 might be slightly different. What is the target path where you're moving data in mongo5? And how is that mounted?
And when you say "broken", could you elaborate on that? Does the target Mongo Pod crash when trying to move the data? Or you succeed in copying the data but can't see the result in the UI?

  
  
Posted 3 months ago

@<1729671499981262848:profile|CooperativeKitten94> the pod is crashing during the migration of the files, im copying the db folder with all the wt files, etc. into the db folder of the mongo pods

  
  
Posted 3 months ago

@<1736194540286513152:profile|DeliciousSeaturtle82> when you copy the folder on the new pod, it crashes almost instantly?

  
  
Posted 3 months ago

yes, less than 1 minute

  
  
Posted 3 months ago

I think Mongo does not like for its db folder to be replaced like this in the running Pod.
You can try by turning off Mongo for a moment (scale it down to 0 replicas from the deployment), then create a one-time Pod (non-mongo, you can use an ubuntu image for example) mounting the same volume that Mongo was mounting, and try using this Pod to copy the db folder in the right place. When it's done, delete this Pod and scale back to 1 the Mongo deployment.

  
  
Posted 3 months ago

@<1729671499981262848:profile|CooperativeKitten94> thanks that indeed helped!!
same helped for elastic db (its important to scale back to 1 and not to 3 right after data migration).
finally im done, thanks for helping 🙂

  
  
Posted 3 months ago
203 Views
8 Answers
3 months ago
3 months ago
Tags
gcp