Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, I'Ve Set Up A Clearml Server On Aws Ec2 And Configured Output_Uri To Log Everything To S3. However, I Just Noticed That The Input Model Captured By Clearml Is Being Stored On The Ec2 Instance Instead Of S3.

Hi everyone,
I've set up a ClearML server on AWS EC2 and configured output_uri to log everything to S3. However, I just noticed that the input model captured by ClearML is being stored on the EC2 instance instead of S3.
Model URL: file:///tmp/tmpascxcevj/31_0.194824/data/model.pth
How can I force ClearML to store the input model on S3 instead of the local EC2 instance?

Would appreciate any guidance—thanks in advance! 🙌
image

  
  
Posted 15 days ago
Votes Newest

Answers 3


Just to confirm: "output_uri to log everything to S3" is that on the server config or client config (the clearml.conf where the code is actually running) ?

Where the model will be saved/uploaded is defined by the client and not the server.

  
  
Posted 14 days ago

Is it because your training code download the pretrain model from pytorch or whatever, to local disk in /tmp/xxx then train from there ? so ClearML will just reference the local path.

I think you need to manually download the pre-train model, then wrap it with Clearml InputModel (eg here )
And then use that InputModel as pre-train ?

May be clearml staffs have better approach ? CostlyOstrich36 SuccessfulKoala55

  
  
Posted 13 days ago

Thanks, ManiacalLizard2 , for replying!

Yes, you’re correct—I have set it in clearml.conf on the client side. Everything except the input model has an s3:// URL.

  
  
Posted 13 days ago
96 Views
3 Answers
15 days ago
13 days ago
Tags