Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, I'Ve Set Up A Clearml Server On Aws Ec2 And Configured Output_Uri To Log Everything To S3. However, I Just Noticed That The Input Model Captured By Clearml Is Being Stored On The Ec2 Instance Instead Of S3.

Hi everyone,
I've set up a ClearML server on AWS EC2 and configured output_uri to log everything to S3. However, I just noticed that the input model captured by ClearML is being stored on the EC2 instance instead of S3.
Model URL: file:///tmp/tmpascxcevj/31_0.194824/data/model.pth
How can I force ClearML to store the input model on S3 instead of the local EC2 instance?

Would appreciate any guidance—thanks in advance! 🙌
image

  
  
Posted 4 days ago
Votes Newest

Answers 3


Thanks, ManiacalLizard2 , for replying!

Yes, you’re correct—I have set it in clearml.conf on the client side. Everything except the input model has an s3:// URL.

  
  
Posted 2 days ago

Is it because your training code download the pretrain model from pytorch or whatever, to local disk in /tmp/xxx then train from there ? so ClearML will just reference the local path.

I think you need to manually download the pre-train model, then wrap it with Clearml InputModel (eg here )
And then use that InputModel as pre-train ?

May be clearml staffs have better approach ? CostlyOstrich36 SuccessfulKoala55

  
  
Posted 2 days ago

Just to confirm: "output_uri to log everything to S3" is that on the server config or client config (the clearml.conf where the code is actually running) ?

Where the model will be saved/uploaded is defined by the client and not the server.

  
  
Posted 3 days ago
40 Views
3 Answers
4 days ago
2 days ago
Tags