Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Is There A Way To Forbid Uploading Datasets Into Fileserver Or To Make S3 Storage A Default Location For Datasets? As Far As I Know, The Only Way To Upload Dataset To The S3 Storage Is To Use

Hi, Is there a way to forbid uploading datasets into fileserver or to make s3 storage a default location for datasets? As far as I know, the only way to upload dataset to the s3 storage is to use --storage s3//bucket/ parameter in clearml-data upload but if somebody from the team forgets to set that parameter it will be uploaded to the fileserver which is just a EBS volume under the hood in our case and there is always a possibility to run out of the space there.

  
  
Posted 2 years ago
Votes Newest

Answers 7


ok, got it, thank you for the quick response

  
  
Posted 2 years ago

Hi ContemplativeGoat37 ,

You can also configure CLEARML_DEFAULT_OUTPUT_URI env var for doing so

  
  
Posted 2 years ago

I think it makes more sense to implement it in the configuration file.

  
  
Posted 2 years ago

yes (every machine 🙂 )

  
  
Posted 2 years ago

ContemplativeGoat37 , I'm curious about your implementation. Which method was more relevant - config file change or using an environment variable or are both useful?

  
  
Posted 2 years ago

ContemplativeGoat37 , Hi 🙂

You can do the following configuration in your ~/clearml.conf
sdk.development.default_output_uri: " s3://my_bucket/ "

  
  
Posted 2 years ago

Hi Natan and Alon, thank you for the quick answer. It means that we need to set that configuration parameter for every team member, right?

  
  
Posted 2 years ago
992 Views
7 Answers
2 years ago
one year ago
Tags
Similar posts