Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Is There A Way To Forbid Uploading Datasets Into Fileserver Or To Make S3 Storage A Default Location For Datasets? As Far As I Know, The Only Way To Upload Dataset To The S3 Storage Is To Use

Hi, Is there a way to forbid uploading datasets into fileserver or to make s3 storage a default location for datasets? As far as I know, the only way to upload dataset to the s3 storage is to use --storage s3//bucket/ parameter in clearml-data upload but if somebody from the team forgets to set that parameter it will be uploaded to the fileserver which is just a EBS volume under the hood in our case and there is always a possibility to run out of the space there.

  
  
Posted one year ago
Votes Newest

Answers 7


ContemplativeGoat37 , I'm curious about your implementation. Which method was more relevant - config file change or using an environment variable or are both useful?

  
  
Posted one year ago

ContemplativeGoat37 , Hi 🙂

You can do the following configuration in your ~/clearml.conf
sdk.development.default_output_uri: " s3://my_bucket/ "

  
  
Posted one year ago

Hi Natan and Alon, thank you for the quick answer. It means that we need to set that configuration parameter for every team member, right?

  
  
Posted one year ago

ok, got it, thank you for the quick response

  
  
Posted one year ago

I think it makes more sense to implement it in the configuration file.

  
  
Posted one year ago

Hi ContemplativeGoat37 ,

You can also configure CLEARML_DEFAULT_OUTPUT_URI env var for doing so

  
  
Posted one year ago

yes (every machine 🙂 )

  
  
Posted one year ago
572 Views
7 Answers
one year ago
one year ago
Tags
Similar posts