Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone!

Hi everyone!
I'm new to ClearML and I'm facing an issue. I want to use clearml-data to upload a dataset to a remote storage disk. Currently, when I run:
clearml-data upload --id <dataset_id>
it stores the dataset on the ClearML server at /opt/clearml/data/fileserver .
However, I’d like to store the dataset on an external storage disk that I’ve mounted. Ideally, I want it to go to something like /mnt/... instead of the default /opt/... .
Does anyone know how I can configure this or point ClearML to store the dataset in a different directory?
Thanks in advance!

  
  
Posted 4 months ago
Votes Newest

Answers 5


Do you know how to do it when the disk is mounted to an external server instead of a local one?

  
  
Posted 4 months ago

For a NAS you just specify the path, file:///mnt/... – for local disk paths.

  
  
Posted 4 months ago

thank you for your answer! I tried the --output-uri parameter but it doesn't answer my request, it doesn't allow to change the path to another storage location:
It needs a URI (Uniform Resource Identifier) that tells ClearML how and where to store your dataset.
It could be:

  • file:///path/to/local/folder – for local disk paths.
  • None – for AWS S3 storage.
  • http(s)://... – for web-based storage.
  • clearml://... – to use ClearML’s default file server.but it doesn't allow to use a NAS for example
  
  
Posted 4 months ago

Hi @<1820993248525553664:profile|DisturbedReindeer69> , I think you're looking for the --output-uri parameter in clearml-data create - None

  
  
Posted 4 months ago

Simply point it to the relevant address

  
  
Posted 4 months ago
444 Views
5 Answers
4 months ago
4 months ago
Tags
Similar posts