Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone!

Hi everyone!
I'm new to ClearML and I'm facing an issue. I want to use clearml-data to upload a dataset to a remote storage disk. Currently, when I run:
clearml-data upload --id <dataset_id>
it stores the dataset on the ClearML server at /opt/clearml/data/fileserver .
However, I’d like to store the dataset on an external storage disk that I’ve mounted. Ideally, I want it to go to something like /mnt/... instead of the default /opt/... .
Does anyone know how I can configure this or point ClearML to store the dataset in a different directory?
Thanks in advance!

  
  
Posted 14 days ago
Votes Newest

Answers 5


thank you for your answer! I tried the --output-uri parameter but it doesn't answer my request, it doesn't allow to change the path to another storage location:
It needs a URI (Uniform Resource Identifier) that tells ClearML how and where to store your dataset.
It could be:

  • file:///path/to/local/folder – for local disk paths.
  • None – for AWS S3 storage.
  • http(s)://... – for web-based storage.
  • clearml://... – to use ClearML’s default file server.but it doesn't allow to use a NAS for example
  
  
Posted 14 days ago

Hi DisturbedReindeer69 , I think you're looking for the --output-uri parameter in clearml-data create - None

  
  
Posted 14 days ago

Simply point it to the relevant address

  
  
Posted 13 days ago

For a NAS you just specify the path, file:///mnt/... – for local disk paths.

  
  
Posted 14 days ago

Do you know how to do it when the disk is mounted to an external server instead of a local one?

  
  
Posted 13 days ago
63 Views
5 Answers
14 days ago
13 days ago
Tags
Similar posts