Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Want To Upload Models To The Server, But Store Data Locally Like Dvc, And Only Manage Data Meta-Information In Clearml. What Should I Do?

I want to upload models to the server, but store data locally like DVC, and only manage data meta-information in clearML.
What should I do?

  
  
Posted one year ago
Votes Newest

Answers 3


Maybe that would save the model locally too?

When I tested in
examples/datasets/dataset_creation.py
I set
dataset.upload(output_url='. /data_upload_test')
it was also uploaded to the server configured in clearml.conf file. I want to stop this.Should I just not upload the dataset?

I want to upload models to a remote server, but,
I want to store the dataset locally and do not want to upload the dataset itself to the remote server.
If possible, I want to upload the meta-information of the dataset to the remote server.

In other words, I want to manage models and datasets in separate locations.

What should I do?

  
  
Posted one year ago

Hi @<1561885941545570304:profile|PunyKangaroo87>
What do mean by store data locally?
Like clearml-data? I.e Dataset?
You can always use file:///root/path/folder as destination, this will store everything into the local folder, is that it?

  
  
Posted one year ago

I see if this is the case try to set
'output_uri="file:///full/path/to/dir"'
Notice it has to have the full path there and the file:// prefix

  
  
Posted 12 months ago