Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Clearml Server Is Deployed On K8S In My Organization, I Have Been Asked To Check Feasibility To Use It With The Storage Server Of The Company For Example To Mount Fileserver (Nfs Storage) Should With Mounted With Clearml Storage So That All The Data

Hi, clearml server is deployed on k8s in my organization, I have been asked to check feasibility to use it with the storage server of the company for example to mount Fileserver (NFS storage) should with mounted with clearml storage so that all the data in the FileServer can we accessed in Datasets or maybe in any other way (In other words, we must not download the data then upload using API call, Dataset.get/ Dataset.add. Can you give a feasibility and approach to go around it. (maybe links to documentatio would also work). Personally I have a limited understanding of Kubernetes and Docker but have worked around it, it would be a great help for me 🙏

  
  
Posted one year ago
Votes Newest

Answers 11


No, I wanted to have my data (in folders) to be visible in the dataset tab. So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC, will it automatically be available in dataset tab? or do I need to perform some action

  
  
Posted one year ago

Thanks for the answer! If I set a PVC is it possible that the data(datasets) present in it will automatically be visible in Datasets tab ?

  
  
Posted one year ago

for example: I copy a folder (which has data) from my local machine to file share, would it be visible automatically in the clearml data tab, or I need to upload the data using Dataset class

  
  
Posted one year ago

@<1554275773496430592:profile|DeliciousRaven95> , in general the data in datasets is bundled and zipped, you can add visualization manually on to of it. Is what what you're referring to?

  
  
Posted one year ago

So If I manually add a dataset (many excels), in a folder, and copy that folder to NFC

How would you do that?

  
  
Posted one year ago

Hi @<1554275773496430592:profile|DeliciousRaven95> , ClearML will only show registered datasets

  
  
Posted one year ago

Hi @<1554275773496430592:profile|DeliciousRaven95> , just to make sure I understand, you wish to make the fileserver store the actual data on NFS? Is that's the case, you'll need to set a PVC for the appropriate driver (using the correct storage class)

  
  
Posted one year ago

here I mean
image

  
  
Posted one year ago

If however your aim is to place data directly in the storage (not using upload/download) and than refer to it using a Dataset, I'm not sure that's possible - ClearML Dataset bundles data and automatically uploads/downloads it

  
  
Posted one year ago

Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.

You can. But that would entail creating a new dataset with output_uri pointing to the new location

  
  
Posted one year ago

Also 1 more question, can we have more than one storage options , a secondary storage maybe. if yes which changes need to be performed.

  
  
Posted one year ago
609 Views
11 Answers
one year ago
one year ago
Tags