Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Have A Question About Datasets. I See That In The Process Of Creating A Dataset, You Have To Use

hi all, i have a question about datasets. i see that in the process of creating a dataset, you have to use Dataset.upload() which uploads the data to the server, but my files are actually already on the server itself in a shared folder, so i don't need to upload them?

  
  
Posted 2 years ago
Votes Newest

Answers 12


hi i have another question- when setting up the agent on the worker machine, what credentials do i give it? a user's?

  
  
Posted 2 years ago

Hi ConvolutedChicken69 , the Dataset.upload() will upload the data as an artifact to the task and will allow others to use the dataset (ClearML agents for example, running and using the data with Dataset.get() ).

  
  
Posted 2 years ago

Hi ConvolutedChicken69 ,
You can give it whatever credentials you'd like 🙂 - are you using the default UI login mode, or did you set up users and passwords on the server?

  
  
Posted 2 years ago

So you can either create a set of credentials from your own user and give that to the agent, or be nice, and simply define a user/password for the agent 🙂

  
  
Posted 2 years ago

ok ya i thought maybe to create a user for the agent

  
  
Posted 2 years ago

Assuming you define a user/password for the agent, you can either use the username/password as the key/secret, or log into the UI "as the agent" and create a set of credentials using the profile page

  
  
Posted 2 years ago

ok great thanks

  
  
Posted 2 years ago

both will work

  
  
Posted 2 years ago

and another question.. how can i get support over the phone? i feel like i have a lot of questions about setting this up and that would be easier

  
  
Posted 2 years ago

Well, you can contact the ClearML sales team for that 🙂

  
  
Posted 2 years ago

users and passwords for the web login

  
  
Posted 2 years ago

ConvolutedChicken69
basically the cleamrl-data needs to store an immutable copy of the delta changes per version, if the files are already uploaded, there is a good chance they could be modified...
So in order to make sure we you have a clean immutable copy, it will always upload the data (notice it also packages everything into a single zip file, so it is easy to manage).

  
  
Posted 2 years ago
564 Views
12 Answers
2 years ago
one year ago
Tags
Similar posts