Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! Is It Possible To Read Data Directly From Server W/O Using Get_Local_Copy()?

👋 Hi everyone!

Is it possible to read data directly from server w/o using get_local_copy()?

  
  
Posted 2 months ago
Votes Newest

Answers 6


I want to call that dataset in local PC without downloading

when you say "call" what do you mean? the dataset itself is a set of files compressed and stored in the clearml file server (or on your S3 bucket etc.)

  
  
Posted 2 months ago

Hi @<1523701205467926528:profile|AgitatedDove14>
What I mean is, dataset is loaded in server, I want to call that dataset in local PC without downloading its copy and do the analysis.

  
  
Posted 2 months ago

Please see this code snippet:
reviews_dataset_path = Dataset.get(
dataset_id=config["reviews_data_file_id"],
only_completed=True,
only_published=False,
). get_local_copy()

is there a way we can still read the data without using ". get_local_copy()"

  
  
Posted 2 months ago

Thats nice to hear.
Thanks a lot @<1523701205467926528:profile|AgitatedDove14> :-)

  
  
Posted 2 months ago

No, it is zipped and stored, so in order to open the zipfile and read the files you have to download them.
That said everything is cached, so if the machine already downloaded the dataset there is zero download / unzipping,
make sese?

  
  
Posted 2 months ago

Hi @<1720249421582569472:profile|NonchalantSeaanemone34>

Is it possible to read data directly from server w/o using get_local_copy()?

do you mean an artifact ? what is direct here?

  
  
Posted 2 months ago
260 Views
6 Answers
2 months ago
2 months ago
Tags