Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is There Any Documentation For

Is there any documentation for StorageHelper class?

  
  
Posted 2 years ago
Votes Newest

Answers 15


AgitatedDove14 are models technically Task s and can they be treated as such? If not, how to delete a model permanently (both from the server and from AWS storage)?

  
  
Posted 2 years ago

MelancholyElk85 that looks great, let me see how quickly we can push it (I think 1.1.5 needs to be pushed very soon, I'll check if we can have it before 🙂 )

  
  
Posted 2 years ago

I just happened to spawn multiple OutputModels within a single script which is being run in a single task. That is, I see dozens of models in Models tab in web UI. What I want is to delete most of them (along with the files in S3), preserving the spawning task

  
  
Posted 2 years ago

i need it so much man

  
  
Posted 2 years ago

StorageManager class seems to lack methods for removal as well

  
  
Posted 2 years ago

Hi MelancholyElk85
I think you are right, OutputModel is missing, remove method.
Maybe we should have a class method on Model , something like:
@classmethod Model.remove(model: Union[str, Model], delete_weights_file: bool, force: bool): # actually remove model and weights filewdyt?

  
  
Posted 2 years ago

StorageManager

Oh it has no remove 😞
StorageHelper.delete is the only way

  
  
Posted 2 years ago

AgitatedDove14 Yes this would be great

  
  
Posted 2 years ago

As for now it seems to query only by project name and model name.

  
  
Posted 2 years ago

AgitatedDove14 by task you mean the training task or the separate task corresponding to the model itself? The former won't work since I don't want to delete the training task, only the models

  
  
Posted 2 years ago

 are models technically 

Task

s and can they be treated as such? If not, how to delete a model permanently (both from the server and from AWS storage)?

When you call Task.delete() it actually goes over a;; the models/artifacts and deletes them from the storage

  
  
Posted 2 years ago

AND also add task_name parameter to Model.query_models

  
  
Posted 2 years ago

AgitatedDove14 thank you. Maybe you know about OutputModel.remove method or something like that?

  
  
Posted 2 years ago

so that the way of doing it would be like this:
all_models = Model.query_models(projeect_name=..., task_name=..., tags=['running-best-checkpoint']) all_models = sorted(all_models, key=lambda x: extract_epoch(x)) for model in all_models[:-num_to_preserve]: Model.remove(model, delete_weights_file=True)

  
  
Posted 2 years ago
999 Views
15 Answers
2 years ago
one year ago
Tags
Similar posts