Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi There, I'Ve Been Trying To Work With Trains And I Wanted To Save A Folder As The Model Like When Using The "Transformers" Library. They Have This "Save_Pretrained" Method To Their Models. It Saves The Pytorch Model And You Detect It Well, But Only That

Hi there, I've been trying to work with trains and I wanted to save a folder as the model like when using the "transformers" library. They have this "save_pretrained" method to their models. It saves the pytorch model and you detect it well, but only that. Not anything else in that folder. Is there a way to override/avoid this auto output file and define it myself?

  
  
Posted 4 years ago
Votes Newest

Answers 2


Hi PompousBeetle71 , Trains will log all the torch.save call, I'm assuming they do not actually use it for the rest of the files on that folder.
If you like to share a code snippet we could see if we could auto-magically log it You could use artifacts and store the entire folder. It will zip it an upload it. Then you can reuse it from other experiments. https://allegro.ai/docs/task.html?highlight=artifact#trains.task.Task.upload_artifact
Example:
task.upload_artifact('transformer', './my_trans_folder')Then from another experiment you could do:
local_copy_of_the_folder = Task.get_task(task_id='11111').artifacts['transformer'].get()

  
  
Posted 4 years ago

Yeah, I thought to use artifact, wondered if I can avoid using it or on the other hand, use only it just to define the "the model" as a folder.
Thanks.

  
  
Posted 4 years ago
1K Views
2 Answers
4 years ago
one year ago
Tags