Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, I Am Using A Nas Storage To Save My Models And Dataset Artifacts. My Pipeline Consists Of Two Steps:

Hello,
I am using a NAS storage to save my models and dataset artifacts. My pipeline consists of two steps:
stage_process (stores processed dataset on NAS storage) stage_train (trains and stores the model on NAS storage)When I run these as individual tasks, they perform flawlessly and store the models at the output_uri that I have specified but when I use them in a pipeline, my processed dataset gets stored in a .pipeline folder in the output_uri directory for stage_process task and my model doesn't get saved in the output_uri that I have defined for the stage_train task

  
  
Posted one year ago
Votes Newest

Answers 19


and I'm plotting the losses like this

  
  
Posted one year ago

Just locally but it is saved fine

  
  
Posted one year ago

I mean code wise. Also where is it saved locally?

  
  
Posted one year ago

What if you point it to the fileserver? Does it still not upload the model?

  
  
Posted one year ago

I haven't pointed it to the file server because I'm running a locally deployed docker instance of ClearML

  
  
Posted one year ago

Do I have to run a task individually completely for it to function properly in a pipeline?

  
  
Posted one year ago

How is the model saved in the code?

  
  
Posted one year ago

It was getting logged when I was running it as an individual task but it is not getting logged in the pipeline. I was plotting loss graphs too but now they're not getting plotted.

  
  
Posted one year ago

I have used a output_uri argument in my Task initialization for storing my models

  
  
Posted one year ago

Is output_uri defined for both steps? Just making sure.

  
  
Posted one year ago

Not on the NAS storage but on my PC where the training is running

  
  
Posted one year ago

This is how I am defining the task in the code

  
  
Posted one year ago

My models are not getting saved in the .pipeline folder. They are not getting saved in the output_uri specified in the Task.init as well.

  
  
Posted one year ago

I got this message when the training started and it is only saving the model locally

  
  
Posted one year ago

The model is only getting saved locally

  
  
Posted one year ago

Hi PerfectMole86 ,

How are you saving your models? How are they being saved, under .pipeline folder as well?

  
  
Posted one year ago

And how is the model being saved?

  
  
Posted one year ago

How is the model being saved/logged into clearml?

  
  
Posted one year ago

image

  
  
Posted one year ago