Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Anyone Know How To Report Scalars With Tenserflow? Thanks

Hi,
Anyone know how to report scalars with tenserflow?
Thanks

  
  
Posted 2 years ago
Votes Newest

Answers 18


To report scalars manually (due to your custom function) you can use the following:
https://clear.ml/docs/latest/docs/references/sdk/logger#report_scalar

You also have a nice example here for usage 🙂
https://github.com/allegroai/clearml/blob/master/examples/reporting/scalar_reporting.py

  
  
Posted 2 years ago

CostlyOstrich36 tensorflow reporting it, ClearML capture it, and I get it with that function.

  
  
Posted 2 years ago

CostlyOstrich36

  
  
Posted 2 years ago

logger = task.get_logger()
train(model_dir=trained_model_dst, pipeline_config_path=pipeline_config_path, save_checkpoints_steps=args.checkpoints)
logger.report_scalar(title='evaluate', series='score', value=5, iteration=task.get_last_iteration())

  
  
Posted 2 years ago

Hmmm I think it should work, give it a try 🙂

  
  
Posted 2 years ago

CostlyOstrich36 When I do

logger = task.get_logger()
logger.report_scalar(title='evaluate', series='score', value=5, iteration=task.get_last_iteration())
train(model_dir=trained_model_dst, pipeline_config_path=pipeline_config_path, save_checkpoints_steps=args.checkpoints)

It only captures the first iteration...

  
  
Posted 2 years ago

Is your function taking into account iterations? How are iterations moved along? Do you attempt this scalar report on every iteration or only once in the script?

  
  
Posted 2 years ago

I have nowhere else to bring iteration number ..

  
  
Posted 2 years ago

CostlyOstrich36 I get the last iteration by task.get_last_iteration()
I want to report each iteration..

  
  
Posted 2 years ago

Yeah, but how are iterations marked in the script?

  
  
Posted 2 years ago

Yes that's exactly what i do, But I'm trying to figure out if I can write down the line of code
logger.report_scalar(title='evaluate', series='score', value=5, iteration=task.get_last_iteration())
anywhere in the code?
Does the line of code open up another process parallel to training?

  
  
Posted 2 years ago

If I'm not mistaken Task.get_last_iteration()
https://clear.ml/docs/latest/docs/references/sdk/task#get_last_iteration
reports the last iteration that was reported. However someone has to report that iteration. You either have to report it manually yourself during the script OR have something else like tensorflow/tensorboard do that reporting and ClearML should capture it

Does it make sense?

  
  
Posted 2 years ago

CostlyOstrich36 Not sure I understood, the current iterations come from the function
task.get_last_iteration() ...

  
  
Posted 2 years ago

Do you mean reporting scalars with tensorflow OR having the reported tensorflow scalars show up on ClearML?

  
  
Posted 2 years ago

Or do I have to dive into the code in train function and write the code there?

  
  
Posted 2 years ago

CostlyOstrich36 I have my own function that gives an estimate of performance, and I want to display it in the graph of each iteration.
And I am using tensorflow

  
  
Posted 2 years ago

CostlyOstrich36 More precisely, My function only calculates the accuracy as I defined it.
I passing the accuracy to logger.report_scalar by
logger.report_scalar(title='evaluate', series='score', value=my_acc, iteration=task.get_last_iteration())

  
  
Posted 2 years ago

CostlyOstrich36 having the reported tensorflow scalars show up on ClearML

  
  
Posted 2 years ago