Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Folks !! I Have Two Questions On Pytorch Lightning Example In Particular Logging. The Comment Says “Connecting Clearml With The Current Process, From Here On Everything Is Logged Automatically.” Q1: Does This Comment Mean That

Hi, folks !!

I have two questions on pytorch lightning example in particular logging.

The comment says “Connecting ClearML with the current process, from here on everything is logged automatically.”

Q1: Does this comment mean that self.log("key_name", value) in LightningModule automatically stores value as clearml data ??

https://github.com/allegroai/clearml/blob/master/examples/frameworks/pytorch-lightning/pytorch_lightning_example.py#L56-L58

Q2: Can I dump this logged keys & values as local files ?

  
  
Posted 2 years ago
Votes Newest

Answers 5


EcstaticBaldeagle77 , Can you share an example of:
self.log("key_name", value) that you save? (not 100% sure what self is 🙂 )

What the automagic integration provide is that you have all the parameters of your pl trainer automatically fetched and populated, as well as when you call this function:
def validation_step(self, batch, batch_idx): x, y = batch y_hat = self(x) loss = F.cross_entropy(y_hat, y) self.log('valid_loss', loss)The call to "self.log()" is fetched and reported as a metric (with the name "valid_loss")

  
  
Posted 2 years ago

EcstaticBaldeagle77 , Actually, these scalars and configurations are not saved locally to a file, but can be retrieved and saved manually. If you want to get metrics you can call task.get_reported_scalars() and if you want configuration then call task.get_configuration_object() with the configuration section as it appears in the web application

  
  
Posted 2 years ago

Can you share an example of:
self.log(“key_name”, value) that you save?

Hi, AnxiousSeal95 thanks for your help.

self.log(“key_name”, value) just means self.log("train_loss", loss) or self.log("valid_loss", loss) in the example source code 😅

It’s also possible to retrieve configurations from clearml and dump them as a file. Is that what you’re looking for?

If configurations include values which logged at self.log("train_loss", loss) and self.log("valid_loss", loss) , that’s what I am looking for.

Can I manually set the local path to be dumped?

  
  
Posted 2 years ago

As for your second question, You can connect files as TimelyPenguin76 suggested. It's also possible to retrieve configurations from clearml and dump them as a file. Is that what you're looking for?

  
  
Posted 2 years ago

Hi EcstaticBaldeagle77 ,

The comment says “Connecting ClearML with the current process, from here on everything is logged automatically.”

this comment means that every framework is now patched and will report to ClearML too, this can be configure (per task) with auto_connect_frameworks in your Task.init call (example can be found here - https://clear.ml/docs/latest/docs/faq#experiments )

Q2: Can I dump this logged keys & values as local files ? (edited)

Not sure what you mean here, but you can connect parameters and configuration files to your task with task.connect (parameters) and task.connect_configuration (configuration files) methods

  
  
Posted 2 years ago
720 Views
5 Answers
2 years ago
one year ago
Tags