Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GloriousPanda26
Moderator
2 Questions, 26 Answers
  Active since 10 January 2023
  Last activity 20 days ago

Reputation

0

Badges 1

26 × Eureka!
0 Votes
30 Answers
531 Views
0 Votes 30 Answers 531 Views
Hello! I add to inject the configuration into clearml with task.connect_configuration( http://OmegaConf.to _container(cfg, resolve=True)) because I use hydra...
3 years ago
0 Votes
9 Answers
508 Views
0 Votes 9 Answers 508 Views
Hello 👋 ! I'm facing some issues when I try to register a configuration parsed with Hydra. Any idea how to do it? I tried connect_configuration but it yield...
3 years ago
0 Hello

This seems to be working:
t.connect_configuration(OmegaConf.to_container(conf, resolve=True))

3 years ago
0 Hello

This is unfortunate as OmegaConf behaves like dict

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

between Hydra, PL, TB and clearml I am not quite sure who is adding the prefix for each run

3 years ago
0 Hello

This solve this issue. However it does not interpolate values

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

Below is an example with one metric reported using multirun. This is taken from a single experiment result page as all runs feed the same experiment. Unfortunately I have no idea what 1 refers to for example. Is it possible to name each run or to break them into several experiments ?

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

And this is when I compare two tasks

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

I am not really familiar with TB internal mechanics. For this project we are using Pytorch Lightning

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

ClearML does

Thanks for doing that ! :i_love_you_hand_sign:

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

but despite the naming it's working quite well actually

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

but to go back to your question, I think it would make sense to have one task per run to make the comparison on hyper-parameters easier

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

the previous image was from the dashboard of one experiment

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

That is what I was hoping at first

3 years ago
0 Hello

Casting the configuration into a dict does not solve the problem as clearml does not capture the nested aspect of the configuration object. This is how it looks on your example:

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

the import order does is not related to the problem

3 years ago
0 Hello

sorry for the delay. ClearML capture the command line arguments but they are hydra parameters (mulitrun, config_dir, config_name, config_path, etc). I append and override some hyper parameters of the model but they are all stored as a string under "overrides".

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

yes. As you can see this one has the hydra section reported in the config

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

it's a single taks which contains metrics for all 4 executions

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

on one experiment it overlays the same metrics (not taking into account the run number)

3 years ago
0 Hello

image

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

but when I compare experiments the run numbers are taken into account comparing "1:loss" with "1:loss" and putting "2:loss"s in a different graph

3 years ago
0 Hello! I Add To Inject The Configuration Into Clearml With

but I have no idea what's behing 1 , 2 and 3 compare to the first execution

3 years ago