
Reputation
Badges 1
25 × Eureka!I think this is great! That said, it only applies when you are spining agents (the default helm is for the server). So maybe we need another one? or an option?
Are you saying you have a single line in the console output of the component Task?
Could it be in a python at_exit event ?
Its stored on the Task, you can see it under the execution tab in the UI
Ok the doc needs fixΒ (edited)
suggestion?
JitteryCoyote63 it should just "freeze" after a while as it will constantly try to resend logs. Basically you should be fine π
(If for some reason something crashed, please let me know so we can fix it)
using this is it possible to add to requirements of task with task_overrides?
Correct, but you will be replacing (not adding) requirements
BoredHedgehog47 you need to configure the clearml k8s glue to spin pods (instead of allocating agents per pods statically) does that make sense ?
Yes, I was referring to logging the "clearlm-data" Dataset ID on the Task itself, not an external database.
Make sense?
because comparing experiments using graphs is very useful. I think it is a nice to have feature.
So currently when you compare the graphs you can select the specific scalars to compare, and it Update in Real Time!
You can also bookmark the actual URL and it is fully reproducible (i.e. full state is stored)
You can also add custom columns to the experiment table (with the metrics) and sort / filter based on them, and create a summary dashboard (again like ll pages in the web app, URL is...
Could it be that this is the callback that causes it?
None
based on this one:
https://stackoverflow.com/questions/31436407/git-ls-remote-returns-fatal-no-remote-configured-to-list-refs-from
I think this is a specific issue of the local git repo configuration, can you verify
(btw: I tested with git 2.17.1 git ls-remote --get-url
will return the remote url, without an error)
Oh that's definitely off π
Can you send a quick toy snippet to reproduce it ?
SoreDragonfly16 . In the hyper parameters Tab, you have "parallel coordinates" (next to the "add experiment" the button saying "values" press on it and there should be " parallel coordinates")
Is that it?
SoreDragonfly16 as SmallDeer34 mentioned, you can iterate over the Tasks, pull metrics (with either task.get_last_scalar_metrics
or task.get_reported_scalar
) then report them on the Task that runs the Loop itself with the Logger.
wdyt?
Oh I see, these are to secure your server (basically we recommend you replace the default key/secret π )
Make sense ?
Hmm, I'm without, no reason why it will get stuck .
Removing all the auto loggers, this can be done with
Task.init(..., auto_connect_frameworks=False)
which would disconnect all the automatic loggers (Hydra etc) off course this is for debugging purposes
Hi @<1797800418953138176:profile|ScrawnyCrocodile51>
The upload function returns Only after the files were uploaded:
None
Is this what you mean?
With pleasure π
Hi BoredPigeon26
what do you mean by "reuse the task" ? is this manual execution (i.e. from code)?
How about archiving the old version?
You can also force Task.init to always create a new Task (which preserves the previous run alongside the execution tab)
Basically what's the specific use case ?
Yes, the same will work with artifacts, use pass the full url to the artifact_object
it should just register it as is.
Hi RipeGoose2
when creating a task the default path is still there
What do you mean by "PATH" do you want to provide path for the config file? is it for trains
manual execution or the agent
?
Hi WearyLeopard29
Yes π this is exactly how it should work
ReassuredTiger98
It seems like clearml is not able to fetch the dependencies correctly whenΒ
importlib
Β is used.
If you have an example please let me know we'll try to fix it :)
Is it possible to read the dependencies manually from a conda environment.yml?
You can set detect_with_conda_freeze: true
in clearml.conf, it will just use the entire conda env
https://github.com/allegroai/clearml/blob/28b85028fe4da3ab963b69e8ac0f7feef73cfcf6/docs/clearml.conf#L170
@<1523711619815706624:profile|StrangePelican34> are you saying that after the " with
" block the task is marked completed? how is that possible? is this done manually ?
Could that be the proper way to install ?
https://github.com/facebookresearch/pytorch3d/blob/main/INSTALL.md#3-install-wheels-for-linux