So basically I'm wondering if it's possible to add some kind of small hierarchy in the artifacts, be it sections, groupings, tabs, folders, whatever.
Opened this - https://github.com/allegroai/clearml/issues/530 let me know if it's not clear enough FrothyDog40 !
The SDK is fine as it is - I'm more looking at the WebUI at this point
TimelyPenguin76 that would have been nice but I'd like to upload files as artifacts (rather than parameters).
AgitatedDove14 I mean like a grouping in the artifact. If I add e.g. foo/bar
to my artifact name, it will be uploaded as foo/bar
.
not sure about the Other
, but maybe adding some metadata to the artifact can do the trick?
You can get all the artifacts with task.artifacts
and you can go over it and filter with the metadata, wdyt?
UnevenDolphin73 you can create you own parameter section under hyper-parameters with task.connect(name="my_section", param_dict)
, but it doesnt connect to the artifacts automatically
UnevenDolphin73 Well... not right now... Currently the ClearML UI only partitions internal artifact types.
That said, having user-defined artifact groups sure sounds worth looking into - Care to https://github.com/allegroai/clearml/issues/new/choose ?
So kind of the ability to have more artifact types in "Artifacts" tab, other than Other
and OutputModels
, etc
Hey FrothyDog40 ! Thanks for clarifying - guess we'll have to wait for that as a feature 😁
Should I create a new issue or just add to this one? https://github.com/allegroai/clearml/issues/529
For example, we have a complicated YAML file with built-in !include
instructions, so we upload all the included files too. This then clogs up the artifacts sidebar, and it would be nice to be able to say "these are all artifacts from this one file, you can collapse it by clicking here"
UnevenDolphin73 I think it'd be easier to track as a separate one.