@<1523704157695905792:profile|VivaciousBadger56> regrading: None
Is this a discussion or PR ?
(general ranting is saved for our slack channel ๐ )
@<1523701087100473344:profile|SuccessfulKoala55> : I referenced this conversation in the issue None
@<1523701083040387072:profile|UnevenDolphin73> : Thanks, but it does not mention the File Storage of "ClearML Hosted Server".
We'll try to add referenced to that in other places as well ๐
FWIW Itโs also listed in other places @<1523704157695905792:profile|VivaciousBadger56> , e.g. None says:
In order to make sure we also automatically upload the model snapshot (instead of saving its local path), we need to pass a storage location for the model files to be uploaded to.
For example, upload all snapshots to an S3 bucketโฆ
@<1523701087100473344:profile|SuccessfulKoala55> Also, I think that - in this case, but also in other cases - the issue is not just the documentation, but also the design of the SDK.
@<1523701087100473344:profile|SuccessfulKoala55> : That is the link I posted as well. But this should be mentioned also at places where it is about about the external or non-external storage. Also it should be mentioned everywhere we talk about models or artifacts etc. Not necessarily in details, but at least with a sentence and a link.
By the way, output_uri is also documented as part of the Task.init() docstring ( None )
We're certainly working hard on improving the documentation (and I do apologize for the frustrating experience)
Hi all, sorry for not being so responsive today ๐
@<1523701083040387072:profile|UnevenDolphin73> : From which URL is your most recent screenshot?
I can only say Iโve found ClearML to be very helpful, even given the documentation issue.
I think theyโve been working on upgrading it for a while, hopefully something new comes out soon.
Maybe @<1523701205467926528:profile|AgitatedDove14> has further info ๐
I have already been trying to contribute (have three pull requests), but honestly I feel it is a bit weird, that I need to update a documentation about something I do not understand, while I actually try to evaluate if ClearML is the right tool for our company...
The documentation is messy, Iโve complained about it the in the past too ๐
Do you mean "exactly" as in "you finally got it" or in the sense of "yes, that was easy to miss"?
FWIW, we prefer to set it in the agentโs configuration file, then itโs all automatic
@<1523701083040387072:profile|UnevenDolphin73> : I see. I did not make the connection that output_uri=True
is what I was missing. I thought this was the default. But the default is actually "None", which is different than "True".
Heh, well, John wrote that in the first reply in this thread ๐
And in Task.init
main documentation page (nowhere near the code), it says the following -
@<1523701083040387072:profile|UnevenDolphin73>
But, I guess @<1523701070390366208:profile|CostlyOstrich36> wrote that in a different chat, right?
It is documented at None ... super deep in the code. If you don't know that output_uri
in TASK's (!) init is relevant, you would never know...
Heh, good @<1523704157695905792:profile|VivaciousBadger56> ๐
I was just repeating what @<1523701070390366208:profile|CostlyOstrich36> suggested, credits to him
We have the following, works fine (we also use internal zip packaging for our models):
model = OutputModel(task=self.task, name=self.job_name, tags=kwargs.get('tags', self.task.get_tags()), framework=framework)
model.connect(task=self.task, name=self.job_name)
model.update_weights(weights_filename=cc_model.save())