
Reputation
Badges 1
44 × Eureka!I call it like that:logger.clearml_logger.report_image( self.tag, f"{self.tag}_{iteration:0{pad}d}", epoch, image=image ) `` self.tag
is train
or valid
. iteration
is an int for the minibatch in the epoch
Wow thanks a lot, I'll test it. I didn't even search in trains_agent
documentation.
Something like 100 epoch with a least more than 100 images par epoch reported.
Thanks a lot I'll check how to do this correctly
I'll give a try with the virtualenv solution. If I have any question I'll ask in this thread. Thanks a lot.
Oh can't wait to see this feature 👀
So I see two options:
Reducing the number of image reported (already in our plan) Make on big image per epoch
I have made some changes in the codelogger.clearml_logger.report_image( self.tag, f"{self.tag}_{epoch:0{pad}d}", iteration=iteration, image=image ) `` epoch
range is 0-150 iteration
range is 0-100And the error is still there
` General data error (TransportError(503, 'search_phase_execution_exception', 'Trying to create too many buckets. Must be less than or equal to: [10000] but was [10001]. This limit can be set by changing the [search.max_buckets] clus...
I have 6 plots with one or 2 metrics. But I have a lot of debug samples.
SuccessfulKoala55 feel free to roast my errors.
Even simpler than a github, this code reproduce the issues I have.
AgitatedDove14 This is what I expected for the community version. It would really nice to have a read-only link. My use case is when I have a merge request for a model modification I need to provide several informations for our Quality Management System one is to show that the experiment is a success and the model has some improvement over the previous iteration. Obviously I don't want the reviewer to see all my failed experiments 😉 . So yes it should be really nice to have read-only ...
Issue open on the clearml-server github https://github.com/allegroai/clearml-server/issues/89 . Thanks for your help.
SuccessfulKoala55 Also I see that the images name are not ordered naturaly it's display like this image_name_1
, image_name_10
, image_name_2
, and so on, is it possible to have a natural order to see image_name_1
, image_name_2
, etc... ?
Yes this will work I think.
I'll try to make a code that reproduce this behavior and post it on github is it fine ? that way you could check if I'm the problem (which is really likely) 😛
Is it better on clearml or clearml-server ?
I made the experiment on the allegroai demo server and it's the same https://demoapp.trains.allegro.ai/projects/fcf3f3fb1013434eb2001870990e5e94/experiments/6ed32a2b5a094f2da47e6967bba1ebd0/output/debugImages . I really think it's a technical limitation to not display all the image am I right ?
Wow, that really nice. I did almost the same code, TrainsLogger
, TrainsSaver
, and all the OutputHandler
. I'll use your version instead and put any comment if I find something.
yes tag is fixed
I'm in a process to setup a trains
stack for my projects
and so far it work great thank for this awesome work.
Is it somewhere in the documentation ?