Good evening everyone, I have a question on how to monitor model performance (in terms of accuracy of predictions) with grafana.
In this tutorial: None , only variables are logged (both features and the target), but is it possible to log some metrics too, like rmse or the likes? If so, how would you do it?
What I was thinking for now is to call the collect_custom_statistics_fn() function in the preprocessing script, and add the metric score inside the postprocess() method. Is this correct?
Hi @<1578193378640662528:profile|MoodySeaurchin4>
but is it possible to log some metrics too, like rmse or the likes? If so, how would you do it?
Sure, I'm assuming this is part of the output ? if not, this means this is part of your code, and if this is the case then yes you should use collect_custom_statistics_fn
Nonecollect_custom_statistics_fn({'rmse': 1.337})
