Thanks! I think I was able to locate the issue, but I wanted to verify 🙂
i just run it and it saved it, I did nothing more then what was provided in the code. Only difference is in those two lines with comments, one works one does not.
# outputs = TestLayer(a=1, b=2)(inputs) # model uploads properly outputs = TestLayer(a=1, b={"b": 2})(inputs) # model does not upload
I just uncommented first line and commented second line
Thanks for pinging OutrageousGiraffe8
I think I was able to reproduce.
model is saved to the clearml as an output model when
b
is not a dictionary.
How did you make the example work with the automagic ?
AgitatedDove14 Hi, were you able to reproduce issue? Can I be of any assistance? Do you still need toy code?
I will not be able to do it untill at least tomorrow but rest of the code is quite simple.. It is essentially this;
` task = Task.init(...)
task.output_uri = gs://<artifact_location>
model = build_model_test(None)
tf.keras.models.save_model(model, "/tmp/model")
`
I use both latest stable versions of clearml and tensorflow
Thanks OutrageousGiraffe8
Any chance you can expand the example code to be a fully a reproducible toy code? (I would really like to make sure we fix it)
There is no explicit error. When I call tf.keras.models.save_model(model, model_path)
model is saved to the clearml as an output model when b
is not a dictionary. But if b
is dict than model is not saved, and is not in artifacts under output models
I will try to log model manually, thank you for the info. But still saving keras model should result in clearml artifact according to documentation, so I believe this might be a bug.
Hi OutrageousGiraffe8
Does anybody knows why this is happening and is there any workaround, e.g. how to manually report model?
What exactly is the error you are getting? and with which clearml version are you using?
Regrading manual Model reporting:
https://clear.ml/docs/latest/docs/fundamentals/artifacts#manual-model-logging