OK, there appears to be a github issue relating this:
https://github.com/allegroai/clearml/issues/388
I was right regarding encountering this before. People have asked for this feature and I think it appears to be a priority to add as a feature.

You can circumvent auto logging with the following:
task = Task.init(..., auto_connect_frameworks={'pytorch': False})However you will need to log other models manually now. More information is in the github issue 🙂