was thinking that would delete the old weights from the file server once they get updated,

If you are uploading it to the same Task, make sure the model name and the filename is the same and it will override it (think filesystem filenames)

but they are still there, consuming space. Is this the expected behavior? How can I get rid of those old files?

you can programatically also remove (delete) models None