I think it deserves some sort of warning because we really are implementing a rather dumb way to upgrade.
Alternatively, I could do the really right thing and implement version checks and such.

Maybe the thing is not to have version numbers in plugins but have the site building script just put commit hashes there, and whenever it's different than the local one, it's newer.