Yes, a VPS really is private. The virtualization technology involved will ensure all users on the same server get a dedicate share of its system resources. Same goes for security - an unauthorized breach in a neighboring account would not affect your operations, like in shared hosting.