Conclusion: The Empire is the better choice. It will benifit everyone better, and every reason you have to dislike them would be gone after the defeat of the Thalmor/Aldmeri Dimionion.