ispell-personal-dict can't handle different languages without a hassle.
Make sure aspell knows about latex