Bug 875963 - Switch case without rebuilding keyboard

Don't rebuild the full keyboard every we activate a new one.