I don't recommend adding hard caramels into the pie filling as the filling may get stuck in your teeth after it's baked. It's best to use soft caramels or to omit the caramel altogether.