Yes, it is ok to not grind the tea leaves. You can simply steep the Earl Grey tea in the hot cream and then strain and discard the leaves. I like my Earl Grey cheesecake to have the tiny specks of tea leaves in the filling, hence the grinding, but this grinding process can be omitted.