It's possible that your cream cheese wasn't quite soft enough when you started mixing. You can put the filling through a fine mesh strainer to work out any lumps if needed.