Gridfield Paginator counting only viewable items

When displaying any list which contains objects which aren't viewable for the current user the count isn't equal with the number of viewed elements. I tried it with a ArrayList containing DataObjects which use _canView() to determine if it should be displayed. The DataObjects which weren't allowed to display didn't show up but still were counted.