This will throw off pagination and need to be moved into a filter.
You could combine it with the readable filter.  Something like:

 filters = [:terms => {:id => SystemGroup.readable(@system.organization).pluck(:id) - @system.system_group_ids}]