This should probably be `private[spark]` so it doesn't get included in ScalaDocs.