Fixed. Dont really need private[spark] as the whole class is private[spark]. So just making them public is sufficient.