[core] Remove some Java dependencies

Keep plugin as is for now as no real need to optimize its build.