changes by hand modifications