modify by hand