modify from notebook