Yes you are. The passwords were a part of your job and therefore belong to your fomer employer. You can face legal action if you do not comply.