cleaned up, only adding not object if annotations to nots are present