Prime Minister Shinzo Abe in the Diet on Wednesday rejected opposition demands for welfare minister Hakuo Yanagisawa's resignation over his controversial remarks about women.