Revert "Add debian dir to build package"

This reverts commit c859ab0a419b6019c1899e4ef63a80cec29dfbf3.