Jack was clearly aware of the threat posed by Oogie Boogie, as he specifically attempted to keep him away from the Christmas preparations.
He was not known to have made any other moves to suppress Oogie Boogie or remove him as a threat.