See https://github.com/plexus/kramdown/blob/78b441cfbc3c1c82befc91f1fe50d6d7e0201618/test/testcases/block/06_codeblock/backticks_disable_highlighting.html for a test case that specifically tests this behavior.