Only add debugger/byebug if on MRI

[fixes #18142]

review @sgrif @bl4ckn0de