[shell mode] add very incomplete tests, including failures for #2506