Better support for code generation without the use of transformers.