A method implemented by one or more processors, comprising: receiving a voice input provided by a user via a voice-enabled electronic device; performing a voice to text conversion, using a voice to text model, to convert the voice input to text; transmitting the text to a third-party agent via one or more network interfaces; receiving content from the third-party agent in response to transmitting the text, the receiving being via one or more of the network interfaces and the content including: responsive content that is responsive to the text, and one or more contextual parameters that are in addition to the responsive content and that indicate one or more tokens of further voice input to be provided in response to the responsive content; providing output that is based on the responsive content for presentation to the user via the voice-enabled electronic device, the output being provided in response to the voice input; receiving an additional voice input provided by the user via the voice-enabled electronic device and provided by the user in response to the output; and using the content received from the third-party agent to perform an additional voice to text conversion, using the voice to text model, to convert the additional voice input to additional text, wherein using the content comprises using the contextual parameters to perform the additional voice to text conversion using the voice to text model, wherein using the contextual parameters to perform the additional voice to text conversion comprises biasing, based on the contextual parameters, values that are generated over the voice to text model and that are associated with the one or more tokens. receiving a voice input provided by a user via a voice-enabled electronic device; performing a voice to text conversion, using a voice to text model, to convert the voice input to text; transmitting the text to a third-party agent via one or more network interfaces; receiving content from the third-party agent in response to transmitting the text, the receiving being via one or more of the network interfaces and the content including: responsive content that is responsive to the text, and one or more contextual parameters that are in addition to the responsive content and that indicate one or more tokens of further voice input to be provided in response to the responsive content; responsive content that is responsive to the text, and one or more contextual parameters that are in addition to the responsive content and that indicate one or more tokens of further voice input to be provided in response to the responsive content; providing output that is based on the responsive content for presentation to the user via the voice-enabled electronic device, the output being provided in response to the voice input; receiving an additional voice input provided by the user via the voice-enabled electronic device and provided by the user in response to the output; and using the content received from the third-party agent to perform an additional voice to text conversion, using the voice to text model, to convert the additional voice input to additional text, wherein using the content comprises using the contextual parameters to perform the additional voice to text conversion using the voice to text model, wherein using the contextual parameters to perform the additional voice to text conversion comprises biasing, based on the contextual parameters, values that are generated over the voice to text model and that are associated with the one or more tokens. <EOS>