Is JSON mode available in the Phi-3-vision API
Hi all, I tried explicitly mentioning regarding the output format in JSON and also to avoid any other information apart from it.
but, looks like phi3-vision doesn't respect much about the output format.
Do we have a output mode like json as available in GPT-4 API.
@gaurav646
I was having the same issue with you. However I noticed Phi3-mini just shows bad performance at formatting the output in json.
You can see at here https://huggingface.co/microsoft/Phi-3-mini-128k-instruct json foratting showing bad performance.
I'm using XML formatting for the alternative way and it is much better now.
Got it. You ask for the output in the xaml format. And the format is coming consistent.
I will try that.
@gaurav646 Yes I'm using something like this
prompt_for_llm = (
"Provide all necessary information in the report and it should be filled in a XML format with the options below:\n"
"<report>\n"
" <category>[Construction/Flood/Congestion/Normal]</category>\n"
" <weather>[Clear/Overcast/Snow/Rain]</weather>\n"
" <level>[Danger/Caution/Safe]</level>\n"
" <detail>[detailed description of the situation]</detail>\n"
"</report>"
)