Include LLM responses in clientMessages
L
Lucas Ngoo
Currently https://docs.vapi.ai/sdk/web#message does not return responses from the LLM; it only provides transcripts (https://github.com/VapiAI/web/blob/2cc10cf008740ed0993fe888b6571139f1b1c2a4/api.ts#L902). These transcripts may vary or contain transcription errors, which can result in discrepancies with the LLM's responses. Additionally, the content for 'conversation-update' is sourced from these transcripts rather than directly from the LLM responses. It would be good for the 'conversation-update' to directly use the responses by the LLM.
Fully Informed Conversations
We would also SUPER love this feature. We need the assistant to list potential answer choices in a standard format. Crucial for usability.
K
Krzysztof Wurst
Agree, would be great to receive raw transcript - could be very useful with assistants that serve as math teachers for example.