Bug: The Grok's response API can only answer the first, third, fifth, seventh sentences

[alabulei1]

When I use EchoKit Box + Grok's response API, It can only answer the first, third, fifth, seventh sentences.

To reproduce this error, set LLM to the Grok's response APi

[llm]
platform = "openai_responses"
url = "https://api.x.ai/v1/responses"
api_key = ""
model = "grok-4-1-fast-non-reasoning"

The log below shows when I say Hey, the ASR worked well and I can see the ASR result on the screen but I can't hear any voices back. From the log I can see the LLM doesn't generate answers. When I say the next sentence Hello, the response API works well.

[2026-01-14T17:39:35Z INFO  echokit_server::services::ws] `fc012ccfc8dc` ASR took: 302.767333ms
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws] ASR result: " Hey!"
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 asr result:  Hey!
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 started llm and tts handling for this input
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable::llm] start llm responses
[2026-01-14T17:39:35Z DEBUG echokit_server::ai] #### send to responses llm:
    {
      "model": "grok-4-1-fast-non-reasoning",
      "previous_response_id": "a030ed39-bad3-743b-3c62-72a4b067c71a",
      "instructions": "Your name is EchoKit, a smart and highly individualistic AI assistant. Your current mission is to help users to manager their google calendar. When users mention they want to manage the calendar(Adding events and delete events), please call the MCP server to do that. The default time is SGT.\n\n- NEVER use bullet points\n- NEVER use tables\n- Answer in complete English sentences but shortly as if you are in a conversation.\n\n",
      "input": " Hey!",
      "stream": true
    }
    #####
[2026-01-14T17:39:35Z DEBUG reqwest::connect] starting new connection: https://api.x.ai/
[2026-01-14T17:39:35Z DEBUG hyper_util::client::legacy::connect::http] connecting to 104.18.18.80:443
[2026-01-14T17:39:35Z DEBUG hyper_util::client::legacy::connect::http] connected to 104.18.18.80:443
[2026-01-14T17:39:35Z DEBUG hyper_util::client::legacy::pool] pooling idle connection for ("https", api.x.ai)
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable::llm] llm responses done
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 session processing done for this input
[2026-01-14T17:39:35Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 waiting for asr input
[2026-01-14T17:39:35Z DEBUG echokit_server::services::ws] EndResponse
[2026-01-14T17:39:39Z DEBUG echokit_server::services::ws] Received text message: {"event":"StartChat"}
[2026-01-14T17:39:39Z DEBUG echokit_server::services::ws] Received binary message of size: 16384
[2026-01-14T17:39:40Z DEBUG echokit_server::services::ws] Received binary message of size: 15360
[2026-01-14T17:39:40Z DEBUG echokit_server::services::ws] Received text message: {"event":"Submit"}
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws] end audio
[2026-01-14T17:39:40Z DEBUG reqwest::connect] starting new connection: http://localhost:9093/
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::connect::http] connecting to [::1]:9093
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::connect::http] connecting to 127.0.0.1:9093
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::pool] reuse idle connection for ("https", api.groq.com)
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::pool] pooling idle connection for ("https", api.groq.com)
[2026-01-14T17:39:40Z DEBUG echokit_server::ai] ASR response: Object {
        "text": String(" Hello?"),
        "x_groq": Object {
            "id": String("req_01keysez9ge5nbq51xf73cq3n0"),
        },
    }
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws] `fc012ccfc8dc` ASR took: 248.8465ms
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws] ASR result: " Hello?"
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 asr result:  Hello?
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 started llm and tts handling for this input
[2026-01-14T17:39:40Z INFO  echokit_server::services::ws::stable::llm] start llm responses
[2026-01-14T17:39:40Z DEBUG echokit_server::ai] #### send to responses llm:
    {
      "model": "grok-4-1-fast-non-reasoning",
      "instructions": "Your name is EchoKit, a smart and highly individualistic AI assistant. Your current mission is to help users to manager their google calendar. When users mention they want to manage the calendar(Adding events and delete events), please call the MCP server to do that. The default time is SGT.\n\n- NEVER use bullet points\n- NEVER use tables\n- Answer in complete English sentences but shortly as if you are in a conversation.\n\n",
      "input": " Hello?",
      "stream": true
   #####
[2026-01-14T17:39:40Z DEBUG reqwest::connect] starting new connection: https://api.x.ai/
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::connect::http] connecting to 104.18.18.80:443
[2026-01-14T17:39:40Z DEBUG hyper_util::client::legacy::connect::http] connected to 104.18.18.80:443
[2026-01-14T17:39:42Z DEBUG echokit_server::services::ws::stable::llm] llm responses chunk: "Hello! How can I help with your Google Calendar today?"
[2026-01-14T17:39:42Z INFO  echokit_server::services::ws::stable::tts] 3 processing TTS request: Hello! How can I help with your Google Calendar today?
[2026-01-14T17:39:42Z DEBUG echokit_server::ai::elevenlabs::tts] Connect Elevenlabs TTS WebSocket URL: wss://api.elevenlabs.io/v1/text-to-speech/pNInz6obpgDQGcFmaJgB/stream-input?model_id=eleven_flash_v2_5&output_format=pcm_16000
[2026-01-14T17:39:42Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:9172d0ba13b94799ae0b424632a80da6 starting tts for chunk: Hello! How can I help with your Google Calendar today?
[2026-01-14T17:39:42Z DEBUG reqwest::connect] starting new connection: https://api.elevenlabs.io/
[2026-01-14T17:39:42Z DEBUG hyper_util::client::legacy::connect::http] connecting to 34.36.213.91:443
[2026-01-14T17:39:42Z DEBUG hyper_util::client::legacy::connect::http] connected to 34.36.213.91:443

[alabulei1]

Another similar log

[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] [Chat] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 connected. ConnectQueryParams { reconnect: true, opus: true, vowel: true }
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] `fc012ccfc8dc` starting socket io processing
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] received new session for id `fc012ccfc8dc`, restarting session
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] Running session for id `fc012ccfc8dc`
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 starting session processing
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 waiting for asr input
[2026-01-15T01:56:08Z DEBUG echokit_server::services::ws] EndResponse
[2026-01-15T01:56:08Z WARN  echokit_server::services::ws::stable] fc012ccfc8dc:72aef2a4b17948e9839205ae26443ef9 handle_socket error: ws channel closed
[2026-01-15T01:56:08Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:72aef2a4b17948e9839205ae26443ef9 disconnected.
[2026-01-15T01:56:13Z DEBUG echokit_server::services::ws] Received text message: {"event":"StartChat"}
[2026-01-15T01:56:13Z DEBUG echokit_server::services::ws] Received binary message of size: 16384
[2026-01-15T01:56:13Z DEBUG echokit_server::services::ws] Received binary message of size: 16384
[2026-01-15T01:56:13Z DEBUG echokit_server::services::ws] Received text message: {"event":"Submit"}
[2026-01-15T01:56:13Z INFO  echokit_server::services::ws] end audio
[2026-01-15T01:56:13Z DEBUG reqwest::connect] starting new connection: http://localhost:9093/
[2026-01-15T01:56:13Z DEBUG hyper_util::client::legacy::connect::http] connecting to [::1]:9093
[2026-01-15T01:56:13Z DEBUG hyper_util::client::legacy::connect::http] connecting to 127.0.0.1:9093
[2026-01-15T01:56:13Z DEBUG reqwest::connect] starting new connection: https://api.groq.com/
[2026-01-15T01:56:13Z DEBUG hyper_util::client::legacy::connect::http] connecting to 104.18.38.236:443
[2026-01-15T01:56:13Z DEBUG hyper_util::client::legacy::connect::http] connected to 104.18.38.236:443
[2026-01-15T01:56:14Z DEBUG hyper_util::client::legacy::pool] pooling idle connection for ("https", api.groq.com)
[2026-01-15T01:56:14Z DEBUG echokit_server::ai] ASR response: Object {
        "text": String(" What's your name?"),
        "x_groq": Object {
            "id": String("req_01keznw6ryf148stcsfbgkjg2r"),
        },
    }
[2026-01-15T01:56:14Z INFO  echokit_server::services::ws] `fc012ccfc8dc` ASR took: 606.096458ms
[2026-01-15T01:56:14Z INFO  echokit_server::services::ws] ASR result: " What's your name?"
[2026-01-15T01:56:14Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 asr result:  What's your name?
[2026-01-15T01:56:14Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 started llm and tts handling for this input
[2026-01-15T01:56:14Z INFO  echokit_server::services::ws::stable::llm] start llm responses
[2026-01-15T01:56:14Z DEBUG echokit_server::ai] #### send to responses llm:
    {
      "model": "grok-4-1-fast-non-reasoning",
      "instructions": "Your name is EchoKit, a smart and highly individualistic AI assistant. Your current mission is to help users to manager their google calendar. When users mention they want to manage the calendar(Adding events and delete events), please call the MCP server to do that. The default time is SGT.\n\n- NEVER use bullet points\n- NEVER use tables\n- Answer in complete English sentences but shortly as if you are in a conversation.\n\n",
      "input": " What's your name?",
      "stream": true
    }
    #####
[2026-01-15T01:56:14Z DEBUG reqwest::connect] starting new connection: https://api.x.ai/
[2026-01-15T01:56:14Z DEBUG hyper_util::client::legacy::connect::http] connecting to 104.18.18.80:443
[2026-01-15T01:56:14Z DEBUG hyper_util::client::legacy::connect::http] connected to 104.18.18.80:443
[2026-01-15T01:56:15Z INFO  echokit_server::ai] llm response message: id=msg_92e9031a-0686-ae31-be6d-b910dd3c72b3, role=assistant, content=[
      {
        "annotations": [],
        "logprobs": [],
        "text": "My name is EchoKit.",
        "type": "output_text"
      }
    ]
[2026-01-15T01:56:15Z DEBUG echokit_server::ai] llm response completed: {
      "id": "92e9031a-0686-ae31-be6d-b910dd3c72b3"
    }
[2026-01-15T01:56:15Z DEBUG echokit_server::services::ws::stable::llm] llm responses chunk: "My name is EchoKit."
[2026-01-15T01:56:15Z INFO  echokit_server::services::ws::stable::llm] llm responses done
[2026-01-15T01:56:15Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 starting tts for chunk: My name is EchoKit.
[2026-01-15T01:56:15Z INFO  echokit_server::services::ws::stable::tts] 3 processing TTS request: My name is EchoKit.
[2026-01-15T01:56:15Z DEBUG echokit_server::ai::elevenlabs::tts] Connect Elevenlabs TTS WebSocket URL: wss://api.elevenlabs.io/v1/text-to-speech/pNInz6obpgDQGcFmaJgB/stream-input?model_id=eleven_flash_v2_5&output_format=pcm_16000
[2026-01-15T01:56:15Z DEBUG reqwest::connect] starting new connection: https://api.elevenlabs.io/
[2026-01-15T01:56:15Z DEBUG hyper_util::client::legacy::connect::http] connecting to 34.36.213.91:443
[2026-01-15T01:56:16Z DEBUG hyper_util::client::legacy::connect::http] connected to 34.36.213.91:443
[2026-01-15T01:56:16Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 finished tts for chunk: My name is EchoKit.
[2026-01-15T01:56:16Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 session processing done for this input
[2026-01-15T01:56:16Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 waiting for asr input
[2026-01-15T01:56:16Z DEBUG echokit_server::services::ws] EndResponse
[2026-01-15T01:56:22Z DEBUG echokit_server::services::ws] Received text message: {"event":"StartChat"}
[2026-01-15T01:56:22Z DEBUG echokit_server::services::ws] Received binary message of size: 16384
[2026-01-15T01:56:22Z DEBUG echokit_server::services::ws] Received binary message of size: 16384
[2026-01-15T01:56:23Z DEBUG echokit_server::services::ws] Received binary message of size: 5120
[2026-01-15T01:56:23Z DEBUG echokit_server::services::ws] Received text message: {"event":"Submit"}
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws] end audio
[2026-01-15T01:56:23Z DEBUG reqwest::connect] starting new connection: http://localhost:9093/
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::connect::http] connecting to [::1]:9093
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::connect::http] connecting to 127.0.0.1:9093
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::pool] reuse idle connection for ("https", api.groq.com)
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::pool] pooling idle connection for ("https", api.groq.com)
[2026-01-15T01:56:23Z DEBUG echokit_server::ai] ASR response: Object {
        "text": String(" What can you do?"),
        "x_groq": Object {
            "id": String("req_01keznwfh1f17ba78mjtx461yv"),
        },
    }
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws] `fc012ccfc8dc` ASR took: 216.881208ms
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws] ASR result: " What can you do?"
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 asr result:  What can you do?
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 started llm and tts handling for this input
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable::llm] start llm responses
[2026-01-15T01:56:23Z DEBUG echokit_server::ai] #### send to responses llm:
    {
      "model": "grok-4-1-fast-non-reasoning",
      "previous_response_id": "92e9031a-0686-ae31-be6d-b910dd3c72b3",
      "instructions": "Your name is EchoKit, a smart and highly individualistic AI assistant. Your current mission is to help users to manager their google calendar. When users mention they want to manage the calendar(Adding events and delete events), please call the MCP server to do that. The default time is SGT.\n\n- NEVER use bullet points\n- NEVER use tables\n- Answer in complete English sentences but shortly as if you are in a conversation.\n\n",
      "input": " What can you do?",
      "stream": true
    }
    #####
[2026-01-15T01:56:23Z DEBUG reqwest::connect] starting new connection: https://api.x.ai/
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::connect::http] connecting to 104.18.18.80:443
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::connect::http] connected to 104.18.18.80:443
[2026-01-15T01:56:23Z DEBUG hyper_util::client::legacy::pool] pooling idle connection for ("https", api.x.ai)
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable::llm] llm responses done
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 session processing done for this input
[2026-01-15T01:56:23Z INFO  echokit_server::services::ws::stable] fc012ccfc8dc:f8cada354774da5afa3f24f20125177 waiting for asr input
[2026-01-15T01:56:23Z DEBUG echokit_server::services::ws] EndResponse