no AI response

[tigermick]

Steps to reproduce

1. Install llm2 app
2. Go to assistant
3. Try to speak with AI
4. No response

Expected behaviour

Tell us what should happen
I should have an answer

Actual behaviour

I haven't an answer and i have this error in log :
Network error fetching the next task Remote end closed connection without response

Server configuration

Web server: Apache

Database: MySQL

PHP version: 8.4

Nextcloud version: 33.0.2

Browser

Browser name: Firefox

Browser version: 149.0.1
Operating system: Linux and android

[edward-ly]

Hello, could you please paste the complete log entry here and not just the error message? That may help us better understand the issue.

[tigermick]

Hi
Thank you to try to help me.
That is the complete log entry :

{
  "reqId": "sD7OTkdIBbi75ooetIDd",
  "level": 3,
  "time": "2026-04-06T07:00:57+00:00",
  "remoteAddr": "192.168.0.43",
  "user": "--",
  "app": "llm2",
  "method": "POST",
  "url": "/ocs/v1.php/apps/app_api/api/v1/log?format=json",
  "scriptName": "/ocs/v1.php",
  "message": "Network error fetching the next task Remote end closed connection without response",
  "userAgent": "ExApp/llm2/2.6.0 (niquests/3.15.2)",
  "version": "33.0.2.2",
  "data": {
    "app": "llm2"
  },
  "id": "69d35d85ef1a6"
}

Is it better like this ? Or something is missing again ?

[edward-ly]

Hm, that's better, but I still can't quite tell what the cause might be. It's possible that the dependencies are outdated or there's something wrong with your AppAPI deploy daemon. We're working on an update to the llm2 app which should be out soon. Let us know then if that update doesn't resolve this issue.

[marcelklehr]

@tigermick Also, please try to get the logs from the llm2 docker container

[tigermick]

@edward-ly Yes I can wait the next release to check if that update resolve my issue.
@marcelklehr I have this logs :

HP_SHARED_KEY is set, creating /frpc.toml configuration file...
Found /certs/frp directory. Creating configuration with TLS certificates.
Starting frpc in the background...
Starting application: poetry run python3 main.py
2026-04-11 19:41:53.064 [I] [sub/root.go:142] start frpc service for config file [/frpc.toml]
2026-04-11 19:41:53.065 [I] [client/service.go:295] try to connect to server...
2026-04-11 19:41:53.072 [I] [client/service.go:287] [4e5e51b9ce5289f6] login to server success, get run id [4e5e51b9ce5289f6]
2026-04-11 19:41:53.072 [I] [proxy/proxy_manager.go:173] [4e5e51b9ce5289f6] proxy added: [llm2]
2026-04-11 19:41:53.073 [I] [client/control.go:168] [4e5e51b9ce5289f6] [llm2] start proxy success
INFO:     Started server process [1]
INFO:     Waiting for application startup.
TRACE:    ASGI [1] Started scope={'type': 'lifespan', 'asgi': {'version': '3.0', 'spec_version': '2.0'}, 'state': {}}
TRACE:    ASGI [1] Receive {'type': 'lifespan.startup'}
TRACE:    ASGI [1] Send {'type': 'lifespan.startup.complete'}
INFO:     Application startup complete.
INFO:     Uvicorn running on unix socket /tmp/exapp.sock (Press CTRL+C to quit)
TRACE:    HTTP connection made
TRACE:    ASGI [2] Started scope={'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': None, 'client': None, 'scheme': 'http', 'root_path': '', 'headers': '<...>', 'state': {}, 'method': 'GET', 'path': '/heartbeat', 'raw_path': b'/heartbeat', 'query_string': b''}
TRACE:    ASGI [2] Send {'type': 'http.response.start', 'status': 200, 'headers': '<...>'}
INFO:      - "GET /heartbeat HTTP/1.1" 200 OK
TRACE:    ASGI [2] Send {'type': 'http.response.body', 'body': '<15 bytes>'}
TRACE:    ASGI [2] Completed
TRACE:    ASGI [3] Started scope={'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.3'}, 'http_version': '1.1', 'server': None, 'client': None, 'scheme': 'http', 'root_path': '', 'headers': '<...>', 'state': {}, 'method': 'PUT', 'path': '/enabled', 'raw_path': b'/enabled', 'query_string': b'enabled=1'}
2026-04-11 19:41:55,598 - main - INFO - enabled=True
2026-04-11 19:41:55,738 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:summary
2026-04-11 19:41:55,804 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:headline
2026-04-11 19:41:55,869 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:topics
2026-04-11 19:41:55,934 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:simplification
2026-04-11 19:41:56,001 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:reformulation
2026-04-11 19:41:56,070 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:contextwrite
2026-04-11 19:41:56,135 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text
2026-04-11 19:41:56,201 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:chat
2026-04-11 19:41:56,267 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:proofread
2026-04-11 19:41:56,332 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:changetone
2026-04-11 19:41:56,402 - main - INFO - Registered Olmo-3-7B-Instruct-Q4_K_M:core:text2text:chatwithtools
2026-04-11 19:41:56,469 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:summary
2026-04-11 19:41:56,537 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:headline
2026-04-11 19:41:56,603 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:topics
2026-04-11 19:41:56,669 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:simplification
2026-04-11 19:41:56,735 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:reformulation
2026-04-11 19:41:56,801 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:contextwrite
2026-04-11 19:41:56,890 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text
2026-04-11 19:41:56,957 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:chat
2026-04-11 19:41:57,024 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:proofread
2026-04-11 19:41:57,088 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:changetone
2026-04-11 19:41:57,158 - main - INFO - Registered Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:chatwithtools
TRACE:    ASGI [3] Send {'type': 'http.response.start', 'status': 200, 'headers': '<...>'}
INFO:      - "PUT /enabled?enabled=1 HTTP/1.1" 200 OK
TRACE:    ASGI [3] Send {'type': 'http.response.body', 'body': '<12 bytes>'}
TRACE:    ASGI [3] Completed
TRACE:    HTTP connection lost
2026-04-11 19:43:41,788 - main - ERROR - Network error fetching the next task Remote end closed connection without response
2026-04-11 19:43:51,997 - main - INFO - chain: Meta-Llama-3.1-8B-Instruct-Q4_K_M:core:text2text:chat
ggml_cuda_init: failed to initialize CUDA: no CUDA-capable device is detected