SSH connection asks for private key password on every directory change

[pathetic-lynx]

Describe the bug
v3.11.3 fixed the issue with ed25519 keys. SSH now works with these connections. However, the decrypted private key is not cached and the session is terminated immediately (Note that I am guessing from the observed behavior)

To Reproduce
Steps to reproduce the behavior:

1. Create ssh connection with ed25519 encrypted privkey
2. Use the connection
3. Get asked for password (expected for the initial connection, i don't want my decrypted privkey stored by the app)
4. Change directory
5. Goto 3.

Note: App closes if you select 'cancel' on the password prompt

Expected behavior
Keep ssh session open until I close the tab or 5min of inactivity or sth.

Smartphone (please complete the following information):

• Device: pixel 8a
• OS: latest grapheneos
• Rooted: no
• Version: v3.11.3

Additional Notes
I have observed being able to cd without re-entering the passphrase sometimes. Have not found a way to consistently reproduce.

I have not checked if this is specific to ed25519 with encrypted privkey