Skip to content

[BUG] too much overhead even for a 1b instruct model #1277

Open
Open
[BUG] too much overhead even for a 1b instruct model#1277
Labels
bugSomething isn't working
@JINO-ROHIT

Description

@JINO-ROHIT
JINO-ROHIT
opened on Apr 18, 2026

im trying to run 1b instruct model on a 16gb vram gpu, it still fails to start up

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions