Skip to content

llama.cpp server with OpenVINO backend with Stateful inference support #108

Open
Open
llama.cpp server with OpenVINO backend with Stateful inference support#108
Labels
gsoclong-term
@ravi9

Description

@ravi9
ravi9
opened on Mar 23, 2026

Enable robust stateful inference support within server and API workflows to enable multiple parallel sessions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    gsoclong-term

    Projects

    LlamaCPP_OpenVINO Backend Project

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions