Skip to content

Support for thinking in ollama models like granite3.2 #99

Description

@Eloitor

It would be nice if it was possible to enable thinking with ollama granite3.2
https://ollama.com/gabegoodhart/granite3.2-preview

Generation: To enable thinking, add a message with "role": "control" and set "content" to "thinking". For example:

{
    "messages": [
        {"role": "control", "content": "thinking"},
        {"role": "user", "content": "How do I get to the airport if my car won't start?"}
    ]
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions