Skip to content

No clear explanation of how Model Hub integrates into real application flows #246

@ctolerate

Description

@ctolerate

Problem:
While Model Hub is introduced conceptually, it is not very clear how it fits into a real application architecture.

For example:

  • When should developers call Model Hub directly vs through SDK?
  • How does inference fit into a full agent pipeline?
  • How is state or memory expected to be handled alongside Model Hub?

Suggestion:
Add a “Typical Architecture” section showing:

  • user input → model inference → post-processing → output
  • where Model Hub sits in the pipeline
  • how it interacts with agents or external systems

This would help developers think in systems instead of isolated API calls.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions