Skip to content

@FlowGPT FlowGPT

Change the repository type filter

All

    Repositories list

    20 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •12k•0•0•11•Updated Jan 6, 2026Jan 6, 2026

    • aibrix

      Public
      Cost-efficient and pluggable Infrastructure components for GenAI inference
      Jupyter Notebook
      •
      Apache License 2.0
      •506•0•0•13•Updated Jan 5, 2026Jan 5, 2026

    • production-stack

      Public
      vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
      Python
      •
      Apache License 2.0
      •349•0•0•3•Updated Jan 5, 2026Jan 5, 2026

    • gpucost

      Public
      Python
      •0•0•0•0•Updated Dec 3, 2025Dec 3, 2025

    • evals

      Public
      TypeScript
      •0•0•0•1•Updated Nov 6, 2025Nov 6, 2025

    • ppg-log-analysis

      Public
      TypeScript
      •0•0•0•2•Updated Oct 21, 2025Oct 21, 2025

    • kafka-action

      Public
      Shell
      •
      MIT License
      •2•0•0•0•Updated Sep 29, 2025Sep 29, 2025

    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Apache License 2.0
      •764•0•0•6•Updated Sep 24, 2025Sep 24, 2025

    • RNLDNetDiagnoService

      Public
      Objective-C
      •
      MIT License
      •0•1•0•0•Updated Sep 18, 2025Sep 18, 2025

    • llm-inference-benchmarking

      Public
      Python
      •4•0•0•0•Updated Sep 16, 2025Sep 16, 2025

    • EAGLE

      Public
      Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.
      Python
      •
      Apache License 2.0
      •238•0•0•2•Updated Aug 6, 2025Aug 6, 2025

    • Eagle3_for_MiniCPM4

      Public
      根据MiniCPM4训练Eagle3的投机解码模型
      Python
      •
      Apache License 2.0
      •1•0•0•3•Updated Aug 6, 2025Aug 6, 2025

    • LMCache

      Public
      Redis for LLMs
      Python
      •
      Apache License 2.0
      •840•0•0•1•Updated Jul 29, 2025Jul 29, 2025

    • socket.io-client-swift

      Public
      Swift
      •
      Other
      •858•0•0•0•Updated Feb 12, 2025Feb 12, 2025

    • Cookbook

      Public
      MDX
      •16•59•3•2•Updated Dec 30, 2024Dec 30, 2024

    • langfuse

      Public
      🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
      TypeScript
      •
      Other
      •2k•0•0•0•Updated Dec 23, 2024Dec 23, 2024

    • SQLite.swift

      Public
      A type-safe, Swift-language layer over SQLite3.
      C
      •
      MIT License
      •1.6k•0•0•1•Updated Oct 28, 2024Oct 28, 2024

    • amplify-swift

      Public
      A declarative library for application development using cloud services.
      Swift
      •
      Apache License 2.0
      •225•0•0•6•Updated Oct 19, 2024Oct 19, 2024

    • clickstream-swift

      Public
      Swift SDK for Clickstream Analytics on AWS
      Swift
      •
      Apache License 2.0
      •2•0•0•0•Updated Jul 28, 2024Jul 28, 2024

    • FlowDocsPage

      Public
      TypeScript
      •1•3•0•2•Updated Oct 25, 2023Oct 25, 2023