Add ONNX inference documentation #49
Open
+409
−387
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Updated complete-library.mdx table with ONNX links for 5 models - Added ONNX buttons to LFM2-8B-A1B, LFM2-VL-3B, LFM2-VL-1.6B, LFM2-VL-450M, and LFM2.5-Audio-1.5B model pages Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Delete LEAP pages that are not in navigation and contain outdated content: - find-model.mdx - vibe-check-models.mdx - index.mdx - finetuning.mdx - laptop-support.mdx Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Delete docs pages that are not in navigation: - docs/index.mdx (redirect page) - docs/key-concepts/models.mdx (deprecated models page) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Change /leap/index references to /leap/edge-sdk/overview since the old LEAP index page was removed. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Make all model names in the Model Chart link to their respective model pages for easier navigation. Also adds LFM2-2.6B-Exp to table. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Add llama.cpp tab with installation and usage instructions for VL models: LFM2-VL-3B, LFM2-VL-1.6B, LFM2-VL-450M, LFM2.5-VL-1.6B Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Style first-column model name links differently from checkmark links: - No underline, regular text appearance - Purple text + light background on hover - Distinct from green checkmark links in other columns Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
alay2shah
requested review from
a team,
dbhathena and
mlabonne
as code owners
mlabonne
approved these changes
Feb 1, 2026
ykhrustalev
reviewed
Feb 2, 2026
| @@ -0,0 +1,250 @@ | |||
| --- | |||
| title: "ONNX" | |||
| description: "ONNX provides cross-platform inference for LFM models across CPUs, GPUs, NPUs, and browsers via WebGPU." | |||
There was a problem hiding this comment.
Suggested change
| description: "ONNX provides cross-platform inference for LFM models across CPUs, GPUs, NPUs, and browsers via WebGPU." | |
| description: "ONNX provides cross-platform inference for LFM models across CPUs, GPUs, NPUs, and browsers via WebGPU." | |
| description: "ONNX provides a platform-agnostic inference specification that allows running the model on device-specific runtimes that include CPU, GPU, NPU, and WebGPU." |
|
|
||
| ## Pre-exported Models | ||
|
|
||
| Pre-exported ONNX models are available from LiquidAI and the [onnx-community](https://huggingface.co/onnx-community). Check the [Model Library](/docs/models/complete-library) for a complete list of available formats. |
There was a problem hiding this comment.
I'd add a link on "from LiquidAI" that points on our HF
Comment on lines
+24
to
+32
| ### Installation | ||
|
|
||
| ```bash | ||
| pip install onnxruntime transformers numpy huggingface_hub jinja2 | ||
|
|
||
| # For GPU support | ||
| pip install onnxruntime-gpu transformers numpy huggingface_hub jinja2 | ||
| ``` | ||
|
|
There was a problem hiding this comment.
maybe instead point on the onnx-export repo directly or use it
git clone ...
uv sync
uv ryn ...
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.