Skip to content

DEBUG: Hardware benchmark on GitHub Actions (CPU)#439

Closed
mmcky wants to merge 4 commits into
mainfrom
debug/benchmark-github-actions
Closed

DEBUG: Hardware benchmark on GitHub Actions (CPU)#439
mmcky wants to merge 4 commits into
mainfrom
debug/benchmark-github-actions

Conversation

@mmcky

@mmcky mmcky commented Nov 27, 2025

Copy link
Copy Markdown
Contributor

Purpose

This PR runs hardware benchmarks on the standard GitHub Actions runner (CPU-only) to compare performance against the RunsOn GPU runner.

Benchmarks Included

  • Pure Python: Integer sum, float sqrt operations
  • NumPy: Matrix multiplication (3000x3000), element-wise ops (50M elements)
  • Numba: JIT-compiled loops, parallel operations
  • JAX (CPU): Matrix multiplication with JIT warm-up timing

Comparison

Results from this PR should be compared with PR #437 which runs the same benchmarks on RunsOn (GPU).

Runner PR
GitHub Actions (CPU) This PR
RunsOn (GPU) #437

Note

This is a debugging PR to investigate performance differences. It should not be merged.

- Add benchmark-hardware.py script for CPU/GPU performance testing
- Install JAX CPU version for comparison
- This PR tests standard GitHub Actions runner performance
@github-actions

github-actions Bot commented Nov 27, 2025

Copy link
Copy Markdown

@github-actions github-actions Bot temporarily deployed to pull request November 27, 2025 05:42 Inactive
- Update benchmark-hardware.py to save results to JSON
- Update benchmark-jupyter.ipynb to save results to JSON
- Update benchmark-jupyterbook.md to save results to JSON
- Add CI step to collect and display benchmark results
- Add CI step to upload benchmark results as artifact
@github-actions github-actions Bot temporarily deployed to pull request November 27, 2025 05:54 Inactive
@mmcky

mmcky commented Nov 27, 2025

Copy link
Copy Markdown
Contributor Author

Closing as no longer required.

@mmcky mmcky closed this Nov 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant