Skip to content

Big blobs p2p model sharing example#609

Open
IAvecilla wants to merge 9 commits intop2p-bandwidth-sort-improvementsfrom
model-sharing-example
Open

Big blobs p2p model sharing example#609
IAvecilla wants to merge 9 commits intop2p-bandwidth-sort-improvementsfrom
model-sharing-example

Conversation

@IAvecilla
Copy link
Contributor

This is a standalone test harness that exercises the full production P2P model sharing pipeline end-to-end, without requiring actual model data or GPU resources. It simulates the flow that happens during the Warmup phase when new clients join a training run and need to download the current model state from existing peers.

  • Sharer peers are initialized with FakeStore (an iroh blob store that generates blobs on-the-fly without holding data in memory), serving both model config and parameter blobs. This allows simulating arbitrarily large models with zero memory allocation.
  • Downloader peers use the real production pipeline: blob_ticket_param_request_task for peer selection and ticket requests, NetworkConnection.start_download() for the DownloadManager/iroh Downloader integration, and NetworkConnection.poll_next() for BandwidthTracker and ConnectionMonitor integration.
  • Concurrent worker tasks pull from a shared work queue and request blob tickets from peers via PeerManagerHandle (bandwidth + latency-based peer selection with error tracking).

@IAvecilla IAvecilla changed the title Model sharing example Big blobs p2p model sharing example Mar 2, 2026
@IAvecilla IAvecilla changed the base branch from main to p2p-bandwidth-sort-improvements March 4, 2026 14:24
@IAvecilla IAvecilla marked this pull request as ready for review March 6, 2026 13:34
@IAvecilla IAvecilla force-pushed the p2p-bandwidth-sort-improvements branch from 91576e4 to 0ba4031 Compare March 6, 2026 13:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant