Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
77c5cd3
Squashed commit of the following:
levb Feb 19, 2026
b990de1
benchmark-compress
levb Feb 19, 2026
35f2eda
benchmark-compress: fix apples-to-apples comparison and polish output
levb Feb 19, 2026
a916447
add compressed write path for template builds
levb Feb 19, 2026
f91809c
benchmark-compress: fix concurrent part ordering and adjust LZ4 levels
levb Feb 20, 2026
ac61265
rename compression config fields: add FrameAlignmentSize const, clean…
levb Feb 20, 2026
1f8e5e5
refactor storage: simplify rangeReadFunc, push FF into upload path, c…
levb Feb 20, 2026
b6b03ab
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 20, 2026
8a381f8
chore: auto-commit generated changes
github-actions[bot] Feb 20, 2026
d79d8df
chunker: unified slot-based regionLock for fetch session dedup + over…
levb Feb 21, 2026
234b985
renamed back to cache_seekable...
levb Feb 23, 2026
1cf4ea0
refactor: simplify single-layer upload path, rename for clarity
levb Feb 23, 2026
4e3caba
refactor: move upload API to TemplateBuild, internalize PendingFrameT…
levb Feb 24, 2026
028e780
typo
levb Feb 24, 2026
ef5393f
refactor: use storage.LoadBlob for OpenBlob→GetBlob sequences
levb Feb 24, 2026
8131b97
move makeFrameFilename to storage_cache_seekable.go
levb Feb 24, 2026
77c474c
restore GetFrame validation, use makeFrameFilename helper
levb Feb 24, 2026
aee5d3e
nit: rename
levb Feb 24, 2026
746771e
nits
levb Feb 24, 2026
8779dc1
Merge branch 'lev-compression-readonly-v3' of github.com:e2b-dev/infr…
levb Feb 24, 2026
f1d9e73
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 24, 2026
087a3b3
chore: auto-commit generated changes
github-actions[bot] Feb 24, 2026
a1dcc6a
chore: auto-commit generated changes
github-actions[bot] Feb 24, 2026
4a56655
nit: fix comments and rename per PR review
levb Feb 24, 2026
238a37f
fix: FrameTable.Range must initialize from StartAt, add tests
levb Feb 24, 2026
ed37b63
doc 1
levb Feb 24, 2026
cb68837
doc: add failure modes, cost/benefit, fix orphaned line
levb Feb 24, 2026
ce9f4d5
doc: rename section headings
levb Feb 24, 2026
033f599
doc: add TOC, trim fluff
levb Feb 24, 2026
0dd0d06
test: add t.Parallel() to frame_table_test.go
levb Feb 24, 2026
b835622
doc: fix TODO descriptions, add progressive GetBlock flag item
levb Feb 24, 2026
81a2732
fix: validate uncompressed GetFrame params, add cache miss debug log
levb Feb 24, 2026
e9518c8
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 24, 2026
5cb2be5
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 24, 2026
a7786dc
doc: add compression modes & write-path timing items to remaining work
levb Feb 24, 2026
8aa901a
fix: remove unused frameSize param from makeCompressedTestData
levb Feb 24, 2026
e2c05cf
perf: replace sync.Map + regionLock with []atomic.Bool and broadcast …
levb Feb 25, 2026
c58a563
bench: add side-by-side Legacy vs Framed chunker benchmarks
levb Feb 25, 2026
d57e88a
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 25, 2026
95b63fb
sbx bench changes
levb Feb 24, 2026
4e67528
fix: resolve merge breakage — add BlocksTimerFactory, generate flagsC…
levb Feb 26, 2026
f4cee18
Merge branch 'main' of github.com:e2b-dev/infra into lev-compression-…
levb Feb 26, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,5 @@ go.work.sum
.vscode/mise-tools
/packages/fc-kernels
/packages/fc-versions
/compress-build
/inspect-build
40 changes: 27 additions & 13 deletions .mockery.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,32 +7,46 @@ packages:
filename: mocks.go
pkgname: filesystemconnectmocks

github.com/e2b-dev/infra/packages/orchestrator/internal/sandbox/block:
interfaces:
flagsClient:
config:
dir: packages/orchestrator/internal/sandbox/block
filename: mock_flagsclient_test.go
pkgname: block
inpackage: true
structname: MockFlagsClient

github.com/e2b-dev/infra/packages/shared/pkg/storage:
interfaces:
featureFlagsClient:
config:
dir: packages/shared/pkg/storage/mocks
filename: mockfeatureflagsclient.go
pkgname: storagemocks
dir: packages/shared/pkg/storage
filename: mock_featureflagsclient_test.go
pkgname: storage
inpackage: true
structname: MockFeatureFlagsClient
Blob:
config:
dir: packages/shared/pkg/storage/mocks
filename: mockobjectprovider.go
pkgname: storagemocks
Seekable:
dir: packages/shared/pkg/storage
filename: mock_blob_test.go
pkgname: storage
inpackage: true
FramedFile:
config:
dir: packages/shared/pkg/storage/mocks
filename: mockseekableobjectprovider.go
pkgname: storagemocks
dir: packages/shared/pkg/storage
filename: mock_framedfile_test.go
pkgname: storage
inpackage: true

io:
interfaces:
Reader:
config:
dir: packages/shared/pkg/storage/mocks
filename: mockioreader.go
pkgname: storagemocks
dir: packages/shared/pkg/storage
filename: mock_ioreader_test.go
pkgname: storage
inpackage: true

github.com/e2b-dev/infra/packages/shared/pkg/utils:
interfaces:
Expand Down
7 changes: 6 additions & 1 deletion CLAUDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -286,6 +286,11 @@ make connect-orchestrator
- Access: `https://nomad.<your-domain>`
- Token: GCP Secrets Manager

### Logs
### Nomad Logs
- Use `nomad alloc logs -job <job-name>` to fetch service logs (e.g., `nomad alloc logs -job orchestrator-dev`)
- Use `-stderr` flag for stderr output: `nomad alloc logs -job orchestrator-dev -stderr`
- Use `-tail` for live tailing: `nomad alloc logs -job orchestrator-dev -tail`
- The orchestrator job in dev is called `orchestrator-dev`
- Integration test failures should be diagnosed by checking these logs first
- Local: Docker logs in `make local-infra`
- Production: Grafana Loki or Nomad UI
16 changes: 16 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -171,6 +171,22 @@ test:
test-integration:
$(MAKE) -C tests/integration test

.PHONY: test-integration/sandboxes
test-integration/sandboxes:
$(MAKE) -C tests/integration test/api/sandboxes

.PHONY: test-integration/templates
test-integration/templates:
$(MAKE) -C tests/integration test/api/templates

.PHONY: test-integration/envd
test-integration/envd:
$(MAKE) -C tests/integration test/envd

.PHONY: reset-test-env
reset-test-env:
scripts/reset-test-env.sh

.PHONY: connect-orchestrator
connect-orchestrator:
$(MAKE) -C tests/integration connect-orchestrator
Expand Down
349 changes: 349 additions & 0 deletions docs/compression-architecture.md

Large diffs are not rendered by default.

Loading
Loading