next.js
turbo-persistence: streaming SST writer for reduced memory usage
#90617

Merged

turbo-persistence: streaming SST writer for reduced memory usage #90617

lukesandberg merged 16 commits into canary from sokra/streaming-compaction

turbo-persistence: streaming SST writer for reduced memory usage

4b3cbd61

nextjs-bot added created-by: Turbopack team

nextjs-bot added Turbopack

lukesandberg commented on 2026-02-26

vercel commented on 2026-02-26

lukesandberg commented on 2026-02-26

lukesandberg commented on 2026-02-26

lukesandberg commented on 2026-02-27

turbo-persistence: simplify streaming SST writer and fix compaction bug

a262627f

lukesandberg commented on 2026-02-27

turbo-persistence: use exact block capacity tracking in streaming SST…

0de4f437

sokra commented on 2026-02-27

turbo-persistence: add clarifying comments and unit tests for streami…

6c84510b

turbo-persistence: rename entry_count_hint, fix empty-file panic, doc…

443f5679

turbo-persistence: fix block capacity for large keys, debug_assertion…

1ae330d2

turbo-persistence: rename finish→close, add drop guards

23aca527

turbo-persistence: refactor add() with helper methods, flush small bl…

198b531a

turbo-persistence: fix drop panic, deduplicate flush, add tests

bb0d2515

sokra commented on 2026-02-27

turbo-persistence: make StreamingSstWriter generic over Entry, avoid …

8a7f1726

turbo-persistence: make KeyBlockBuilder methods generic over Entry

cea1d163

turbo-persistence: flush key blocks incrementally, fix O(N²) scan

a6252519

sokra commented on 2026-02-27

turbo-persistence: shrink AMQF filter to actual entry count on close

ad092434

sokra commented on 2026-02-27

turbo-persistence: only shrink AMQF filter when <50% capacity used

93f2b54b

sokra approved these changes on 2026-02-27

turbo-persistence: rename PendingKeyEntry, add capacity buffer, fix c…

2f05800c

lukesandberg marked this pull request as ready for review 81 days ago

lukesandberg commented on 2026-02-28

turbo-persistence: address review feedback on StreamingSstWriter

f59af9bd

lukesandberg force pushed to f59af9bd 81 days ago

lukesandberg merged 28df39ba into canary 81 days ago

lukesandberg deleted the sokra/streaming-compaction branch 81 days ago

github-actions added locked

github-actions locked as resolved and limited conversation to collaborators 67 days ago

Reviewers

sokra

vercel

Assignees

No one assigned

Labels

Turbopack created-by: Turbopack team locked

Milestone

No milestone

next.js turbo-persistence: streaming SST writer for reduced memory usage #90617 Merged

turbo-persistence: streaming SST writer for reduced memory usage #90617

next.js
turbo-persistence: streaming SST writer for reduced memory usage
#90617

Merged