[Turbopack] add persisting to the new backend #69668
sokra
merged
46 commits into
canary
from
sokra/persisting-2
sokra
changed the title
add lmdb persisting and restoring
63e47a22
pass test name to test_config to construct db name
c9f303a3
continue uncompleted operations
a08b8225
create dir and logging
77d52580
improve error messages
9719916d
handle keys larger than 511 bytes
df96007d
avoid storing transient tasks
7c092e74
show lookup error
3e9d86f2
handle state serialization
f190d6f3
validate serialization and improve errors
c4a2414a
add turbo_tasks_backend to tracing, add tracing for restore
f76a16e2
disable TLS
e0fd0367
print lookup error
bf6e895c
verify serialization
b77626bc
fix lookup deserialization
6fa201de
replace bincode with pot
de99d8b9
fix restore data trace
31d3f070
more tracing in db
0e016fb6
remove verify_serialization
d26c6c82
fix race condition
02eed51a
do not interrupt persisting while there is data
0ddd6904
add persist trace
ebab3100
improve task aggregation
d9805508
restore task_pair
23ebb6ef
verify persistent function only calls persistent functions
2c51283e
pass test name to test_config to construct db name
c9f303a3
continue uncompleted operations
a08b8225
create dir and logging
77d52580
improve error messages
9719916d
handle keys larger than 511 bytes
df96007d
avoid storing transient tasks
7c092e74
show lookup error
3e9d86f2
handle state serialization
f190d6f3
validate serialization and improve errors
c4a2414a
add turbo_tasks_backend to tracing, add tracing for restore
f76a16e2
disable TLS
e0fd0367
print lookup error
bf6e895c
verify serialization
b77626bc
fix lookup deserialization
6fa201de
replace bincode with pot
de99d8b9
fix restore data trace
31d3f070
remove verify_serialization
d26c6c82
add persist trace
ebab3100
improve task aggregation
d9805508
clippy
8fa030fe
add more details to save_snapshot tracing
6cc4c27b
store task data and aggregation separately
ca084fc3
compare with old value before storing to db
a50a2745
Early stop snapshot interval when stopping
bdd8f8f6
parallel save_snapshot
9ef72f75
run snapshot in spawn_blocking
9ec165c2
save snapshot when starting idle
4a9e70c1
wait until idle for a second before persisting
1624294d
increase max DB size
2f3b5fb2
remove db lookup tracing
e4927416
remove database println
80241415
sharded transaction log
361c1cf0
share read transition
451c1355
remove aggregation update queue tracing
bbc443b8
improve messaging
dee5f7b7
handle idle end event for idle detection in persisting
be672502
improve imports
077eec92
clippy
041751d7
apply review comments
594b0a8c
clippy
bdd1c621
Reviewers
Assignees
No one assigned
Labels
Turbopack
created-by: Turbopack team
locked
Milestone
No milestone
Login to write a write a comment.
Login via GitHub