feat: 🎸 make the queue agnostic to the types of jobs #608
severo
merged
43 commits into
main
from
agnostic_queue_and_split_workers
feat: 🎸 make the queue agnostic to the types of jobs
303686ea
feat: 🎸 publish new version
0d47c4f1
feat: 🎸 upgrade to libqueue 0.3.0
45cea4c9
feat: 🎸 remove created_at field in pending_jobs
42db8178
style: 💄 fix style
8f6c4418
feat: 🎸 upgrade libqueue to 0.3.0
6f27aee0
refactor: 💡 use an enum to prevent typos
3c54b58f
fix: 🐛 fix mypy
81f7bcae
feat: 🎸 upgrade libqueue to 0.3.0 and datasets
3c0a2e4b
test: 💍 fix test
d6664cfa
refactor: 💡 pack the queue functions into a Queue class
cab29419
refactor: 💡 use relative imports
2692096f
feat: 🎸 upgrade to libqueue 0.3.1
4b40da1f
refactor: 💡 use relative imports
2ec9085e
feat: 🎸 upgrade to libqueue 0.3.1
205a358a
refactor: 💡 use relative imports
45f0aee5
feat: 🎸 upgrade to libqueue 0.3.1
cb39a413
refactor: 💡 use a common Worker class for the loop logic
d8f02d21
refactor: 💡 simplify the code
6a544052
refactor: 💡 factor process_job in Worker, and remove refresh
64bdb37a
test: 💍 temporarily disable unrelated failing tests
b8b8b954
test: 💍 fix tests
2564e2e4
refactor: 💡 add Worker to libqueue
51ee0f3f
chore: 🤖 install types
c54e020c
feat: 🎸 upgrade to libqueue 0.3.2
0a85620e
refactor: 💡 new project isolating the /first-rows worker
0d84eb19
feat: 🎸 create a new project: worker_splits
c72059b2
chore: 🤖 add the commented dependency to think to reinstall it
881b8141
feat: 🎸 replace services/workers with the workers/
5f03c496
ci: 🎡 fix argument name
d41b141c
fix: 🐛 fix details and upgrade docker images for admin and api
1694b081
feat: 🎸 upgrade docker images for the two workers
fce3bc44
fix: 🐛 reinstall apache beam, pinned to 2.41.0
e64810af
fix: 🐛 use absolute imports, not relative imports
db1a233e
fix: 🐛 upgrade httplib2 to remove safety alert
676c7764
test: 💍 hack the tests order to fix the CI?
9d9f2fc3
test: 💍 restore the tests order to show the problem
2c50fe83
test: 💍 force datasets to patch csv for streaming every time
328d4453
style: 💄 fix style
33ddc927
test: 💍 don't store the HF token on the disk
4291351d
chore: 🤖 install libsndfile1 from repos instead of building it
dadb8f20
chore: 🤖 add a missing package to have ICU work
bb202a62
feat: 🎸 update the docker images
e2275586
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub