Refactor common cache entry (#634)
* docs: ✏️ fix docstring
* feat: 🎸 use a common CachedResponse collection
instead of one collection for each kind of cached entry (splits,
first-rows, etc). Some admin methods have bveen disabled for now and
will be reintroduced later.
* feat: 🎸 deprecate cache_refresh scripts (not used)`
The preferred way to refresh the cache is to specifically call the
webhook for each dataset you want to refresh
* feat: 🎸 add support for cache_reports and metrics count
* feat: 🎸 update to libcache 0.4. Disable /cache-reports/features
* feat: 🎸 remove the "stale" field which is not needed anymore
since the cache is considered stale if the worker version or the git
revision has changed.
* feat: 🎸 update libcache
* feat: 🎸 rename delete_responses to delete_dataset_responses
as we only need this for now
* feat: 🎸 add two methods for external /valid+/is-valid endpoints
also: rename internal method _clean_database to _clean_cache_database
* feat: 🎸 update to libqueue 0.4.0
* feat: 🎸 update libcache
* feat: 🎸 add delete_response and get_response_without_content
needed for the splits worker
* feat: 🎸 change the return format of get_dataset_response_ids
and add tests
* feat: 🎸 update to libcache 0.4.0
* feat: 🎸 update to libcache 0.4.0
* feat: 🎸 update libcache
* style: 💄 fix style
* fix: 🐛 fix kind of the caches
* chore: 🤖 create the database migration script
* feat: 🎸 update the indexes
* feat: 🎸 update libcache
* chore: 🤖 respect the alphabet
* fix: 🐛 stale has been deprecated in the cache
just remove these lines
* test: 💍 remove test to avoid using obsolete objects (SplitResp)
* style: 💄 fix style
* test: 💍 fix test that randomly fails
* feat: 🎸 update docker images
* test: 💍 adapt tests to cache change
* chore: 🤖 don't delete the migration job to be able to read logs
* fix: 🐛 the migration script returns exit code "1" if error
So that the hook will stop the update of the Helm chart. If not, the
code will be updated (and expects the new database) while the database
migration has failed
* test: 💍 fix test and style
* feat: 🎸 update docker image
* fix: 🐛 fix the migration script
* fix: 🐛 support empty fields (None)
* fix: 🐛 fix mismatch in the name of the collection
use variables to avoid typos
* fix: 🐛 fix field name
* feat: 🎸 add log information in case of validation error
* fix: 🐛 fix a mongoengine issue with unique_with and null values
* feat: 🎸 update libcache
