remove finished jobs (#2175)
* removing unnecesary fiels
* remove finished jobs
* remove finished jobs
* fix tests
* adding back filters for compatibility
* adding tests to delete finished jobs
* add migration to delete finished_at field
* fix style
* add delete index migration
* Apply suggestions from code review
Co-authored-by: Sylvain Lesage <sylvain.lesage@huggingface.co>
* add code review suggestion
---------
Co-authored-by: Sylvain Lesage <sylvain.lesage@huggingface.co>
