Celery: Handle Celery Killed Job Status Correctly.

[Prajna1999]

Is your feature request related to a problem?
Currently, Celery tasks using Gevent do not trigger the soft time limit and are forcibly killed at the hard time limit of 25 minutes. This causes the document collection job status to remain as PROCESSING instead of changing to FAILED.

Describe the solution you'd like

• Mark the document collection job status as FAILED around 23 minutes.
• Implement proper bookkeeping for this status change.
• Consider using a common function or decorator for the solution.

Original issue

Describe the current behavior
Currently celery tasks with gevent does not get soft time limit triggered and gets SIGKILLED at the hard time limit @25 mins. As a result, the document collection job status stays PROCESSING and not changed to FAILED.

Describe the enhancement you'd like
The document collection job status to be marked FAILED at about ~23 mins with proper bookkeeping. Maybe a common function/decorator will do.

Why is this enhancement needed?
It helps in performance

[nishika26]

this is a duplicate issue of #767, hence closing this