URGENT 10 Min JOB - Python Celery Fix - Only apply if you can fix!
We have a crawler written in Python, PhantomJS, Using RabbitMQ and Using Celery ([url removed, login to view]).
The problem is the Celery Part.
Some of the workers keep on hanging with no warnings, no errors and no output. They just do nothing.
We have tried the same script on 3 different servers and on our local machine.
I have had 4 people look into this and they could not fix it. its just one of those things you either know or you don't.
If you know how to fix this - and are available for work in the next few hours - please apply.
PLEASE DO NOT APPLY UNLESS YOU 100% KNOW THE PROBLEM WE ARE FACING.