Hello.
I have a web scrapper that scrapes data from multiple online retailer. Software gets data such as price, stock, title etc..
Three days ago, one of the suppliers([login to view URL]) has block my scrapper. When software runs, it is able to pull data only
for the first few links. After the first few links, software is not able to pull any data for the rest of the link as
hayneedle detects that it is a robot trying to gather data from their website and they block it.
I hired a programmer a day ago to do the job to avoid detection but he could not do it. So please only bid IF YOU CAN DO IT
for sure. The programmer tried doing ip rotation but it did not work. It is not an ip problem. The programmer also created
a one second delay for make it run slow and that too did not work. There is something about the software that hayneedle is able
to detect that it is a bot trying get data.
Job conditions:
I need a programmer expienced enough to overcome that detection and make software work and pull data without getting blocked.
You will only be paid IF after working on the project, the software is able to run and get data without detection.
If you do the work and fail in the end and not able to do it(accomplish task), you will not be paid.
So please only bid if you know for sure you can do it.
Hi,
I’ve had a good look at your project description and I’m very interested in providing a solution.
I have 4+ hands on experience on developing quality web solutions as well as desktop standalone solutions. I used to develop systems using latest adaptive technology such as
1. .NET/ASP.NET - MVC4,MVC5 - Entity Framework - SQL - C# (for .NET solutions)
2. JQuery/Javascript/HTML5 - Angular.js/Bootstrap etc (for designing and front end implementations)
I want to start work immediately and awaiting for your positive response so I can show you some of my Quality Development Work as well as we can discuss
project in details.
Thank you.
Hi sir,
I am scraping expert, I have did too many similar projects, please check my feedback then you will know.
Can you tell me more details? then I will provide demo data for you.
Thanks,
Kimi
Hello. I think I can cope with this problem, but your scraper on this "bad" site will work much slower. If you agree, please contact me and start doing business =)
Hello,
I hope you doing very well!
I have gone through the description and would like to provide a quality solution using my 5+ years of professional experience in required skills. (.NET/ASP.NET - MVC, EF, SQL, C#).
Awaiting for your positive response so we can have final talk and start project immediately :)