download pdfs from a series of webpages

Lukket Lagt ut 5 år siden Betales ved levering
Lukket Betales ved levering

I have a series of 16 million webpages that each open a single pdf. It starts at 1 and goes to 16,000,000+. I want to download every pdf that is 4 pages or larger (that is, greater than 3 pages). I want to download it onto cloud storage (e.g., google drive). I think it will be less than 20 terabytes.

Nett-scraping

Prosjekt-ID: #18796704

Om prosjektet

10 bud Eksternt prosjekt Aktiv 4 år siden

10 frilansere byr i gjennomsnitt $797 for denne jobben

e3d

Hello, I can download those 16M pdfs and filter ones that have greater than 3 pages and upload them to cloud storage of your choice. I'd vote against google drive as it's not very cost effective for storing 20TB, but I Mer

$399 USD på 10 dager
(251 Omtaler)
8.7
bilalmaher053

hey, i can scrape 16 million pdf files, can u please share sample URL in chat?

$30 USD på 1 dag
(114 Omtaler)
6.4
farooq4161

Greetings, I am an expert data scrapper and have done similar projects in the past. Same can be verified by my profile. Looking forward to assist you. Thanks

$777 USD på 5 dager
(56 Omtaler)
6.1
osmanaydin

Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs for many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to he Mer

$400 USD på 1 dag
(38 Omtaler)
5.3
contactvidura

Hello, I'm a professional Web Automation Developer (Java/Selenium), I have created many scrapers and bots before, you can check my reviews for reference, I'm really interested in this task. Thanks, Nirmal Vidura

$200 USD på 1 dag
(114 Omtaler)
5.4
kunitsynartem

Hello! I'm interested in your project for pdf files scraping and storing in the cloud storage. I can make a Python + Scrapy script to do that. Just show me the source website.

$800 USD på 15 dager
(30 Omtaler)
5.4
Exactwork1

Hi Sir, I am able to download 16 million pdfs and upload to cloud with proper accuracy. Great Experience in Manual Typing, Word, Excel, PDF, Data Entry, Web Search, Technical Entry, Typing, Data Processing and all t Mer

$5000 USD på 30 dager
(22 Omtaler)
4.9
engrranakaleem21

Hello, I have already gone through the details from you. I think it is the best suited for me and you will have got an excellent feedback. I am available from now on. I ensure you i will provide you a better quality w Mer

$100 USD på 5 dager
(3 Omtaler)
2.7
languagedr

Dear project Admin/manager, we are looking at your requirements from the project description. We are a team of few members and all the member are specialist and trainer of all kinds of Data entry type work for any time Mer

$15 USD på 1 dag
(0 Omtaler)
0.0
MinuteJavascript

Scraping 16 million pages shouldn't be a problem. The main thing is that Google cloud costs $10 per terabyte per month. If you have an account we can have you the data within a week.

$250 USD på 7 dager
(0 Omtaler)
0.0