Find Jobs
Hire Freelancers

Scrapy/Selenium (Python) to extract texts and files(specific webpages) based on keywords.

$250-750 USD

Fullført
Lagt ut omtrent 5 år siden

$250-750 USD

Betalt ved levering
I need to make a Python script (Scrapy or Selenium, I am up to suggestions) to extract information within some specific(I have around 12) websites - daily(auto) or manually. The pages are in portuguese, but I can guide you into the key input-fields and key-pages to look for. 1. User input: - Time period (if the page has this feature) - Website to scrap. - Keywords(can be a list of words) to look for. - User chooses the local path to the files to be downloaded. 2. Back-end: - Access the page. - Searches the tabs that can have useful information(I will provide the specific parts for each webpage to make the queries) links inside that domain. - Download(if the page serves files in doc, html or pdf) and look for the keywords. - Extract all the related content (files or the text in html). - Go around Captchas(if the page has captcha) 3. Logging: - All the extracted content must have the URL which the information/file is available in the webpage - can be done by logs. - All the extracted content must have the DATE which the scrapping has been made - can be done by logs. 4. Configuration: - All key-fields (like CSSSelector for a date field) should be configurable for each spider. - The URL to start scrapping each webpage should be configurable. - If page contains Authentication(Login/Password), user will fill the configuration for it. IMPORTANT: 1. My plan is to pay for each 4 mapped websites (so total project is for 3 "packs" of websites) 2. The content in few cases will need to be extracted from images. 3. Start your bid with the word forward, so I can know if you did read all the description. 4. If you can't extract properly the content I can give you another one to replace that one, so you still need to deliver 4 websites per milestone. 5. I WILL RELEASE THE MILESTONES ONLY AFTER YOU SEND ME THE CODE AND I AM TOTALLY SATISFIED (I WILL RUN TESTS TO CHECK FUNCTIONALITY). I have many projects at hand and would be great to stablish a good relation with you, since I constantly need someone to work with me. Thank you.
Prosjekt-ID: 19212037

Om prosjektet

27 forslag
Eksternt prosjekt
Aktiv 5 år siden

Ønsker du å tjene penger?

Fordeler med budgivning på Freelancer

Angi budsjettet og tidsrammen
Få betalt for arbeidet ditt
Skisser forslaget ditt
Det er gratis å registrere seg og by på jobber
Tildelt til:
Brukeravatar
Hi there, I am interested in your project. I would approach your project by using Python with Scrapy. The website will be written in Python with Django. Here is a demo project: Price tracking system: [login to view URL] I have 4+ years’ experience at Web scraping. If you'd like to view my previous work, take a look at my profile https://www.freelancer.com/u/etuannv or check some demo videos here: [login to view URL] Thank you!
$250 USD om 10 dager
5,0 (105 omtaler)
6,8
6,8
27 frilansere byr i gjennomsnitt $608 USD for denne jobben
Brukeravatar
Hi! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can complete your project and extract data from the sites you need. Please contact me to discuss project details, Best regards, Vlad
$748 USD om 7 dager
4,9 (62 omtaler)
7,7
7,7
Brukeravatar
Forward Hi there,I am Python Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$705 USD om 10 dager
4,9 (133 omtaler)
7,5
7,5
Brukeravatar
Hi Can you provide the sites so i can analysis them? Thanks
$800 USD om 5 dager
5,0 (114 omtaler)
7,6
7,6
Brukeravatar
forward Hello sir I have 9 years of experience about web scraping and have made 200+ crawlers with python. I have fully understood the project and I am confident. I can start the work right now. Best Regards, Yongtao
$588 USD om 10 dager
4,9 (127 omtaler)
7,6
7,6
Brukeravatar
forward I've read your requirements about User Input,Back-end,Logging and Configuration. I have a good experience with selenium and python. Recently,I've developed B*T for Telegram. That acts like human 100% exactly.(Login,Follow,Post article,Direct Message etc) And no Instagram APIs are used. So I can do your project with high quality and I am sure you will be satisfied with it. Please let me ask a few questions kindly over chat. King Regards.
$1 000 USD om 10 dager
5,0 (17 omtaler)
6,1
6,1
Brukeravatar
Hello! I have 2 years of experience in web scraping using Python and I'm interested in your project. I can use both Selenium and Scrapy depending on what is better for certain website. Also I can handle logins, file downloading, etc. Would you be so kind to provide me with some more details about your project, please (website URLs)?
$600 USD om 10 dager
5,0 (38 omtaler)
5,9
5,9
Brukeravatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,,,
$444 USD om 10 dager
4,9 (93 omtaler)
5,7
5,7
Brukeravatar
Hello. I have good skills in "Data Scraping, Python, Scrapy, Selenium Webdriver, Web Scraping". I have working for 7+ years in this field. I 'm very interest to your project. I have checked your project description carefully and i can do it. I 'll do my best till you satisfy if you want me. Contact me please. Thank you. Yang L.
$250 USD om 3 dager
4,9 (35 omtaler)
5,3
5,3
Brukeravatar
Hi, I am a senior selenium/python expert and I can build the script as requirements in the description. I have 7+ years of professional experiences in web development. I can start immediately, also finish your project within the deadline. My skills has been certified by this platform. Please feel free to send me a message and discuss the project. Looking forward to working for you soon. Regards.
$750 USD om 7 dager
5,0 (4 omtaler)
3,8
3,8
Brukeravatar
I am an experienced developer with close to 5 years experience in Automation,Python,Scrapy,ASP.NET MVC and Web Forms,Web API work in the present. I also have a wealth of experience developing for a dynamic and responsive client side using advanced JavaScript frameworks such as Angular JS, and CSS/HTML frameworks such as Twitter Bootstrap.
$555 USD om 10 dager
5,0 (2 omtaler)
3,2
3,2
Brukeravatar
Hi, Thanks for your job posting. I've read your project description carefully. You are going to build scrapy that gets data based on keywords. As a senior scraping developer, I have rich experience in scrapy and python selenium . I am sure I can handle this project as you expected. If you have desire to work with me, please respond me to discuss more. Thanks.
$500 USD om 10 dager
4,2 (8 omtaler)
3,8
3,8
Brukeravatar
I have more than 6+ years of experience into IT field. Since last 6 years, I am dealing with different kind of field such like : - Laravel, CI, YII - Angular.js - Node.js - Ionic Framework - PHP - HTML - Python - Django - PostgreSQL - Microsoft.net - SharePoint 2013, 2016 & Office 365 - WordPress - Magento 1 & 2 - CSS - Info path & Microsoft powerapps - MS Power BI reporting - Graphics designing (UX/UI) - Logo Design - Custom development with PHP - Amazon & eBay API - Mobile application development with native iOS and Android, Ionic, Phonegap. - I have also experience with Software Testing & App Testing. When you work with me, you can expect high quality results, clear and ethical communication, attention to detail, an eye for aesthetics, and a personalized, professional and friendly service. Looking forward to working with you!
$666 USD om 10 dager
4,0 (2 omtaler)
4,1
4,1
Brukeravatar
HI, how are you? I have checked your description carefully. I can say I understood fully what you want. As I have rich experienced in python(2, 3) so that your project is not problem for me. I am really confident and would like to discuss further more details with you. I am waiting for your positive reply here. Thanks so much.
$777 USD om 10 dager
5,0 (1 omtale)
2,8
2,8
Brukeravatar
Hi I am an engineer on applied mathematics.I scraped many websites to constitute databases valuable for my researchs.I can develope spiders very well in object oriented approach.
$277 USD om 10 dager
5,0 (3 omtaler)
2,3
2,3
Brukeravatar
Forward Web scraper - 250$ Captcha go-around - 350$ Packaging - 50$ I am gonna need following: - regular communication to clear queries - login credentials for those websites
$722 USD om 15 dager
0,0 (0 omtaler)
0,0
0,0
Brukeravatar
hi i am having rich experience in python, selenium and web scraping Relevant Skills and Experience python, selenium and webscrapping
$555 USD om 10 dager
0,0 (0 omtaler)
0,0
0,0
Brukeravatar
I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement. The functionalities of Scraping / Crawling Solutions is as mentioned below, - Fetch the details targeted websites in quick time - More than 98% accuracy in scraping the information - Provision of IP-Management and de-captcha resolution - More than 10 years of experience in industry domain - User defined output to be delivered i.e. excel / csv, JSON, HTML etc. - Output delivery via Email, FTP, API etc. Do let me know if you require further details from our side. We have experience in fetching the pricing and other information on a regular basis from more than 250 websites on a regular basis. The partial list of the websites are as mentioned below, - LinkedIn - Facebook - Twitter - Yellowpages - Super pages - Amazon - Ebay - Rakuten - Wallmart - Insight - Kikatek - CDiscount - Sephore - Bechtel - Farfetch - Zoho - Mouser - bestbuy - officedepot Do let me know if you require further details from our side.
$650 USD om 10 dager
0,0 (0 omtaler)
0,0
0,0
Brukeravatar
Hi, I have good experience using selenium and BeautifulSoup with python. I should be able to meet all of the requirements you have listed. Look forward to hearing from you, Rhys
$777 USD om 10 dager
0,0 (0 omtaler)
0,0
0,0

Om klienten

BRAZILs flagg
FORTALEZA, Brazil
5,0
7
Medlem siden jan. 18, 2010

Klientbekreftelse

Takk! Vi har sendt deg en lenke for at du skal kunne kreve din gratis kreditt.
Noe gikk galt. Vær så snill, prøv på nytt.
Registrerte brukere Publiserte jobber
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Forhåndsvisning innlasting
Tillatelse gitt for geolokalisering.
Påloggingsøkten din er utløpt og du har blitt logget ut. Logg på igjen.