Build a module that scrapes html element info/dimensions after JS has been extracted.
$750-1500 AUD
Kansellert
Lagt ut omtrent 6 år siden
$750-1500 AUD
Betalt ved levering
We are building a scraping tool, and we need some assistance with executing Javascript and getting some data back.
You can use any common technology stack you like.
We need a simple HTTP API that will help us with scraping Javascript websites.
The requirements are:
A] There will be three endpoints:
Endpoint 1: api/page-content?url={webpageURL}
Take a web page URL, execute the Javascript then return the HTML that results.
Endpoint 2: api/image-dimensions?url={webpageURL}&imgUrl={imageURL}
Take a webpage URL and an image URL, and execute the Javascript, then return a JSON object with the height and width of the specified image as displayed on the page.
Note: this is not the actual height and width of the image file, but the display dimension of the image object on the page. Naturally the exact value depends on the screen resolution. You can set the screen resolution to something like 1200x1600
Often the actual image is much larger than the displayed image, we only want the displayed dimensions (in pixels).
Endpoint 3: api/largest-image?url={webpageURL}
Take a web page URL, execute the JS, then returns the imageURL, height and with of the largest image
The largest image is the one where the displayed size= height * width is the greatest.
Again height and width are based on the displayed dimensions, not the actual height/width.
C] There should be no need for adding anything to the server. We just deploy the app in a docker container and then it should run. If you need to for example add a .exe file to the server, this is not a suitable solution.
D] It should be able to use a proxy server for IP rotation. we will provide the host and login details of the proxy server for testing.
E] There should be simple authentication to provide unwanted access. But the authentication params should be hardcoded/in a config file, and not require database access.
We will need you to write and deploy the application - most likely we can host it with our PAAS company (depends on your chosen stack), otherwise it will be deployed on Digital Ocean (we will provide the account).
For us, this is very urgent so speed is important.
In your bid please specify the tech stack (or stacks) you are able to use, ask any questions you may have, and specify approximately how long this will take - or at least when you can start.
Look forward to working with you.
Hello Sir
I can design & develop high quality website to fulfill all of your requirements. Our developed cross-browser website would be highly secure from HACKING and spamming.
I can create web scrapper for you with info and dimension scrapper configs as well.
I am Faisal having 8 years of experience with more than 600 successful projects. Please come in private chat to discuss in detail about your website and I am ready to start your project right now.
Regards,
Faisal
Hello, After going through your project descriptions,I found your project doable by our team. Our Aim is to help you achieve your project’s goal. If you have few minutes lets chat.
Thanks A lot.
We have expert team in javascript and api programming. I am sure i can deliver the final product on time. you will be very satisfy with our efforts. please contact me for any queries.
thanks
Hello there,
I have 6+ years of experience in web development.
I got your requirement, in short you need to create API which will be called from jQuery ajax.
Those events will be on button click.
If you think I can help you let me know.
Thanks
We have done many web scrapping tasks that you can check in our profile also . We found ourself perfect for this job .
We are having very good impact in market since last few months with our very accurate timely delivery and quality of work being delivered . We assured you quality and timely completion of this project which you can confirm from our profile as well .
Dear Employer,
I'm ready to work on "scrape html after JS has been extracted" project.
Relevant Skills
API, Excel, VBA
Milestones
1156 AUD - code writing
289 AUD - userfriendly interface
I would love to work on your project.