webscrape google play

Web scrape google play games [login to view URL] all work is to be done using python 3.X and needs to run on a linux server Categories:- i should be able to add words without an issue Action Adventure Arcade Board Card Casino Casual Educational Music Puzzle Racing Role Playing Simulation Sports Strategy Trivia Word Inside each search: (in this case- action game was searched) I want to loop through each category and add the worm game to it. [login to view URL] do free/paid per search [login to view URL] [login to view URL] in the browser, all apps do not show up. you first have to scroll to the bottom of the page, then go up a little, then go back to the bottom, then click show more. you can then get all the urls from the class "id-card-list card-list two-cards" only (since there are a lot of other links around, we just want things in that div -from there, you can store the urls in some table, along with the date added to the table get urls from here as well using the same logic [login to view URL] [login to view URL] [login to view URL] [login to view URL] Use table of urls to base which urls to scrape store ALL info: postgres preferred -TABLE-app -appName -appId -app description -ADDITIONAL INFORMATION -WHAT'S NEW -genre -target audience -number of images -image urls seperated by commas -date scraper ran -website -TABLE-reviews -reviewID (can be computer generated) -appName -score -review text -review date -developer response -developer response date