71618 meta travel price live search

travel meta price live search, could be a clone of the travel price comparison site and hotel, flights and travel search at http://reisen.kelkoo.de. That means: I need real time parsers that retrieves the content out of the below listed travel sites and displays them on 4 different types of result pages. For velocity a powerful and fast C++ or perl parser is requested. That means we need 4 several meta searches (flights, hotels, cars, last minute) for each travel price comparison site. To display the results I don't want to wait until the last result is delivered. So at least one output from the faster pages should be displayed even if the rest of the scripts is still processing. We need parsers for following themes and the pages similar to those you can see on kelkoo: * Flights with data from: [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] * Hotels with data from: [login to view URL] [login to view URL] [login to view URL] (we probably can supply xml feed) [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] * Rent a car with data from: [login to view URL] [login to view URL] [login to view URL] [login to view URL] * Last minute [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] Everything should be in (smarty-) templates to edit html code of any page easier – all this should be possible through the admin area. An XML interface is requested to spread the product on different websites. Within XML search it should be possible to add a parameter through admin backend for every affiliate to track where traffic comes from. The idea is to have a background process running at all times. The front end will send a message to the background telling it what to search for, and the background process will start all necessary parsers at once. This way we can use multi-threading and this will ensure the fastest possible results, and in no way can the front-end time out. The parsers running in the background will temporarily store the results in a MySQL database, and automatically delete them after 4 hours. This gives the user more than enough time to browse the results, and also makes sure the database isn't filled with old results. Negative results (no result to a certain destination) should be collected for longer and have to be editable through admin interface. Also we need to store results for 2-3 hours, because many users make the same request after a few minutes for a second time. Page 1: User enters flight details - Javascript checks to see if the user does not enter rubbish or old data. - Impossible combinations should not be allowed (flight from London to London for example) - On submit, a script sends a message to the background process. Page 2: “Search in progress” page - pages shows a status about the search. Usually “no results” are shown faster, so page could send a status like: Search is in progress …... [login to view URL] processing [login to view URL] no results [login to view URL] processing [login to view URL] processing [login to view URL] processing [login to view URL] no results [login to view URL] processing [login to view URL] processing Background process: - Stop words or stop queries omit parsers to retrieve data from those engines, where we know that they won't bring any answers (for instance when a website operates only flights from and to London and a flight to other destinations is requested). - Parsers retrieves data out of allowed websites. - after a few moments first status info is sent to display on page 2. - Caching of queries without results. If the last 5 searches didn't give any results for a certain combination from a certain site, it is not necessary to search on this site for next 2-3 hours. This also has to check the dates somehow, because some flights might just be full booked. We can make a difference between dates within a month from now, 1-6 months, and more than 6? - Page automatically refreshes to Page 3 after 5 (?) seconds, or sooner if the all parsers are finished. - Caching of time per request and number of results for statistics. Page 3: Partially done / First results - If the minimum number of results (20) for first page is met, continue to Page 4 - All available results are fetched and shown. - results must be sortable like in the example (by price, by shop, by alphabet, by flight time etc). That means caching is absolutely necessary. Page 4: exactly the same as page 3, but full result set (max 20 per page). Admin area - add/edit feeds - add/edit stop words or stop queries for every page where we retrieve results - statistics about every page, where results were retrieved (response time, number of queries per period, number of result sets per period, results per result set) If you have a similar product, please show me (send logins and passwords to all accounts). Requirements * Scripts should be bug free. * Scripts should contain easy installation routines. * Scripts should contain easy documentation. * Scripts must be using 100% templates. * Scripts must be done in pure source code, no crypted or compiled code. * Removal of copyright and exclusive rights are preferred (but not obligatory). * Scripts must be efficiently written. * Scripts must work with most standard Linux based servers (we prefer Debian). * Script has to be in multi language mode. * A preview of your work must be possible. * Please don't offer us hourly rates, planning of time and speed is yours. * Payment can be done 30-80% in advance on escrow account, and partly released depending on progress of the project, the last 20% will be released, when project is 6 weeks bugfree. Calculate this into your prices or negotiate it in advance. * You should be available on messengers and have a phone contact. * We plan on maintaining the site after it is created. So we will need customer support, just Q and A emails. * A long term partnership is preferred. So everything written above is negotiable after we know each other better. In the beginning we need some extra help to spider more detailed content to setup navigation with flight targets, last minute targets, hotel or car data. Please use the message board ONLY, automatic submissions will be ignored - Thanks! Please think of this: "Programmers pay NO fee to participate in Featured projects" *********************************************************************** Apart from this I'd like to have parsed the flight plans from the most popular destinations from airport pages like: [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL]