Hi all,
As the title states, im pretty confident in D7 with a few twists in being right for a project im working on.
Please offer some opinions/experience on the following scenario.
I plan to build a listing search engine. Think of it like an ebay (but no buying or transacting) for vertical markets. To get listings I am scraping data from various (dozens, eventually hundreds and hopefully thousands of listing websites) aggregating it and then using a better search facility to serve better/faster/more comprehensive results to a visitor.
I want this to run very light on a server/vps/hell even shared hosting...if possible, and I think it is.
Here is some things about this project.
1. No user management, no accounts, logins etc everything completely anonymous.
2. No transactions. You come you search you go.
3. The data driving this is not neat. It cant be, im scraping html websites...
4. High amounts of data, potentially millions of listings
5. Needs powerful faceted search.
6. The listings MAY be updated every couple of days as I rescrape those website, or if no update is found to that listing, the listing remains unchanged = prime caching oportunity.
Here is my plan.
1. Drupal7. No front end modules, everything stripped back as light as possible.