PithPicker - A news reader service using RSS that provides you with just summary of news articles. It works by extracting key sentences using Natural Language Processing (NLP) algorithm.
The main goal was to build a website that could be easily handle content and user management. New content will be added frequently so we needed a strong content management system in place. We at KnackForge, having strong background in Drupal and its flexibility with hundreds of modules, easy third part integration, chose to harness its power.
Core features we developed
- News summary
- Daily news digest
- Responsive design
- Social popularity
- Social sharing
- API integration
- Android app development
- Drupal website for content and user management
- Python engine for Summarizing
- Python algorithm for Social popularity
Modern web always demands a responsive website that can fit well on small devices. We used bootstrap theme and added our customizations on top of that to bring a sleek User Interface.
Summarizing the text
We wrote powerful Python multi-threaded program that can consume Drupal nodes via REST API. This engine will run summarization on fetched news article to generate summaries and store in the DB. Periodically these summaries are sent back to Drupal site via REST calls.
The content and title are used for summarizing. We use the following main criteria to identify top sentences,
- Title words' presence
- Length of the sentences
- Sentence position
- Keywords' presence on sentences and their intersection
- Frequency of occurrence
We use Facebook and similar social networks to find the popularity of given article. Again, it uses multi threaded Python program and communicates the result back to Drupal site.
You can add websites to read in two ways,
- Choose from suggestions categorized under various topics like Technology and Internet, Health and so on.
- Type your own website url
You can group your websites into topics, say you can add 3 websites as "Technology" and a few as "Health". On clicking topic name on left sidebar, it will show you all recent news from all the websites under the topic. You can drill down to individual website by clicking the website link under the topic.
We have developed native Android app that takes advantage of Drupal’s lightweight API interface. This basic app lets users to read their news summaries grouped under various topics. The android app uses social login support directly from the website, read more here http://knackforge.com/blog/selvam/android-app-integration-drupal-oauth. The app uses typical components in Android parlance like,
- UI layouts
- Custom Adapter