Support from Acquia helps fund testing for Drupal Acquia logo

Comments

leovarg’s picture

Title: PubSubHubbub and RSSCloud support » it sounds soooo cool

it sounds soooo cool

alex_b’s picture

Title: it sounds soooo cool » PubSubHubbub and RSSCloud support
mchelen’s picture

is any code from this module helpful? http://drupal.org/node/590928#comment-2144090

also, simpleupdateprotocol http://code.google.com/p/simpleupdateprotocol/ might be another good option that some other php projects have had good luck with

alex_b’s picture

I can't see any Drupal modules on that thread but I left a comment pointing to this issue.

G.I.Joe’s picture

I will publish the first release of this module in a few days... let's say monday 9 november... and you will find it here http://drupal.org/node/609440#comment-2231628

alex_b’s picture

There is PHP source code for PubSubHubub available on http://code.google.com/p/pubsubhubbub/source/checkout

I just realized that we will need to support pausing single feeds for this feature as a importer configuration will decide on a feed by feed basis on whether a feed needs to be refreshed on cron or not depending on whether a pubsub hub could be found for it. #629372: Pause single feeds

alex_b’s picture

Status: Active » Needs work
FileSize
5.97 KB
5.97 KB

This is a first shot, building on subscriber.php included in http://code.google.com/p/pubsubhubbub/source/checkout

Completely untested and not functional. I'm posting this here to share where I'm going. Most likely, I won't have much time for working on this in the next week.

G.I.Joe’s picture

I would like to contribute or collaborate with the feeds.module.
You can find a Beta version of my fastwebfeed.module at http://cupid-project.be/

alex_b’s picture

#8 Always welcome. The issue queue is a great place to start. Soon I will come up with a roadmap, too.

#7: I thought more about implementing pub/sub. I think the approach taken in #7 of breaking it out into its own fetcher/parser is not the way to go as pub sub is fundamentally a problem that concerns the importer configuration. I. e. only specific Atom/RSS parsers can actually detect the pubsub hub URL in a feed and then this URL is to be used only if the fetcher supports HTTP GET (or in the case of PuSH receiving HTTP POST requests). Will roll a new patch if I can get more time.

G.I.Joe’s picture

#8 I have improved my code for Drupal 6. You can find the module here (http://cupid-project.be/project/fastwebfeed-module/page/downloads)
My next approach can be the feedapi.module.

G.I.Joe’s picture

The first Release Candidate for Drupal 6 is a fact. (fastwebfeed.module-6.x-1.0-RC1)
It supports pubsubhubbub and sup and it inserts this to the drupal RSS feeds.

See http://drupal.org/node/609440#comment-2330606

My next approach can be the feedapi.module.

leovarg’s picture

+1

mcaudy’s picture

Subscribing

m3avrck’s picture

subscribe

ckng’s picture

+1, subscribing

alex_b’s picture

Status: Needs work » Needs review
FileSize
22.89 KB

This patch implements pubsubhubbub support. Very close now. Will test with superfeedr.

alex_b’s picture

FileSize
32.54 KB

Improvements:

* Implemented authenticated content distribution.
* Implemented unsubscribe on delete.
* Bunch of smaller bug fixes

For testing I opened an account with Superfeedr and hooked up to http://superfeedr.com/dummy.xml . You can send notifications for http://superfeedr.com/dummy.xml when going to Superfeedr's console on the dashboard and hitting the 'click here' button. You can observe notifications and subscription requests by following the debug log (see feeds_dbg() in feeds.module after patching).

Patch applies to HEAD. If you have applied #16, a reinstall is required.

alex_b’s picture

FileSize
32.69 KB

- Fix fallback to $url when self can't be found.

alex_b’s picture

The latest patched version is available on github here: http://github.com/lxbarth/Feeds

Setup:

* using the PubsubHubbub Fetcher instead of the HTTP Fetcher will automatically use pubsubhubbub if available.
* See README.txt on how to set up a designated hub (e. g. Superfeedr) with Feeds.

Outstanding:

* Do not automatically refresh feeds if they are successfully subscribed through PuSH (right now feeds will continue to import feeds at the given setting even if they are successfully subscribed).
* Automatically adjust re-subscription frequency to hub's verification response.

Both will require a significant rework of FeedsScheduler class that currently does not allow for different refresh frequencies per source.

alex_b’s picture

Title: PubSubHubbub and RSSCloud support » PubSubHubbub support
FileSize
33.44 KB

Latest updated patch:

- Removed resubscription handling: Waiting on #721428: Make scheduler next scheduled time based to build this properly.
- Factored FeedsPubsubFetcher into FeedsHTTPFetcher
- More clean ups.
- Made sure all tests pass.

[Edit, hit save too fast:]

Removing RSSCloud from title as this patch won't implement RSSCloud support.

http://github.com/lxbarth/feeds is up to date

alex_b’s picture

FileSize
35 KB

- Renamed fetcher menu callbacks from feeds/fetcher/[importer_id] to feeds/importer/[importer_id] - more generic
- Cleaned up PuSHSubscriber.inc for release

alex_b’s picture

FileSize
34.99 KB

Clean up description on designated hub field.

alex_b’s picture

FileSize
33.73 KB

Reroll after http://github.com/lxbarth/PuSHSubscriber was released.

alex_b’s picture

Status: Needs review » Fixed

Committed.

I will do a blog post on PuSH support in Feeds tomorrow. Will post a quick notification here when it's out.

alex_b’s picture

Fyi, a little while ago I posted this summary of PuSH subscriber support on our blog: http://developmentseed.org/blog/2010/feb/23/pubsubhubbub-support-drupal

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

venusrising’s picture

Status: Closed (fixed) » Active

Can someone please clarify as we are confused. Read the dev see article but after installing Feeds and following instructions I think we misunderstood and that this is to pull other feeds into our site. What we are trying to do is FEED our core created feeds with pubsubhubbub. Matt Cutts suggested this as a means to cut down on scrapers that may pull your content and repost it. His article said this would help Google easily see who first posted it for search etc. We have had junk scraper sites ripping our articles . Can someone please help me understand. Thanks so much

kenorb’s picture

Drupal 7 is supported?

Ted51’s picture

Issue summary: View changes

Can someone confirm if PubSubHubbub is supported (or is planed to be supported) by Drupal 7 ?

ximo’s picture

Status: Active » Fixed

#28, #29: Yes, this is supported in 7.x-2.0-alpha8 (the latest release on that branch):

http://cl.ly/image/0k3Y0v3t1b2O

And for the record, just to answer #27, the Feeds module only supports the "subscribe" part of PubSubHubbub.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.