Support other protocols like FTP [#1428274]

I know the module name is "HTTP", but I had requests from users about checking FTP links in linkchecker, too.

I know cURL supports a large number of protocols and I don't know about stream stuff, maybe we can support some more. I'm not sure how difficult it is to check CDNs, telnet and some others. At least FTP is a very common case if it comes to link checking and a site provides many FTP links to users. It would be extremely easy if I could just push the FTP links to the HTTPRL module for checking them, too.

Comments

Comment #0.0

hass commented 4 February 2012 at 13:49

Issue summary:

View changes

Comment #0.1

hass commented 4 February 2012 at 13:50

Issue summary:

View changes

Comment #1

mikeytown2 commented 24 February 2012 at 22:06

I believe stream_socket_client() will support ftp. It's just a matter of handling the meta data. http has a lot of meta data, I believe ftp doesn't.

2 Things to keep in mind.
http://php.net/stream-get-wrappers
http://php.net/stream-get-transports

Looks like we (drupal core & httprl) are using a transport (tcp) so we need to issue a bunch of write commands. If we were using a wrapper then it would be a little easier to implement, but I probably wouldn't be able to do things in parallel then.

More reading:
http://rohitiyer2109.blogspot.com/2012/02/simulate-file-transfer-protoco...