Spider & Clean-up features

I know I'm pushing it a bit asking for these next two features, but they would be very useful and I have seen them before in other Linking scripts.

Spider:

- on the weblink.module admin there would a section to setup spidering.

- type in a keyword and how many sites to gather in a batch. he was having time out issues and made a modication to prg to go get max 20 sites at a time.

- then these 20 web links are feed into an approval screen, where you can see the url and site description and preview site if so desired. This is also where the Category is assigned via a drop down.

It was a very nice feature and a person could build content rather fast.

Clean-up
- Batch run program to visit links and flag them if not found.
- this is not fool proof however - most often someone will plug in some other material on this page to take advantage of it being indexed by one of SE's.