Venus: My Homepage has suddently stopped updating

[Sam Ruby]

Amit Chakradeo (अमित चक्रदेव) wrote:
> 
> 
> On Thu, Apr 16, 2009 at 8:54 AM, Gordon Hodgson <feeds at greenfeed.org.uk 
> <mailto:feeds at greenfeed.org.uk>> wrote:
> 
>     Apparently my host is aout-terminating scripts that take longer than
>     60 seconds to run. Is there anyway to split the config.ini into
>     smaller chunks?
> 
> Not a proper solution, but you could try running spider and splice 
> scripts separately
> 
> python spider.py config.ini
> 
> and later 
> python splice.py config.ini

What's improper about that? :-)

If a config.ini is split up into smaller pieces, running spider on each 
of the smaller lists will populate the cache.

A separate, master, list could simply include each of the subconfigs:

http://intertwingly.net/code/venus/tests/data/config/rlist-config.ini

Running splice on the master list will pull from everything in the cache.

- Sam Ruby