Venus: My Homepage has suddently stopped updating

[Gordon Hodgson]

What I've done is cut my config.ini in half into two files called  
config1.ini and config2.ini (the scripts were terminating before the  
spidering was complete)

Then I've run spider config1.ini
And then 5 minutes later  spider config 2.ini
And then 5 minutes later splice config.ini

Does this make sense?

I'm not completely sure about how much of the file info can be removed  
(for instance, whether the avatar stuff and most of the [planet]  
section needs to be in the spidered files (although I've cut it out,  
and everything seems to work fine). Can anything be cut out from the  
master config.ini (spliced) file? I haven;t been able to work all this  
stuff out too easily from the Venus documentation website (and I don't  
understand python).

Many thanks,
Gordon

On 16 Apr 2009, at 17:52, Sam Ruby wrote:

> Amit Chakradeo (अमित चक्रदेव) wrote:
>> On Thu, Apr 16, 2009 at 8:54 AM, Gordon Hodgson <feeds at greenfeed.org.uk 
>>  <mailto:feeds at greenfeed.org.uk>> wrote:
>>    Apparently my host is aout-terminating scripts that take longer  
>> than
>>    60 seconds to run. Is there anyway to split the config.ini into
>>    smaller chunks?
>> Not a proper solution, but you could try running spider and splice  
>> scripts separately
>> python spider.py config.ini
>> and later python splice.py config.ini
>
> What's improper about that? :-)
>
> If a config.ini is split up into smaller pieces, running spider on  
> each of the smaller lists will populate the cache.
>
> A separate, master, list could simply include each of the subconfigs:
>
> http://intertwingly.net/code/venus/tests/data/config/rlist-config.ini
>
> Running splice on the master list will pull from everything in the  
> cache.
>
> - Sam Ruby
>