KeyError's for various wiki feeds

[Marc Girod]

Hi Sam,

Sam Ruby <rubys at intertwingly.net> writes:

> There are no plans to update Planet 2.0.

This is what I had understood, so getting Venus to work is a
reasonable plan for me, I guess.

> I can't help with the latter...  :-)

But fortunately, *I* can.
Anyway, it eased up by itself.
In fact, it seems like the problem related to planet:
- there were 3 processes running 2 generations of crontab invocations
  of planet (20 minutes interval)
- it seems that the first one was having some trouble--the two
  processes started at the same time were not in a parent child
  relationship
- many (18 or so) moin.cgi scripts for various wiki instances were
  running
- after they exited (I didn't kill them), the time stamp of the
  compound rss was old, so that I checked and found errors (the same
  kind I am presently chasing) with 2 more wikis, which I thus
  commented away in the config file, after which the generation could
  go on...

I got then a slightly different error, but below...

> The first messages indicate that you don't have a number of optional
> packages installed, and therefore the functions that integrate with
> those features can't be tested.  No biggie.

I installed the first two already...
Thus:

venus> python tests/reconstitute.py "http://wiki.iona.com/icde-wiki/RecentChanges?action=rss_rc&items=50&ddiffs=1&unique=1"
Error processing http://wiki.iona.com/icde-wiki/RecentChanges?action=rss_rc&items=50&ddiffs=1&unique=1
TypeError: _resolveRelativeURIs() takes exactly 3 arguments (4 given)
  File "/home/mgirod/tmp/bzr/venus/venus/planet/spider.py", line 420, in spiderPlanet
    writeCache(uri, feed_info, data)
  File "/home/mgirod/tmp/bzr/venus/venus/planet/spider.py", line 152, in writeCache
    scrub.scrub(feed_uri, data)
  File "/home/mgirod/tmp/bzr/venus/venus/planet/scrub.py", line 129, in scrub
    node.value, node.base, 'utf-8', node.type)
Traceback (most recent call last):
  File "tests/reconstitute.py", line 85, in <module>
    os.removedirs(os.path.dirname(work))
  File "/usr/local/lib/python2.5/os.py", line 185, in removedirs
    rmdir(name)
OSError: [Errno 39] Directory not empty: '/home/mgirod/tmp/bzr/venus/venus/tests/work'


> The only one of any significance is libxml2; that's what triggers
> the "syntax error" above and the first two of your failures.  I'd
> recommend that you install it (it is called python-libxml2 on
> Ubuntu/Debian), but it truly is meant to be optional, so this is a
> bug.

I am now doing it.
 
> I've pushed up a fix for these two errors.  If you let me know what
> the next error is, I can take a look at it.

I tried:

venus> bzr update
Tree is up to date at revision 241.
venus> bzr status
unknown:
  tests/work/
venus> find tests/work
tests/work
tests/work/spider
tests/work/spider/cache
tests/work/spider/cache/index
tests/work/spider/cache/cache
tests/work/spider/cache/sources
tests/work/spider/cache/sources/tests,data,spider,testfeed0.atom
tests/work/spider/cache/sources/tests,data,spider,testfeed2.atom
tests/work/spider/cache/sources/tests,data,spider,testfeed1b.atom
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed2,1
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed2,2
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed2,3
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed2,4
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed1,1
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed1,2
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed1,3
tests/work/spider/cache/planet.intertwingly.net,2006,testfeed1,4

Do I remove this by hand?

Marc

----------------------------
IONA Technologies PLC (registered in Ireland)
Registered Number: 171387
Registered Address: The IONA Building, Shelbourne Road, Dublin 4, Ireland