[topicmapmail] Screen scrapers for TopicMap with PiggyBank?

Lars Marius Garshol larsga at garshol.priv.no
Wed Sep 5 09:09:33 EDT 2007


* Thomas Flemming
>
> Has anyone written any screenscraper for extracting topicmap
> data from websites with Piggy Bank[1]? Seems like many of
> the Pggy Bank users uses this neat Firefox extensions to
> write scrapers in JavaScript to get RDF data.

In general this should be no harder than producing RDF with  
PiggyBank, and then doing a normal RDF->TM conversion.

For a while Ontopia used an internal tool which produced RDF from raw  
data sources, massaged it, and then converted it to Topic Maps. This  
worked OK, although we've abandoned that approach now (for various  
reasons). In any case, there's no doubt that a two-step approach is  
workable.

--Lars M.



More information about the topicmapmail mailing list