babelscriptbabelscript is a script language I designed to do data mining in web sites like Wikipedia for use in certain web applications. It uses a special pattern matching syntax, easy http access and automatic loop conditions. The following example prints a list of page names of all internal links on the Wikipedia main page:
load http://en.wikipedia.org as {page}
loop
find <a href="/wiki/{internalLink}" in {page}
print {internalLink}
repeat
Why
a new script language for this? Because with regular expressions this
is much more tedious. Here's an example that demonstrates this. Other features of babelscript include:find <a href="/wiki/{internalLink}" in {page}
print {internalLink}
repeat
- Automatic caching of http requests in bz2-compressed files (located in subfolder babelCache).
- Easy definition of new commands. Just save a file with the name of the command plus extension .bls (see directory library for examples).
- No need to define loop conditions. A loop is repeated as long as states are changing. Also, if a find command fails, the script automatically repeats the loop (or exits, if nothing changed).
- Ready to use query command to do automated web queries using a free meta search engine, for examplequery Obama as {link}
The query command is a babelscript module itself (located in the directory library).
Further documentation:
This software is freeware and comes without any warranty. It is a work in progress, so if you have any feedback or questions, please mail to
.