[NTLUG:Discuss] Scriptable, javascript-aware web browser OR virtual operator

[Carl Haddick]

On Tue, Aug 28, 2007 at 11:37:41PM -0500, Leroy Tennison wrote:
> I need to "screen scrape" a generated web page which is generated by 
> filling in a form on a previous page. I haven't had any success finding 
> a solution yet so I'm hoping someone here can help.
> 

I had an application where I needed to harvest information from an
interactive web site to include on my generated page.  Basically, an
internal corporate user queried my web server, and my web server went
out and surfed another internal web server to gain some information from
a database I didn't have direct access to.

I used Python's http support, and for my situation was a piece of cake.
Being sort of a Python patriot, my mileage may have varied.