Re: Using Solvent with Javascript rendered HTML pages

From: David Huynh <dfhuynh_at_csail.mit.edu>
Date: Wed, 01 Feb 2006 06:41:10 -0500

Barney wrote:

>I was trying it with an online shopping site:
>
>http://www.sainsburystoyou.com
>
>but you need a login. Google mail seems to exhibit the same problem:
>
>http://mail.google.com/mail/
>
>
The problem with gmail is that there is an IFRAME. XPaths can't go
inside IFRAMEs. I don't know about the other site.

There should be no problem at all with generated elements as Solvent
(and scrapers) operates on live DOMs, not original HTML code.

David
Received on Wed Feb 01 2006 - 11:42:26 EST

This archive was generated by hypermail 2.3.0 : Thu Aug 09 2012 - 16:39:18 EDT