Re: no coordinates in my starbucks piggy bank results

From: Susan Hardin <shardin_at_umich.edu>
Date: Fri, 13 Jan 2006 10:46:54 -0500

I understand how this should work, but for some reason I never get past
the point of being told that additional pages are being loaded. I
choose 0 or 1 for additional pages, to minimize the amount of time it
would take to get results, and still my browser just churns and churns.
  That window never goes away, and no results appear. Since it never
gets past this point, it never steps into the "waiting for Google
coordinates" popup window. This occurs on all machines I've tested.
     Seems that it is in a loop or something, or not finding the
additional pages.

Thinking that my home networks (ISDN and Satellite) were too slow, I
tried it several times on the university's high speed network this
morning. Same results.

I experimented with creating a couple of scrapers using solvent last
night for single pages and things went very well. However, any
attempts at working with multiple pages seemed to stall out or hang. I
would have to restart Firefox to be able stop the current process so I
could retry running the scraper (using solvent).

My primary machine is a Mac, running 10.3.9, the other Mac is running
10.4.x(?) and both machines are running Firefox 1.5. The other
machine is a PC, running XP and Firefox 1.5. All are running Piggy
Bank 2.1.2 (Jan 11th build).

Any ideas on what's happening?

Susan





On Jan 12, 2006, at 7:58 PM, Prokopp, Christian wrote:

> Hi Susan,
>
> This just means that you can load/scrape the data from the following
> pages too e.g., at craigslist at the bottom you see "next 100 postings"
> link which would be the next page piggy bank scrapes for you if you
> enter additional pages in the pop-up. It should work just fine but
> obviously might take a while to load all pages and scrape them.
>
> Cheers,
> Christian
>
> ________________________________
>
> From: Susan Hardin [mailto:shardin_at_umich.edu]
> Sent: Friday, 13 January 2006 3:07 AM
> To: general_at_simile.mit.edu
> Subject: Re: no coordinates in my starbucks piggy bank results
>
>
> We pulled down the new build (Jan 11th). The Starbucks demo now brings
> up coordinates. Great!
>
> However, any test on the http://www.craigslist.org/apa/ results in a
> pop
> up window asking how many additional pages I'd like to load. When I
> enter '1' I get a new popup window that says:
>
> Piggy Bank Loading additional Pages:
> Please wait while this screen sraper loads additional relevant web
> pages
>
> http://www.craigslist.org/apa/index100.html
>
> If I enter 5, then I get five urls in the list of relevant web pages.
>
> What is happening? I see similar responses to other scrapers like the
> WorlCat library example. Is this a firewall issue? Something else?
>
>
> Thanks,
> Susan
>
>
>
> On Jan 10, 2006, at 11:35 AM, Stefano Mazzocchi .wrote:
>
>
> Susan Hardin wrote:
>
> When I first installed Piggybank and the Starbucks
> scraper I had no problems getting the appropriate results along with
> the
> coordinates for mapping. Since the first day though, the results still
> appear fine but the coordinates facet does not appear.
> I've installed Piggybank on other machines in the last
> few days and the same thing is happening on them- no coordinates. (Yes,
> I've gone through the steps to get Google Map Key).
> We'd like to demo piggy bank with coordinates mapping in
> a U of Mich course next week and need to have at least one example that
> demos well.
> Any suggestions about what is happening and how to fix
> it? Any other demo suggestions?
>
>
> Had the exact same problem the other day before presenting to
> the Getty Foundation: Google changed the way they do address lookup
> (which is not part of their stable API) and broke all versions of Piggy
> Bank before wednesday last week.
>
> My suggestion, for now, is to install a nightly build from:
>
> http://simile.mit.edu/builds/piggy-bank/
>
> (the last one, the one at the bottom should work)
>
> Let us know how that went.
>
> --
> Stefano Mazzocchi
> Research Scientist Digital Libraries Research Group
> Massachusetts Institute of Technology location: E25-131C
> 77 Massachusetts Ave telephone: +1 (617) 253-1096
> Cambridge, MA 02139-4307 email: stefanom at mit . edu
>
> -------------------------------------------------------------------
>
>
>
>
>
> Susan Hardin
> Webmaster - sakaiproject.org
> shardin_at_umich.edu
>
>
>
>
Susan Hardin
Webmaster - sakaiproject.org
shardin_at_umich.edu
Received on Fri Jan 13 2006 - 15:46:37 EST

This archive was generated by hypermail 2.3.0 : Thu Aug 09 2012 - 16:39:18 EDT