I got the same. It appears that piggy bank is combining (where available)
the RSS feed from the html HEAD with the data gathered through the scraper.
In which case, why's all the additional metadata (prism:publicationName etc)
that is visible in the RSS feeds for all these pages not turning up in the
collected data? Am I doing something wrong?
-- arvind
> -----Original Message-----
> From: David Huynh [mailto:dfhuynh_at_csail.mit.edu]
> Sent: Wednesday, November 30, 2005 11:01 PM
> To: general_at_simile.mit.edu
> Subject: Re: Solvent/piggy-bank weirdness
>
> Arvind Venkataramani wrote:
>
> >http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
> >http://www.citeulike.org/tag/learning
> >http://www.citeulike.org/author/Joseph
> >http://www.citeulike.org/user/amygdala
> >
> >
> I used your scraper and these are the things I got from those 4 links,
> respectively:
>
> 10 taggeditems
> 1 channel, 51 items, 50 taggeditems
> 1 channel, 27 items, 27 taggeditems
> 1 channel, 51 items, 50 taggeditems
>
> I'm actually using Firefox 1.5. There could be some relevant differences
> between your Firefox 1.0.7 and my Firefox 1.5. If you have a chance, try
> Firefox 1.5. I'll try Firefox 1.0.7 when I get a chance.
>
> David
>
> >I just closed all these tabs (I have the session saver extension
> >installed), and reopened & retried. Now I'm getting some data, but I'm
> >getting a mixture of the scraper output (only part of it) and the RSS
> >associated with the page.
> >
> >I also retried (meaning opened a new tab and re-navigated to)
> >http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
> >because this page does not have HEAD-linked RSS - the data coin showed
> >up, and the script worked fine. I don't know if either session-saver's
> >or firefox's cache is interfering.
> >
> >Interestingly, I noticed some error messages in the java console that
> >come up whenever I exit firefox, and just managed to capture them:
> >
> >Java Plug-in 1.5.0_04
> >Using JRE version 1.5.0_04 Java HotSpot(TM) Client VM User home
> >directory = C:\Documents and Settings\arvind
> >
> >
> >----------------------------------------------------
> >c: clear console window
> >f: finalize objects on finalization queue
> >g: garbage collect
> >h: display this help message
> >l: dump classloader list
> >m: print memory usage
> >o: trigger logging
> >p: reload proxy configuration
> >q: hide console
> >r: reload policy configuration
> >s: dump system and deployment properties
> >t: dump thread list
> >v: dump thread stack
> >x: clear classloader cache
> >0-5: set trace level to <n>
> >----------------------------------------------------
> >
> >java.net.MalformedURLException: no protocol:
> > at java.net.URL.<init>(Unknown Source)
> > at java.net.URL.<init>(Unknown Source)
> > at java.net.URL.<init>(Unknown Source)
> > at
> >sun.plugin.liveconnect.SecureInvocation.checkLiveConnectCaller(Unknown
> >Source)
> > at sun.plugin.liveconnect.SecureInvocation.access$000(Unknown
> >Source)
> > at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
> >Source)
> > at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
> >Source)
> > at
> >sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown
> >Source) 22:00:36.250 [...nk.PiggyBank] Failed to dispose Piggy bank
> >server (0ms)
> >java.security.AccessControlException: access denied
> >(java.io.FilePermission C:\Documents and Settings\arvind\Application
> >Data\Mozilla\Firefox\Profiles\s1knzmiq.Piggybank\piggy-bank\temporary-s
> >ource
> >s\model1133229279109 write)
> > at java.security.AccessControlContext.checkPermission(Unknown
> >Source)
> > at java.security.AccessController.checkPermission(Unknown Source)
> > at java.lang.SecurityManager.checkPermission(Unknown Source)
> > at java.lang.SecurityManager.checkWrite(Unknown Source)
> > at sun.plugin.security.ActivatorSecurityManager.checkDelete(Unknown
> >Source)
> > at java.io.File.delete(Unknown Source)
> > at
> >edu.mit.simile.SimileUtilities.deleteDirectory(SimileUtilities.java:320)
> > at
>
>edu.mit.simile.piggyBank.TemporaryProfile.dispose(TemporaryProfile.java:107
)
> > at
> >edu.mit.simile.longwell.LongwellServer.dispose(LongwellServer.java:69)
> > at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:450)
> > at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> > at java.lang.reflect.Method.invoke(Unknown Source)
> > at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
> > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> > at java.lang.reflect.Method.invoke(Unknown Source)
> > at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
> > at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
> >Source)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
> >Source)
> > at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
> >Source)
> > at
> >sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown
> >Source)
> >java.security.PrivilegedActionException:
> >java.lang.reflect.InvocationTargetException
> > at java.security.AccessController.doPrivileged(Native Method)
> > at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
> >Source)
> > at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
> >Source)
> > at
> >sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown
> >Source) Caused by: java.lang.reflect.InvocationTargetException
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> > at java.lang.reflect.Method.invoke(Unknown Source)
> > at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
> > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> > at java.lang.reflect.Method.invoke(Unknown Source)
> > at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
> > at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
> >Source)
> > ... 6 more
> >Caused by: java.security.AccessControlException: access denied
> >(java.lang.RuntimePermission getClassLoader)
> > at java.security.AccessControlContext.checkPermission(Unknown
> >Source)
> > at java.security.AccessController.checkPermission(Unknown Source)
> > at java.lang.SecurityManager.checkPermission(Unknown Source)
> > at java.lang.Thread.getContextClassLoader(Unknown Source)
> > at org.mortbay.http.HttpContext.doStop(HttpContext.java:1779)
> > at org.mortbay.util.Container.stop(Container.java:154)
> > at org.mortbay.http.HttpContext.stop(HttpContext.java:1758)
> > at org.mortbay.http.HttpServer.doStop(HttpServer.java:796)
> > at org.mortbay.util.Container.stop(Container.java:154)
> > at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:458)
> > at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
> > ... 16 more
> >
> >I don't know what this has, if anything, do with it. These are the
> >piggy-bank specific messages I could get off the javascript console
> >(I'm only putting piggybank stuff because the console has no easy way
> >to select all and copy)
> >
> >Error: PiggyBank._getCollector(PiggyBank._tabBrowser.selectedBrowser)
> >has no properties Source File:
> >chrome://piggy-bank/content/scripts/piggybank.js
> >Line: 201
> >
> >Error: PiggyBank._removeCollector(browser) has no properties Source
> >File: chrome://piggy-bank/content/scripts/piggybank.js
> >Line: 173
> >
> >(repeat 6 more times)
> >
> >Error: PiggyBank._getCollector(browser) has no properties Source File:
> >chrome://piggy-bank/content/scripts/piggybank.js
> >Line: 90
> >
> >
> >-- arvind
> >
> >
> >
> >>-----Original Message-----
> >>From: David Huynh [mailto:dfhuynh_at_csail.mit.edu]
> >>Sent: Wednesday, November 30, 2005 10:01 PM
> >>To: general_at_simile.mit.edu
> >>Subject: Re: Solvent/piggy-bank weirdness
> >>
> >>Arvind Venkataramani wrote:
> >>
> >>
> >>
> >>>I've set the 'redirect javascript console to stdout' option for
> >>>piggybank, so any javascript messages should be in the firefox
> >>>console output (if I understand that option right). In any case, I
> >>>don't remember seeing any javascript errors before I did that, but if
> >>>you like, I can run the scraper again and mail you the javascript
> >>>output to
> >>>
> >>>
> >you separately...
> >
> >
> >>>-- arvind
> >>>
> >>>
> >>>
> >>>
> >>Which particular page on citeulike does your scraper have problem with?
> >>It seems to be working for me--I haven't gotten the "no typed data
found"
> >>
> >>
> >message.
> >
> >
> >>David
> >>
> >>
> >
> >
> >
Received on Thu Dec 01 2005 - 04:02:51 EST