http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
http://www.citeulike.org/tag/learning
http://www.citeulike.org/author/Joseph
http://www.citeulike.org/user/amygdala
I just closed all these tabs (I have the session saver extension installed),
and reopened & retried. Now I'm getting some data, but I'm getting a mixture
of the scraper output (only part of it) and the RSS associated with the
page.
I also retried (meaning opened a new tab and re-navigated to)
http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
because this page does not have HEAD-linked RSS - the data coin showed up,
and the script worked fine. I don't know if either session-saver's or
firefox's cache is interfering.
Interestingly, I noticed some error messages in the java console that come
up whenever I exit firefox, and just managed to capture them:
Java Plug-in 1.5.0_04
Using JRE version 1.5.0_04 Java HotSpot(TM) Client VM
User home directory = C:\Documents and Settings\arvind
----------------------------------------------------
c: clear console window
f: finalize objects on finalization queue
g: garbage collect
h: display this help message
l: dump classloader list
m: print memory usage
o: trigger logging
p: reload proxy configuration
q: hide console
r: reload policy configuration
s: dump system and deployment properties
t: dump thread list
v: dump thread stack
x: clear classloader cache
0-5: set trace level to <n>
----------------------------------------------------
java.net.MalformedURLException: no protocol:
at java.net.URL.<init>(Unknown Source)
at java.net.URL.<init>(Unknown Source)
at java.net.URL.<init>(Unknown Source)
at
sun.plugin.liveconnect.SecureInvocation.checkLiveConnectCaller(Unknown
Source)
at sun.plugin.liveconnect.SecureInvocation.access$000(Unknown
Source)
at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
Source)
at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
Source)
at
sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
22:00:36.250 [...nk.PiggyBank] Failed to dispose Piggy bank server (0ms)
java.security.AccessControlException: access denied (java.io.FilePermission
C:\Documents and Settings\arvind\Application
Data\Mozilla\Firefox\Profiles\s1knzmiq.Piggybank\piggy-bank\temporary-source
s\model1133229279109 write)
at java.security.AccessControlContext.checkPermission(Unknown
Source)
at java.security.AccessController.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkWrite(Unknown Source)
at sun.plugin.security.ActivatorSecurityManager.checkDelete(Unknown
Source)
at java.io.File.delete(Unknown Source)
at
edu.mit.simile.SimileUtilities.deleteDirectory(SimileUtilities.java:320)
at
edu.mit.simile.piggyBank.TemporaryProfile.dispose(TemporaryProfile.java:107)
at
edu.mit.simile.longwell.LongwellServer.dispose(LongwellServer.java:69)
at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:450)
at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
Source)
at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
Source)
at
sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
java.security.PrivilegedActionException:
java.lang.reflect.InvocationTargetException
at java.security.AccessController.doPrivileged(Native Method)
at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
Source)
at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
Source)
at
sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
Source)
... 6 more
Caused by: java.security.AccessControlException: access denied
(java.lang.RuntimePermission getClassLoader)
at java.security.AccessControlContext.checkPermission(Unknown
Source)
at java.security.AccessController.checkPermission(Unknown Source)
at java.lang.SecurityManager.checkPermission(Unknown Source)
at java.lang.Thread.getContextClassLoader(Unknown Source)
at org.mortbay.http.HttpContext.doStop(HttpContext.java:1779)
at org.mortbay.util.Container.stop(Container.java:154)
at org.mortbay.http.HttpContext.stop(HttpContext.java:1758)
at org.mortbay.http.HttpServer.doStop(HttpServer.java:796)
at org.mortbay.util.Container.stop(Container.java:154)
at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:458)
at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
... 16 more
I don't know what this has, if anything, do with it. These are the
piggy-bank specific messages I could get off the javascript console (I'm
only putting piggybank stuff because the console has no easy way to select
all and copy)
Error: PiggyBank._getCollector(PiggyBank._tabBrowser.selectedBrowser) has no
properties
Source File: chrome://piggy-bank/content/scripts/piggybank.js
Line: 201
Error: PiggyBank._removeCollector(browser) has no properties
Source File: chrome://piggy-bank/content/scripts/piggybank.js
Line: 173
(repeat 6 more times)
Error: PiggyBank._getCollector(browser) has no properties
Source File: chrome://piggy-bank/content/scripts/piggybank.js
Line: 90
-- arvind
> -----Original Message-----
> From: David Huynh [mailto:dfhuynh_at_csail.mit.edu]
> Sent: Wednesday, November 30, 2005 10:01 PM
> To: general_at_simile.mit.edu
> Subject: Re: Solvent/piggy-bank weirdness
>
> Arvind Venkataramani wrote:
>
> >I've set the 'redirect javascript console to stdout' option for
> >piggybank, so any javascript messages should be in the firefox console
> >output (if I understand that option right). In any case, I don't
> >remember seeing any javascript errors before I did that, but if you
> >like, I can run the scraper again and mail you the javascript output to
you separately...
> >
> >-- arvind
> >
> >
> Which particular page on citeulike does your scraper have problem with?
> It seems to be working for me--I haven't gotten the "no typed data found"
message.
>
> David
Received on Thu Dec 01 2005 - 03:12:03 EST