Arvind Venkataramani wrote:
>http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
>http://www.citeulike.org/tag/learning
>http://www.citeulike.org/author/Joseph
>http://www.citeulike.org/user/amygdala
>
>
I used your scraper and these are the things I got from those 4 links,
respectively:
10 taggeditems
1 channel, 51 items, 50 taggeditems
1 channel, 27 items, 27 taggeditems
1 channel, 51 items, 50 taggeditems
I'm actually using Firefox 1.5. There could be some relevant differences
between your Firefox 1.0.7 and my Firefox 1.5. If you have a chance, try
Firefox 1.5. I'll try Firefox 1.0.7 when I get a chance.
David
>I just closed all these tabs (I have the session saver extension installed),
>and reopened & retried. Now I'm getting some data, but I'm getting a mixture
>of the scraper output (only part of it) and the RSS associated with the
>page.
>
>I also retried (meaning opened a new tab and re-navigated to)
>http://www.citeulike.org/search/all?f=tag&q=evolution%2Bgene-expression
>because this page does not have HEAD-linked RSS - the data coin showed up,
>and the script worked fine. I don't know if either session-saver's or
>firefox's cache is interfering.
>
>Interestingly, I noticed some error messages in the java console that come
>up whenever I exit firefox, and just managed to capture them:
>
>Java Plug-in 1.5.0_04
>Using JRE version 1.5.0_04 Java HotSpot(TM) Client VM
>User home directory = C:\Documents and Settings\arvind
>
>
>----------------------------------------------------
>c: clear console window
>f: finalize objects on finalization queue
>g: garbage collect
>h: display this help message
>l: dump classloader list
>m: print memory usage
>o: trigger logging
>p: reload proxy configuration
>q: hide console
>r: reload policy configuration
>s: dump system and deployment properties
>t: dump thread list
>v: dump thread stack
>x: clear classloader cache
>0-5: set trace level to <n>
>----------------------------------------------------
>
>java.net.MalformedURLException: no protocol:
> at java.net.URL.<init>(Unknown Source)
> at java.net.URL.<init>(Unknown Source)
> at java.net.URL.<init>(Unknown Source)
> at
>sun.plugin.liveconnect.SecureInvocation.checkLiveConnectCaller(Unknown
>Source)
> at sun.plugin.liveconnect.SecureInvocation.access$000(Unknown
>Source)
> at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
>Source)
> at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
>Source)
> at
>sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
>22:00:36.250 [...nk.PiggyBank] Failed to dispose Piggy bank server (0ms)
>java.security.AccessControlException: access denied (java.io.FilePermission
>C:\Documents and Settings\arvind\Application
>Data\Mozilla\Firefox\Profiles\s1knzmiq.Piggybank\piggy-bank\temporary-source
>s\model1133229279109 write)
> at java.security.AccessControlContext.checkPermission(Unknown
>Source)
> at java.security.AccessController.checkPermission(Unknown Source)
> at java.lang.SecurityManager.checkPermission(Unknown Source)
> at java.lang.SecurityManager.checkWrite(Unknown Source)
> at sun.plugin.security.ActivatorSecurityManager.checkDelete(Unknown
>Source)
> at java.io.File.delete(Unknown Source)
> at
>edu.mit.simile.SimileUtilities.deleteDirectory(SimileUtilities.java:320)
> at
>edu.mit.simile.piggyBank.TemporaryProfile.dispose(TemporaryProfile.java:107)
> at
>edu.mit.simile.longwell.LongwellServer.dispose(LongwellServer.java:69)
> at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:450)
> at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> at java.lang.reflect.Method.invoke(Unknown Source)
> at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> at java.lang.reflect.Method.invoke(Unknown Source)
> at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
> at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
>Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
>Source)
> at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
>Source)
> at
>sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
>java.security.PrivilegedActionException:
>java.lang.reflect.InvocationTargetException
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.plugin.liveconnect.SecureInvocation$2.run(Unknown Source)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.plugin.liveconnect.SecureInvocation.CallMethod(Unknown
>Source)
> at sun.plugin.liveconnect.SecureInvocation.access$300(Unknown
>Source)
> at
>sun.plugin.liveconnect.SecureInvocation$CallMethodThread.run(Unknown Source)
>Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> at java.lang.reflect.Method.invoke(Unknown Source)
> at sun.plugin.javascript.invoke.JSInvoke.invoke(Unknown Source)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> at java.lang.reflect.Method.invoke(Unknown Source)
> at sun.plugin.javascript.JSClassLoader.invoke(Unknown Source)
> at sun.plugin.liveconnect.PrivilegedCallMethodAction.run(Unknown
>Source)
> ... 6 more
>Caused by: java.security.AccessControlException: access denied
>(java.lang.RuntimePermission getClassLoader)
> at java.security.AccessControlContext.checkPermission(Unknown
>Source)
> at java.security.AccessController.checkPermission(Unknown Source)
> at java.lang.SecurityManager.checkPermission(Unknown Source)
> at java.lang.Thread.getContextClassLoader(Unknown Source)
> at org.mortbay.http.HttpContext.doStop(HttpContext.java:1779)
> at org.mortbay.util.Container.stop(Container.java:154)
> at org.mortbay.http.HttpContext.stop(HttpContext.java:1758)
> at org.mortbay.http.HttpServer.doStop(HttpServer.java:796)
> at org.mortbay.util.Container.stop(Container.java:154)
> at edu.mit.simile.piggyBank.PiggyBank.dispose(PiggyBank.java:458)
> at edu.mit.simile.piggyBank.PiggyBank.shutdown(PiggyBank.java:233)
> ... 16 more
>
>I don't know what this has, if anything, do with it. These are the
>piggy-bank specific messages I could get off the javascript console (I'm
>only putting piggybank stuff because the console has no easy way to select
>all and copy)
>
>Error: PiggyBank._getCollector(PiggyBank._tabBrowser.selectedBrowser) has no
>properties
>Source File: chrome://piggy-bank/content/scripts/piggybank.js
>Line: 201
>
>Error: PiggyBank._removeCollector(browser) has no properties
>Source File: chrome://piggy-bank/content/scripts/piggybank.js
>Line: 173
>
>(repeat 6 more times)
>
>Error: PiggyBank._getCollector(browser) has no properties
>Source File: chrome://piggy-bank/content/scripts/piggybank.js
>Line: 90
>
>
>-- arvind
>
>
>
>>-----Original Message-----
>>From: David Huynh [mailto:dfhuynh_at_csail.mit.edu]
>>Sent: Wednesday, November 30, 2005 10:01 PM
>>To: general_at_simile.mit.edu
>>Subject: Re: Solvent/piggy-bank weirdness
>>
>>Arvind Venkataramani wrote:
>>
>>
>>
>>>I've set the 'redirect javascript console to stdout' option for
>>>piggybank, so any javascript messages should be in the firefox console
>>>output (if I understand that option right). In any case, I don't
>>>remember seeing any javascript errors before I did that, but if you
>>>like, I can run the scraper again and mail you the javascript output to
>>>
>>>
>you separately...
>
>
>>>-- arvind
>>>
>>>
>>>
>>>
>>Which particular page on citeulike does your scraper have problem with?
>>It seems to be working for me--I haven't gotten the "no typed data found"
>>
>>
>message.
>
>
>>David
>>
>>
>
>
>
Received on Thu Dec 01 2005 - 03:57:00 EST