OneSwarm Forum

User forum for the OneSwarm Friend-to-Friend data sharing network

1. unique-username
   Member

   Wow, oneswarm is one of the few p2p programs that doesnt die with 100% cpu
   usage when I feed it with my 416 GB data in 58000 files that I wanna share
   with the world. HOWEVER, I have noticed that firefox will use ALL memory
   and die the swap death after a night when it displayed "Hashing.... 0% ..
   100%" thing. If possible, try so oneswarm doesnt use up all the memory. In
   the morning FF used 2.6 GB (I have 3 GB) memory and the box had a load of
   55. Had to login remotely and kill firefox.

   The other thing is I noticed is that it dies after about 2000 hashed files
   with "java.lang.OutOfMemoryError: Java heap space". When I rised java
   memory with -Xmx512m. It worked alot longer... but it died also.
   In the end I used -Xmx1536m but it also died after a day or so. But it was
   quite long time. It took over a WEEK to hash 58k files! Now its done, it
   become 52700 torrents of it. I use -Xmx512m now because I have better use
   of the memory then letting oneswarm get so much memory. What needs to be
   fixed:

   * Not use so much memory, something that can hash ALL files should be
   default, so if -Xmx512m can hash unlimited amount of files, that should
   be default and not -Xmx256m like it is now.

   * Doesnt crash after a while when hashing files.

   My sysinfo: oneswarm 0.6, firefox-3.0.10, linux 2.6, java version 1.6.0_13

   Posted 4 years ago #

2. unique-username
   Member

   shit, i cant even start oneswarm with 512M ram;

   Exception in thread "Magic directory scanner" java.lang.OutOfMemoryError: Java heap space
   at java.lang.reflect.Array.newArray(Native Method)
   at java.lang.reflect.Array.newInstance(Unknown Source)
   at java.util.Arrays.copyOf(Unknown Source)
   at java.util.ArrayList.toArray(Unknown Source)
   at java.util.Collections$SynchronizedCollection.toArray(Unknown Source)
   at edu.washington.cs.oneswarm.watchdir.MagicDecider.excluded(MagicDecider.java:285)
   at edu.washington.cs.oneswarm.watchdir.MagicDecider.decideTorrents(MagicDecider.java:113)
   at edu.washington.cs.oneswarm.watchdir.MagicDecider.decideTorrents(MagicDecider.java:168)
   at edu.washington.cs.oneswarm.watchdir.MagicDecider.decideTorrents(MagicDecider.java:168)
   at edu.washington.cs.oneswarm.watchdir.MagicDecider.decideTorrents(MagicDecider.java:168)
   at edu.washington.cs.oneswarm.watchdir.MagicDirectoryManager.process_additions(MagicDirectoryManager.java:505)
   at edu.washington.cs.oneswarm.watchdir.MagicDirectoryManager.run(MagicDirectoryManager.java:329)

   I guess I have to try 1024m.

   Posted 4 years ago #

3. DanyaelX
   Member

   have you tried not to add everything at once?
   and have you tried to tell it to add and then while it is hashing shut down FireFox?

   That worked for me

   Posted 4 years ago #

4. kkr
   Member

   I confirm the hashing process is leaking a lot, especially with the web interface open. How much memory is consumed just by starting oneswarm (not starting hashing)?

   Posted 4 years ago #

5. bachenke
   Member

   I have the same problem. Debug log tells me java.lang.OutOfMemoryError: Java heap space

   How do i actually use the "-Xmx512m" command? Could you perhaps provide a tutorial for Java n00bs?

   Thanks

   Posted 4 years ago #

6. kkr
   Member

   Just change the executable script (the one you run called oneswarm). It's down in the end of the file on the row where java is called. The maximum heap size tells java how big heap it's allowed and how often garbage collect (freeing no longer used memory) is performed will depend on this.

   Do you have problems also when not hashing? (that is, only starting oneswarm fills the memory)

   Posted 4 years ago #

7. bachenke
   Member

   Thank you for your quick reply.

   I have to tell you though... I can't really find the "executable script". What is the file called and where is it located? If you could tell me that i will probably be able to figure the rest out for myself :)

   I can't say that i've experienced any problems when not hashing, but I'm still not even close to hashing all of my ~1200GB so who knows? I might experience the same thing as you when i'm done.

   Thanks again

   Posted 4 years ago #

8. unique-username
   Member

   DanyaelX: Later I didnt show http://127.0.0.1:29615/ so FF didnt use all my mem.
   bachenke: find file "OneSwarm". edit it. at the bottom you see it. you are allowed to think.
   on my system its /usr/local/OneSwarm/OneSwarm on yours its maybe in c:\i\have\no\clue\OneSwarm\OneSwarm. See part about allowed to think above.

   Posted 4 years ago #

RSS feed for this topic

Reply

You must log in to post.