Version 0.6.9 « OneSwarm Forum

OneSwarm Forum » General

Version 0.6.9

(61 posts) (9 voices)

Started 3 years ago by piatek
Latest reply from isdal

Tags:

No tags yet.

12 3 Next »

piatek
Administrator

We've started issuing developer releases of the next version of OneSwarm. Updates to the community server are also available -- an updated community server is required for file publishing support (But, we aren't allowing arbitrary file publishing at the UW community server.)

* Support for publishing to community servers
* Fixed bug in group management UI
* At first handshake, agree on secret location to publish IP:port (instead of at SHA1(A_pubkey+B_pubkey) )
* SHA1 and ed2k hash search to find swarms containing a specific file
* Added --configure command line option to configure remote access on linux servers without X (Xvfb is still needed)
* More localized strings (not yet complete, however)
* Fixed torrent opening bugs on OSX Snow Leopard
* Fixed bug preventing connections to obfuscated peers for public torrents
* Fixed DHT memory leak for users with many friends
* Reduced memory usage for users with large watch directories
* Fixed watch directory bug preventing hashing of some directories on Windows
* Support for sharing and searching files with 4-byte characters in the names

19 Nov. Updated with more recent change list

Posted 3 years ago #
alpahc
Member

Nice!

I have a question though :
"* SHA1 and ed2k hashes now added to swarms by default"

Does this mean that 1S will able to match downloads and searches even if files/swarms are renamed ? If so, will it be applied as well to the swarms prior to 0.6.9 ?

Posted 3 years ago #
piatek
Administrator

We're about half done with a feature that will allow clients to act as data sources for other swarms even if the exact hashes don't match, so long as individual files are the same. This isn't quite renaming, but will allow cross-swarm sharing so long as files are the same, which (I think) is the problem you're mentioning.

This may be done in time for the final release of 0.6.9, but isn't quite there yet. It depends on per-file hashes being added to new swarms, which is why we're adding them now.

Posted 3 years ago #
alpahc
Member

Great ! I can't wait for that to be done. I struggle to finish so many identical files by deleting stalled swarms whilst keeping the raw data, forcing verification,
then continue downloading on other seemingly same swarms. (Until this one halts as well, in which case I have to start over again.)

Hopefully this little ritual will end... soon. hehe !

Posted 3 years ago #
isdal
Administrator

In the version we just released OneSwarm will notice if you are downloading 2 torrents that contain files with the same sha1 hash. If that happens it will copy data between the torrents so that if a block completes in one of them that block will be completed in both. This way you benefit from downloading multiple different torrents as long as there is file in them that is the same.

We plan to automate this in future releases but I wanted it out there as soon as possible to see if it is useful or not (and to discover bugs).

To search for additional torrents for a file, select the swarm then go to "View swarm details" under the "More actions" menu. In the window that pops up, select the "File Info" tab. Then click the sha1 entry so make a search for all torrents that contain a file with that sha1.

Posted 3 years ago #
alpahc
Member

I can't see the sha1 entry you refer to.

Here is what I have :
http://img694.imageshack.us/img694/451/1ssha.png
Tried to click everywhere. No result.
Window not adjusted, maybe?

Posted 3 years ago #
Happycat
Member

When I try to click on "UW CSE Community Server", Chrome just gives me a red page that says the page was blocked since it contains insecure content. Something similar happens in firefox.

Posted 3 years ago #
isdal
Administrator

alpahc: Currently it only works on torrents that are created by OneSwarm, unfortunately there is no requirement to add sha1 hashes in normal .torrent files so if you get the torrent from other sources they are unlikely to contain any sha1 hashes of individual files.

One way to solve it would be compute the sha1 hash of each file when OneSwarm completes the download, that way the hashes would be available in the network as soon as the first OneSwarm user finishes the file.

Posted 3 years ago #
jolavillette
Member

Hi

Here is an emule link (OpenOffice.org 3.1) :

ed2k://|file|OOo_3.1.0_Win32Intel_install_wJRE_fr.exe|149787648|804E67D2C41E10D4AF75E2CBE4882E20|h=EXQF6OEWQGGNRVROHZFIKWBVCNWGQ7QD|/

After downloading this file with emule I shared it with 1S, and in "File Info" I got the following "ed2k" value :

ed2k;blsq6BIkV78BUOcL8iSnNdBco0Y=

Is there any relation between these 2 "ed2k links" ? How can I convert the emule ed2k link into the 1S e2dk link ? This would allow me to download files on the 1S network using regular ed2k links.

Cheers

Jo

Posted 3 years ago #
blau
Member

* Support for publishing to community servers

How can I access this feature in the UI?

Posted 3 years ago #
jolavillette
Member

Sorry, i made a mistake in my previous post about 1S and emule different ed2k hash.

In the example the correct 1S ed2k value is :
ed2k;gE5n0sQeENSvdeLL5IguIA==

(the value in my previous post was actually the sha1 value)

Posted 3 years ago #
TataYoyo
Member

Still haven't found the corellation between ed2k; and ed2k:
But, you can search for ed2k:804E67D2C41E10D4AF75E2CBE4882E20 in 1S, it works!

Posted 3 years ago #
piatek
Administrator

To publish files, you'll need to be subscribe to a community server that supports it (and have permissions to do so). Then, select the swarms you want to publish and go to the more actions -> publish menu.

Posted 3 years ago #
TataYoyo
Member

piatek, how do you go from ed2k:804E67D2C41E10D4AF75E2CBE4882E20 to ed2k;gE5n0sQeENSvdeLL5IguIA== ? I believed it was base64 but it's not the case (and base 64 would have been 28 bytes long, and it's 24 here). Is it base 96 ?

Posted 3 years ago #
piatek
Administrator

TataYoyo: these are actually the same values when converted to raw bytes. The first is hex, the second is indeed base 64.

Posted 3 years ago #
TataYoyo
Member

I'm buggy ;) You're totally right ! Thanks ;)

Posted 3 years ago #
jolavillette
Member

@ TataYoyo and piatek :
thanks for the answers about 1S and emule ed2k values

Posted 3 years ago #
isdal
Administrator

I changed the ed2k: links that are displayed to use base16 to decrease any confusion. OneSwarm converts it anyway so it is only what is displayed to the user and since ed2k links traditionally are Base16 we might as well stick to that...

Posted 3 years ago #
Rafa
Member

Devs,

Can you give us the structure of the MySQL tables used by the CS 0.7pre ?

Cheers,
Rafa

Oh ! You are doing a fantastic job with Oneswarm ... ;)

Posted 3 years ago #
piatek
Administrator

The SQL for creating the tables is ~140 lines down here: http://bit.ly/pXkY9

Posted 3 years ago #
Rafa
Member

Thanks Piatek.

This is a good reason to wait the next dev build. B)

Posted 3 years ago #
Rafa
Member

Piatek !

In the meantime, I have gnawed nails and the skin under, I begin with the flesh now.
I'll finish by the finger bones in few time ...

Please !! Do not wait too much for launch the CS 0.7pre03 !
Otherwise, I will not be able to report any (false) bug quickly ...

Regards :)

Posted 3 years ago #
piatek
Administrator

I posted the latest build. Let me know of any problems you're experiencing. Thanks!

http://oneswarm.cs.washington.edu/builds/community_server/

Posted 3 years ago #
Rafa
Member

Merci !! :D

Posted 3 years ago #
Rafa
Member

Heya Piatek !

I have tried to install it briefly this morning without success.

Here is are the first trouble found :

1 - If ($db.name) doesn't exist create it ! :)
I needed to create the database with MySQL myself.

2 - Theses errors (if they are ...)

[INFO] 20/11/09 07:54 CommunityDAO: Admin account already exists, skipped creation ...
[WARNING] 20/11/09 07:54 CommunityDAO: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry 'Other' for key 1
& entry 'Video' for key 1
& entry 'Audio' for key 1
& entry 'Pictures' for key 1
& entry 'Documents' for key 1

And espacially this ones :

WARNING] 20/11/09 07:54 CommunityDAO: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry 'Documents' for key 1
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Table 'community_db.registered_keys' doesn't exist

[WARNING] 20/11/09 07:54 CommunityDAO: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
Table 'community_db.registered_keys' doesn't exist
& Table 'community_db.topology' doesn't exist

Maybe some missing table creations somewhere !
I'm looking for ... ("Eh, Google ! WTF ? :)

Regards,
Rafa

[Edit : Config = Linux 2.6.28-11-server #42-Ubuntu SMP i686 GNU/Linux
mysql Ver 14.12 Distrib 5.0.75, for debian-linux-gnu (i486)

Oh ! I get strange FF error when i try to access on the web pages :
Error code : ssl_error_rx_record_too_long ]

Posted 3 years ago #
piatek
Administrator

It sounds like some of the tables were created successfully, but others failed. You might try deleting the DB entirely in MySQL admin, creating it again, and then restarting the server and looking at the output. (The first failure is likely causing the problem)

Also, it may be a MySQL issue with the version you're using. We've tested with 5.0.77 and 5.1.8, although 5.0.75 should be pretty similar.

RE: SSL, are you generating the SSL key with java's keytool, or using some other key?

Posted 3 years ago #
Rafa
Member

Hi Piatek,

I did it !

For MySQL :

- drop database community_db;
- show databases; (empty !)
- create database community_db;

I launch the CSpre03 ans i got *exactly* the same errors.
I just send you an email with the complete log (flood).

I have to say I think that in my first attempt with the pre02 : it seems me the i got many many more table errors? For every orders sent to MySQL in fact ...

And the key (the 'keystore') was simply copied from the CS65R5 folder, not regenerated.

Regards,
Rafa

Posted 3 years ago #
piatek
Administrator

looking at this now, will hopefully resolve shortly...

Posted 3 years ago #
Rafa
Member

I found the the new 0.7pre03-test build. :)

No more MySQL error reported !

But still the same strange error when i try to open the jetty pages : ssl_error_rx_record_too_long ...

I'm verifying my config for the 'CN name', hostname, ...

Posted 3 years ago #
piatek
Administrator

which page are you trying to open? have you changed the configuration file to point to your keystore file (and specified your keystore password?)

Do you get the same error when browsing to https://community.oneswarm.org/ ?

Posted 3 years ago #

RSS feed for this topic

12 3 Next »

Reply »

You must log in to post.