quix0rs-apt-p2p.git
16 years agoAdded a mirror manager frontend for the AptPackages.
Cameron Dale [Sat, 15 Dec 2007 03:58:20 +0000 (19:58 -0800)]
Added a mirror manager frontend for the AptPackages.

16 years agoClean up the imports again.
Cameron Dale [Sat, 15 Dec 2007 02:43:09 +0000 (18:43 -0800)]
Clean up the imports again.

16 years agoAptPackages only takes a single cache directory.
Cameron Dale [Sat, 15 Dec 2007 02:37:19 +0000 (18:37 -0800)]
AptPackages only takes a single cache directory.

Also changed the path specific to use os.path.

16 years agoMoved the index file tracking inside the AptPackages _load method.
Cameron Dale [Sat, 15 Dec 2007 00:02:42 +0000 (16:02 -0800)]
Moved the index file tracking inside the AptPackages _load method.

16 years agoCleanup AptPackages code.
Cameron Dale [Fri, 14 Dec 2007 23:53:54 +0000 (15:53 -0800)]
Cleanup AptPackages code.

Cleanup and order the imports.
Remove unnnecessary parts.
Add comments and docstrings.

16 years agoImplemented cache loading with threads and deferreds.
Cameron Dale [Fri, 14 Dec 2007 23:26:06 +0000 (15:26 -0800)]
Implemented cache loading with threads and deferreds.

Fixed the stdout redirection to work with threads.
Added individual findHash tests and one large multipleFindHash test.

16 years agoAdd a findHash function to AptPackages that searches everywhere for a hash.
Cameron Dale [Fri, 14 Dec 2007 07:56:39 +0000 (23:56 -0800)]
Add a findHash function to AptPackages that searches everywhere for a hash.

Also added a test for it.

16 years agoAdd tracking of index file hashes from Release files.
Cameron Dale [Fri, 14 Dec 2007 06:43:44 +0000 (22:43 -0800)]
Add tracking of index file hashes from Release files.

Also added test for this.

16 years agoAdded support for source package hashes to AptPackages.
Cameron Dale [Fri, 14 Dec 2007 02:57:23 +0000 (18:57 -0800)]
Added support for source package hashes to AptPackages.

Also added a test for it.

16 years agoFix the architecture problem in the AptPackages config system.
Cameron Dale [Fri, 14 Dec 2007 02:19:17 +0000 (18:19 -0800)]
Fix the architecture problem in the AptPackages config system.

16 years agoAdded a unittest to make sure AptPackages gets the right SHA1 hash.
Cameron Dale [Fri, 14 Dec 2007 01:45:33 +0000 (17:45 -0800)]
Added a unittest to make sure AptPackages gets the right SHA1 hash.

16 years agoRemove the apt-proxy specific stuff from AptPackages.
Cameron Dale [Fri, 14 Dec 2007 00:59:16 +0000 (16:59 -0800)]
Remove the apt-proxy specific stuff from AptPackages.

16 years agoSwitched AptPackages to use twisted's logging facility
Cameron Dale [Thu, 13 Dec 2007 23:27:04 +0000 (15:27 -0800)]
Switched AptPackages to use twisted's logging facility

16 years agoRemove some apt-proxy specific stuff.
Cameron Dale [Thu, 13 Dec 2007 08:16:36 +0000 (00:16 -0800)]
Remove some apt-proxy specific stuff.

16 years agoAdded the packages.py file (as AptPackages.py) from apt-proxy.
Cameron Dale [Thu, 13 Dec 2007 02:50:26 +0000 (18:50 -0800)]
Added the packages.py file (as AptPackages.py) from apt-proxy.

16 years agoAdded new HTTPServer that serves static files.
Cameron Dale [Thu, 13 Dec 2007 02:21:29 +0000 (18:21 -0800)]
Added new HTTPServer that serves static files.

16 years agoUpdate the downloader to set the headers itself and add a getRange function.
Cameron Dale [Wed, 12 Dec 2007 22:03:13 +0000 (14:03 -0800)]
Update the downloader to set the headers itself and add a getRange function.

16 years agoRead the response in the unit tests to prevent RST packets.
Cameron Dale [Wed, 12 Dec 2007 21:31:57 +0000 (13:31 -0800)]
Read the response in the unit tests to prevent RST packets.

16 years agoAdd a manager for the client downloads and the tests for it.
Cameron Dale [Wed, 12 Dec 2007 07:08:43 +0000 (23:08 -0800)]
Add a manager for the client downloads and the tests for it.

16 years agoGet it working and add trial unit testing.
Cameron Dale [Wed, 12 Dec 2007 06:16:15 +0000 (22:16 -0800)]
Get it working and add trial unit testing.

Lots of changes that make it work now.

Also added twisted-style unit tests to be run with
the trial program.

16 years agoAdd a unittest to the HTTPDownloader.
Cameron Dale [Tue, 11 Dec 2007 07:27:18 +0000 (23:27 -0800)]
Add a unittest to the HTTPDownloader.

16 years agoFirst attempt (untested) at new HTTP downloader.
Cameron Dale [Mon, 10 Dec 2007 07:20:59 +0000 (23:20 -0800)]
First attempt (untested) at new HTTP downloader.

16 years agoFixed a bug in test that called hash instead of khash.
Cameron Dale [Mon, 10 Dec 2007 06:06:58 +0000 (22:06 -0800)]
Fixed a bug in test that called hash instead of khash.

16 years agoFix a callLater bug introduced in commit 6075497a.
Cameron Dale [Sun, 9 Dec 2007 20:39:47 +0000 (12:39 -0800)]
Fix a callLater bug introduced in commit 6075497a.

switched to callLater from callFromThread but forgot to
include the delay of 0.

16 years agoClean up all the imports.
Cameron Dale [Sun, 9 Dec 2007 04:52:45 +0000 (20:52 -0800)]
Clean up all the imports.

16 years agoSwitch from the entropy definition to using os.urandom.
Cameron Dale [Sun, 9 Dec 2007 04:07:57 +0000 (20:07 -0800)]
Switch from the entropy definition to using os.urandom.

16 years agoFix some errors found by PyLint.
Cameron Dale [Sun, 9 Dec 2007 04:00:03 +0000 (20:00 -0800)]
Fix some errors found by PyLint.

16 years agoRemove the obsolete whrandom module and use random instead.
Cameron Dale [Sun, 9 Dec 2007 03:18:03 +0000 (19:18 -0800)]
Remove the obsolete whrandom module and use random instead.

16 years agoRemoved all unused threading.
Cameron Dale [Sun, 9 Dec 2007 03:16:02 +0000 (19:16 -0800)]
Removed all unused threading.

16 years agoIgnore the pyc and eclipse project files.
Cameron Dale [Sun, 9 Dec 2007 03:01:22 +0000 (19:01 -0800)]
Ignore the pyc and eclipse project files.

16 years agoRemove all the airhook stuff.
Cameron Dale [Sun, 9 Dec 2007 02:41:48 +0000 (18:41 -0800)]
Remove all the airhook stuff.

19 years agoadded a simple tcp over airhook proxy, not fully tested
burris [Sun, 11 Jul 2004 08:57:54 +0000 (08:57 +0000)]
added a simple tcp over airhook proxy, not fully tested

cleaned up airhook a bit

19 years agobroke up khashmir class into base, read, and write classes, since
burris [Thu, 8 Jul 2004 04:02:59 +0000 (04:02 +0000)]
broke up khashmir class into base, read, and write classes, since
having generic read/write methods on deployed DHTs is not a great idea

actions now take an "action" method, since it's not always
"storeValueForKey"

buckets now get refreshed

nodes that change their ID are now handled properly

19 years agonow if you provide a list to storeValueForKey it will use the krpc
burris [Tue, 15 Jun 2004 16:57:05 +0000 (16:57 +0000)]
now if you provide a list to storeValueForKey it will use the krpc
method "store_values" to store multiple values under the same key in
one swoop

19 years agothis is a script for setting up a lot of khashmir nodes at once
burris [Mon, 14 Jun 2004 05:01:25 +0000 (05:01 +0000)]
this is a script for setting up a lot of khashmir nodes at once

19 years agoonly send the ID along in khashmir messages, don't send the host and
burris [Mon, 14 Jun 2004 04:53:26 +0000 (04:53 +0000)]
only send the ID along in khashmir messages, don't send the host and
port, get that from the socket instead

19 years agoalways use the socket's idea of host and port
burris [Mon, 14 Jun 2004 02:32:02 +0000 (02:32 +0000)]
always use the socket's idea of host and port

19 years agomajor cleanup, updated for twisted
burris [Mon, 14 Jun 2004 00:21:57 +0000 (00:21 +0000)]
major cleanup, updated for twisted

not using airhook, it's buggy   now KRPC over single UDP packets
values can't be too big, around 1400 bytes

khashmir test code is now more sane though it doesn't do much more
than build a couple of tables and fetch some values

21 years ago * removing hack to allow threading
myers_carpenter [Thu, 13 Mar 2003 02:08:02 +0000 (02:08 +0000)]
 * removing hack to allow threading

21 years ago * adding setup.py, and __init__.py to make this installable package.
myers_carpenter [Sun, 9 Mar 2003 16:33:02 +0000 (16:33 +0000)]
 * adding setup.py, and __init__.py to make this installable package.
 * Adding some links to README.txt, updating about depenancies, and formating fixes
 * Removing out of date script for debian

21 years agohandle late err messages
burris [Sun, 23 Feb 2003 00:11:04 +0000 (00:11 +0000)]
handle late err messages

21 years agoadded license information
burris [Sat, 22 Feb 2003 07:05:49 +0000 (07:05 +0000)]
added license information

21 years ago*** empty log message ***
burris [Sat, 22 Feb 2003 06:55:43 +0000 (06:55 +0000)]
*** empty log message ***

21 years agocallbacks now return a dict now that has the _krpc_sender connection information
burris [Thu, 30 Jan 2003 04:42:00 +0000 (04:42 +0000)]
callbacks now return a dict now that has the _krpc_sender connection information

fixed connection resets in airhook, resets are propogated to the protocol via resetConnection()

21 years agofix bug where we fail to return any values we have stored locally
burris [Thu, 30 Jan 2003 04:38:46 +0000 (04:38 +0000)]
fix bug where we fail to return any values we have stored locally

fixed test script to wait for store to finish before trying to find

grab port from airhook connection info

21 years agocheck responses and fail if they don't come from the peer we were
burris [Wed, 22 Jan 2003 07:22:48 +0000 (07:22 +0000)]
check responses and fail if they don't come from the peer we were
expecting them to come from

added bencode.py, whoops

21 years agofixed reset connection handling
burris [Mon, 20 Jan 2003 04:22:35 +0000 (04:22 +0000)]
fixed reset connection handling

21 years agoripped out xmlrpc, experimented with xmlrpc but with bencode, finally
burris [Thu, 16 Jan 2003 16:28:42 +0000 (16:28 +0000)]
ripped out xmlrpc, experimented with xmlrpc but with bencode, finally
settled on bencode rpc over Airhook

21 years agotwistified airhook, added reactor based tests
burris [Mon, 13 Jan 2003 07:08:01 +0000 (07:08 +0000)]
twistified airhook, added reactor based tests

21 years agorenamed OrderedConnection to StreamConnection
burris [Mon, 23 Dec 2002 03:19:57 +0000 (03:19 +0000)]
renamed OrderedConnection to StreamConnection

21 years agobug fixes, more tests, looking solid now
burris [Mon, 23 Dec 2002 02:59:11 +0000 (02:59 +0000)]
bug fixes, more tests, looking solid now

21 years agostream connection class
burris [Sun, 22 Dec 2002 11:02:32 +0000 (11:02 +0000)]
stream connection class

21 years agoairhook reliable datagram protocol
burris [Sun, 22 Dec 2002 08:40:59 +0000 (08:40 +0000)]
airhook reliable datagram protocol

21 years agoreformatting plus changed some method names, added a new function for "testing"
burris [Tue, 10 Dec 2002 04:29:09 +0000 (04:29 +0000)]
reformatting plus changed some method names, added a new function for "testing"

21 years agogeneral cleanup, added testing makefle
aaronsw [Mon, 9 Dec 2002 22:57:50 +0000 (22:57 +0000)]
general cleanup, added testing makefle

21 years agonow we store and retrieve node information from our database...
burris [Tue, 3 Dec 2002 03:49:58 +0000 (03:49 +0000)]
now we store and retrieve node information from our database...

21 years agoadd invalidateNode
burris [Tue, 3 Dec 2002 03:49:26 +0000 (03:49 +0000)]
add invalidateNode

21 years agoslight changes to test scripts
burris [Sun, 1 Dec 2002 22:56:40 +0000 (22:56 +0000)]
slight changes to test scripts

21 years agotab/space fix
burris [Sun, 1 Dec 2002 22:54:35 +0000 (22:54 +0000)]
tab/space fix

21 years agofixed borked tab/space problems, damn ProjectBuilder doesn't come with reasonable...
burris [Sun, 1 Dec 2002 21:08:01 +0000 (21:08 +0000)]
fixed borked tab/space problems, damn ProjectBuilder doesn't come with reasonable defaults

stopped using "int" for ivars since that conflicts with a builtin, now
use node.num for getting the integer representation of a node's ID

21 years agoutility module for random stuff
burris [Sun, 1 Dec 2002 21:06:08 +0000 (21:06 +0000)]
utility module for random stuff

has func for counting min/max/average peers in table for a list of
khashmir instances

21 years agoremoving unused btemplate.py
aaronsw [Thu, 28 Nov 2002 20:36:51 +0000 (20:36 +0000)]
removing unused btemplate.py

21 years agooops, another buglet
aaronsw [Thu, 28 Nov 2002 19:44:30 +0000 (19:44 +0000)]
oops, another buglet

21 years agofixed buglet
aaronsw [Thu, 28 Nov 2002 19:37:46 +0000 (19:37 +0000)]
fixed buglet

21 years agogeneral cleanup. test_replace_stale_node doesn't pass but it didn't before either
aaronsw [Thu, 28 Nov 2002 19:34:43 +0000 (19:34 +0000)]
general cleanup. test_replace_stale_node doesn't pass but it didn't before either

21 years agooops, forgot to test. fixed little bugs
aaronsw [Thu, 28 Nov 2002 18:00:24 +0000 (18:00 +0000)]
oops, forgot to test. fixed little bugs

21 years agogeneral cleanup: tabs->spaces, comments->docstrings, etc. should whrandom become...
aaronsw [Thu, 28 Nov 2002 17:58:30 +0000 (17:58 +0000)]
general cleanup: tabs->spaces, comments->docstrings, etc. should whrandom become random?

21 years agouse autocommit
burris [Thu, 28 Nov 2002 01:15:58 +0000 (01:15 +0000)]
use autocommit

21 years agoquiet down the factory
burris [Thu, 28 Nov 2002 01:15:44 +0000 (01:15 +0000)]
quiet down the factory

21 years agofix bug in setting duplicate kv
burris [Thu, 28 Nov 2002 01:13:08 +0000 (01:13 +0000)]
fix bug in setting duplicate kv

21 years agocanonicalize time for accurate sorting
burris [Mon, 14 Oct 2002 06:11:15 +0000 (06:11 +0000)]
canonicalize time for accurate sorting

21 years agoremoved bsddb3 depenendcy
burris [Mon, 14 Oct 2002 05:36:51 +0000 (05:36 +0000)]
removed bsddb3 depenendcy

21 years agoremoved h(k+v) field from database, wasn't necessary
burris [Mon, 14 Oct 2002 04:30:23 +0000 (04:30 +0000)]
removed h(k+v) field from database, wasn't necessary

21 years agochanged from bsddb3 to pysqlite
burris [Mon, 14 Oct 2002 03:53:01 +0000 (03:53 +0000)]
changed from bsddb3 to pysqlite

21 years agomo' constants
burris [Tue, 1 Oct 2002 05:11:03 +0000 (05:11 +0000)]
mo' constants

21 years agoall rpc's return ([<args>], {<sender}), previously ping did not
burris [Tue, 1 Oct 2002 05:10:09 +0000 (05:10 +0000)]
all rpc's return ([<args>], {<sender}), previously ping did not
un hard-coded some constants

21 years agoautomatically check responses to make sure it's from the node
burris [Tue, 1 Oct 2002 05:07:14 +0000 (05:07 +0000)]
automatically check responses to make sure it's from the node
we are expecting it to be from, else errback

21 years agono longer keep our own node in table
burris [Tue, 1 Oct 2002 05:05:28 +0000 (05:05 +0000)]
no longer keep our own node in table

21 years agoupdate key expirer to use bencode - store access should be abstracted
burris [Tue, 24 Sep 2002 23:34:52 +0000 (23:34 +0000)]
update key expirer to use bencode - store access should be abstracted

21 years agoadded a short script with instructions on how to install on debian
aaronsw [Tue, 24 Sep 2002 01:40:50 +0000 (01:40 +0000)]
added a short script with instructions on how to install on debian

21 years agofix missing arg in storevalue errback
burris [Tue, 24 Sep 2002 01:37:46 +0000 (01:37 +0000)]
fix missing arg in storevalue errback

21 years agofix bugs in stringify
burris [Mon, 23 Sep 2002 23:43:43 +0000 (23:43 +0000)]
fix bugs in stringify

21 years agofix typo
burris [Mon, 23 Sep 2002 23:12:56 +0000 (23:12 +0000)]
fix typo

21 years agofix peer update problem connection refused in store value
burris [Mon, 23 Sep 2002 23:09:35 +0000 (23:09 +0000)]
fix peer update problem connection refused in store value

21 years agoremoved client side connection host determination
burris [Mon, 23 Sep 2002 23:04:49 +0000 (23:04 +0000)]
removed client side connection host determination

21 years agofix missing arg conversion
burris [Mon, 23 Sep 2002 22:20:34 +0000 (22:20 +0000)]
fix missing arg conversion

21 years agofix refreshTable
burris [Mon, 23 Sep 2002 22:12:17 +0000 (22:12 +0000)]
fix refreshTable

21 years agominor fixes
burris [Mon, 23 Sep 2002 22:11:16 +0000 (22:11 +0000)]
minor fixes

21 years agograb the remote end's IP address
burris [Mon, 23 Sep 2002 22:09:52 +0000 (22:09 +0000)]
grab the remote end's IP address

21 years agodon't touch buckets when we are only reading from them
burris [Mon, 23 Sep 2002 22:08:40 +0000 (22:08 +0000)]
don't touch buckets when we are only reading from them

21 years agomore constants
burris [Mon, 23 Sep 2002 22:07:51 +0000 (22:07 +0000)]
more constants

21 years agobencode is back, for marshalling before going into the database - pickle module has...
burris [Mon, 23 Sep 2002 22:07:28 +0000 (22:07 +0000)]
bencode is back, for marshalling before going into the database - pickle module has security issues

21 years agomuch better method of converting between hashes<>integers
burris [Mon, 23 Sep 2002 22:06:41 +0000 (22:06 +0000)]
much better method of converting between hashes<>integers

21 years agofix bug where less than K nodes were being utilized from the seed nodes of find nodes...
burris [Sun, 22 Sep 2002 07:38:55 +0000 (07:38 +0000)]
fix bug where less than K nodes were being utilized from the seed nodes of find nodes/values requests

21 years agoreturn K nodes and not K-1
burris [Sun, 22 Sep 2002 07:07:06 +0000 (07:07 +0000)]
return K nodes and not K-1

21 years agobetter readme
burris [Sat, 21 Sep 2002 20:43:40 +0000 (20:43 +0000)]
better readme

21 years agomuch better handling of ip addresses and potentially unreachable peers
burris [Sat, 21 Sep 2002 20:43:20 +0000 (20:43 +0000)]
much better handling of ip addresses and potentially unreachable peers

21 years agomoved some constants
burris [Sat, 21 Sep 2002 20:42:18 +0000 (20:42 +0000)]
moved some constants

21 years agofixed some serious bugs in findNode
burris [Sat, 21 Sep 2002 20:41:25 +0000 (20:41 +0000)]
fixed some serious bugs in findNode

also, change behaviour of insertNode based on if we have a confirmed contact or not

21 years agoadd some default bogus values in __init__
burris [Sat, 21 Sep 2002 20:39:14 +0000 (20:39 +0000)]
add some default bogus values in __init__