]>
git.mxchange.org Git - quix0rs-apt-p2p.git/log
Cameron Dale [Mon, 7 Jan 2008 02:55:31 +0000 (18:55 -0800)]
Added caching of downloaded files to the MirrorManager.
Also made the MirrorManager work with full URLs (http://...).
Also added some log messages to the HTTPDownloader.
Cameron Dale [Fri, 4 Jan 2008 02:58:53 +0000 (18:58 -0800)]
Lots of log messages and blocked non-local access to server.
Remote peers can still access the shared files, but not make
requests that result in lookups or see the stats.
Also fixed a bug in the main findHash routines.
Also changed to use splitHostPort rather than manual splitting.
Cameron Dale [Fri, 4 Jan 2008 01:43:14 +0000 (17:43 -0800)]
Made the DHT bootstrapping use IPs instead of DNS names.
Also added some logging messages.
Also fixed a problem that caused the application to be loaded twice.
Cameron Dale [Fri, 4 Jan 2008 00:01:38 +0000 (16:01 -0800)]
Move all url parsing into the PeerManager.
Also added a lookupHash_done function to the main code.
Cameron Dale [Thu, 3 Jan 2008 23:51:22 +0000 (15:51 -0800)]
Fixed some minor bugs.
Cameron Dale [Thu, 3 Jan 2008 02:06:46 +0000 (18:06 -0800)]
Made the get and storeValue DHT functions work.
Also added tests for them.
Had to modify the callback from khashmir's get and storeValue functions
to include the key, and the key and value, respectively so multiple
calls can be tracked.
Cameron Dale [Wed, 2 Jan 2008 21:52:59 +0000 (13:52 -0800)]
Updated the DHT join and leave to check if a join is in progress.
Cameron Dale [Wed, 2 Jan 2008 21:45:40 +0000 (13:45 -0800)]
Made the DHT join method work and added tests for it.
Cameron Dale [Wed, 2 Jan 2008 19:48:37 +0000 (11:48 -0800)]
Added a shutdown method to the khasmir DHT.
Cameron [Mon, 24 Dec 2007 22:42:08 +0000 (14:42 -0800)]
Add timeouts to some unittests.
Cameron [Mon, 24 Dec 2007 22:37:01 +0000 (14:37 -0800)]
Fixed 2 broken AptPackages unittests.
Cameron Dale [Fri, 21 Dec 2007 03:52:43 +0000 (19:52 -0800)]
Disable the deprecation warning for the khashmir tests.
Need to rewrite the khashmir main functions to use Deferreds
or something.
Cameron Dale [Fri, 21 Dec 2007 03:43:25 +0000 (19:43 -0800)]
Change all unittests to use twisted's trial.
Merge separate "test_*.py" files into their modules.
Cameron Dale [Fri, 21 Dec 2007 01:54:53 +0000 (17:54 -0800)]
Modify khashmir's config system to not use the const module.
Configuration variables are all passed in as a dictionary where needed.
The NULL_ID config option has been made a constant.
The ConfigParser now stores all keys as upper case.
Cameron Dale [Wed, 19 Dec 2007 21:48:25 +0000 (13:48 -0800)]
Add more to khashmir's DHT implementation.
Still needs a massive rewrite for loading config values properly.
Cameron [Wed, 19 Dec 2007 00:24:57 +0000 (16:24 -0800)]
Add a MirrorError exception.
Fixes the deprecated use of calling errback with a string.
Cameron [Wed, 19 Dec 2007 00:17:17 +0000 (16:17 -0800)]
Update all tests to add the deferred as both errback and callback.
Cameron [Wed, 19 Dec 2007 00:06:32 +0000 (16:06 -0800)]
Fix the MirrorManager tests to be dist-agnostic too.
Cameron [Wed, 19 Dec 2007 00:01:06 +0000 (16:01 -0800)]
Fix some broken AptPackages tests.
Cameron [Tue, 18 Dec 2007 23:39:44 +0000 (15:39 -0800)]
Made the AptPackages tests dist-agnostic so it works with Ubuntu.
Cameron Dale [Mon, 17 Dec 2007 02:41:27 +0000 (18:41 -0800)]
Added the new DHT interface and a bare implmentation of it.
Cameron Dale [Mon, 17 Dec 2007 02:39:43 +0000 (18:39 -0800)]
Added the DHT starting to the application.
Cameron Dale [Sun, 16 Dec 2007 21:19:50 +0000 (13:19 -0800)]
Removed the old .cvsignore from khashmir.
Cameron Dale [Sun, 16 Dec 2007 09:09:41 +0000 (01:09 -0800)]
Add some of the fetching logic.
Cameron Dale [Sun, 16 Dec 2007 04:02:15 +0000 (20:02 -0800)]
Fix up the application to work with then new structure.
Cameron Dale [Sun, 16 Dec 2007 03:53:41 +0000 (19:53 -0800)]
Moved the files to appropriate package directories.
Cameron Dale [Sun, 16 Dec 2007 03:32:31 +0000 (19:32 -0800)]
Make it also work from the command-line.
Cameron Dale [Sun, 16 Dec 2007 03:27:41 +0000 (19:27 -0800)]
Added the application control files.
Cameron Dale [Sun, 16 Dec 2007 03:24:01 +0000 (19:24 -0800)]
Add proper version numbers to the user-agent string.
Cameron Dale [Sun, 16 Dec 2007 03:12:02 +0000 (19:12 -0800)]
Added a manager to the HTTPServer for it to call when a file is not found.
Cameron Dale [Sat, 15 Dec 2007 22:30:37 +0000 (14:30 -0800)]
Moved the HTTPDownloader to the new PeerManager.
Cameron Dale [Sat, 15 Dec 2007 03:58:20 +0000 (19:58 -0800)]
Added a mirror manager frontend for the AptPackages.
Cameron Dale [Sat, 15 Dec 2007 02:43:09 +0000 (18:43 -0800)]
Clean up the imports again.
Cameron Dale [Sat, 15 Dec 2007 02:37:19 +0000 (18:37 -0800)]
AptPackages only takes a single cache directory.
Also changed the path specific to use os.path.
Cameron Dale [Sat, 15 Dec 2007 00:02:42 +0000 (16:02 -0800)]
Moved the index file tracking inside the AptPackages _load method.
Cameron Dale [Fri, 14 Dec 2007 23:53:54 +0000 (15:53 -0800)]
Cleanup AptPackages code.
Cleanup and order the imports.
Remove unnnecessary parts.
Add comments and docstrings.
Cameron Dale [Fri, 14 Dec 2007 23:26:06 +0000 (15:26 -0800)]
Implemented cache loading with threads and deferreds.
Fixed the stdout redirection to work with threads.
Added individual findHash tests and one large multipleFindHash test.
Cameron Dale [Fri, 14 Dec 2007 07:56:39 +0000 (23:56 -0800)]
Add a findHash function to AptPackages that searches everywhere for a hash.
Also added a test for it.
Cameron Dale [Fri, 14 Dec 2007 06:43:44 +0000 (22:43 -0800)]
Add tracking of index file hashes from Release files.
Also added test for this.
Cameron Dale [Fri, 14 Dec 2007 02:57:23 +0000 (18:57 -0800)]
Added support for source package hashes to AptPackages.
Also added a test for it.
Cameron Dale [Fri, 14 Dec 2007 02:19:17 +0000 (18:19 -0800)]
Fix the architecture problem in the AptPackages config system.
Cameron Dale [Fri, 14 Dec 2007 01:45:33 +0000 (17:45 -0800)]
Added a unittest to make sure AptPackages gets the right SHA1 hash.
Cameron Dale [Fri, 14 Dec 2007 00:59:16 +0000 (16:59 -0800)]
Remove the apt-proxy specific stuff from AptPackages.
Cameron Dale [Thu, 13 Dec 2007 23:27:04 +0000 (15:27 -0800)]
Switched AptPackages to use twisted's logging facility
Cameron Dale [Thu, 13 Dec 2007 08:16:36 +0000 (00:16 -0800)]
Remove some apt-proxy specific stuff.
Cameron Dale [Thu, 13 Dec 2007 02:50:26 +0000 (18:50 -0800)]
Added the packages.py file (as AptPackages.py) from apt-proxy.
Cameron Dale [Thu, 13 Dec 2007 02:21:29 +0000 (18:21 -0800)]
Added new HTTPServer that serves static files.
Cameron Dale [Wed, 12 Dec 2007 22:03:13 +0000 (14:03 -0800)]
Update the downloader to set the headers itself and add a getRange function.
Cameron Dale [Wed, 12 Dec 2007 21:31:57 +0000 (13:31 -0800)]
Read the response in the unit tests to prevent RST packets.
Cameron Dale [Wed, 12 Dec 2007 07:08:43 +0000 (23:08 -0800)]
Add a manager for the client downloads and the tests for it.
Cameron Dale [Wed, 12 Dec 2007 06:16:15 +0000 (22:16 -0800)]
Get it working and add trial unit testing.
Lots of changes that make it work now.
Also added twisted-style unit tests to be run with
the trial program.
Cameron Dale [Tue, 11 Dec 2007 07:27:18 +0000 (23:27 -0800)]
Add a unittest to the HTTPDownloader.
Cameron Dale [Mon, 10 Dec 2007 07:20:59 +0000 (23:20 -0800)]
First attempt (untested) at new HTTP downloader.
Cameron Dale [Mon, 10 Dec 2007 06:06:58 +0000 (22:06 -0800)]
Fixed a bug in test that called hash instead of khash.
Cameron Dale [Sun, 9 Dec 2007 20:39:47 +0000 (12:39 -0800)]
Fix a callLater bug introduced in commit
6075497a .
switched to callLater from callFromThread but forgot to
include the delay of 0.
Cameron Dale [Sun, 9 Dec 2007 04:52:45 +0000 (20:52 -0800)]
Clean up all the imports.
Cameron Dale [Sun, 9 Dec 2007 04:07:57 +0000 (20:07 -0800)]
Switch from the entropy definition to using os.urandom.
Cameron Dale [Sun, 9 Dec 2007 04:00:03 +0000 (20:00 -0800)]
Fix some errors found by PyLint.
Cameron Dale [Sun, 9 Dec 2007 03:18:03 +0000 (19:18 -0800)]
Remove the obsolete whrandom module and use random instead.
Cameron Dale [Sun, 9 Dec 2007 03:16:02 +0000 (19:16 -0800)]
Removed all unused threading.
Cameron Dale [Sun, 9 Dec 2007 03:01:22 +0000 (19:01 -0800)]
Ignore the pyc and eclipse project files.
Cameron Dale [Sun, 9 Dec 2007 02:41:48 +0000 (18:41 -0800)]
Remove all the airhook stuff.
burris [Sun, 11 Jul 2004 08:57:54 +0000 (08:57 +0000)]
added a simple tcp over airhook proxy, not fully tested
cleaned up airhook a bit
burris [Thu, 8 Jul 2004 04:02:59 +0000 (04:02 +0000)]
broke up khashmir class into base, read, and write classes, since
having generic read/write methods on deployed DHTs is not a great idea
actions now take an "action" method, since it's not always
"storeValueForKey"
buckets now get refreshed
nodes that change their ID are now handled properly
burris [Tue, 15 Jun 2004 16:57:05 +0000 (16:57 +0000)]
now if you provide a list to storeValueForKey it will use the krpc
method "store_values" to store multiple values under the same key in
one swoop
burris [Mon, 14 Jun 2004 05:01:25 +0000 (05:01 +0000)]
this is a script for setting up a lot of khashmir nodes at once
burris [Mon, 14 Jun 2004 04:53:26 +0000 (04:53 +0000)]
only send the ID along in khashmir messages, don't send the host and
port, get that from the socket instead
burris [Mon, 14 Jun 2004 02:32:02 +0000 (02:32 +0000)]
always use the socket's idea of host and port
burris [Mon, 14 Jun 2004 00:21:57 +0000 (00:21 +0000)]
major cleanup, updated for twisted
not using airhook, it's buggy now KRPC over single UDP packets
values can't be too big, around 1400 bytes
khashmir test code is now more sane though it doesn't do much more
than build a couple of tables and fetch some values
myers_carpenter [Thu, 13 Mar 2003 02:08:02 +0000 (02:08 +0000)]
* removing hack to allow threading
myers_carpenter [Sun, 9 Mar 2003 16:33:02 +0000 (16:33 +0000)]
* adding setup.py, and __init__.py to make this installable package.
* Adding some links to README.txt, updating about depenancies, and formating fixes
* Removing out of date script for debian
burris [Sun, 23 Feb 2003 00:11:04 +0000 (00:11 +0000)]
handle late err messages
burris [Sat, 22 Feb 2003 07:05:49 +0000 (07:05 +0000)]
added license information
burris [Sat, 22 Feb 2003 06:55:43 +0000 (06:55 +0000)]
*** empty log message ***
burris [Thu, 30 Jan 2003 04:42:00 +0000 (04:42 +0000)]
callbacks now return a dict now that has the _krpc_sender connection information
fixed connection resets in airhook, resets are propogated to the protocol via resetConnection()
burris [Thu, 30 Jan 2003 04:38:46 +0000 (04:38 +0000)]
fix bug where we fail to return any values we have stored locally
fixed test script to wait for store to finish before trying to find
grab port from airhook connection info
burris [Wed, 22 Jan 2003 07:22:48 +0000 (07:22 +0000)]
check responses and fail if they don't come from the peer we were
expecting them to come from
added bencode.py, whoops
burris [Mon, 20 Jan 2003 04:22:35 +0000 (04:22 +0000)]
fixed reset connection handling
burris [Thu, 16 Jan 2003 16:28:42 +0000 (16:28 +0000)]
ripped out xmlrpc, experimented with xmlrpc but with bencode, finally
settled on bencode rpc over Airhook
burris [Mon, 13 Jan 2003 07:08:01 +0000 (07:08 +0000)]
twistified airhook, added reactor based tests
burris [Mon, 23 Dec 2002 03:19:57 +0000 (03:19 +0000)]
renamed OrderedConnection to StreamConnection
burris [Mon, 23 Dec 2002 02:59:11 +0000 (02:59 +0000)]
bug fixes, more tests, looking solid now
burris [Sun, 22 Dec 2002 11:02:32 +0000 (11:02 +0000)]
stream connection class
burris [Sun, 22 Dec 2002 08:40:59 +0000 (08:40 +0000)]
airhook reliable datagram protocol
burris [Tue, 10 Dec 2002 04:29:09 +0000 (04:29 +0000)]
reformatting plus changed some method names, added a new function for "testing"
aaronsw [Mon, 9 Dec 2002 22:57:50 +0000 (22:57 +0000)]
general cleanup, added testing makefle
burris [Tue, 3 Dec 2002 03:49:58 +0000 (03:49 +0000)]
now we store and retrieve node information from our database...
burris [Tue, 3 Dec 2002 03:49:26 +0000 (03:49 +0000)]
add invalidateNode
burris [Sun, 1 Dec 2002 22:56:40 +0000 (22:56 +0000)]
slight changes to test scripts
burris [Sun, 1 Dec 2002 22:54:35 +0000 (22:54 +0000)]
tab/space fix
burris [Sun, 1 Dec 2002 21:08:01 +0000 (21:08 +0000)]
fixed borked tab/space problems, damn ProjectBuilder doesn't come with reasonable defaults
stopped using "int" for ivars since that conflicts with a builtin, now
use node.num for getting the integer representation of a node's ID
burris [Sun, 1 Dec 2002 21:06:08 +0000 (21:06 +0000)]
utility module for random stuff
has func for counting min/max/average peers in table for a list of
khashmir instances
aaronsw [Thu, 28 Nov 2002 20:36:51 +0000 (20:36 +0000)]
removing unused btemplate.py
aaronsw [Thu, 28 Nov 2002 19:44:30 +0000 (19:44 +0000)]
oops, another buglet
aaronsw [Thu, 28 Nov 2002 19:37:46 +0000 (19:37 +0000)]
fixed buglet
aaronsw [Thu, 28 Nov 2002 19:34:43 +0000 (19:34 +0000)]
general cleanup. test_replace_stale_node doesn't pass but it didn't before either
aaronsw [Thu, 28 Nov 2002 18:00:24 +0000 (18:00 +0000)]
oops, forgot to test. fixed little bugs
aaronsw [Thu, 28 Nov 2002 17:58:30 +0000 (17:58 +0000)]
general cleanup: tabs->spaces, comments->docstrings, etc. should whrandom become random?
burris [Thu, 28 Nov 2002 01:15:58 +0000 (01:15 +0000)]
use autocommit
burris [Thu, 28 Nov 2002 01:15:44 +0000 (01:15 +0000)]
quiet down the factory