]> git.mxchange.org Git - quix0rs-apt-p2p.git/log
quix0rs-apt-p2p.git
16 years agoFinal version of abstract.
Cameron Dale [Mon, 30 Jun 2008 20:33:21 +0000 (13:33 -0700)]
Final version of abstract.

16 years agoUpdated the abstract to the ACM class.
Cameron Dale [Tue, 24 Jun 2008 20:21:48 +0000 (13:21 -0700)]
Updated the abstract to the ACM class.

16 years agoMore WIP on the poster.
Cameron Dale [Mon, 23 Jun 2008 22:43:20 +0000 (15:43 -0700)]
More WIP on the poster.

16 years agoWork in progress before changing to landscape.
Cameron Dale [Mon, 23 Jun 2008 19:39:01 +0000 (12:39 -0700)]
Work in progress before changing to landscape.

16 years agoAdded work on poster for SIGCOMM '08.
Cameron Dale [Mon, 23 Jun 2008 16:28:15 +0000 (09:28 -0700)]
Added work on poster for SIGCOMM '08.

16 years agoMake sure bad nodes don't get added to the routing table.
Cameron Dale [Sun, 22 Jun 2008 06:55:36 +0000 (23:55 -0700)]
Make sure bad nodes don't get added to the routing table.

16 years agoNew changelog entry and version update for relase.
Cameron Dale [Sun, 22 Jun 2008 06:31:48 +0000 (23:31 -0700)]
New changelog entry and version update for relase.

16 years agoAdd a logrotate file that should work with the twistd log rotation.
Cameron Dale [Sun, 22 Jun 2008 06:25:06 +0000 (23:25 -0700)]
Add a logrotate file that should work with the twistd log rotation.

16 years agoPrevent BitTorrent nodes from infiltrating the DHT.
Cameron Dale [Sat, 21 Jun 2008 19:59:43 +0000 (12:59 -0700)]
Prevent BitTorrent nodes from infiltrating the DHT.

16 years agoConsume ping errors so they aren't printed in the log.
Cameron Dale [Sat, 21 Jun 2008 19:59:21 +0000 (12:59 -0700)]
Consume ping errors so they aren't printed in the log.

16 years agoFinal version of SigCom travel grant application.
Cameron Dale [Mon, 16 Jun 2008 21:08:48 +0000 (14:08 -0700)]
Final version of SigCom travel grant application.

16 years agoNew changelog entry and version update for release.
Cameron Dale [Mon, 16 Jun 2008 06:23:48 +0000 (23:23 -0700)]
New changelog entry and version update for release.

16 years agoUse the version number in the Khashmir node ID.
Cameron Dale [Sun, 15 Jun 2008 01:12:26 +0000 (18:12 -0700)]
Use the version number in the Khashmir node ID.

16 years agoAllow the setting of khashmir ID's suffix.
Cameron Dale [Sat, 14 Jun 2008 23:24:21 +0000 (16:24 -0700)]
Allow the setting of khashmir ID's suffix.

16 years agoAdd $remote_fs dependency in init.d LSB header (Closes: #480645)
Cameron Dale [Sat, 14 Jun 2008 22:27:22 +0000 (15:27 -0700)]
Add $remote_fs dependency in init.d LSB header (Closes: #480645)

16 years agoAdd the travel grant submission.
Cameron Dale [Tue, 20 May 2008 00:03:04 +0000 (17:03 -0700)]
Add the travel grant submission.

16 years agoRemove the unneeded misc depends variable.
Cameron Dale [Sat, 10 May 2008 07:00:20 +0000 (00:00 -0700)]
Remove the unneeded misc depends variable.

16 years agoAlways return the result at the end of a callback function.
Cameron Dale [Sat, 10 May 2008 06:58:32 +0000 (23:58 -0700)]
Always return the result at the end of a callback function.

16 years agoNew changelog entry and versions for next release.
Cameron Dale [Sat, 10 May 2008 06:53:05 +0000 (23:53 -0700)]
New changelog entry and versions for next release.

16 years agoSchedule a re-ping message after adding a new node.
Cameron Dale [Sat, 10 May 2008 05:19:42 +0000 (22:19 -0700)]
Schedule a re-ping message after adding a new node.

Also fixed a typo in the new nodeFailed function.

16 years agoMake nodes hashable so they can be used in dictionaries.
Cameron Dale [Sat, 10 May 2008 04:06:37 +0000 (21:06 -0700)]
Make nodes hashable so they can be used in dictionaries.

16 years agoAdd a NEWS entry for port forwarding.
Cameron Dale [Sat, 10 May 2008 01:48:18 +0000 (18:48 -0700)]
Add a NEWS entry for port forwarding.

16 years agoRevert "Add debconf to inform the user of the necessity of port forwarding."
Cameron Dale [Sat, 10 May 2008 01:37:01 +0000 (18:37 -0700)]
Revert "Add debconf to inform the user of the necessity of port forwarding."

This reverts commit 61fd574b4497f00fc69cc4523f5bf478fb3ca9c5.

Conflicts:

debian/control

16 years agoFix a typo bug in the Krpc error messages.
Cameron Dale [Sat, 10 May 2008 01:33:24 +0000 (18:33 -0700)]
Fix a typo bug in the Krpc error messages.

16 years agoRevert "Fix a postrm bug due to debconf generating errors if the apt-p2p user is...
Cameron Dale [Sat, 10 May 2008 01:32:21 +0000 (18:32 -0700)]
Revert "Fix a postrm bug due to debconf generating errors if the apt-p2p user is missing."

This reverts commit 6573b9d12bf656557a584c6c1a469ba2e66ca2b9.

16 years agoWhen a node fails, schedule a future ping to check again.
Cameron Dale [Sat, 10 May 2008 00:18:20 +0000 (17:18 -0700)]
When a node fails, schedule a future ping to check again.

Should help to eliminate bad nodes faster.
To facilitate, added a sendPing() to Khashmir.
insertNode now uses sendPing() rather than it's own routines.
Pinging is now stateful, so that multiple pings are not sent simultaneously.

16 years agoOnly touch a bucket if a find request targets it.
Cameron Dale [Fri, 9 May 2008 22:56:20 +0000 (15:56 -0700)]
Only touch a bucket if a find request targets it.

Should prevent quiet nodes from keeping old contacts in the buckets.

16 years agoIncrease the stored value redundancy to 6.
Cameron Dale [Fri, 9 May 2008 22:19:51 +0000 (15:19 -0700)]
Increase the stored value redundancy to 6.

16 years agoIncrease the concurrency of DHT requests to 8.
Cameron Dale [Fri, 9 May 2008 22:16:46 +0000 (15:16 -0700)]
Increase the concurrency of DHT requests to 8.

16 years agoSet a new peer's ranking values so they don't get an unfair advantage.
Cameron Dale [Fri, 9 May 2008 21:51:09 +0000 (14:51 -0700)]
Set a new peer's ranking values so they don't get an unfair advantage.

16 years agoTests for some more HTTP connection errors.
Cameron Dale [Fri, 9 May 2008 21:41:36 +0000 (14:41 -0700)]
Tests for some more HTTP connection errors.

16 years agoSet the HTTP connection timeout to 10s, and add a test for it.
Cameron Dale [Fri, 9 May 2008 21:35:43 +0000 (14:35 -0700)]
Set the HTTP connection timeout to 10s, and add a test for it.

16 years agoBetter error logging for store_value token errors.
Cameron Dale [Fri, 9 May 2008 02:34:31 +0000 (19:34 -0700)]
Better error logging for store_value token errors.

16 years agoNew TODO for better total number of nodes calculation.
Cameron Dale [Fri, 9 May 2008 02:18:17 +0000 (19:18 -0700)]
New TODO for better total number of nodes calculation.

16 years agoTolerate a limited number of errors from peers before dropping them.
Cameron Dale [Fri, 9 May 2008 02:02:38 +0000 (19:02 -0700)]
Tolerate a limited number of errors from peers before dropping them.

16 years agoPeerManager keeps a list of site names, peers are kept in a dictionary.
Cameron Dale [Fri, 9 May 2008 00:28:07 +0000 (17:28 -0700)]
PeerManager keeps a list of site names, peers are kept in a dictionary.

16 years agoSpeed up the recursive DHT actions when timeouts occur.
Cameron Dale [Thu, 8 May 2008 22:24:34 +0000 (15:24 -0700)]
Speed up the recursive DHT actions when timeouts occur.

If the action proceeds too far beyond a node, ignore it and move on.
If the closest K nodes have all responded, abort early.

16 years agoMove the bucket manipulation into the KBucket class.
Cameron Dale [Thu, 8 May 2008 21:04:57 +0000 (14:04 -0700)]
Move the bucket manipulation into the KBucket class.

16 years agoFix a traceback generating bug in the refreshing of DHT entries.
Cameron Dale [Wed, 7 May 2008 07:10:38 +0000 (00:10 -0700)]
Fix a traceback generating bug in the refreshing of DHT entries.

Also change the DB's expiredHashes to return a sorted list.

16 years agoNew TODO item for rotating DNS entries.
Cameron Dale [Mon, 5 May 2008 06:43:18 +0000 (23:43 -0700)]
New TODO item for rotating DNS entries.

16 years agoUpdate versions and changelog for new release.
Cameron Dale [Mon, 5 May 2008 06:18:40 +0000 (23:18 -0700)]
Update versions and changelog for new release.

16 years agoFixed a bug in the HTTP downloader that caused errors with some mirrors that always...
Cameron Dale [Sun, 4 May 2008 21:16:25 +0000 (14:16 -0700)]
Fixed a bug in the HTTP downloader that caused errors with some mirrors that always close the connections.

16 years agoMake sure full timeouts occur even if a resend timeout has not.
Cameron Dale [Sat, 3 May 2008 18:14:57 +0000 (11:14 -0700)]
Make sure full timeouts occur even if a resend timeout has not.

16 years agoUpdate the version numbers and changelog for new release.
Cameron Dale [Sat, 3 May 2008 17:27:35 +0000 (10:27 -0700)]
Update the version numbers and changelog for new release.

16 years agoLower the timeout to 9 sec to reduce delays.
Cameron Dale [Sat, 3 May 2008 17:21:38 +0000 (10:21 -0700)]
Lower the timeout to 9 sec to reduce delays.

16 years agoFinal abstract for submission.
Cameron Dale [Fri, 2 May 2008 21:15:18 +0000 (14:15 -0700)]
Final abstract for submission.

16 years agoFix the broken local IP regexes.
Cameron Dale [Thu, 1 May 2008 20:04:46 +0000 (13:04 -0700)]
Fix the broken local IP regexes.

16 years agoMassive update to most of the abstract.
Cameron Dale [Thu, 1 May 2008 02:31:53 +0000 (19:31 -0700)]
Massive update to most of the abstract.

16 years agoDon't log KRPC errors for receiving an invalid store_value token.
Cameron Dale [Tue, 29 Apr 2008 17:16:50 +0000 (10:16 -0700)]
Don't log KRPC errors for receiving an invalid store_value token.

16 years agoCreate the Kile project for the SIGCOMM poster abstract.
Cameron Dale [Tue, 29 Apr 2008 00:46:22 +0000 (17:46 -0700)]
Create the Kile project for the SIGCOMM poster abstract.

16 years agoOnly add nodes to the routing table that have responded to a request.
Cameron Dale [Tue, 29 Apr 2008 00:44:45 +0000 (17:44 -0700)]
Only add nodes to the routing table that have responded to a request.

If they haven't, ping them before adding them.
Still ping the old node first to see if it's stale.
Move the temporary functions for ping/join to be module functions.

16 years agoDon't try and add ourself to the routing table during an action.
Cameron Dale [Tue, 29 Apr 2008 00:36:30 +0000 (17:36 -0700)]
Don't try and add ourself to the routing table during an action.

16 years agoDon't add local IP addresses to the routing table (with config option to override).
Cameron Dale [Mon, 28 Apr 2008 23:28:06 +0000 (16:28 -0700)]
Don't add local IP addresses to the routing table (with config option to override).

16 years agoNew TODO for hashing files with detached GPG signatures.
Cameron Dale [Mon, 28 Apr 2008 22:08:35 +0000 (15:08 -0700)]
New TODO for hashing files with detached GPG signatures.

16 years agoFix: no files were added to the DHT due to missing hashing results.
Cameron Dale [Sat, 26 Apr 2008 17:01:08 +0000 (10:01 -0700)]
Fix: no files were added to the DHT due to missing hashing results.

16 years agoFix a postrm bug due to debconf generating errors if the apt-p2p user is missing.
Cameron Dale [Sat, 26 Apr 2008 03:10:23 +0000 (20:10 -0700)]
Fix a postrm bug due to debconf generating errors if the apt-p2p user is missing.

16 years agoClean up the copyrights mentioned in the code.
Cameron Dale [Sat, 26 Apr 2008 02:38:39 +0000 (19:38 -0700)]
Clean up the copyrights mentioned in the code.

16 years agoRemove the changelog parsing from setup.py and just hardcode the version.
Cameron Dale [Sat, 26 Apr 2008 01:57:05 +0000 (18:57 -0700)]
Remove the changelog parsing from setup.py and just hardcode the version.

16 years agoFix some documentation errors.
Cameron Dale [Sat, 26 Apr 2008 01:50:42 +0000 (18:50 -0700)]
Fix some documentation errors.

16 years agoUpdate the version number and changelog for the initial release.
Cameron Dale [Sat, 26 Apr 2008 01:25:19 +0000 (18:25 -0700)]
Update the version number and changelog for the initial release.

16 years agoClean up the language in the description and man pages.
Cameron Dale [Sat, 26 Apr 2008 01:24:50 +0000 (18:24 -0700)]
Clean up the language in the description and man pages.

Also tightened the dependency on Twisted to 8.0.

16 years agoUpdate the config file for the change in default key expiry length.
Cameron Dale [Sat, 26 Apr 2008 01:23:12 +0000 (18:23 -0700)]
Update the config file for the change in default key expiry length.

16 years agoAdd an optimization to the HTTP client protocol so that pieplining begins sooner.
Cameron Dale [Fri, 25 Apr 2008 21:43:14 +0000 (14:43 -0700)]
Add an optimization to the HTTP client protocol so that pieplining begins sooner.

Specifically, it begins after the first requests headers are sent, instead of the whole response.

16 years agoDon't use the fallback mirror retry download.
Cameron Dale [Fri, 25 Apr 2008 05:20:43 +0000 (22:20 -0700)]
Don't use the fallback mirror retry download.

Until we can distinuish real errors from apt-get closing the
connection, this is not a good idea. See the connectionLost()
function of the web2.http.Request object for a possible solution.

16 years agoMore fixes for the broken twisted HTTP client.
Cameron Dale [Fri, 25 Apr 2008 05:18:58 +0000 (22:18 -0700)]
More fixes for the broken twisted HTTP client.

16 years agoMove all streams to new Streams module and replace ProxyFileStream with GrowingFileSt...
Cameron Dale [Fri, 25 Apr 2008 05:18:29 +0000 (22:18 -0700)]
Move all streams to new Streams module and replace ProxyFileStream with GrowingFileStream.

Instead of ProxyFileStream, now use a combination of GrowingFileStream
and StreamToFile like the PeerManager does to download and upload. It's
mostly working, only some errors when aborting apt-get in test 'a'.

Also added a new test 'c' for downloading out of order, which is why
ProxyFileStream can not be used.

16 years agoAdd a final retry of all errback mirror downloads.
Cameron Dale [Thu, 24 Apr 2008 23:19:09 +0000 (16:19 -0700)]
Add a final retry of all errback mirror downloads.

16 years agoFix some errors in the new twisted HTTP client's connectionLost() methods.
Cameron Dale [Thu, 24 Apr 2008 23:17:54 +0000 (16:17 -0700)]
Fix some errors in the new twisted HTTP client's connectionLost() methods.

See http://twistedmatrix.com/trac/ticket/3207 for more info.

16 years agoAdd debconf to inform the user of the necessity of port forwarding.
Cameron Dale [Thu, 24 Apr 2008 19:05:03 +0000 (12:05 -0700)]
Add debconf to inform the user of the necessity of port forwarding.

16 years agoMove the DHT stuff out of the main program and into the new DHTManager module.
Cameron Dale [Thu, 24 Apr 2008 18:15:58 +0000 (11:15 -0700)]
Move the DHT stuff out of the main program and into the new DHTManager module.

16 years agoBetter handling and logging for intermittent HTTP client submission errors.
Cameron Dale [Thu, 24 Apr 2008 16:54:31 +0000 (09:54 -0700)]
Better handling and logging for intermittent HTTP client submission errors.

16 years agoDon't add attributes to HTTP requests, store them separately.
Cameron Dale [Thu, 24 Apr 2008 16:33:34 +0000 (09:33 -0700)]
Don't add attributes to HTTP requests, store them separately.

16 years agoHTTP client no longer keeps a response queue of requests.
Cameron Dale [Thu, 24 Apr 2008 05:02:43 +0000 (22:02 -0700)]
HTTP client no longer keeps a response queue of requests.

Instead the requests are added as variables to the call/errbacks.
There is a new variable keeping track of how many responses are outstanding.
clientGone no longer remove/errback responses, as the errbacks will be
called by the client protocol instead.

16 years agoFix a typo in commit 80399176ed66d.
Cameron Dale [Thu, 24 Apr 2008 04:41:38 +0000 (21:41 -0700)]
Fix a typo in commit 80399176ed66d.

16 years agoFixed an error in downloading source packages from peers.
Cameron Dale [Thu, 24 Apr 2008 03:52:11 +0000 (20:52 -0700)]
Fixed an error in downloading source packages from peers.

Source packages with no pieces were hash checked with sha1, which would fail.
Also added a test for source packages.
Also removed some unneeded logging in the peer downloader.

16 years agoFix a typo in commit e82e704e27.
Cameron Dale [Thu, 24 Apr 2008 03:50:06 +0000 (20:50 -0700)]
Fix a typo in commit e82e704e27.

16 years agoSet the Last-Modified header when downloading from peers.
Cameron Dale [Wed, 23 Apr 2008 23:12:29 +0000 (16:12 -0700)]
Set the Last-Modified header when downloading from peers.

16 years agoRemove temporary files from the peer's download cache.
Cameron Dale [Wed, 23 Apr 2008 22:50:14 +0000 (15:50 -0700)]
Remove temporary files from the peer's download cache.

16 years agoRefresh expired DHT hashes concurrently instead of sequentially.
Cameron Dale [Wed, 23 Apr 2008 22:30:39 +0000 (15:30 -0700)]
Refresh expired DHT hashes concurrently instead of sequentially.

16 years agoDon't check file when listing expired hashes, instead check files at startup.
Cameron Dale [Wed, 23 Apr 2008 21:31:03 +0000 (14:31 -0700)]
Don't check file when listing expired hashes, instead check files at startup.

16 years agoTrap KRPC errors in writing to the transport and wait for timeout instead.
Cameron Dale [Wed, 23 Apr 2008 03:16:21 +0000 (20:16 -0700)]
Trap KRPC errors in writing to the transport and wait for timeout instead.

16 years agoDisconnect the insertNode calls from the callers so errors don't affect them.
Cameron Dale [Wed, 23 Apr 2008 02:10:21 +0000 (19:10 -0700)]
Disconnect the insertNode calls from the callers so errors don't affect them.

16 years agoRemove some unnecessary calls to log.err and just print the error message instead.
Cameron Dale [Mon, 21 Apr 2008 21:15:14 +0000 (14:15 -0700)]
Remove some unnecessary calls to log.err and just print the error message instead.

16 years agoFix a bug in loading the new KRPC timeout config params.
Cameron Dale [Mon, 21 Apr 2008 20:08:13 +0000 (13:08 -0700)]
Fix a bug in loading the new KRPC timeout config params.

16 years agoMake the DHT timeouts configuration parameters.
Cameron Dale [Mon, 21 Apr 2008 19:41:24 +0000 (12:41 -0700)]
Make the DHT timeouts configuration parameters.

16 years agoConf time parser works with floats, and lengthened DHT hash expiry to 3 hours.
Cameron Dale [Mon, 21 Apr 2008 19:05:56 +0000 (12:05 -0700)]
Conf time parser works with floats, and lengthened DHT hash expiry to 3 hours.

16 years agoFix an error in the actions that allowed for the result to be sent twice.
Cameron Dale [Mon, 21 Apr 2008 18:54:05 +0000 (11:54 -0700)]
Fix an error in the actions that allowed for the result to be sent twice.

16 years agoSome more TODO items.
Cameron Dale [Mon, 21 Apr 2008 05:55:40 +0000 (22:55 -0700)]
Some more TODO items.

16 years agoApt packages cache now saves an unload request received during loading.
Cameron Dale [Mon, 21 Apr 2008 05:09:34 +0000 (22:09 -0700)]
Apt packages cache now saves an unload request received during loading.

16 years agoSync the AptPackages db after modification, and close when done.
Cameron Dale [Mon, 21 Apr 2008 02:47:31 +0000 (19:47 -0700)]
Sync the AptPackages db after modification, and close when done.

16 years agoAdd all files to the DB with their hashes.
Cameron Dale [Mon, 21 Apr 2008 02:42:31 +0000 (19:42 -0700)]
Add all files to the DB with their hashes.

Non-DHT files are marked as such.
HTTP server looks up the cache path to decide whether to return a file.

16 years agoFix an HTTP download bug that caused HEAD requests to not pipeline.
Cameron Dale [Mon, 21 Apr 2008 02:39:33 +0000 (19:39 -0700)]
Fix an HTTP download bug that caused HEAD requests to not pipeline.

Also improve the testing for this.

16 years agoReorder the main application to find cached hashes before checking freshness.
Cameron Dale [Sat, 19 Apr 2008 18:39:24 +0000 (11:39 -0700)]
Reorder the main application to find cached hashes before checking freshness.

Eliminates some unnecessary HEAD requests to the server.
HEAD requests are only done if there is no hash for the file.

16 years agoAdd a new test and improve the cleaning of apt files.
Cameron Dale [Sat, 19 Apr 2008 17:48:47 +0000 (10:48 -0700)]
Add a new test and improve the cleaning of apt files.

16 years agoDHT stats now include completed actions and various elapsed times for actions.
Cameron Dale [Fri, 18 Apr 2008 21:03:26 +0000 (14:03 -0700)]
DHT stats now include completed actions and various elapsed times for actions.

16 years agoReturn 404's for hashes that aren't found.
Cameron Dale [Fri, 18 Apr 2008 05:13:17 +0000 (22:13 -0700)]
Return 404's for hashes that aren't found.

16 years agoRemove some unnecessary log messages and use better Exceptions.
Cameron Dale [Fri, 18 Apr 2008 02:14:05 +0000 (19:14 -0700)]
Remove some unnecessary log messages and use better Exceptions.

16 years agoCache returns errors if apt closes the connection and deletes the incomplete files.
Cameron Dale [Fri, 18 Apr 2008 02:05:45 +0000 (19:05 -0700)]
Cache returns errors if apt closes the connection and deletes the incomplete files.

16 years agoRemove some headers Apt sets before returning full requests from the server.
Cameron Dale [Fri, 18 Apr 2008 01:15:35 +0000 (18:15 -0700)]
Remove some headers Apt sets before returning full requests from the server.

Otherwise the streaming will be interrupted or changed by Twisted's
modification of responses before sending (e.g. sending 304's based
on 'If-Modified-Since' and 'Last-Modified' headers). The streaming
is currently needed though to load the file in the cache.

16 years agoBetter identification of peer uploads by the HTTP server.
Cameron Dale [Fri, 18 Apr 2008 01:12:54 +0000 (18:12 -0700)]
Better identification of peer uploads by the HTTP server.