git.mxchange.org Git - hub.git/log

Introduced isUrlStackEmpty() which overwrites the method in BaseSource because
isStackInitialized() does currently not work with file-based stacks.

Used latest 'core'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 19 May 2014 18:04:29 +0000 (20:04 +0200)]

Renamed classes + updated to lastest 'core' commit.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Thu, 15 May 2014 21:05:27 +0000 (23:05 +0200)]

Continued:
- added 'base_path' to stack file name
- updated 'core'
- ignored all stack files

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Thu, 15 May 2014 19:45:28 +0000 (21:45 +0200)]

Continued with crawler:
- added BaseUrlSource class with generic file-based stack initialization.
- added missing configuration entries.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Thu, 15 May 2014 19:19:00 +0000 (21:19 +0200)]

Used scanApplicationClasses() now and fixed core.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Thu, 15 May 2014 19:10:33 +0000 (21:10 +0200)]

Moved BaseIterator class to 'core' project'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Häder [Tue, 13 May 2014 06:44:29 +0000 (08:44 +0200)]

Use fixed core.

Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>

commit | commitdiff | tree

Roland Haeder [Mon, 12 May 2014 20:51:49 +0000 (22:51 +0200)]

Make use of refactured FrameworkDirectoryPointer class.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 12 May 2014 19:21:19 +0000 (21:21 +0200)]

Added crawler stuff:
- Added scanner class/interface and task class.
- Added a scanner class for looking for uploaded lists. They must be located in
  data/url_lists/ .
- Rewritten both factories (scanner, source) to use createObjectByConfiguredName()
  instead of direct createObjectByName(). This allows to set another class if you
  don't like the original implementation.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 12 May 2014 19:20:50 +0000 (21:20 +0200)]

Added/renamed miner classes:
- Added communicator class for miner->node communication. This allows the miner
to claim found blocks and ask the network for more.
- Moved some miner tasks in sub directories

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 11 May 2014 14:01:55 +0000 (16:01 +0200)]

Satisfied Executor interface by adding stub (unfinished method) initExecutor().

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 11 May 2014 12:57:39 +0000 (14:57 +0200)]

Added classes for crawler sources + rewrote 'Source' interface + added more interfaces and many more.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Wed, 7 May 2014 20:18:54 +0000 (22:18 +0200)]

Continued:
- added new tasks for URL sources (I need to split it in separate tasks to maintain a good cycle time).
- removed deprecated files and directories
- added "demo" list for URL list source

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 6 May 2014 19:28:56 +0000 (21:28 +0200)]

Hold your horses, these tasks are running to often.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 6 May 2014 19:26:17 +0000 (21:26 +0200)]

Added more tasks (see wiki: https://wiki.shipsimu.org/doku.php/de/projects/hub/applications/crawler )

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 4 May 2014 12:31:38 +0000 (14:31 +0200)]

Renamed fetcher -> getter + added task for remote-crawl jobs.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 4 May 2014 10:38:33 +0000 (12:38 +0200)]

Added initial crawler stuff:
- Crawler->node communicator classes/interfaces
- Local and remote URL fetcher classes
- The crawler application has now states (currently init, booting, active)
- Also the communicator does now have states (currently init, active)

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sat, 3 May 2014 22:18:26 +0000 (00:18 +0200)]

Continued: ;-)
- deleted deprecated files
- moved 'chains' directory outside 'filter' as filter chains are no filters
- Now use GIT in shell scripts
- updated TODOs.txt

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sat, 3 May 2014 20:13:34 +0000 (22:13 +0200)]

Typos from copy-paste ('chat' was the source) fixed.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sat, 3 May 2014 20:06:16 +0000 (22:06 +0200)]

Added initial files like classes and interface for crawler application.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 28 Apr 2014 17:51:31 +0000 (19:51 +0200)]

Continued on chash.php.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 27 Apr 2014 12:05:52 +0000 (14:05 +0200)]

Added debug lines + commented one noisy out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 27 Apr 2014 11:44:37 +0000 (13:44 +0200)]

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

commit | commitdiff | tree

Roland Haeder [Sun, 27 Apr 2014 11:39:16 +0000 (13:39 +0200)]

Enhanced some log messages + commented one out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 27 Apr 2014 11:39:16 +0000 (13:39 +0200)]

Enchanged some log messages + commented one out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 27 Apr 2014 11:37:11 +0000 (13:37 +0200)]

Commented out noisy debug lines.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 25 Apr 2014 22:59:41 +0000 (00:59 +0200)]

Added code for "Broken pipe" (32).

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 22:05:01 +0000 (00:05 +0200)]

Once per second is fine, else it would possibly overload the local node as the node cannot search so very often.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 22:00:50 +0000 (00:00 +0200)]

Block and WU producers are two different producer classes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 21:07:41 +0000 (23:07 +0200)]

Added unfinished stuff for producing the test "genesis block".

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 20:24:02 +0000 (22:24 +0200)]

Added missing getter/setter for miner instance.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 19:34:15 +0000 (21:34 +0200)]

Fixed copyright to latest year.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 19:33:55 +0000 (21:33 +0200)]

Added initial README entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 19:32:15 +0000 (21:32 +0200)]

Added very basic classes and config entries (duplicated from cruncher sub-project) for "continued hashing miner".

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 31 Mar 2014 18:45:08 +0000 (20:45 +0200)]

Updated 'core' ("continued hashing").

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 28 Mar 2014 20:14:39 +0000 (21:14 +0100)]

Also this assertion was a bit to hard.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 28 Mar 2014 19:25:19 +0000 (20:25 +0100)]

Removed if() block ("cache") + added some debug lines.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Wed, 26 Mar 2014 19:34:29 +0000 (20:34 +0100)]

Some cleanups + created a "late bootstrap" task for DHTs:
- deleted no longer used classes (NodeDhtFooTask are used)
- added class for "late bootstrapping" of DHTs which will be used by all nodes
except 'boot'. This task will be started after the announcement answer came
back from the "upper nodes".

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Wed, 26 Mar 2014 19:10:17 +0000 (20:10 +0100)]

Allow 'init' state for bootstrap nodes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Wed, 26 Mar 2014 18:57:48 +0000 (19:57 +0100)]

Added in last commit missing files.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Wed, 26 Mar 2014 18:47:44 +0000 (19:47 +0100)]

Continued 'hub' project:
- added public method addExtraTasks() to allow node-specific tasks
- such task is 'dht_bootstrap' for bootstrap nodes as they also need (and can)
bootstrap their DHT
- removed .gitattributes (from Subversion->GIT transition)

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 22:12:18 +0000 (23:12 +0100)]

Added logger for raw pending data.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 21:49:50 +0000 (22:49 +0100)]

This assertion cannot work here as a new node has no entry in the DHT (bad copy-paste stuff).

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 21:44:32 +0000 (22:44 +0100)]

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 21:39:07 +0000 (22:39 +0100)]

Continued:
- improved logging messages
- added logger for enableAcceptDhtBootstrap()
- moved this call from 'virigin' state to 'booting' as on 'virigin' state the DHT has
no records registered. This may require reconsidering.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 21:39:07 +0000 (22:39 +0100)]

Continued:
- improved logging messages
- added logger for enableAcceptDhtBootstrap()
- moved this call from 'init' state to 'booting' as on 'init' state the DHT has
no records registered. This may require reconsidering.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 25 Mar 2014 21:28:02 +0000 (22:28 +0100)]

One is enough.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Thu, 20 Mar 2014 20:36:54 +0000 (21:36 +0100)]

Introduced enableAcceptDhtBootstrap() + updated core.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 18 Mar 2014 22:58:49 +0000 (23:58 +0100)]

Renamed method to make it more clear.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Tue, 18 Mar 2014 22:46:41 +0000 (23:46 +0100)]

Continued with DHT stuff:
- added a very generic way to query the local DHT for key/value matches
- used this way to look for DHT nodes accepting bootstrap requests.
- renamed method DhtObjectFactory::createDhtObjectInstance to createDhtInstance
to match with its getter/setter mates.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 22:28:28 +0000 (23:28 +0100)]

Setting the node instance in the handler saves another array element in
$messageArray and makes it a little faster because the "expensive" registry
calls are not used.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 22:08:53 +0000 (23:08 +0100)]

Bad find-replace.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 22:07:24 +0000 (23:07 +0100)]

No 'this' in static methods. ;-)

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 22:05:53 +0000 (23:05 +0100)]

Had to move more code into factory.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 21:49:16 +0000 (22:49 +0100)]

Introduced NodeObjectFactory to encapsulate (and ease) a lot calls.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 20:14:21 +0000 (21:14 +0100)]

Introduced ifDhtIsBooting(), updated TODOs.txt

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 19:56:53 +0000 (20:56 +0100)]

Fixed array element usage

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Mon, 17 Mar 2014 19:39:25 +0000 (20:39 +0100)]

Removed usage of array elements that are never transmitted.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:47:11 +0000 (21:47 +0100)]

Added missing config entry + unfinished class NodeMessageDhtBootstrapAnswerHandler

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:34:22 +0000 (21:34 +0100)]

Should be the correct name.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:30:42 +0000 (21:30 +0100)]

Renamed

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:29:36 +0000 (21:29 +0100)]

Added missing config entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:25:55 +0000 (21:25 +0100)]

No invert here.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Sun, 16 Mar 2014 20:16:24 +0000 (21:16 +0100)]

Fixed parser error.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Sun, 16 Mar 2014 20:16:31 +0000 (21:16 +0100)]

Implemented handleMultipleMessages()

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:59:01 +0000 (00:59 +0100)]

Added unfinished stuff for multiple messages.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:46:03 +0000 (00:46 +0100)]

Fixed exception.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:44:31 +0000 (00:44 +0100)]

Renamed file to match convention.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:42:55 +0000 (00:42 +0100)]

Renamed (fixed some stuff).

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:40:55 +0000 (00:40 +0100)]

Fixed names.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 23:37:06 +0000 (00:37 +0100)]

Renamed path + fixed stacker names + added some missing entries.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 23:21:01 +0000 (00:21 +0100)]

Wrong name for XML node.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:53:52 +0000 (23:53 +0100)]

Reverted, not here.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:52:38 +0000 (23:52 +0100)]

Also this was possibly missing.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:49:23 +0000 (23:49 +0100)]

Added possibly missing entry.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:43:50 +0000 (23:43 +0100)]

Commented in again as this is needed for debugging dht-bootstrap requests.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:15:05 +0000 (23:15 +0100)]

Added missing class for dht_bootstrap_answert "tag" (aka. object type).

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:08:39 +0000 (23:08 +0100)]

Also this was badly named (missed 's')

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:07:22 +0000 (23:07 +0100)]

Fixed name of XML node.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 22:05:47 +0000 (23:05 +0100)]

Added missing XML node 'dht-node-list' + object type 'dht_bootstrap_answer.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 23:18:29 +0000 (00:18 +0100)]

No object type list in DHT bootstraps.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 22:44:07 +0000 (23:44 +0100)]

Opps. :(

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 22:40:02 +0000 (23:40 +0100)]

Nope, wasn't working.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 22:37:27 +0000 (23:37 +0100)]

Renamed methods ...

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 22:34:40 +0000 (23:34 +0100)]

Added check for NULL + renamed XML nodes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 22:00:17 +0000 (23:00 +0100)]

Added again another missing config entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 21:57:22 +0000 (22:57 +0100)]

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 21:57:53 +0000 (22:57 +0100)]

Renamed path 'dht' to 'dht_bootstrap'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 21:50:12 +0000 (22:50 +0100)]

Added missing config entry for template "type" (path + template name).

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 21:48:46 +0000 (22:48 +0100)]

Added missing config entry for stacker. :-)

Signed-off-by: Roland Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 21:44:49 +0000 (22:44 +0100)]

Added missing answer message handler for DHT bootstrap requests.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland 'Quix0r' Haeder [Fri, 14 Mar 2014 21:39:05 +0000 (22:39 +0100)]

Added missing config entry.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

commit | commitdiff | tree

Roland Haeder [Fri, 14 Mar 2014 21:35:29 +0000 (22:35 +0100)]

Added support for visiting package assembler which will e.g. clear pending data on shut down stockets or handle multiple messages.

Signed-off-by: Roland Haeder <roland@mxchange.org>