Introduced isUrlStackEmpty() which overwrites the method in BaseSource because
isStackInitialized() does currently not work with file-based stacks.

Used latest 'core'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed classes + updated to lastest 'core' commit.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued:
- added 'base_path' to stack file name
- updated 'core'
- ignored all stack files

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued with crawler:
- added BaseUrlSource class with generic file-based stack initialization.
- added missing configuration entries.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Used scanApplicationClasses() now and fixed core.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Moved BaseIterator class to 'core' project'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Use fixed core.

Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>

Make use of refactured FrameworkDirectoryPointer class.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added crawler stuff:
- Added scanner class/interface and task class.
- Added a scanner class for looking for uploaded lists. They must be located in
  data/url_lists/ .
- Rewritten both factories (scanner, source) to use createObjectByConfiguredName()
  instead of direct createObjectByName(). This allows to set another class if you
  don't like the original implementation.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added/renamed miner classes:
- Added communicator class for miner->node communication. This allows the miner
  to claim found blocks and ask the network for more.
- Moved some miner tasks in sub directories

Signed-off-by: Roland Haeder <roland@mxchange.org>

Satisfied Executor interface by adding stub (unfinished method) initExecutor().

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added classes for crawler sources + rewrote 'Source' interface + added more interfaces and many more.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued:
- added new tasks for URL sources (I need to split it in separate tasks to maintain a good cycle time).
- removed deprecated files and directories
- added "demo" list for URL list source

Signed-off-by: Roland Haeder <roland@mxchange.org>

Hold your horses, these tasks are running to often.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added more tasks (see wiki: https://wiki.shipsimu.org/doku.php/de/projects/hub/applications/crawler )

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed fetcher -> getter + added task for remote-crawl jobs.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added initial crawler stuff:
- Crawler->node communicator classes/interfaces
- Local and remote URL fetcher classes
- The crawler application has now states (currently init, booting, active)
- Also the communicator does now have states (currently init, active)

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued: ;-)
- deleted deprecated files
- moved 'chains' directory outside 'filter' as filter chains are no filters
- Now use GIT in shell scripts
- updated TODOs.txt

Signed-off-by: Roland Haeder <roland@mxchange.org>

Typos from copy-paste ('chat' was the source) fixed.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added initial files like classes and interface for crawler application.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued on chash.php.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added debug lines + commented one noisy out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

Enhanced some log messages + commented one out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Enchanged some log messages + commented one out.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Commented out noisy debug lines.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added code for "Broken pipe" (32).

Signed-off-by: Roland Haeder <roland@mxchange.org>

Once per second is fine, else it would possibly overload the local node as the node cannot search so very often.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Block and WU producers are two different producer classes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added unfinished stuff for producing the test "genesis block".

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added missing getter/setter for miner instance.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Fixed copyright to latest year.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added initial README entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added very basic classes and config entries (duplicated from cruncher sub-project) for "continued hashing miner".

Signed-off-by: Roland Haeder <roland@mxchange.org>

Updated 'core' ("continued hashing").

Signed-off-by: Roland Haeder <roland@mxchange.org>

Also this assertion was a bit to hard.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Removed if() block ("cache") + added some debug lines.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Some cleanups + created a "late bootstrap" task for DHTs:
- deleted no longer used classes (NodeDhtFooTask are used)
- added class for "late bootstrapping" of DHTs which will be used by all nodes
  except 'boot'. This task will be started after the announcement answer came
  back from the "upper nodes".

Signed-off-by: Roland Haeder <roland@mxchange.org>

Allow 'init' state for bootstrap nodes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added in last commit missing files.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued 'hub' project:
- added public method addExtraTasks() to allow node-specific tasks
- such task is 'dht_bootstrap' for bootstrap nodes as they also need (and can)
  bootstrap their DHT
- removed .gitattributes (from Subversion->GIT transition)

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added logger for raw pending data.

Signed-off-by: Roland Haeder <roland@mxchange.org>

This assertion cannot work here as a new node has no entry in the DHT (bad copy-paste stuff).

Signed-off-by: Roland Haeder <roland@mxchange.org>

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

Continued:
- improved logging messages
- added logger for enableAcceptDhtBootstrap()
- moved this call from 'virigin' state to 'booting' as on 'virigin' state the DHT has
  no records registered. This may require reconsidering.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued:
- improved logging messages
- added logger for enableAcceptDhtBootstrap()
- moved this call from 'init' state to 'booting' as on 'init' state the DHT has
  no records registered. This may require reconsidering.

Signed-off-by: Roland Haeder <roland@mxchange.org>

One is enough.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Introduced enableAcceptDhtBootstrap() + updated core.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed method to make it more clear.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Continued with DHT stuff:
- added a very generic way to query the local DHT for key/value matches
- used this way to look for DHT nodes accepting bootstrap requests.
- renamed method DhtObjectFactory::createDhtObjectInstance to createDhtInstance
  to match with its getter/setter mates.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Setting the node instance in the handler saves another array element in
$messageArray and makes it a little faster because the "expensive" registry
calls are not used.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Bad find-replace.

Signed-off-by: Roland Haeder <roland@mxchange.org>

No 'this' in static methods. ;-)

Signed-off-by: Roland Haeder <roland@mxchange.org>

Had to move more code into factory.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Introduced NodeObjectFactory to encapsulate (and ease) a lot calls.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Introduced ifDhtIsBooting(), updated TODOs.txt

Signed-off-by: Roland Haeder <roland@mxchange.org>

Fixed array element usage

Signed-off-by: Roland Haeder <roland@mxchange.org>

Removed usage of array elements that are never transmitted.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added missing config entry + unfinished class NodeMessageDhtBootstrapAnswerHandler

Signed-off-by: Roland Haeder <roland@mxchange.org>

Should be the correct name.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added missing config entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

No invert here.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Fixed parser error.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Implemented handleMultipleMessages()

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added unfinished stuff for multiple messages.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Fixed exception.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed file to match convention.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed (fixed some stuff).

Signed-off-by: Roland Haeder <roland@mxchange.org>

Fixed names.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed path + fixed stacker names + added some missing entries.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Wrong name for XML node.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Reverted, not here.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Also this was possibly missing.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added possibly missing entry.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Commented in again as this is needed for debugging dht-bootstrap requests.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added missing class for dht_bootstrap_answert "tag" (aka. object type).

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Also this was badly named (missed 's')

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Fixed name of XML node.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added missing XML node 'dht-node-list' + object type 'dht_bootstrap_answer.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

No object type list in DHT bootstraps.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Opps. :(

Signed-off-by: Roland Haeder <roland@mxchange.org>

Nope, wasn't working.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Renamed methods ...

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added check for NULL + renamed XML nodes.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added again another missing config entry.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Merge branch 'master' of git.mxchange.org:/var/cache/git/repos/hub

Renamed path 'dht' to 'dht_bootstrap'.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added missing config entry for template "type" (path + template name).

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added missing config entry for stacker. :-)

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added missing answer message handler for DHT bootstrap requests.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added missing config entry.

Signed-off-by: Roland 'Quix0r' Haeder <roland@mxchange.org>

Added support for visiting package assembler which will e.g. clear pending data on shut down stockets or handle multiple messages.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Added incomplete handling of multiple messages.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Noisy debug line added + check if start and end markers are set.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Must be a FILO (First In, Last Out).

Signed-off-by: Roland Haeder <roland@mxchange.org>

Some stuff needs to be renamed to match better naming: 'announced' is not true
at this state as the node is currently trying to announce itself. So
'announcing' fits the exact state.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Surpress errors/warnings for socket_write as they flood the later logfiles, added missing handler method for socket error.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Opps, wrong place and value for this.

Signed-off-by: Roland Haeder <roland@mxchange.org>

Refactured sending encoded (raw) data to sockets to a stacker-based approach.

Signed-off-by: Roland Haeder <roland@mxchange.org>