Roland Haeder [Sat, 7 Mar 2015 22:07:11 +0000 (23:07 +0100)]
Continued with crawler:
- Added class constant STACKER_NAME_URLS for stacker name 'urls'
- enrichCrawlerQueueData() is still unfinished as there *must* be added more entries
- Updated 'core' to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sat, 7 Mar 2015 18:18:44 +0000 (19:18 +0100)]
Continued with crawler:
- initUrlSourceTask() cannot be called in constructor as this would lead to a
missing entry in seachTask() method
- Renamed crawler classes from *UrlGetterTask to *UrlCrawlerTask
- Added new field urlSourceInstance which requires an interface UrlSource
- TODOs.txt updated
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sat, 7 Mar 2015 18:04:42 +0000 (19:04 +0100)]
Register the task handler after it has been created as some tasks may need it
during initialization phase.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sat, 7 Mar 2015 17:54:54 +0000 (18:54 +0100)]
Continued with crawler:
- Renamed method processStack() to fillUrlStack() to reflect its purpose
- Added isUrlStackEmpty() to interface as it is now public
- Added new base class BaseUrlSourceTask which will initialize all such tasks
by creating the proper URL source instance
- Contants belong to top of classes
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 6 Mar 2015 23:26:35 +0000 (00:26 +0100)]
Continued with crawler:
- The indexed array needs to be converted to assoziative as other URL sources
may use index X for something else.
- Renamed $isLoaded to $isAdded as it fits more
- Updated 'core' to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 6 Mar 2015 01:39:47 +0000 (02:39 +0100)]
Fixed parser error ... :-(
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 5 Mar 2015 22:02:04 +0000 (23:02 +0100)]
Now all URL sources (stacks) are initialized in a loop. This config entry will
later be used by the crawlers to "look" for pending crawl jobs.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 5 Mar 2015 21:07:22 +0000 (22:07 +0100)]
Continued with crawler:
- Made some noisy debug lines quiet (commented out)
- Added parseCsvEntry() as a stub (only debug lines)
- Some other minor improvements
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 5 Mar 2015 02:01:10 +0000 (03:01 +0100)]
Continued with crawler:
- Renamed parseCsvEntry() to parseCsvFile() as it reads a CSV file
- Added check method if a CSV entry is stacked
- Updated 'core' to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 1 Mar 2015 02:24:41 +0000 (03:24 +0100)]
Converted an assertion into a more informative backtrace, if $unlInstance is not
implementing the expected interface 'LocateableNode'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 22 Feb 2015 18:01:35 +0000 (19:01 +0100)]
Improved exception message a little (external and internal UNLs are now clearly
separated).
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 18 Feb 2015 17:52:24 +0000 (18:52 +0100)]
Need to set back the "internal" (LAN) address in config as this is later needed
in announcement.xml template (please refer there).
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 18 Feb 2015 17:35:12 +0000 (18:35 +0100)]
Improved some comments + added commented-out debug lines.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 25 Feb 2015 00:22:34 +0000 (01:22 +0100)]
Commented out some noisy lines.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 19 Feb 2015 12:28:36 +0000 (13:28 +0100)]
It is 'CALLED' + commented some noisy lines out + 'core' updated
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 19 Feb 2015 10:41:36 +0000 (11:41 +0100)]
Lesser noisy debug messages + updated 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 19 Feb 2015 10:26:47 +0000 (11:26 +0100)]
Implementation of isOwnAddress() basicly finished:
- ... which will check if the currently saved UNL is the same as own external
or internal UNL (internal only returns IP!!!).
- Introduced getCurrentUniversalNodeLocator()
- Updated 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 30 Jan 2015 00:34:18 +0000 (01:34 +0100)]
Continued with refacturing:
- Deleted deprecated stuff, such as the ConnectionRegistry class as there is
now only a SocketRegistry.
- More cleanups (e.g. no longer used config entry and many more)
- Use more ShareableInfo class which main contain a Listenable or
ConnectionHelper instance. If both is missing, please report this.
- Updated 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 29 Jan 2015 20:53:48 +0000 (21:53 +0100)]
Continued with refactoring:
- Added ShareableInfo interface
- Added ConnectionInfo class which can be filled by Listenable classes and
ConnectionHelper classes. This fixes a bug that isSocketRegistered(),
registerSocket() and so on, are only accepting a Listenable class and not
the other.
- Updated 'core'
- UNFINISHED!
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 23 Jan 2015 20:58:12 +0000 (21:58 +0100)]
Continued rewrite:
- Added discoverListenerInstance() to inteface
- Introduced new generic class BaseIpV4ConnectionHelper
- ... and moved some methods to it
- Other rewrites + more debug lines added (mostly commented out)
- Updated 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Tue, 20 Jan 2015 09:20:35 +0000 (10:20 +0100)]
Continued a little:
- Renamed method as shortcuts are not wanted
- Updated to latest "core"
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Fri, 16 Jan 2015 23:22:56 +0000 (00:22 +0100)]
Continued refacturing:
- Added new exception InvalidUnlException
- Added very basic validation of UNLs (only regex)
- Updated 'core'
- TODOs.txt updated
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Mon, 12 Jan 2015 08:00:48 +0000 (09:00 +0100)]
Continued with refacturing:
- Added missing method getConnectionType() + a few commented out debug lines
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Sun, 11 Jan 2015 23:53:19 +0000 (00:53 +0100)]
Continued rewrite:
- New base class added for IPv4 protocol handler.
- Some improvements here and there
- TODOs.txt updated
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 11 Jan 2015 23:23:21 +0000 (00:23 +0100)]
Updated to latest 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 11 Jan 2015 20:55:35 +0000 (21:55 +0100)]
Merge branch 'master' into refacuring/protocol_handler
Now with latest "core".
Signed-off-by: Roland Haeder <roland@mxchange.org>
Conflicts:
application/hub/main/source/urls/class_CrawlerUploadedListUrlSource.php
core
Roland Haeder [Sun, 11 Jan 2015 20:51:25 +0000 (21:51 +0100)]
Continued with crawler (won't work with out-dated core):
- Added new method to check stack size for added CSV files
- Added empty stub for adding entries from loaded CSV file
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 26 Dec 2014 18:00:32 +0000 (19:00 +0100)]
Updated 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 24 Dec 2014 14:07:04 +0000 (15:07 +0100)]
A lot changes for refacturing protocol handler
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 23 Dec 2014 12:55:43 +0000 (13:55 +0100)]
Continued with refacturing:
- Removed no longer needed port which was only for TCP/UDP connections
- Added UniversalNodeLocator class
- Some parts are now "basicly finished", still there is a lot work to do
- Updated 'core' to latest commit id
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Tue, 16 Dec 2014 10:10:42 +0000 (11:10 +0100)]
Nope, that commit does not fork with this old master.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Mon, 15 Dec 2014 23:07:58 +0000 (00:07 +0100)]
Used correct commit id (again?).
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 15 Dec 2014 20:23:31 +0000 (21:23 +0100)]
Continued rewriting:
- IPs are a little "static" which means that you only connect to Internet nodes.
Universal node locators (UNL) give you the ability to connect also to node
which are not available over the internet, such as "fax nodes".
- Updated core
- Added new script for finding bad scripts
- Added more stuff towards refacturing to protocol handler
- Introduced discoverUniversalNodeLocatorByConfiguredAddress()
- Introduced resolveUniversalNodeLocatorFromConfigKey()
- Other rewrites
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 15 Dec 2014 18:30:01 +0000 (19:30 +0100)]
Continued with refacturing:
- renamed some variables
- expanded bootstrap node with protocol to fit UNL scheme (protocol://address[:port])
- added another die() as this part needs overworking, too
- introduced detectOwnUniversalNodeLocator()
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 15 Dec 2014 18:19:36 +0000 (19:19 +0100)]
Correct logger name
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Mon, 8 Dec 2014 08:13:51 +0000 (09:13 +0100)]
Now this should work with master branch.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Häder [Mon, 8 Dec 2014 08:05:07 +0000 (09:05 +0100)]
Used older 'core' for master (only the refacturing branch will use latest core).
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Sun, 7 Dec 2014 22:38:20 +0000 (23:38 +0100)]
Fixed correct config entry.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 7 Dec 2014 22:30:22 +0000 (23:30 +0100)]
Merge branch 'master' into refacuring/protocol_handler
Signed-off-by: Roland Haeder <roland@mxchange.org>
Conflicts:
application/hub/config.php
application/hub/interfaces/resolver/.htaccess
application/hub/main/nodes/class_BaseHubNode.php
application/hub/main/resolver/protocol/class_BaseProtocolResolver.php
application/hub/main/source/urls/class_CrawlerUploadedListUrlSource.php
Roland Haeder [Sun, 7 Dec 2014 22:20:01 +0000 (23:20 +0100)]
Continued:
- Fixed name for getter
- Added commented-out debug lines
- Updated to latest 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 7 Dec 2014 21:45:55 +0000 (22:45 +0100)]
Continued:
- Added some more stuff for URL CSV file importing
- Ignored all files in data/url_lists/ (and removed a "demo" file)
- Used new 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 7 Dec 2014 20:30:48 +0000 (21:30 +0100)]
Continued:
- added initial stuff to import CSV files (unfinished)
- udpated to latest core
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 7 Dec 2014 18:23:04 +0000 (19:23 +0100)]
Continued a little:
- Added resolveUniversalResourceLocatorFromNodeHelper() to interface
- BaseProtocolResolver now expandes BaseHubSystem to have some setters back.
- Improved comments here and there
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 11 Nov 2014 21:40:18 +0000 (22:40 +0100)]
Added more UNL (Universal Node Locator) stuff:
- Added interface for protocol resolvers
- Added factory for same class
- Added (lifeless) TCP resolver (NodeHelper -> LocateableNode resolver)
- The UNL is now a class implementation (see interface LocateableNode)
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 31 Oct 2014 22:43:41 +0000 (23:43 +0100)]
Continued on rewrite:
- Added new interface + first (completely unfinished) implementation for UNL discovery
-
- Made UNL upper-case
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sat, 25 Oct 2014 11:13:32 +0000 (13:13 +0200)]
More rewrites (and code stops):
- Renamed a lot variables towards UNL (universal node locator) which allows not
just ip:port locators but in a more URI-like style: protocol://address[:port]
'address' could also be a fax number where you want to establish a
"connection" to by sending the serialized base64-encoded data to.
- Renamed methods to reflect latest rewrites
- Updated core to latest changes
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 22:52:47 +0000 (00:52 +0200)]
Removed deprecated stuff.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Conflicts:
application/hub/interfaces/connectors/class_Connectable.php
Roland Haeder [Fri, 17 Oct 2014 22:52:47 +0000 (00:52 +0200)]
Removed deprecated stuff.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 22:50:08 +0000 (00:50 +0200)]
Merge branch 'refacuring/procol_handler' of git.mxchange.org:/var/cache/git/repos/hub into refacuring/procol_handler
Signed-off-by: Roland Haeder <roland@mxchange.org>
Conflicts:
application/hub/main/class_BaseHubSystem.php
Roland Haeder [Fri, 17 Oct 2014 21:21:25 +0000 (23:21 +0200)]
Moved getter/setter to proper location.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 20:56:30 +0000 (22:56 +0200)]
Continued with hub:
- Renamed class: files must be named "class_<ClassName>.php" without quotes and braces
- Updated copyright year
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 18:46:44 +0000 (20:46 +0200)]
Continued on refacturing from string to ProtocolHandler:
- Moved some classes to core as they become "generic" (generalized code).
- 'core' updated to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 8 Oct 2014 21:44:04 +0000 (23:44 +0200)]
Refacturing to pass a ProtocolHandler instance instead of the direct name. This
makes the code more flexible to other protocol handlers including FAX
"connections" and many fancy stuff more.
This refacuring is not complete.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 21:21:25 +0000 (23:21 +0200)]
Moved getter/setter to proper location.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 21:17:42 +0000 (23:17 +0200)]
Continued:
- Added new general HubHelper interface and let it extend/implement by suitable classes/interfaces
- Used the new interface as type-hint in enqueueRawDataFromTemplate()
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 20:56:30 +0000 (22:56 +0200)]
Continued with hub:
- Renamed class: files must be named "class_<ClassName>.php" without quotes and braces
- Updated copyright year
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 18:46:44 +0000 (20:46 +0200)]
Continued on refacturing from string to ProtocolHandler:
- Moved some classes to core as they become "generic" (generalized code).
- 'core' updated to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 8 Oct 2014 21:44:04 +0000 (23:44 +0200)]
Refacturing to pass a ProtocolHandler instance instead of the direct name. This
makes the code more flexible to other protocol handlers including FAX
"connections" and many fancy stuff more.
This refacuring is not complete.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 22:36:15 +0000 (00:36 +0200)]
Minor things improved + TODO added as it is unfinished.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Conflicts:
application/hub/main/factories/handler/class_ProtocolHandlerFactory.php
core
Roland Haeder [Fri, 17 Oct 2014 22:36:15 +0000 (00:36 +0200)]
Minor things improved + TODO added as it is unfinished.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 21:21:25 +0000 (23:21 +0200)]
Moved getter/setter to proper location.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 21:17:42 +0000 (23:17 +0200)]
Continued:
- Added new general HubHelper interface and let it extend/implement by suitable classes/interfaces
- Used the new interface as type-hint in enqueueRawDataFromTemplate()
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 20:56:30 +0000 (22:56 +0200)]
Continued with hub:
- Renamed class: files must be named "class_<ClassName>.php" without quotes and braces
- Updated copyright year
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Fri, 17 Oct 2014 18:46:44 +0000 (20:46 +0200)]
Continued on refacturing from string to ProtocolHandler:
- Moved some classes to core as they become "generic" (generalized code).
- 'core' updated to latest commit
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 8 Oct 2014 21:44:04 +0000 (23:44 +0200)]
Refacturing to pass a ProtocolHandler instance instead of the direct name. This
makes the code more flexible to other protocol handlers including FAX
"connections" and many fancy stuff more.
This refacuring is not complete.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Fri, 26 Sep 2014 07:57:13 +0000 (09:57 +0200)]
New 'core'.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Thu, 25 Sep 2014 20:31:00 +0000 (22:31 +0200)]
Updated core.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 29 Jul 2014 19:11:21 +0000 (21:11 +0200)]
Commented out again.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 29 Jul 2014 19:07:43 +0000 (21:07 +0200)]
Added noisy debug lines + changed asserts to check non-empty IP/port.
Note to self: Rewrite this hard wired stuff into a more flexible code allow
recipients other than IPv4:port.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 21:58:09 +0000 (23:58 +0200)]
New 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 21:27:39 +0000 (23:27 +0200)]
And yet another one.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 21:22:36 +0000 (23:22 +0200)]
Cleanup + added debug lines:
- cleaned up no longer used paths (previously copied to 'node' wit SVN)
- added noisy debug lines to fix an error in announcement
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 20:14:56 +0000 (22:14 +0200)]
New 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 19:41:55 +0000 (21:41 +0200)]
Also add session id.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 19:25:29 +0000 (21:25 +0200)]
This assert can be savely removed (see some lines below why).
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Tue, 22 Jul 2014 18:54:28 +0000 (20:54 +0200)]
Continued:
- fixed bad handlig in NodeDistributedHashTableDatabaseWrapper
- improved other stuff (communicator, ...)
- used new 'core' (only chash.php)
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Wed, 25 Jun 2014 17:50:41 +0000 (19:50 +0200)]
Continued:
- added a Minable interface for minable blocks
- added a HashBlock class which can be "mined"
- added missing debug output in some state factories
- added 'booting' state for block miners
- used updated 'core'
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Tue, 24 Jun 2014 06:44:09 +0000 (08:44 +0200)]
Used fixed 'core'.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Mon, 23 Jun 2014 21:27:54 +0000 (23:27 +0200)]
Added missing config entries + updated to latest 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 23 Jun 2014 20:55:27 +0000 (22:55 +0200)]
createFileStackInstance() has 2 parameters.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 23 Jun 2014 20:52:00 +0000 (22:52 +0200)]
Continued:
- renamed 'stacker' to 'stack' as they are stacks
- updated to latest 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sat, 31 May 2014 12:00:03 +0000 (14:00 +0200)]
New fixed 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Mon, 26 May 2014 07:58:19 +0000 (09:58 +0200)]
Used updated 'core' with fixed/half-added stuff (unfinished).
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Thu, 22 May 2014 20:58:35 +0000 (22:58 +0200)]
Ignored all stack files and index files + updated core.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 22 May 2014 19:09:11 +0000 (21:09 +0200)]
Added needed config entries for index files (not search index).
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Thu, 22 May 2014 08:19:14 +0000 (10:19 +0200)]
Used new core.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Häder [Thu, 22 May 2014 08:16:08 +0000 (10:16 +0200)]
Fixed interface.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Mon, 19 May 2014 21:19:09 +0000 (23:19 +0200)]
Used new 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 19 May 2014 20:36:43 +0000 (22:36 +0200)]
Introduced isUrlStackEmpty() which overwrites the method in BaseSource because
isStackInitialized() does currently not work with file-based stacks.
Used latest 'core'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 19 May 2014 18:04:29 +0000 (20:04 +0200)]
Renamed classes + updated to lastest 'core' commit.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 15 May 2014 21:05:27 +0000 (23:05 +0200)]
Continued:
- added 'base_path' to stack file name
- updated 'core'
- ignored all stack files
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 15 May 2014 19:45:28 +0000 (21:45 +0200)]
Continued with crawler:
- added BaseUrlSource class with generic file-based stack initialization.
- added missing configuration entries.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 15 May 2014 19:19:00 +0000 (21:19 +0200)]
Used scanApplicationClasses() now and fixed core.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Thu, 15 May 2014 19:10:33 +0000 (21:10 +0200)]
Moved BaseIterator class to 'core' project'.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Häder [Tue, 13 May 2014 06:44:29 +0000 (08:44 +0200)]
Use fixed core.
Signed-off-by: Roland Häder <haeder@hmmdeutschland.de>
Roland Haeder [Mon, 12 May 2014 20:51:49 +0000 (22:51 +0200)]
Make use of refactured FrameworkDirectoryPointer class.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 12 May 2014 19:21:19 +0000 (21:21 +0200)]
Added crawler stuff:
- Added scanner class/interface and task class.
- Added a scanner class for looking for uploaded lists. They must be located in
data/url_lists/ .
- Rewritten both factories (scanner, source) to use createObjectByConfiguredName()
instead of direct createObjectByName(). This allows to set another class if you
don't like the original implementation.
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Mon, 12 May 2014 19:20:50 +0000 (21:20 +0200)]
Added/renamed miner classes:
- Added communicator class for miner->node communication. This allows the miner
to claim found blocks and ask the network for more.
- Moved some miner tasks in sub directories
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 11 May 2014 14:01:55 +0000 (16:01 +0200)]
Satisfied Executor interface by adding stub (unfinished method) initExecutor().
Signed-off-by: Roland Haeder <roland@mxchange.org>
Roland Haeder [Sun, 11 May 2014 12:57:39 +0000 (14:57 +0200)]
Added classes for crawler sources + rewrote 'Source' interface + added more interfaces and many more.
Signed-off-by: Roland Haeder <roland@mxchange.org>
projects / hub.git / log