]> git.mxchange.org Git - hub.git/commit
Added crawler stuff:
authorRoland Haeder <roland@mxchange.org>
Mon, 12 May 2014 19:21:19 +0000 (21:21 +0200)
committerRoland Haeder <roland@mxchange.org>
Mon, 12 May 2014 19:56:45 +0000 (21:56 +0200)
commit9c3e6306f211737d6d48dbb6a581a2afbe6f0ff2
tree2cca9092d86998e6056caabc0508eda18fbc07b2
parent716e597e5d42c271fee57dbe589816e3d7f65dc3
Added crawler stuff:
- Added scanner class/interface and task class.
- Added a scanner class for looking for uploaded lists. They must be located in
  data/url_lists/ .
- Rewritten both factories (scanner, source) to use createObjectByConfiguredName()
  instead of direct createObjectByName(). This allows to set another class if you
  don't like the original implementation.

Signed-off-by: Roland Haeder <roland@mxchange.org>
24 files changed:
application/hub/config.php
application/hub/interfaces/scanner/.htaccess [new file with mode: 0644]
application/hub/interfaces/scanner/class_Scanner.php [new file with mode: 0644]
application/hub/interfaces/source/urls/class_UrlSource.php
application/hub/main/factories/scanner/.htaccess [new file with mode: 0644]
application/hub/main/factories/scanner/class_ScannerObjectFactory.php [new file with mode: 0644]
application/hub/main/factories/source/url/class_UrlSourceObjectFactory.php
application/hub/main/filter/task/crawler/class_CrawlerTaskHandlerInitializerFilter.php
application/hub/main/scanner/.htaccess [new file with mode: 0644]
application/hub/main/scanner/class_ [new file with mode: 0644]
application/hub/main/scanner/class_BaseScanner.php [new file with mode: 0644]
application/hub/main/scanner/crawler/.htaccess [new file with mode: 0644]
application/hub/main/scanner/crawler/class_Crawler [new file with mode: 0644]
application/hub/main/scanner/crawler/uploaded_list/.htaccess [new file with mode: 0644]
application/hub/main/scanner/crawler/uploaded_list/class_CrawlerUploadedListScanner.php [new file with mode: 0644]
application/hub/main/source/urls/class_CrawlerUrlSource
application/hub/main/source/urls/class_CrawlerUrlSourceFoundRss.php
application/hub/main/source/urls/class_CrawlerUrlSourceLocalStart.php
application/hub/main/source/urls/class_CrawlerUrlSourceRssStart.php
application/hub/main/source/urls/class_CrawlerUrlSourceUploadedList.php
application/hub/main/tasks/crawler/scanner/.htaccess [new file with mode: 0644]
application/hub/main/tasks/crawler/scanner/class_Crawler [new file with mode: 0644]
application/hub/main/tasks/crawler/scanner/class_CrawlerUploadedListScannerTask.php [new file with mode: 0644]
docs/TODOs.txt