]>
git.mxchange.org Git - fba.git/log
Roland Häder [Wed, 24 May 2023 13:11:47 +0000 (15:11 +0200)]
Continued:
- fixed debug message (ops)
- commented out noisy debug lines
Roland Häder [Wed, 24 May 2023 12:43:32 +0000 (14:43 +0200)]
Continued:
- tidyup() used for header.text
- moved translations table to header
- renamed variable
Roland Häder [Wed, 24 May 2023 12:20:20 +0000 (14:20 +0200)]
Continued:
- reformatted, I tried to use post_json_api() for bot postings
Roland Häder [Wed, 24 May 2023 12:16:35 +0000 (14:16 +0200)]
Continued:
- 'mode' must be used also for these elements
Roland Häder [Wed, 24 May 2023 10:34:43 +0000 (12:34 +0200)]
Continued:
- also including 'follower', not only 'following'
Roland Häder [Wed, 24 May 2023 10:21:54 +0000 (12:21 +0200)]
Continued:
- PeerTube has discoverable instances lists, so let us browse them
Roland Häder [Wed, 24 May 2023 06:40:12 +0000 (08:40 +0200)]
Continued:
- no shortening of packages
Roland Häder [Wed, 24 May 2023 05:23:50 +0000 (07:23 +0200)]
Continued:
- if fetching nodeinfo was successful, then clear any status codes and error
messages for this instance
- also tidyup() found instance, some are invalid :-(
Roland Häder [Tue, 23 May 2023 23:13:36 +0000 (01:13 +0200)]
Continued:
- ops, my mistake to remove array element while it is still needed
Roland Häder [Tue, 23 May 2023 19:08:39 +0000 (21:08 +0200)]
Continued:
- use validators.domain() for checking if it is a valid domain (and host name)
Roland Häder [Tue, 23 May 2023 18:02:26 +0000 (20:02 +0200)]
Continued:
- lemmy has an other API URL and also other JSON output for getting more peers
- Unfinished: Fetching blocks from Lemmy
Roland Häder [Tue, 23 May 2023 11:56:05 +0000 (13:56 +0200)]
Continued:
- if the software being used isn't regonized, skip them
Roland Häder [Tue, 23 May 2023 10:04:08 +0000 (12:04 +0200)]
Continued:
- also check if 'blocker' is meanwhile blocked (WIP)
Roland Häder [Tue, 23 May 2023 09:57:41 +0000 (11:57 +0200)]
Continued:
- these are system-specific service files
Roland Häder [Tue, 23 May 2023 08:48:59 +0000 (10:48 +0200)]
Continued:
- added more mastodon-typical fields
Roland Häder [Tue, 23 May 2023 07:10:42 +0000 (09:10 +0200)]
Continued:
- added get_peers_url column
- flush any pending data after get_peers() was invoked
- blacklisted already added instances should be removed (WIP)
Roland Häder [Tue, 23 May 2023 07:01:41 +0000 (09:01 +0200)]
Continued:
- flexible handling of SQL columns and values
Roland Häder [Tue, 23 May 2023 06:18:51 +0000 (08:18 +0200)]
Continued:
- added detection_mode and nodeinfo_url to table 'instances'
- described arrays
Roland Häder [Tue, 23 May 2023 04:43:17 +0000 (06:43 +0200)]
Continued:
- found a Japanese "limited server" phrase
Roland Häder [Tue, 23 May 2023 04:08:42 +0000 (06:08 +0200)]
Continued:
- also 'meisskey' is an alias of misskey software
Roland Häder [Tue, 23 May 2023 04:05:26 +0000 (06:05 +0200)]
Continued:
- proper URLs with base_url
- all JSON replies now start with /api/
Roland Häder [Mon, 22 May 2023 15:08:57 +0000 (17:08 +0200)]
Continued:
- reduce amount of rows to one (performance)
Roland Häder [Mon, 22 May 2023 09:23:57 +0000 (11:23 +0200)]
Continued:
- log entire exception message
- show number of errorous instances
Roland Häder [Mon, 22 May 2023 09:02:07 +0000 (11:02 +0200)]
Continued:
- try to update last error details and with a fake status_code
Roland Häder [Mon, 22 May 2023 05:05:15 +0000 (07:05 +0200)]
Continued:
- proper place
- also log status_code
Roland Häder [Mon, 22 May 2023 05:02:54 +0000 (07:02 +0200)]
Continued:
- older versions are okay, too!
Roland Häder [Mon, 22 May 2023 04:59:42 +0000 (06:59 +0200)]
Continued:
- both isn't fully supported, only peer-disovery works
Roland Häder [Mon, 22 May 2023 04:52:05 +0000 (06:52 +0200)]
Continued:
- Takahe added (partly WIP)
Roland Häder [Mon, 22 May 2023 04:18:01 +0000 (06:18 +0200)]
Continued:
- strip out pipes from software names, too
Roland Häder [Mon, 22 May 2023 04:02:53 +0000 (06:02 +0200)]
Continued:
- added other node rel
Roland Häder [Mon, 22 May 2023 03:28:19 +0000 (05:28 +0200)]
Continued:
- also log these errors
Roland Häder [Mon, 22 May 2023 02:58:41 +0000 (04:58 +0200)]
Continued:
- first try auto-discovery, then static list
Roland Häder [Mon, 22 May 2023 02:52:13 +0000 (04:52 +0200)]
Continued:
- fetching .well-known/nodeinfo for auto-discovery added
Roland Häder [Mon, 22 May 2023 02:13:27 +0000 (04:13 +0200)]
Continued:
- also include bookwyrm in instance discovering (blocks is WIP)
Roland Häder [Mon, 22 May 2023 02:11:48 +0000 (04:11 +0200)]
Continued:
- added support for very old Mastodon instances, e.g. 2.x has no "software" in nodeinfo
Roland Häder [Mon, 22 May 2023 01:35:28 +0000 (03:35 +0200)]
Continued:
- fixed bad handling of errors during nodeinfo discovery
Roland Häder [Mon, 22 May 2023 01:00:24 +0000 (03:00 +0200)]
Continued:
- sorted nodeinfo API URLs by version
- added 1.0
Roland Häder [Mon, 22 May 2023 00:42:07 +0000 (02:42 +0200)]
Continued:
- renamed variable
- used more tidyup()
Roland Häder [Mon, 22 May 2023 00:11:50 +0000 (02:11 +0200)]
Continued:
- try to strip of path if not aliased and known
- fixed some errors
Roland Häder [Sun, 21 May 2023 23:57:02 +0000 (01:57 +0200)]
Continued:
- nicer look
- tidy up software, too
Roland Häder [Sun, 21 May 2023 17:36:42 +0000 (19:36 +0200)]
Continued:
- no local variable needed
Roland Häder [Sun, 21 May 2023 16:03:23 +0000 (18:03 +0200)]
Continued:
- keep connection and read timeout separate
Roland Häder [Sun, 21 May 2023 15:18:38 +0000 (17:18 +0200)]
Continued:
- don't shorten variable names, wrong lazyness
Roland Häder [Sun, 21 May 2023 14:59:12 +0000 (16:59 +0200)]
Continued:
- res.reason is just a text respresentation of the code
Roland Häder [Sun, 21 May 2023 14:31:43 +0000 (16:31 +0200)]
Continued:
- also log last detailed error message
- introduced fba.is_blacklisted()
Roland Häder [Sun, 21 May 2023 09:56:32 +0000 (11:56 +0200)]
Continued:
- make all software names lower-case
- also include initial instance
Roland Häder [Sun, 21 May 2023 09:38:41 +0000 (11:38 +0200)]
Continued:
- added top X for used software
Roland Häder [Sun, 21 May 2023 09:27:16 +0000 (11:27 +0200)]
Continued:
- rewrote a bit
Roland Häder [Sun, 21 May 2023 07:51:48 +0000 (09:51 +0200)]
Continued:
- added top-referencing instances scoreboard
Roland Häder [Sun, 21 May 2023 07:36:08 +0000 (09:36 +0200)]
Continued:
- added first_seen and last_updated to instances table
- moved timestamp creation to functions (lesser parameter)
Roland Häder [Sun, 21 May 2023 05:16:23 +0000 (07:16 +0200)]
Continued:
- reformatted config.defaults.json
- also store script name
Roland Häder [Sat, 20 May 2023 14:30:40 +0000 (16:30 +0200)]
Continued:
- it is more the originator ...
Roland Häder [Sat, 20 May 2023 13:07:40 +0000 (15:07 +0200)]
Continued:
- added origin to track which instance has referenced this one
Roland Häder [Sat, 20 May 2023 12:36:59 +0000 (14:36 +0200)]
Continued:
- looks cooler this way
Roland Häder [Sat, 20 May 2023 12:26:02 +0000 (14:26 +0200)]
Continued:
- only fetch these, others are WIP
Roland Häder [Sat, 20 May 2023 11:31:29 +0000 (13:31 +0200)]
Continued:
- COUNT() is a SQL function, also always upper-case
Roland Häder [Sat, 20 May 2023 11:12:05 +0000 (13:12 +0200)]
Continued:
- added last_blocked to reduce requering instances to often (be nice!)
Roland Häder [Sat, 20 May 2023 11:00:09 +0000 (13:00 +0200)]
Continued:
- try block must be around software type checking, not the reqto.foo() call
Roland Häder [Sat, 20 May 2023 10:32:57 +0000 (12:32 +0200)]
Continued:
- some improvements
Roland Häder [Sat, 20 May 2023 08:50:32 +0000 (10:50 +0200)]
Continued:
- always update last_nodeinfo
Roland Häder [Sat, 20 May 2023 08:45:53 +0000 (10:45 +0200)]
Continued:
- renamed last_access to last_nodeinfo as fetch_blocks will have its own
last access timestamp
Roland Häder [Sat, 20 May 2023 08:33:34 +0000 (10:33 +0200)]
Continued:
- be kind! set recheck_instance to at least 3600 seconds (one hour)
Roland Häder [Sat, 20 May 2023 08:26:29 +0000 (10:26 +0200)]
WIP:
- introduced update_last_access() which will update 'last_access' by instance's
domain
Roland Häder [Sat, 20 May 2023 08:14:56 +0000 (10:14 +0200)]
Continued:
- rewrote fetch_nodeinfo() to test all URLs
Roland Häder [Sat, 20 May 2023 07:39:57 +0000 (09:39 +0200)]
Continued:
- introduced fba.fetch_nodeinfo()
Roland Häder [Sat, 20 May 2023 07:04:54 +0000 (09:04 +0200)]
Continued:
- some instances reported others with '@' in it which isn't correct for a
domain name/host IP
Roland Häder [Sat, 20 May 2023 06:44:44 +0000 (08:44 +0200)]
Continued:
- also show domain and software (mostly 'None')
Roland Häder [Sat, 20 May 2023 06:19:22 +0000 (08:19 +0200)]
WIP:
- blocked spam domain
- also discover more instances by quering already existing instances
Roland Häder [Sat, 20 May 2023 05:28:08 +0000 (07:28 +0200)]
Continued:
- copy-paste mistake fixed
- it must be 'port'
Roland Häder [Fri, 19 May 2023 19:35:04 +0000 (21:35 +0200)]
Continued:
- need to check if current "step"'s entries are lesser than expected to
break out loop
Roland Häder [Fri, 19 May 2023 17:58:01 +0000 (19:58 +0200)]
Continued:
- added more debug lines
- if zero sized list is being returned, quit the loop, again raised exceptions
are NOT there for your flow-control!
Roland Häder [Fri, 19 May 2023 17:30:27 +0000 (19:30 +0200)]
Continued:
- added auto-discoverable RSS feed
- introduced post_json_api()
- some debug lines added
Roland Häder [Fri, 19 May 2023 16:45:19 +0000 (18:45 +0200)]
Continued:
- more formatting
Roland Häder [Thu, 18 May 2023 21:54:23 +0000 (23:54 +0200)]
Continued:
- some instances don't have a block list
Roland Häder [Thu, 18 May 2023 21:09:04 +0000 (23:09 +0200)]
Continued:
- you better should check an array on a specific key with `key in my_array`
Roland Häder [Thu, 18 May 2023 20:33:09 +0000 (22:33 +0200)]
Continued:
- do not include anything that is empty after being cleared (exception reason)
Roland Häder [Thu, 18 May 2023 05:00:57 +0000 (07:00 +0200)]
Very noisy debug lines
Roland Häder [Thu, 18 May 2023 04:58:04 +0000 (06:58 +0200)]
Let's better say "unknown"
Roland Häder [Thu, 18 May 2023 04:32:41 +0000 (06:32 +0200)]
Continued:
- more debug lines added
Roland Häder [Thu, 18 May 2023 02:24:10 +0000 (04:24 +0200)]
Continued:
- INFO level is okay here
- in the end, variable 'reason' wasn't defined
Roland Häder [Thu, 18 May 2023 01:54:45 +0000 (03:54 +0200)]
Continued:
- variable 'peer' can be type of string in case or error, so let's gently
abort here instead of running into error (catching exceptions isn't a proper
flow-control)
Roland Häder [Thu, 18 May 2023 01:23:59 +0000 (03:23 +0200)]
Continued:
- ops, to happy with "fba." adding
- added more debug lines
Roland Häder [Thu, 18 May 2023 00:47:51 +0000 (02:47 +0200)]
Continued:
- lesser direct function imports
- fixed some errors
Roland Häder [Wed, 17 May 2023 17:56:27 +0000 (19:56 +0200)]
Ops!
Roland Häder [Wed, 17 May 2023 17:47:57 +0000 (19:47 +0200)]
Continued:
- removed unused imports
- set LIMIT 1
- improved a bit debug messages
Roland Häder [Wed, 17 May 2023 16:05:27 +0000 (18:05 +0200)]
Continued:
- first attempt
Roland Häder [Wed, 17 May 2023 16:03:38 +0000 (18:03 +0200)]
Continued:
- more rewrites away from single-function imports
- added more debug lines
- maybe fixed adding duplicate instances
Roland Häder [Wed, 17 May 2023 13:12:42 +0000 (15:12 +0200)]
Continued:
- since functions had been moved to module "fba", also the names must be changed
Roland Häder [Wed, 17 May 2023 06:00:27 +0000 (08:00 +0200)]
WIP:
- nicer message
Roland Häder [Wed, 17 May 2023 05:51:25 +0000 (07:51 +0200)]
WIP:
- added else block for any unknown type
Roland Häder [Wed, 17 May 2023 05:49:20 +0000 (07:49 +0200)]
WIP:
- moved functions to fba.py module
Roland Häder [Wed, 17 May 2023 04:15:46 +0000 (06:15 +0200)]
Continued:
- added warning if get_peers() fails
- added sys.exit() if this happens for provided instance from command-line
Roland Häder [Wed, 17 May 2023 03:41:54 +0000 (05:41 +0200)]
Continued:
- added slogan
Roland Häder [Wed, 17 May 2023 03:11:25 +0000 (05:11 +0200)]
Continued:
- needs to be unique!
Roland Häder [Wed, 17 May 2023 03:09:59 +0000 (05:09 +0200)]
Continued:
- encapsulation, still tons of duplicate records in `instances` table
Roland Häder [Tue, 16 May 2023 23:44:58 +0000 (01:44 +0200)]
Also missed this SQL keywords
Roland Häder [Sun, 14 May 2023 22:30:36 +0000 (00:30 +0200)]
Continued:
- also a blocks.db-journal is being written, so let's ignore all
- the software's name is misskey, no need to slur it
Signed-off-by: Roland Häder <roland@mxchange.org>
Roland Häder [Sun, 14 May 2023 00:34:20 +0000 (02:34 +0200)]
Continued:
- _blank for external links
Roland Häder [Sat, 13 May 2023 23:17:57 +0000 (01:17 +0200)]
I have made my own copy of this software!
Roland Häder [Sat, 13 May 2023 23:11:32 +0000 (01:11 +0200)]
Continued:
- added check-daemon.sh
- you can execcute this by yourself or by cronjob