A script to make moderating a Synapse server easier.
Go to file
2023-07-24 02:59:49 +08:00
test_data add generic email send function for automated reporting, hardcode matrix.org abuse email because... well I wanna stay in their good books lol 2023-07-24 02:59:49 +08:00
.gitignore add .gitignore file to prevent accidental leaking of token 2023-07-08 18:07:33 +08:00
example_create_users_list.txt Saner username parsing, added list/download all media in a room, added quarantine all media in a room, added quarantine all media uploaded by specific user 2020-08-25 18:09:57 +08:00
example_room_list.txt Updated deactivate and password reset commands to new API. Added Query/Deactivate multiple user accounts. Added Remove multiple rooms from public directory. Added Download/Purge multiple rooms. Added Prepare database for copying events of multiple rooms (Only works with Spantaleev script). 2020-12-29 01:25:45 +08:00
example_users_list.txt Updated deactivate and password reset commands to new API. Added Query/Deactivate multiple user accounts. Added Remove multiple rooms from public directory. Added Download/Purge multiple rooms. Added Prepare database for copying events of multiple rooms (Only works with Spantaleev script). 2020-12-29 01:25:45 +08:00
hardcoded_variables.py move ipinfo functions to seperate file, add rudimentary user reporting function 2023-07-23 04:21:50 +08:00
ipinfo_commands.py move ipinfo functions to seperate file, add rudimentary user reporting function 2023-07-23 04:21:50 +08:00
LICENSE Add rdlist functionality for automatically loading and blocking/purging rooms from the rdlist repository. Change license to MIT. Fix whitespacing in script. Stop the script from overwriting state event export files by including a timestamp in their name. 2023-07-02 03:23:16 +08:00
moderation_tool.py add generic email send function for automated reporting, hardcode matrix.org abuse email because... well I wanna stay in their good books lol 2023-07-24 02:59:49 +08:00
rdlist_commands.py warn hs admin about which tags are about to be automatically blocked/purged 2023-07-21 01:24:34 +08:00
README.md add function to automatically lookup a homeserver admins email address, either the easy way (MSC1929) or the hard way (Your domain registrars whois email) 2023-07-24 01:44:41 +08:00
report_commands.py add generic email send function for automated reporting, hardcode matrix.org abuse email because... well I wanna stay in their good books lol 2023-07-24 02:59:49 +08:00
room_commands.py move ipinfo functions to seperate file, add rudimentary user reporting function 2023-07-23 04:21:50 +08:00
server_commands.py add generic email send function for automated reporting, hardcode matrix.org abuse email because... well I wanna stay in their good books lol 2023-07-24 02:59:49 +08:00
user_commands.py move ipinfo functions to seperate file, add rudimentary user reporting function 2023-07-23 04:21:50 +08:00

Matrix Moderation Tool

A Matrix moderation tool to make managing a Synapse server easier.

Contact me at @michael:perthchat.org if you get stuck or have an edit in mind.


Licensing

This work is published under the MIT license, for more information on this license see here: https://opensource.org/license/mit/


Setup script

You can hard code the server URL, federation port and access token into the hardcoded_variables.py file for faster use, it will prompt you for these values if you don't.

Your access token can be found in Element > Settings > Help & About, your user account must first be upgraded to a server admin.

This script also requires you to install the following PIP packages:

pip3 install python-whois
pip3 install requests
pip3 install pyAesCrypt

Upgrade user to 'server admin'

https://github.com/matrix-org/synapse/tree/master/docs/admin_api

“So first connect to the correct db and then run the UPDATE users...”

$ sudo -i -u postgres

$ psql synapse

synapse=# UPDATE users SET admin=1 WHERE name='@PC-Admin:perthchat.org';

UPDATE 1

synapse=#

- sign instead of = means:

It means you didn't type a complete SQL query yet.

You need a semicolon to terminate the command.


Make sure /_synapse/ is mapped

A few of the commands will not work unless /_synapse/ is mapped to port 8008. Here is a example for nginx:


    location /_matrix {
        proxy_pass http://127.0.0.1:8008;
        proxy_set_header X-Forwarded-For $remote_addr;
    }

    location /_synapse {
        proxy_pass http://127.0.0.1:8008;
        proxy_set_header X-Forwarded-For $remote_addr;
    }

You can also run the script locally on your server if you do not wish to map /_synapse/.

With the popular matrix-docker-ansible-deploy playbook you can expose this API interface by enabling 'Synapse Admin':

matrix_synapse_admin_enabled: true


Roadmap

To do:

  1. Add the following functions:
  1. Make the menu prettier! - DONE
  2. Modularise the functions into multiple files - DONE
  3. Use URI module for all API calls instead of curl - DONE
  4. Add more automated rdlist function with sane defaults - DONE
  5. Add fully automated (should just return a web link and decryption password) reporting functions for users:
  • Description of why the report was made (what happened)
  • User's ID - DONE
  • Whois Data - DONE
  • Account Data - DONE
  • Query Data - DONE
  • Pushers List - DONE
  • IPs + ipinfo Data - DONE
  • List of the rooms the user is participating in, divided into 1:1 conversations and larger rooms
  • Any other usernames associated with that IP
  • Timestamp for when illegal material was accessed
  • Description of report format and contents (to guide the reader)
  1. Add a room report function to create a properly formatted report for rdlist
  2. Add a function to extract a users email or 3PID
  3. Do room shutdowns in parallel?
  4. Add function for probing the support email of another server automatically
  5. Automated incident report email to other server owners for more scalable coordination
  6. Automated public room joining and reminder if reporting email is not available?

rdlist Functionality

'rdlist' is a comprehensive list of child abuse related rooms on Matrix, it's a safety initiative led by the Legion of Janitors.

This script can automatically load and block/purge abusive rooms from rdlist, making it very easy for inexperienced administrators to block this harmful content.

If you are running a public server, please dm me at @michael:perthchat.org and I can invite you to the 'Legion of Janitors' room.

Once you have read access to the rdlist repository, simply run this moderation script like so:

$ python3 moderation_tool.py 

Please select one of the following options:
...
#### rdlist ####
30) Block all rooms with specific rdlist tags.
34) Block all rooms with recommended rdlist tags.
('q' or 'e') Exit.

34

Successfully set user as server admin.
rdlist repo already cloned...
Fetching origin
rdlist repo is up-to-date, no need to pull changes.

Using recommended rdlist tags.


Number of rooms being shutdown: 318

Are you sure you want to shutdown these rooms? y/n? y

https://matrix.perthchat.org/_synapse/admin/v1/rooms/!***REDACTED***:matrix.org/state

{"errcode":"M_NOT_FOUND","error":"Room not found"}
The room was not found.

https://matrix.perthchat.org/_synapse/admin/v1/rooms/!***REDACTED***:cuteworld.space/state

{"errcode":"M_NOT_FOUND","error":"Room not found"}
The room was not found.

https://matrix.perthchat.org/_synapse/admin/v1/rooms/!***REDACTED***:matrix.org/state

{"errcode":"M_NOT_FOUND","error":"Room not found"}
The room was not found.

https://matrix.perthchat.org/_synapse/admin/v1/rooms/!***REDACTED***:matrix.org/state

{"errcode":"M_NOT_FOUND","error":"Room not found"}
The room was not found.
...

Note that this script before shutting these rooms down will save the state events to the "./state_events" folder, please keep this data as it's important for law enforcement.


One-touch Reporting

WARNING: This section is under heavy development and shouldn't be used by anyone!!!

This script can automatically generate reports about user accounts for law enforcement.

It collects as much data about the target user account as possible, then packages it into an encrypted ZIP file that can be shared:


Please enter a number from the above menu, or enter 'q' or 'e' to exit.

70

Please enter the username to automatically generate a report: michael

...

Report generated successfully on user: "michael"

You can send this .zip file and password when reporting a user to law enforcement.

Password: RwiFrw9zouhVO7Dy9kW7
Encrypted .zip file location: ./reports/michael_2023-07-23_02-21-56.zip.aes
Encrypted .zip file size: 0.503927 MB