24212 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Erik Johnston	d221512498	SS: Implement $ME support (#17469) ... `$ME` can be used as a substitute for the requester's user ID.	2024-07-22 17:48:09 +01:00
Erik Johnston	ed0face8ad	Speed up room keys query by using read/write lock (#17461) ... Linaerizing all access slows things down when devices try and fetch lots of keys on login	2024-07-22 14:51:17 +01:00
dependabot[bot]	73529d3732	Bump ruff from 0.5.0 to 0.5.4 (#17466)	2024-07-22 14:29:06 +01:00
dependabot[bot]	1648337775	Bump sentry-sdk from 2.8.0 to 2.10.0 (#17467)	2024-07-22 14:28:54 +01:00
Shay	dc8ddc6472	Prepare for authenticated media freeze (#17433) ... As part of the rollout of [MSC3916](https://github.com/matrix-org/matrix-spec-proposals/blob/main/proposals/3916-authentication-for-media.md) this PR adds support for designating authenticated media and ensuring that authenticated media is not served over unauthenticated endpoints.	2024-07-22 10:33:17 +01:00
Erik Johnston	d3f9afd8d9	Add a cache on get_rooms_for_local_user_where_membership_is (#17460) ... As it gets used in sliding sync. We basically invalidate it in all the same places as `get_rooms_for_user`. Most of the changes are due to needing the arguments you pass in to be hashable (which lists aren't)	2024-07-19 16:19:15 +01:00
Erik Johnston	43c865f7c9	Generate room sync data concurrently (#17458) ... This is also what we do for standard `/sync`.	2024-07-19 12:09:39 +01:00
dependabot[bot]	71d83477cb	Bump sentry-sdk from 2.6.0 to 2.8.0 (#17456)	2024-07-19 11:02:38 +01:00
Ben Banfield-Zanin	6a01af59e1	Improve default_power_level_content_override documentation (#17451) ... Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>	2024-07-18 13:32:32 +01:00
Erik Johnston	f583f1dce4	Revert "Bump setuptools from 67.6.0 to 70.0.0" (#17455) ... Reverts element-hq/synapse#17448 We hit a bug when deploying with synctl: ``` Traceback (most recent call last): File "/home/synapse/env-python311/bin/synctl", line 33, in <module> sys.exit(load_entry_point('matrix-synapse', 'console_scripts', 'synctl')()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/bin/synctl", line 25, in importlib_load_entry_point return next(matches).load() ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/importlib/metadata/__init__.py", line 202, in load module = import_module(match.group('module')) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "<frozen importlib._bootstrap>", line 1204, in _gcd_import File "<frozen importlib._bootstrap>", line 1176, in _find_and_load File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 690, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 940, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/synapse/src/synapse/_scripts/synctl.py", line 37, in <module> from synapse.config import find_config_files File "/home/synapse/src/synapse/config/__init__.py", line 22, in <module> from ._base import ConfigError, find_config_files File "/home/synapse/src/synapse/config/_base.py", line 49, in <module> import pkg_resources File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 3282, in <module> @_call_aside ^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 3266, in _call_aside f(*args, **kwargs) File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 3295, in _initialize_master_working_set working_set = _declare_state('object', 'working_set', WorkingSet._build_master()) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 589, in _build_master ws.require(__requires__) File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 926, in require needed = self.resolve(parse_requirements(requirements)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 787, in resolve dist = self._resolve_dist( ^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 816, in _resolve_dist env = Environment(self.entries) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 1014, in __init__ self.scan(search_path) File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 1046, in scan for dist in find_distributions(item): File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 2091, in find_on_path yield from factory(fullpath) ^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 2183, in resolve_egg_link return next(dist_groups, ()) ^^^^^^^^^^^^^^^^^^^^^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 2179, in <genexpr> resolved_paths = ( ^ File "/home/synapse/env-python311/lib/python3.11/site-packages/pkg_resources/__init__.py", line 2167, in non_empty_lines for line in _read_utf8_with_fallback(path).splitlines(): ^^^^^^^^^^^^^^^^^^^^^^^^ NameError: name '_read_utf8_with_fallback' is not defined ```	2024-07-18 12:59:53 +01:00
Eric Eastwood	a574de0062	Add m.room.create to default bump event types (#17453) ... Add `m.room.create` to default bump event types This probably helps when no messages have been sent in the room and it was just created.	2024-07-18 12:49:53 +01:00
Eric Eastwood	3fee32ed6b	Order heroes by stream_ordering (as spec'ed) (#17435) ... The spec specifically mentions `stream_ordering` but that's a Synapse specific concept. In any case, the essence of the spec is basically the first 5 members of the room which `stream_ordering` accomplishes. Split off from https://github.com/element-hq/synapse/pull/17419#discussion_r1671342794 ## Spec compliance > This should be the first 5 members of the room, **ordered by stream ordering**, which are joined or invited. The list must never include the client’s own user ID. When no joined or invited members are available, this should consist of the banned and left users. > > *-- https://spec.matrix.org/v1.10/client-server-api/#_matrixclientv3sync_roomsummary* Related to https://github.com/matrix-org/matrix-spec/issues/1334	2024-07-17 13:10:15 -05:00
Till Faelligen	5884f0a956	Merge branch 'master' into develop	2024-07-16 14:33:58 +02:00
dependabot[bot]	79924aebef	Bump mypy from 1.9.0 to 1.10.1 (#17445)	2024-07-16 12:08:06 +01:00
Till Faelligen	574aa53126	1.111.0	2024-07-16 12:55:26 +02:00
dependabot[bot]	83894180b2	Bump matrix-org/done-action from 2 to 3 (#17440)	2024-07-16 11:35:47 +01:00
Shay	429ecb7564	Handle remote download responses with UNKNOWN_LENGTH more gracefully (#17439) ... Prior to this PR, remote downloads which did not provide a `content-length` were decremented from the remote download ratelimiter at the max allowable size, leading to excessive ratelimiting - see https://github.com/element-hq/synapse/issues/17394. This PR adds a linearizer to limit concurrent remote downloads to 6 per IP address, and decrements remote downloads without a `content-length` from the ratelimiter *after* the download is complete and the response length is known. Also adds logic to ensure that responses with a known length respect the `max_download_size`.	2024-07-16 11:13:55 +01:00
dependabot[bot]	9e1acea051	Bump setuptools from 67.6.0 to 70.0.0 (#17448)	2024-07-16 10:06:05 +01:00
Shay	899d33f2ba	Remove unnecessary call to resume producing in fake channel (#17449) ... This fell out of the authenticated media work - this bit of code masked a bug but does not break anything when removed, so probably should be removed.	2024-07-16 09:52:39 +01:00
Erik Johnston	df11af14db	Fix bug where sync could get stuck when using workers (#17438) ... This is because we serialized the token wrong if the instance map contained entries from before the minimum token.	2024-07-15 16:13:04 +01:00
dependabot[bot]	d88ba45db9	Bump types-jsonschema from 4.22.0.20240610 to 4.23.0.20240712 (#17446)	2024-07-15 13:58:28 +01:00
dependabot[bot]	14f2b1eb00	Bump bytes from 1.6.0 to 1.6.1 (#17441)	2024-07-15 13:58:12 +01:00
dependabot[bot]	2af729a193	Bump ulid from 1.1.2 to 1.1.3 (#17442)	2024-07-15 13:57:45 +01:00
dependabot[bot]	0de0689ae8	Bump jsonschema from 4.22.0 to 4.23.0 (#17444)	2024-07-15 13:57:30 +01:00
dependabot[bot]	4c44020838	Bump twine from 5.1.0 to 5.1.1 (#17443)	2024-07-15 13:57:13 +01:00
Quentin Gliech	4f6194492a	Make sure we use the right logic for enabling the media repo. (#17424) ... This removes the `enable_media_repo` attribute on the server config in favour of always using the `can_load_media_repo` in the media config. This should avoid issues like in #17420 in the future	2024-07-15 11:42:59 +02:00
Eric Eastwood	ab62aa09da	Add room subscriptions to Sliding Sync /sync (#17432) ... Add room subscriptions to Sliding Sync `/sync` Based on [MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575): Sliding Sync Currently, you can only subscribe to rooms you have had *any* membership in before. In the future, we will allow `world_readable` rooms to be subscribed to without joining.	2024-07-15 10:37:10 +01:00
Eric Eastwood	fb66e938b2	Add is_dm room field to Sliding Sync /sync (#17429) ... Based on [MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575): Sliding Sync	2024-07-11 18:19:26 -05:00
Eric Eastwood	5a97bbd895	Add heroes and room summary fields to Sliding Sync /sync (#17419) ... Additional room summary fields: `joined_count`, `invited_count` Based on [MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575): Sliding Sync	2024-07-11 14:05:38 -05:00
Erik Johnston	606da398fc	Fix filtering room types on remote rooms (#17434) ... We can only fetch room types for rooms the server is in, so we need to only filter rooms that we're joined to. Also includes a perf fix to bulk fetch room types.	2024-07-11 16:00:44 +01:00
Travis Ralston	677142b6a9	Fix docs on record_action to clarify the actions are applied (#17426) ... This looks like a copy/paste error: the function doesn't reject anything, but instead allows the action count to go through regardless. The remainder of the function's documentation appears correct.	2024-07-11 14:03:13 +01:00
villepeh	342f0c35b7	Add Red Hat Enterprise Linux and Rocky Linux installation instructions (#17423) ... Added RHEL/Rocky install instructions (PyPI). Instructions cover versions 8 and 9 which are the only supported ones - except for RHEL7 which is now on extended life cycle support phase. Large part of the guide is for installing Python 3.11 or 3.12. RHEL8 ships with Python 3.6 and RHEL9 ships with 3.9. Newer Python versions can be installed easily as they don't interfere with OS software that still relies on the default Python version. I was first planning to add prerequisites part to the prerequisites section and then install instructions on the top of the page but that section is for pre-built packages so it just didn't sound right. So I just dumped everything to the PyPI section of the page. But suggestions to change are welcome. I also didn't combine these with Fedora section. I haven't tested those packages on RHEL and Fedora ships with Python 3.12 out-of-box.	2024-07-11 14:02:19 +01:00
Joe Groocock	5871daf877	Use consistent casing between FROM and AS (#17431) ... Signed-off-by: Joe Groocock <me@frebib.net>	2024-07-11 13:56:25 +01:00
dependabot[bot]	30e14c8510	Bump zipp from 3.15.0 to 3.19.1 (#17427)	2024-07-11 11:54:21 +01:00
Will Lewis	3232bc2982	Upload new logo with white bg and update readme to use it (#17387)	2024-07-10 14:59:24 +01:00
Erik Johnston	4ca13ce0dd	Handle to-device extensions to Sliding Sync (#17416) ... Implements MSC3885 --------- Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>	2024-07-10 11:58:42 +01:00
Quentin Gliech	8e229535fa	Merge branch 'release-v1.111' into develop	2024-07-10 11:36:07 +02:00
Quentin Gliech	e0ff850cb7	1.111.0rc2	2024-07-10 10:47:35 +02:00
Erik Johnston	22fbc5be54	Fix new media APIs when using synapse.app.media_repository (#17420) ... Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>	2024-07-09 18:29:32 +01:00
Eric Eastwood	1cf3ff6b40	Add rooms name and avatar to Sliding Sync /sync (#17418) ... Based on [MSC3575](https://github.com/matrix-org/matrix-spec-proposals/pull/3575): Sliding Sync	2024-07-09 12:26:45 -05:00
Andrew Morgan	62d8b0361b	Note the new federated media worker endpoints in the worker docs & upgrade notes (#17421)	2024-07-09 16:41:51 +01:00
Andrew Morgan	4d6f7c0fc9	Route auth'd fed media requests to media repo in Complement tests (#17422)	2024-07-09 15:12:11 +00:00
Quentin Gliech	d48061b7e6	Fix up the changelog	2024-07-09 12:36:24 +02:00
Quentin Gliech	963a60c7e7	Merge remote-tracking branch 'origin/develop' into release-v1.111	2024-07-09 12:36:15 +02:00
Quentin Gliech	8e7da35402	Tweak the changelog for v1.111.0rc1 ... Co-authored-by: Andrew Morgan <andrewm@element.io>	2024-07-09 12:04:52 +02:00
Erik Johnston	028b103ae0	Fix exception when failing to talk to remote server (#17411) ... Broke in #17381	2024-07-09 10:04:40 +00:00
Quentin Gliech	abb1384502	1.111.0rc1	2024-07-09 11:51:51 +02:00
Erik Johnston	0ed1c64c83	Fix /versions requests (#17410) ... We need it to work on workers and allow guest access. Broke by #17392	2024-07-09 10:25:44 +01:00
dependabot[bot]	1353fb3347	Bump ijson from 3.2.3 to 3.3.0 (#17413)	2024-07-09 09:31:57 +01:00
dependabot[bot]	b15e17ce6e	Bump pillow from 10.3.0 to 10.4.0 (#17412)	2024-07-09 09:31:42 +01:00