mirrors/synapse
1
0
Fork 0
mirror of https://github.com/element-hq/synapse.git synced 2024-12-19 09:31:35 +03:00
Code Issues Projects Releases Packages Wiki Activity
24226 commits 937 branches 734 tags 461 MiB
Commit graph

24226 commits

This branch
This branch
All branches
Author SHA1 Message Date
Eric Eastwood
e5f133d0bf Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates 
Conflicts:
	synapse/storage/databases/main/events_bg_updates.py
	tests/storage/test_sliding_sync_tables.py
 2024-09-11 11:34:15 -05:00
Eric Eastwood
6565380a8b Rely on events.stream_ordering 2024-09-11 10:58:07 -05:00
Erik Johnston
6b131a99fe Merge remote-tracking branch 'origin/release-v1.115' into develop 2024-09-11 16:43:07 +01:00
Erik Johnston
76f7c91e44 Sliding sync: don't fetch room summary for named rooms. (#17683) 
For rooms with a name we can skip fetching a full room summary, as we
don't need to calculate heroes, and instead just fetch the room counts
directly.

This also changes things to not return counts and heroes for non-joined
rooms. For left/banned rooms we were returning zero values anyway, and
for invite/knock rooms we don't really want to leak such information
(even if some of is included in the stripped state).
 2024-09-11 16:42:50 +01:00
Erik Johnston
b732d13d4c Sliding sync: various fixups to the background update (#17652) 2024-09-11 16:42:15 +01:00
Erik Johnston
596b96411b
Sliding sync: various fixups to the background update (#17652) 2024-09-11 15:38:46 +01:00
Erik Johnston
f6c2b0ec2e
Sliding sync: don't fetch room summary for named rooms. (#17683) 
For rooms with a name we can skip fetching a full room summary, as we
don't need to calculate heroes, and instead just fetch the room counts
directly.

This also changes things to not return counts and heroes for non-joined
rooms. For left/banned rooms we were returning zero values anyway, and
for invite/knock rooms we don't really want to leak such information
(even if some of is included in the stripped state).
 2024-09-11 13:16:57 +01:00
Eric Eastwood
2e8f5d66da Use correct table 2024-09-10 14:00:34 -05:00
Eric Eastwood
76cc6629de Use events.stream_ordering since local_current_membership.event_stream_ordering is nullable 
And seems to actually have `null` values in it
 2024-09-10 13:55:56 -05:00
Eric Eastwood
8477df44b6 Fix f-string 2024-09-10 13:46:06 -05:00
Eric Eastwood
6f3e8be1dc Add assertion message to better debug 2024-09-10 13:41:49 -05:00
Eric Eastwood
bb5784b268 Need to sort by room_id to make progress 2024-09-10 13:08:06 -05:00
Eric Eastwood
e2dca5d37e Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates 
Conflicts:
	synapse/storage/databases/main/events_bg_updates.py
 2024-09-10 12:59:29 -05:00
Travis Ralston
a7fcac5648
Enable guest access on new media endpoints, per MSC4189 (#17675) 2024-09-10 18:29:24 +01:00
V02460
e06e3c4004
Add config option turn_shared_secret_path (#17690) 
Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
 2024-09-10 17:27:46 +00:00
dependabot[bot]
60441059a3
Bump anyhow from 1.0.86 to 1.0.87 (#17685) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 18:05:31 +01:00
Jeremy Wright
1b197752b6
Fix minor misspelling in README.rst. (#17664) 2024-09-10 17:33:25 +01:00
dependabot[bot]
598a83d005
Bump cryptography from 43.0.0 to 43.0.1 (#17689) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 17:32:17 +01:00
dependabot[bot]
be603de2cb
Bump serde_json from 1.0.127 to 1.0.128 (#17687) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-10 17:31:34 +01:00
dependabot[bot]
62523571ae
Bump serde from 1.0.209 to 1.0.210 (#17686) 2024-09-10 17:30:37 +01:00
Devon Hudson
5562a89168
Update changelog 2024-09-10 08:48:41 -06:00
Devon Hudson
59bcbcec0a
1.115.0rc1 2024-09-10 08:42:01 -06:00
dependabot[bot]
d8b926d323
Bump idna from 3.7 to 3.8 (#17682) 2024-09-10 10:34:54 +01:00
dependabot[bot]
2efed1d4fb
Bump types-setuptools from 71.1.0.20240818 to 74.1.0.20240907 (#17681) 2024-09-10 10:34:45 +01:00
dependabot[bot]
cd24bc2f36
Bump ruff from 0.6.2 to 0.6.4 (#17680) 2024-09-10 10:34:34 +01:00
dependabot[bot]
a193d4a1b5
Bump authlib from 1.3.1 to 1.3.2 (#17679) 2024-09-10 10:34:26 +01:00
Erik Johnston
b3047f3f17
Sliding sync: various fixups to the sliding sync joined room background job (#17673) 
Follow-up to #17652, https://github.com/element-hq/synapse/pull/17641,
https://github.com/element-hq/synapse/pull/17634,
https://github.com/element-hq/synapse/pull/17631 and
https://github.com/element-hq/synapse/pull/17632 to fix-up
https://github.com/element-hq/synapse/pull/17512
 2024-09-10 10:22:46 +01:00
Erik Johnston
9689ac3294
Sliding Sync: Look for bump _stamp in the room timeline (#17684) 
This allows us to skip checking the database a lot of the time.

---------

Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>
 2024-09-10 10:20:30 +01:00
Erik Johnston
588e5b521d
Sliding Sync: Retrieve fewer events from DB in sync (#17688) 
When using timeline limit of 1 we end up fetching 2 events from the DB
purely to tell if the response was "limited" or not. Lets not do that.
 2024-09-10 09:52:42 +01:00
Eric Eastwood
ca4afad068 Be more precise 2024-09-09 23:42:22 -05:00
Eric Eastwood
a2da5376a3 Add changelog 2024-09-09 23:38:36 -05:00
Eric Eastwood
f045574426 Better comments 2024-09-09 23:25:08 -05:00
Eric Eastwood
1688212268 Uncomment and remove todo 2024-09-09 23:14:38 -05:00
Eric Eastwood
815ef2fb99 Read from the room_stats_state table 2024-09-09 23:10:25 -05:00
Eric Eastwood
a4cc5eb02c Get snapshots info concurrently 2024-09-09 22:53:52 -05:00
Eric Eastwood
1078163731 Make sure re-use doesn't blow up 2024-09-09 21:31:44 -05:00
Eric Eastwood
2c2146d167 Only re-use for join memberships 2024-09-09 20:00:42 -05:00
Eric Eastwood
90371d48af Sort by event_stream_ordering so we can re-use snapshots along the way 2024-09-09 19:31:47 -05:00
Eric Eastwood
836bcaefe0 Fix nothing being upserted 2024-09-09 19:13:28 -05:00
Eric Eastwood
f74106bc71 Implement insertion_value_names/insertion_value_values for simple_upsert_many_txn(...) 2024-09-09 18:44:15 -05:00
Eric Eastwood
ef2f5532c8 Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates 
Conflicts:
	synapse/storage/databases/main/events_bg_updates.py
 2024-09-09 17:58:54 -05:00
Eric Eastwood
515c1cc0a1
Sliding Sync: Add comment to explain extra case where you can be invited -> banned -> unbanned (#17654) 
Add comment to explain extra case where you can be
invited -> banned -> unbanned and we want to be able
to find the invite event.

Follow-up to https://github.com/element-hq/synapse/pull/17636#discussion_r1738993330
 2024-09-09 17:55:59 -05:00
Eric Eastwood
e1ed959a68
Sliding Sync: Get bump_stamp from new sliding sync tables because it's faster (#17658) 
Get `bump_stamp` from [new sliding sync
tables](https://github.com/element-hq/synapse/pull/17512) which should
be faster (performance) than flipping through the latest events in the
room.
 2024-09-09 16:41:25 +01:00
Erik Johnston
5c229415c4 Revert "Look for bump stamp in the room timeline" 
This reverts commit a3c49565ff.
 2024-09-09 11:58:50 +01:00
Erik Johnston
a3c49565ff Look for bump stamp in the room timeline 
This allows us to skip checking the database a lot of the time.
 2024-09-09 11:58:18 +01:00
Eric Eastwood
5389374ef8
Sliding Sync: Speed up incremental sync by avoiding extra work (#17665) 
Speed up incremental sync by avoiding extra work. We first look at the
state delta changes and only fetch and calculate further derived things
if they have changed.
 2024-09-09 10:36:22 +01:00
Eric Eastwood
333b4721be TODO and asserts 2024-09-06 15:36:28 -05:00
Erik Johnston
e5d07bb083
Fix bump stamp for non-joined rooms (#17674) 
We should only look for bump stamps in joined rooms, otherwise we should
just use the membership stream ordering.
 2024-09-06 11:44:37 +01:00
Erik Johnston
a708e1afd0
Small performance improvements for sliding sync (#17672) 
A couple of small performance improvements for sliding sync.
 2024-09-06 11:44:13 +01:00
Erik Johnston
786de8570b
Speed up fetching partial-state rooms on sliding sync (#17666) 
Instead of having a large cache of `room_id -> bool` about whether a
room is partially stated, replace with a "fetch rooms the user is which
are partially-stated". This is a lot faster as the set of partially
stated rooms at any point across the whole server is small, and so such
a query is fast.

The main issue with the bulk cache lookup is the CPU time looking all
the rooms up in the cache.
 2024-09-06 11:12:54 +01:00