Eric Eastwood
76cc6629de
Use events.stream_ordering since local_current_membership.event_stream_ordering is nullable
...
And seems to actually have `null` values in it
2024-09-10 13:55:56 -05:00
Eric Eastwood
8477df44b6
Fix f-string
2024-09-10 13:46:06 -05:00
Eric Eastwood
6f3e8be1dc
Add assertion message to better debug
2024-09-10 13:41:49 -05:00
Eric Eastwood
bb5784b268
Need to sort by room_id to make progress
2024-09-10 13:08:06 -05:00
Eric Eastwood
e2dca5d37e
Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates
...
Conflicts:
synapse/storage/databases/main/events_bg_updates.py
2024-09-10 12:59:29 -05:00
Travis Ralston
a7fcac5648
Enable guest access on new media endpoints, per MSC4189 ( #17675 )
2024-09-10 18:29:24 +01:00
V02460
e06e3c4004
Add config option turn_shared_secret_path ( #17690 )
...
Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>
2024-09-10 17:27:46 +00:00
dependabot[bot]
60441059a3
Bump anyhow from 1.0.86 to 1.0.87 ( #17685 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 18:05:31 +01:00
Jeremy Wright
1b197752b6
Fix minor misspelling in README.rst. ( #17664 )
2024-09-10 17:33:25 +01:00
dependabot[bot]
598a83d005
Bump cryptography from 43.0.0 to 43.0.1 ( #17689 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 17:32:17 +01:00
dependabot[bot]
be603de2cb
Bump serde_json from 1.0.127 to 1.0.128 ( #17687 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 17:31:34 +01:00
dependabot[bot]
62523571ae
Bump serde from 1.0.209 to 1.0.210 ( #17686 )
2024-09-10 17:30:37 +01:00
Devon Hudson
5562a89168
Update changelog
2024-09-10 08:48:41 -06:00
Devon Hudson
59bcbcec0a
1.115.0rc1
2024-09-10 08:42:01 -06:00
dependabot[bot]
d8b926d323
Bump idna from 3.7 to 3.8 ( #17682 )
2024-09-10 10:34:54 +01:00
dependabot[bot]
2efed1d4fb
Bump types-setuptools from 71.1.0.20240818 to 74.1.0.20240907 ( #17681 )
2024-09-10 10:34:45 +01:00
dependabot[bot]
cd24bc2f36
Bump ruff from 0.6.2 to 0.6.4 ( #17680 )
2024-09-10 10:34:34 +01:00
dependabot[bot]
a193d4a1b5
Bump authlib from 1.3.1 to 1.3.2 ( #17679 )
2024-09-10 10:34:26 +01:00
Erik Johnston
b3047f3f17
Sliding sync: various fixups to the sliding sync joined room background job ( #17673 )
...
Follow-up to #17652 , https://github.com/element-hq/synapse/pull/17641 ,
https://github.com/element-hq/synapse/pull/17634 ,
https://github.com/element-hq/synapse/pull/17631 and
https://github.com/element-hq/synapse/pull/17632 to fix-up
https://github.com/element-hq/synapse/pull/17512
2024-09-10 10:22:46 +01:00
Erik Johnston
9689ac3294
Sliding Sync: Look for bump _stamp in the room timeline ( #17684 )
...
This allows us to skip checking the database a lot of the time.
---------
Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>
2024-09-10 10:20:30 +01:00
Erik Johnston
588e5b521d
Sliding Sync: Retrieve fewer events from DB in sync ( #17688 )
...
When using timeline limit of 1 we end up fetching 2 events from the DB
purely to tell if the response was "limited" or not. Lets not do that.
2024-09-10 09:52:42 +01:00
Eric Eastwood
ca4afad068
Be more precise
2024-09-09 23:42:22 -05:00
Eric Eastwood
a2da5376a3
Add changelog
2024-09-09 23:38:36 -05:00
Eric Eastwood
f045574426
Better comments
2024-09-09 23:25:08 -05:00
Eric Eastwood
1688212268
Uncomment and remove todo
2024-09-09 23:14:38 -05:00
Eric Eastwood
815ef2fb99
Read from the room_stats_state table
2024-09-09 23:10:25 -05:00
Eric Eastwood
a4cc5eb02c
Get snapshots info concurrently
2024-09-09 22:53:52 -05:00
Eric Eastwood
1078163731
Make sure re-use doesn't blow up
2024-09-09 21:31:44 -05:00
Eric Eastwood
2c2146d167
Only re-use for join memberships
2024-09-09 20:00:42 -05:00
Eric Eastwood
90371d48af
Sort by event_stream_ordering so we can re-use snapshots along the way
2024-09-09 19:31:47 -05:00
Eric Eastwood
836bcaefe0
Fix nothing being upserted
2024-09-09 19:13:28 -05:00
Eric Eastwood
f74106bc71
Implement insertion_value_names/insertion_value_values for simple_upsert_many_txn(...)
2024-09-09 18:44:15 -05:00
Eric Eastwood
ef2f5532c8
Merge branch 'develop' into madlittlemods/sliding-sync-faster-background-updates
...
Conflicts:
synapse/storage/databases/main/events_bg_updates.py
2024-09-09 17:58:54 -05:00
Eric Eastwood
515c1cc0a1
Sliding Sync: Add comment to explain extra case where you can be invited -> banned -> unbanned ( #17654 )
...
Add comment to explain extra case where you can be
invited -> banned -> unbanned and we want to be able
to find the invite event.
Follow-up to https://github.com/element-hq/synapse/pull/17636#discussion_r1738993330
2024-09-09 17:55:59 -05:00
Eric Eastwood
e1ed959a68
Sliding Sync: Get bump_stamp from new sliding sync tables because it's faster ( #17658 )
...
Get `bump_stamp` from [new sliding sync
tables](https://github.com/element-hq/synapse/pull/17512 ) which should
be faster (performance) than flipping through the latest events in the
room.
2024-09-09 16:41:25 +01:00
Erik Johnston
5c229415c4
Revert "Look for bump stamp in the room timeline"
...
This reverts commit a3c49565ff
2024-09-09 11:58:50 +01:00
Erik Johnston
a3c49565ff
Look for bump stamp in the room timeline
...
This allows us to skip checking the database a lot of the time.
2024-09-09 11:58:18 +01:00
Eric Eastwood
5389374ef8
Sliding Sync: Speed up incremental sync by avoiding extra work ( #17665 )
...
Speed up incremental sync by avoiding extra work. We first look at the
state delta changes and only fetch and calculate further derived things
if they have changed.
2024-09-09 10:36:22 +01:00
Eric Eastwood
333b4721be
TODO and asserts
2024-09-06 15:36:28 -05:00
Erik Johnston
e5d07bb083
Fix bump stamp for non-joined rooms ( #17674 )
...
We should only look for bump stamps in joined rooms, otherwise we should
just use the membership stream ordering.
2024-09-06 11:44:37 +01:00
Erik Johnston
a708e1afd0
Small performance improvements for sliding sync ( #17672 )
...
A couple of small performance improvements for sliding sync.
2024-09-06 11:44:13 +01:00
Erik Johnston
786de8570b
Speed up fetching partial-state rooms on sliding sync ( #17666 )
...
Instead of having a large cache of `room_id -> bool` about whether a
room is partially stated, replace with a "fetch rooms the user is which
are partially-stated". This is a lot faster as the set of partially
stated rooms at any point across the whole server is small, and so such
a query is fast.
The main issue with the bulk cache lookup is the CPU time looking all
the rooms up in the cache.
2024-09-06 11:12:54 +01:00
Erik Johnston
d5accec2e5
Speed up sliding sync by avoiding copies ( #17670 )
...
We ended up spending ~10% CPU creating a new dictionary and
`_RoomMembershipForUser`, so let's avoid creating new dicts and copying
by returning `newly_joined`, `newly_left` and `is_dm` as sets directly.
---------
Co-authored-by: Eric Eastwood <eric.eastwood@beta.gouv.fr>
2024-09-06 11:12:29 +01:00
Eric Eastwood
27caa47c50
Work on snapshots background update
2024-09-06 02:34:07 -05:00
Eric Eastwood
ce7e1b4e67
Look for previous snapshot
2024-09-06 01:48:39 -05:00
Eric Eastwood
b4fcbc9686
concurrently_execute inserting
2024-09-06 00:48:48 -05:00
Eric Eastwood
5894fc200c
concurrently_execute data fetching
2024-09-06 00:33:55 -05:00
Eric Eastwood
944661a949
Pull from room_stats_state
2024-09-06 00:24:26 -05:00
Johannes Marbach
de3363ef58
Stabilise MSC4156: server_name -> via ( #17650 )
2024-09-05 17:07:39 +01:00
Erik Johnston
6b770d8bfc
Revert "Fix bump stamp for non-joined rooms"
...
This reverts commit f73c844403
2024-09-05 15:43:37 +01:00
