mirrors/rss-bridge
1
0
Fork 0
mirror of https://github.com/RSS-Bridge/rss-bridge.git synced 2024-12-25 21:58:24 +03:00
Code Issues Projects Releases Packages Wiki Activity
3873 commits 9 branches 34 tags 33 MiB
Commit graph

2591 commits

Author SHA1 Message Date
Dag
5f777d4126
fix(codeberg): add temp fix (#3730) 
they changed html for tag and commit
 2023-10-05 15:36:35 +02:00
Niehztog
e376805249
[NiusBridge] fix parse error, fix image content-type (#3728) 2023-10-05 02:31:04 +02:00
sysadminstory
1cbe1a6f98
[PepperBridge] Fix date parsing (#3727) 
Website changed the date display.
This fix adapt the date parsing to the new website date display
 2023-10-03 23:15:10 +02:00
Dag
64582a64f1
fix(tpb): add category (#3725) 2023-10-01 21:19:27 +02:00
User123698745
69da0dd583
[refactoring] replace direct use of curl with getContents (#3723) 
+ some fixed warnings
 2023-10-01 20:46:51 +02:00
Dag
41df17bc46
refactor (#3712) 
* test: refactor test suite

* docs

* refactor

* yup

* docs
 2023-10-01 19:23:30 +02:00
sysadminstory
0c92cf32d4
[ImgsedBridge] Fix and improvements (#3710) 
* [ImgsedBridge] Fix and improvements

- Display an error if the user doesn't select at least an content type
  to display
- Unsplit the regular expression to make the URL of imgsed.com work too
- Remove the "hour part" of the publication date : the website shows
  only the number of days if the content is older than one day

* [ImgsedBridge] Fix and improvements

Fix syntax

* [ImgsedBridge] Fix and improvements

- Fix TEST_DETECT_PARAMETERS
- change detectParameters regular expression to match more instagram.com
  URLs

* [ImgsedBridge] Fix and improvements

- Fix date parsing for interval 'a day'

* lint

---------

Co-authored-by: Dag <me@dvikan.no>
 2023-10-01 19:00:13 +02:00
Dag
7273a05f02
fix: google play and tiktok (#3722) 
* fix(googleplay)

* fix(tiktok)
 2023-10-01 18:53:50 +02:00
ORelio
3557e5ffd4
[CssSelector/Sitemap] Minor fixes (#3719) 
- Apply title_cleanup to title from metadata (#3717)
- Metadata: Fix ld+json object/array confusion
- Sitemap: Also try /sitemap.xml well known url
 2023-09-30 15:03:52 +02:00
Dag
2172df9fa2
fix: various notice fixes (#3718) 2023-09-29 19:17:03 +02:00
Dag
b9ec6a0eb4
feat: add manyvids bridge (#3716) 2023-09-29 00:39:24 +02:00
Dag
ae53adefad
refactor: FeedItem::setTimestamp() (#3711) 2023-09-26 00:27:45 +02:00
Dag
f421c45b21
test: add feed item test (#3709) 
* test: add feed item test

also some refactor

* yup

* yup
 2023-09-25 22:32:15 +02:00
ORelio
e1b911fc1f
[CssSelectorBridge] Retrieve metadata for social media embeds (#3602, #3687) (#3706) 
* [CssSelectorBridge] Metadata from social embed (#3602, #3687)

Implement the following metadata sources:
 - Facebook Open Graph
 - Twitter <meta> tags
 - Standard <meta> tags
 - JSON linked data (ld+json)

The following metadata is supported:
 - Canonical URL (may help removing garbage from URLs)
 - Article title
 - Truncated summary
 - Published/Updated timestamp
 - Enclosure/Thumbnail image
 - Author Name or Twitter handle

SitemapBridge will also automatically benefit from this commit.

* [php8backports] Add array_is_list()

Needed this function for ld+json implementation in CssSelectorBridge.

* [SitemapBridge] Add option to discard thumbnail

* [CssSelectorBridge] Fix linting issues
 2023-09-24 23:07:43 +02:00
Dag
f321f000c1
feat: add url component (#3684) 
* feat: add url library

* fix
 2023-09-24 18:34:09 +02:00
Dag
437afd67e0
fix: various fixes (#3702) 
* fix: symfonycasts

* various fixes
 2023-09-24 18:15:14 +02:00
ORelio
ce353c1e4f
[CssSelectorBridge] Fix URL filtering (#3676) (#3701) 
Co-authored-by: tougaj <tougaj@users.noreply.github.com>
 2023-09-24 16:12:30 +02:00
Dag
0dc6c66840
fix: add duration (#3699) 2023-09-24 00:03:21 +02:00
Dag
d33808ea9e
fix: image (#3698) 2023-09-23 23:49:01 +02:00
Dag
0c69148cff
fix(vice): news rss changed (#3694) 
* fix: typo in prior commit

* fix(vice): news rss changed
 2023-09-23 20:39:02 +02:00
Dag
bab02bf190
fix(flickr) (#3692) 2023-09-23 19:29:04 +02:00
Dag
cb6c931b1f
fix(duckduckgo): order by date (#3689) 2023-09-23 17:50:41 +02:00
Dag
a6a1d553d9
tweaks (#3686) 2023-09-22 20:59:45 +02:00
Dag
39d6710798
fix(twitch) (#3685) 2023-09-22 20:41:39 +02:00
mruac
a3c29f3a52
resolve comment (#3683) 
https://github.com/RSS-Bridge/rss-bridge/pull/3617#issuecomment-1730244049
 2023-09-22 09:38:05 +02:00
User123698745
7a9bfa1087
[YoutubeBridge] handle new youtube description system / fix missing description (#3682) 
* [YoutubeBridge] handle new youtube description system

* [YoutubeBridge] fix unrelated warnings

* [YoutubeBridge] discard everything when one link can not be matched & add more boundary chars

* [YoutubeBridge] rebase on master & minor fixes
 2023-09-22 05:40:13 +02:00
Dag
7329b83cc0
refactor: logger (#3678) 2023-09-21 22:05:55 +02:00
Julien Papasian
360f953be8
Fix #3674 - [Nautiljon] Remove requirement of cURL NSS (#3679) 
Looks like it works with OpenSSL now.
 2023-09-21 18:55:53 +02:00
Dag
0bf38e5c56
fix: small notice errors (#3677) 
* fix notice

* fix notice

* tweak

* tweaks
 2023-09-20 03:15:15 +02:00
Scott Colby
cf7e3eea56
Add DeutscheWelle FeedExpander bridge. (#3673) 
* [DeutscheWelle] Add DeutscheWelle FeedExpander bridge.

* [DeutscheWelle] Fix linting errors.
 2023-09-15 23:41:08 +02:00
User123698745
3b91b1d260
[XPathBridge] add option to skip htmlspecialchars (#3672) 2023-09-15 01:58:06 +02:00
Dag
409236e48e
fix: logic bug in 429 caching logic (#3669) 2023-09-14 03:26:01 +02:00
Dag
bb7f329e81
fix(instructables): migrate from dom to json api (#3667) 2023-09-13 22:48:37 +02:00
mruac
3e1e96e477
[PatreonBridge] resolve null coalescing issue (#3664) 
* extend post presentation

* applied phpcbf

note: phpcs does not like long null coalescing chains

* resolved phpcs

* resolved github comment https://github.com/RSS-Bridge/rss-bridge/pull/3617/#issuecomment-1699568400

* .

* lint SteamAppNewsBridge
 2023-09-11 13:15:14 +02:00
ImportTaste
a9cf1512e7
[SteamAppNewsBridge] Add tags filter (#3662) 
Undocumented tags filter discovered through /ISteamWebAPIUtil/GetSupportedAPIList/v1/
e.g. /ISteamNews/GetNewsForApp/v2/?appid=1091500&tags=patchnotes
 2023-09-11 03:35:09 +02:00
Dag
3178deb5a8
fix: mastodon, cache tweaks, docs (#3661) 
* cache tweaks

* docs

* fix(mastodon): type bug
 2023-09-10 23:35:40 +02:00
Dag
4b9f6f7e53
fix: rewrite and improve caching (#3594) 2023-09-10 21:50:15 +02:00
July
586d707ae4
[ArsTechnicaBridge] Add new bridge (#3657) 2023-09-09 09:19:09 +02:00
mruac
b3a7842448
[PixivBridge] Add cookie auth and options (#3653) 
* added cookie mgmt and support for issue
https://github.com/RSS-Bridge/rss-bridge/issues/2759

* added image proxy option

* + mature and ai options, + cookie doc

* mention doc

* check cookie is auth'd
 2023-09-06 16:16:25 +02:00
csisoap
dbe37cc302
[TwitterBridge] Filter out any promoted tweet (#3652) 
* Filter out any advertise tweet

* Make some filter work, fix bug that may happen with tweet id list.

* clear phpcs warning, ignore line length warning
 2023-09-06 16:14:11 +02:00
sysadminstory
38b957398a
[AutoJMBridge] Fix content extraction (#3649) 
* [AutoJMBridge] Fix content extraction

- Website changed, bridge was updated accordingly
- Added the function detectParameters
- Added the test array for the detectParameters function

* [AutoJMBridge] Fix test

Fix content of the TEST_DETECT_PARAMETERS array

* [AutoJMBridge] Update exaù^me value parameter

Example value was not valid anymore, so it was updated
 2023-09-05 02:12:47 +02:00
User123698745
99b86c0e1c
[GithubSearchBridge] repair bridge / handle new search ui (#3647) 2023-09-04 03:00:08 +02:00
Niehztog
92b2bc5e11
fixes extracting article images, article date/time and article author and item id (#3645) 2023-09-03 00:22:48 +02:00
R3dError
64000a2526
[NACSouthGermanyMediaLibraryBridge] Add new bridge (#3636) 
* Init nac south bridge

* Rename bridge

* Refactoring

* Refactor

* Fix formatting

* Fix testing errors

* Change constants

* Update logo

* Remove author omission in descriptions

* Fix comment

* Add maintainer

* Rename bridge

* Add technical note to bridge description
 2023-08-30 19:01:55 +02:00
csisoap
4d05d0beff
[TwitterBridge] Add support for OAuth authorization. (#3628) 
* Update TwitterClient.php

- Add OAuth authorization header.
- Add new endpoint.

* Update TwitterBridge.php

- Make some changes to support new endpoint.

* Update TwitterBridge.php

* clean up, fix warning

* fix warning

* fix warning

* remove oauth token

* fix wrong twitter id when encounter reply post.

* Update TwitterClient.php

* fix wrong twitter id cause by previous commit

* clear warning

* attempt to clear warning

* attempt to clear warning
 2023-08-29 17:14:34 +02:00
mruac
9707586ee8
[PatreonBridge] Extend the presentation of parsed posts (#3617) 
* extend post presentation

* applied phpcbf

note: phpcs does not like long null coalescing chains

* resolved phpcs
 2023-08-29 17:09:05 +02:00
mruac
f0ec797f4b
[FurAffinityBridge] Option for instance host to add custom cookie (#3638) 
* added custom cookie config

* appease phpunit
 2023-08-29 17:05:37 +02:00
mruac
9e33a15b93
[FurAffinityBridge] Fix if search result contains hidden submission (#3637) 
* Reverts to preview submission if full is hidden

* Reverts to preview submission if full is hidden

* revert

* added fallback to higher res preview if SWF

* amend
 2023-08-29 17:04:10 +02:00
Paul
00a18a1cd1
Merge pull request #3639 from Mynacol/gitlab-epic 
[GitlabIssueBridge] Add support for GitLab Epics
 2023-08-27 13:32:04 +02:00
Mynacol
14607c07f6 [GitlabIssueBridge] Fix example values for MR 
These values are used for testing and PR artifacts, but
https://gitlab.com/fdroid/fdroidclient currently has no MR !2099,
leading to a HTTP 404 error. This just uses issue #1 and MR !1.

To support epics, the specified repository is ignored.
 2023-08-27 13:27:37 +02:00
Mynacol
999d5dce40 [HeiseBridge] Remove archive link for heise+ 
archive.ph is also not able to provide the full content of paywalled
heise+ articles.
 2023-08-27 13:01:09 +02:00
Mynacol
c3b5b382ba [ZeitBridge] Remove broken paywall workaround 
Clean up spoofing Google Bot as this workaround doesn't work anymore.
 2023-08-27 12:57:36 +02:00
Mynacol
18a8a51271 [GitlabIssueBridge] Add support for GitLab Epics 2023-08-27 12:13:44 +02:00
t0stiman
0325c2414a
fix carthrottlebridge (#3633) 2023-08-25 12:34:35 +02:00
Lars Stegman
eb4ff7099f
CSS Selector Bridge 2 (#3626) 
* [CssSelector2Bridge] Implement CSS Selector bridge 2

* [CssSelector2Bridge] Fix author not being loaded

* [CssSelector2Bridge] Remove unneeded time nullcheck

* Fix linting

* Fix failing test

* Implement PR fixes

* Update bridges/CssSelector2Bridge.php

Co-authored-by: ORelio <ORelio@users.noreply.github.com>

* Rename bridge and fix syntax error for php7

---------

Co-authored-by: ORelio <ORelio@users.noreply.github.com>
 2023-08-22 21:28:16 +02:00
Dag
54045be951
fix(tpb): add missing cat (#3631) 2023-08-22 20:06:16 +02:00
Dag
3ac861a866
fix(twitch): Invalid argument supplied for foreach() at bridges/TwitchBridge.php line 115 (#3630) 2023-08-22 19:47:32 +02:00
veloute
c5cbab1231
Update TheGuardianBridge.php (#3629) 2023-08-22 17:59:06 +02:00
Eugene Molotov
959dd937b4
[VkBridge] Using more universal regular expression to generate item title (#3627) 2023-08-21 04:53:54 +02:00
John S Long
79e3f7f204
[MastodonBridge] Add support for excluding regular statuses (non-boosts/replies) (#3624) 
* [MastodonBridge]: add support for excluding posts (non-boosts/replies)

* Update name of input

* Fix lint failures
 2023-08-20 04:37:21 +02:00
Corentin Garcia
a1237d90f1
[RainbowSixSiegeBridge] fix links, date and img tag (#3619) 2023-08-15 16:16:06 +02:00
mruac
28077155ca
[PatreonBridge] Resolve creator name in feed name (#3616) 
* resolve creators without custom url

* hint how to enter creator with non-custom url

* applied phpcbf
 2023-08-15 16:04:09 +02:00
mruac
7a1180c80f
bridges: added Itaku.ee Bridge (#3615) 
* Fix php8.2 deprecated warning

Fix php8.2 warning: `Deprecated: Creation of dynamic property is deprecated`

* modified tag presentation

* renamed to fit naming convention

* undo commit

* applied phpcbf and phpunit
 2023-08-15 16:02:58 +02:00
Dag
ce72503df6
fix(codeberg): change dom selectors for timestamp and content, fix #3610 (#3611) 2023-08-11 19:02:38 +02:00
George Sokianos
d55994643d
bridges: Added Ko-Fi.com bridge (#3609) 
* Added Ko-Fi.com bridge

* Changed the exampleValue based on KoFiBridge-pr-context1 artifacts

* Fixed "Undefined array key 0" error

* fixed PHPCS issues

---------

Co-authored-by: George Sokianos <George.Sokianos@hostelworld.com>
 2023-08-11 16:16:53 +02:00
Christian Schabesberger
11ea6aedfd
hide dpa articles in Nordbayern News (#3608) 2023-08-10 23:59:37 +02:00
sysadminstory
52d3cce59d
bridges: add context to detectParameters (#3607) 
* bridges: add context to detectParameters

Some bridges did not return the context parameter but they used it in
the parameters

* bridges: add context to detectParameters

Fix test for InstagramBridge
 2023-08-09 22:40:24 +02:00
ORelio
6cc4cf24dc
[FuturaSciences] Fix content extraction (#3487, #3488) (#3606) 2023-08-09 20:10:15 +02:00
sysadminstory
1fcf67f14a
[PepperBridgeAbstract] Fix deal origin (#3605) 
Origin display has chenged : this commit follow the websites changes.

Fixes #3521
 2023-08-09 17:36:02 +02:00
sysadminstory
f3896ed543
[ImgsedBridge] Add detectParameters feature to the bridge (#3604) 
The bridge can detect the most common profile variation URL of
instagram.com or imgsed.com websites to extract the username.
 2023-08-09 17:35:35 +02:00
ORelio
b86ee5778b
[SitemapBridge] Add SitemapBridge (#3602) 
* [SitemapBridge] Add SitemapBridge

This bridge is a variant of CssSelectorBridge.
Instead of retrieving article list from home page,
retrieves article list from SEO sitemap.xml.
Requires CssSelectorBridge to be installed.

* [SitemapBridge] Code linting
 2023-08-08 15:02:01 +02:00
adminvulcano
43ec82179b
[TldrTechBridge] Add Cybersecurity section (#3601) 2023-08-08 07:00:07 +02:00
Korytov Pavel
cf6d94dc2a
[EconomistBridge] Fix strange image urls (#3600) 2023-08-08 06:58:08 +02:00
Niehztog
3e3481bd7a
adds Nius bridge (#3599) 
* adds Nius bridge

* fix linter errors

* fix linter errors

* fix linter errors

* fix extract author
 2023-08-07 05:33:35 +02:00
User123698745
4976cd227e
[FeedExpander] support xhtml content / content with child elements (#3598) 
* [core] support xhtml content type in FeedExpander

* [FilterBridge] change defaultValue to exampleValue

* [core] support content with child elements in FeedExpander
 2023-08-04 22:14:08 +02:00
Tone
d32419ffcf
added the option for a sessioncookie in heiseBridge (#3596) 
* added the option for a sessioncookie

with a valid cookie you can get full heise+ (paywall) articles

* formating

* lint

---------

Co-authored-by: Dag <me@dvikan.no>
 2023-08-03 22:43:55 +02:00
Dag
7e4807530e
fix: various small fixes (#3580) 2023-07-31 20:43:18 +02:00
Dag
8b6eecea25
docs: add note about expensive operation (#3579) 2023-07-31 20:43:11 +02:00
ORelio
f8fd05f08f
[CssSelectorBridge] Handling of missing links (#3585) 
When using parent element as URL selector:

* If no <a> inside some elements, ignore them
* If no <a> inside ALL elements, report an error

Fixes #3573 #issuecomment-1656943318
 2023-07-31 19:07:34 +02:00
User123698745
f957eea300
[FallGuysBridge] new bridge (#3584) 2023-07-31 01:05:38 +02:00
mrtnvgr
3a57fc800b
DoujinStyleBridge: Update html tags (#3581) 2023-07-30 06:46:16 +02:00
Dag
701fe3cfed
fix: various small fixes (#3578) 2023-07-29 00:14:30 +02:00
Aaron F
11ce8b5dcd
CVEDetails got a new HTML layout. (#3577) 
This fixes the parser for CVEDetails.
 2023-07-27 23:54:17 +02:00
Korytov Pavel
f5f76f111b
[TldrTechBridge] Add Web Dev and Founders sections (#3576) 2023-07-26 22:59:49 +02:00
Korytov Pavel
bf4ea12719
[ScientificAmerican] Fix bridge (#3575) 2023-07-26 21:47:47 +02:00
ORelio
235c084820
[DilbertBridge] Remove bridge (#3574) 
dilbert.com has closed down.
 2023-07-26 20:41:48 +02:00
ORelio
977c0db382
[CssSelectorBridge] Improvements (#3537) (#3573) 
* [CssSelectorBridge] Improvements (#3537)

* Improve parameter documentation / add tooltips
* Allow extracting content from home page instead of article page
* Keep titles from home page when every page <title> is the same

* [CssSelectorBridge] Code linting

* [CssSelectorBridge] Code linting (2)

* [CssSelectorBridge] Code linting (3)
 2023-07-26 19:41:29 +02:00
csisoap
556bca58cf
[TwitterBridge] Fix search, user, list ID (#3566) 
* Add ability to fetch user, list tweet

* Fix user, search, list ID although list still broke

* clear whitespace

* Revert CACHE_TIMEOUT

* clear whitespace, change single quote

* Clear PHP warning, add ability to get full-text if truncated

* Clear PHP warning

* clear warning

* clear whitespace

* Add check condition for mediaDetails.

* Add whitespace

* Add try catch exception for get full-text tweet

* clear warning

* clear warning
 2023-07-25 22:36:41 +02:00
Dawid Wróbel
2cc89b767c
[AllegroBridge] fix non-functional bridge (#3571) 
— fix cookie pattern
– use data analytics attributes wherever possible to avoid relying on obfuscated class names
— add support for promoted offers
— include sponsored and promoted offers by default
— some additional refactoring
 2023-07-25 20:52:47 +02:00
Simon Alberny
1f6c2cd32c
Allocine Sorties movie date added (#3569) 2023-07-24 16:25:09 +02:00
Dag
74635fd752
fix(DisplayAction): improve error handling and cache logic (#3558) 
* fix(DisplayAction): improve error handling and cache logic

* restore prev timeouts

* refactor

* yup

* test: fix unit test

* leave twitter client unchanged

* leave twitter bridge unchanged
 2023-07-23 23:05:35 +02:00
Eugene Molotov
38ca124de0
[VkBridge] Better title generation (#3563) 
1. Use first parargraph only
2. Remove tags
3. Allow to use comma and colon in title
 2023-07-22 14:00:12 +02:00
Dag
39a8346c53
fix(pokemonnews): throw if antibot, #3327 (#3562) 2023-07-21 20:52:20 +02:00
Dag
d08b2616ef
feat(twitter): use account icon as feed icon, fix #3348 (#3561) 2023-07-21 20:26:22 +02:00
Predä
663729cf19
[TikTokBridge] Use another way to get videos infos to include video link (#3557) 
* [TikTokBridge] Use another way to get videos infos to include video link

* [TikTokBridge] Use cover if dynamicCover is empty

* [TikTokBridge] Add support for the rest of item params
 2023-07-20 05:50:45 +02:00
Predä
2ffb54c7c2
[PicukiBridge] Add count parameter (#3556) 2023-07-20 00:52:09 +02:00
Dag
a4a328583a
fix(reddit): set custom http ua to fix 429 errors (#3552) 
* refactor

* refactor

* fix(reddit): set custom http ua to fix 429 errors

* lint
 2023-07-19 06:39:17 +02:00
Dag
6254b8593e
refactor(cache): extract and encapsulate cache expiration logic (#3547) 
* refactor(cache): extract and encapsulate cache expiration logic

* fix: logic bug in getSimpleHTMLDOMCached

* fix: silly me, index should of course be on the key column

* silly me again, PRIMARY keys get index by default lol

* comment out the delete portion in loadData

* remove a few log statements

* tweak twitter cache timeout
 2023-07-19 05:05:49 +02:00
sysadminstory
087e790ec1
[ImgsedBridge] Add new Instagram Bridge Alternative (#3550) 
* [ImgsedBridge] Add new Instagram Bridge Alternative

Imgsed is a Website adverstised on instagram website, that's is not
behind Cloudflare Anti Bot feature.
You can select to display Posts, Tags, and Stories of a specific
username

* [ImgsedBridge] Fix empty defaultValue
 2023-07-19 03:28:14 +02:00
mrtnvgr
4ce63c88aa
Add DoujinStyleBridge (#3549) 
* v1

* improve title

* search support

* random support

* fix categories

* add metadata to content

* fix linter errors

* i'm sorry
 2023-07-18 20:48:29 +02:00
Paroleen
a1bae7a9a8
[SpotifyBridge] Add search API support (#3548) 2023-07-18 00:43:08 +02:00
Dag
440adf2f3b
fix(githubissue): add 10 min cache (#3545) 2023-07-16 22:28:20 +02:00
Dag
a59793e8d6
refactor: extract CurlHttpClient (#3532) 
* refactor: extract CurlHttpClient

* refactor

* interface
 2023-07-16 22:07:34 +02:00
Dag
7b46b97abd
refactor(spotify): replace manual curl with getContents (#3544) 2023-07-16 21:50:44 +02:00
Thomas
e5729fdaac
[YouTubeCommunityTabBridge] Fix PHP warnings for posts w/o text (#3536) 
Because "contentText" is always present, PHP warnings were previously
generated for posts without text.
Existence of sub-property "runs" gets checked now to avoid this.
 2023-07-15 15:18:09 +02:00
Ryan Stafford
c8039d483b
[TraktBridge] new bridge (#3534) 2023-07-15 15:12:11 +02:00
Ryan Stafford
73d88dda46
[New Bridge] Strava bridge (#3533) 
* [StravaBridge] new bridge

* [StravaBridge] gpx link, detect parameters
 2023-07-15 06:11:00 +02:00
Ryan Stafford
ea0456ea08
[New Bridge] Qwantz bridge (#3531) 
* [QwantzBridge] new bridge

* [QwantzBridge] title fix

* lint fixes
 2023-07-15 05:58:57 +02:00
ORelio
9efdf24a6e
Add CustomBridge (#3457) 
* Add CustomBridge

For advanced users. Create RSS feed using HTML selectors.

* [CssSelectorBridge] Refactor, Allow Unexpanded

Rename bridge to CssSelectorBridge
Allow unexpanded feed, i.e. make feed from home page only (1 request)
Refactor bridge to put most of the code into protected functions
Makes the code more maintainable and allows inheritance for variants

* [CssSelectorBridge] Fix linting
 2023-07-14 22:09:45 +02:00
alexvong243f
a234392f80
docs: improve discoverability of instagram related bridges (#3528) 2023-07-14 05:15:49 +02:00
Jisagi
b9102d7e87
Add Steam Group Announcements Bridge (#3527) 
* Create SteamGroupAnnouncementsBridge.php

* Shorten implementation

Maybe this fixes the tests

* test

---------

Co-authored-by: Dag <me@dvikan.no>
 2023-07-13 17:23:12 +02:00
Dag
6c0e186d3f
fix(jornaln): Array to string conversion at lib/BridgeAbstract.php li… (#3523) 
* fix(jornaln): Array to string conversion at lib/BridgeAbstract.php line 320

* yup
 2023-07-11 16:54:59 +02:00
Dag
dfe78fb379
fix: various small fixes (#3519) 2023-07-09 10:08:30 +02:00
Dag
f0a504bb9a
fix(FeedMerge): allow xml parse failure too (#3518) 2023-07-08 23:36:36 +02:00
Dag
7881c87bed
fix: various small fixes (#3517) 
* fix(asrocknews): Trying to get property src of non-object

Trying to get property 'src' of non-object at bridges/ASRockNewsBridge.php line 37

* refactor(http): tweak max redirs config

* fix(tiktok)

* fix(gizmodo)

* fix(craig)

* fix(nationalg)

* fix(roadandtrack)

* fix(etsy)
 2023-07-08 23:21:55 +02:00
Dag
1a529fac46
fix(soundcloud): bug in prior cache refactor (#3516) 2023-07-08 22:53:23 +02:00
Dag
61b307a9f9
fix(tiktok): feed item link (#3511) 
* fix(tiktok): feed item link

* fix(tiktok): support entire url, for convenience
 2023-07-08 17:07:20 +02:00
Dag
341649a8a4
fix: tweak the defaultly enabled bridges (#3510) 
* fix: tweak the defaultly enabled bridges

enabled_bridges[] = FeedMerge
enabled_bridges[] = Filter
enabled_bridges[] = GettrBridge
enabled_bridges[] = MastodonBridge
enabled_bridges[] = Reddit
enabled_bridges[] = RumbleBridge
enabled_bridges[] = SoundcloudBridge
enabled_bridges[] = Telegram
enabled_bridges[] = ThePirateBay
enabled_bridges[] = Twitch
enabled_bridges[] = Twitter
enabled_bridges[] = Vk
enabled_bridges[] = XPathBridge
enabled_bridges[] = Youtube
enabled_bridges[] = YouTubeCommunityTabBridge

* add feed reducer too

* add tiktok too
 2023-07-08 17:07:08 +02:00
Dag
c1c8304fc0
refactor: dont create multiple instances of the cache (#3504) 2023-07-08 17:03:12 +02:00
User123698745
ef0b86968c
[PicnobBridge] fix missing images (#3506) 
* [PicnobBridge] fix missing images

* [PicnobBridge] handle invalid relative date (e.g.: 'Just now')

* [PicnobBridge] fix code indent
 2023-07-07 08:16:45 +02:00
somini
d49ea235f0
[JornalDeNoticiasBridge]: Remove bridge (#3505) 
This is now broken, it was replaced by a React monstrosity. The API
doesn't even let me read the post data, it demands authentication.
Bummer.

Better remove it now, since it's worthless.
 2023-07-07 08:14:31 +02:00
Dag
5e22459eb6
fix: remove unnecessary calls to purgeCache (#3502) 2023-07-06 18:52:19 +02:00
Dag
caac7f572c
refacor: improve cache interface (#3492) 
* fix: proper typehint on setScope

* refactor: type hint setKey()

* typehint
 2023-07-06 15:10:30 +02:00
Dag
8f9147458d
fix(gatesnotes): fix #3493 (#3494) 2023-07-06 03:36:01 +02:00
Dag
a9fd3b9e61
fix(CacheInterface): logic bug in getTime (#3491) 
* fix(CacheInterface): logic bug in getTime

* test
 2023-07-05 17:37:21 +02:00
Dag
18e1597361
fix(ph): consent cookie (#3490) 2023-07-05 17:06:23 +02:00
Patrick
e9af41d666
Add bridges for JohannesBlick Steinfeld, OM Online and UsesTech (#3489) 
* Add bridges for JohannesBlick Steinfeld, OM Online and UsesTech

* Fixed linit alert
 2023-07-05 16:43:59 +02:00
Dag
354317d010
fix(rumble): add timestamp to items (#3485) 2023-07-05 05:41:33 +02:00
Dag
82c22bd2b5
fix(feedmerge): allow a single feed to break, and dont break the whole bridge (#3476) 2023-07-05 05:41:01 +02:00
Dag
cf920694d5
fix(futurasciences): fix broken bridge (#3488) 2023-07-04 23:34:24 +02:00
Thomas
bf0d771367 [YouTubeCommunityTabBridge] Fix getURI implementation 
Previously the undefined property "feedUri" was accessed here, always
causing a fallback to the parent class
 2023-07-04 17:03:30 +02:00
Dag
48385777b4
fix: php notices (#3482) 
* fix(furaffinity): notice

* fox(releases3ds): remove references to non-existing vars
 2023-07-03 10:48:33 +02:00
Dag
d8bc015efc
fix: php notices (#3479) 
* fix(jornaln): A non well formed numeric value encountered

fixes

A non well formed numeric value encountered at bridges/JornalNBridge.php line 89

* fix(reuters): fix notice
 2023-07-03 00:39:01 +02:00
Eugene Molotov
0f14a0f6ee
[YandexZenBridge] Add image to post (#3478) 2023-07-02 22:56:45 +02:00
Thomas
eb2b4747ae
[YouTubeCommunityTabBridge] Add timestamps (#3477) 
As YouTube doesn't provide precise dates for community posts, an
increasing multiple of 60 seconds is subtracted from each timestamp.
This ensures that the original order is always preserved, even if there
are multiple posts with the same date (e.g. "1 month ago").
 2023-07-02 22:56:08 +02:00
Dag
748fc9fd65
fix: various small notice fixes (#3474) 
* fix(patreon): php notice

* fix(pepperbridge): php notice

* fix(ebay): php notice

* fix(tiktok): php notice

* fix(yandex): fix notice

* fix(justwatch): notice

* lint
 2023-07-02 06:40:25 +02:00
rmscoelho
cc91ee1e37
[JornalNBridge] getName() fix (#3456) 
* [JornalNBridge] getName() fix

* [JornalNBridge] feed fixes
 2023-06-30 15:54:53 +02:00
Arnav Jain
fece9ed344
[NotAlwaysBridge] Add new categories, remove duplicate header, and social meta (#3463) 
* [NotAlwaysBridge] add new tags

* [NotAlwaysBridge] Remove duplicate header and social meta

* [NotAlwaysBridge] Add space to fix lint issues
 2023-06-30 15:50:54 +02:00
Mynacol
410ef85618 [GolemBridge] Strip <script> tags 
Golem articles referencing their podcast contain a JavaScript reference
to Podigee. We don't want JS, so we strip it.

Example page: https://www.golem.de/news/podcast-besser-wissen-von-schlangenoel-und-sicherheit-2306-175185.html
 2023-06-28 16:01:32 +02:00
António Pereira
bd6f56383c
[PresidenciaPTBridge]: Fix timestamp search (#3459) 2023-06-26 17:52:32 +02:00
ORelio
d4bc63ee98
[TheHackerNews] Update content extraction (#3458) 2023-06-25 19:01:57 +02:00
rmscoelho
1b02d4f49b
[CorreioDaFeiraBridge] cache timeout + getName fixes (#3453) 
* [CorreioDaFeiraBridge] cache timeout fix

* [CorreioDaFeiraBridge] cache timeout fix

* [CorreioDaFeiraBridge] getName() fix
 2023-06-22 07:27:52 +02:00
rmscoelho
a4ed52ca30
[VideoCardzBridge] cache timeout fix + getName fixes (#3454) 
* [VideoCardzBridge] cache timeout fix

* [VideoCardzBridge] getName() + title fix
 2023-06-22 07:27:30 +02:00
rmscoelho
1769399da8
[ABolaBridge] cache timeout fix + getName fixes (#3455) 
* [ABolaBridge] cache timeout fix

* [ABolaBridge] fix timestamp and image alt null

* [ABolaBridge] formatting fixes

* [ABolaBridge] getName() fix
 2023-06-22 07:27:01 +02:00
rmscoelho
12ba6154f9
[JornalNBridge] cache timeout fix (#3452) 
* [JornalNBridge] cache timeout fix

* [JornalNBridge] cache timeout fix
 2023-06-21 11:15:36 +02:00
rmscoelho
8e35ebf482
[New Bridge] Jornal N (Portuguese local newspaper) (#3451) 
* [New Bridge] Jornal N (Portuguese local newspaper)

* [JornalNBridge] formatting fixes
 2023-06-21 05:17:11 +02:00
rmscoelho
61130e89b4
[ABolaBridge] timestamp (#3448) 
* [ABolaBridge] timestamp

* [ABolaBridge] formatting fixes
 2023-06-21 05:15:01 +02:00
rmscoelho
ebebb886c5
[ABolaBridge] feed fixes (#3446) 
* [ABolaBridge] category name and url fixes

* [ABolaBridge] "Mercado" feed fix; feed name fix; img fix;

* [ABolaBridge] formatting fix
 2023-06-20 17:26:55 +02:00
Matt Connell
6eaa31b999
[New Bridge] WYMT news bridge (#3444) 
* feat: add WYMT bridge

* fix: phpcs error
 2023-06-20 15:13:41 +02:00
rmscoelho
1d3888f22a
[VideoCardzBridge] category name and url fixes (#3447) 
* [VideoCardzBridge] category name and url fixes

* [VideoCardzBridge] error fixes

* [VideoCardzBridge] formatting fix

* [VideoCardzBridge] cache timeout removal
 2023-06-20 15:01:41 +02:00
rmscoelho
60be4cdebd
[CorreioDaFeiraBridge] adding timestamps; fixing categories; (#3445) 
* [New Bridge] Correio da Feira (regional newspaper)

* [CorreioDaFeiraBridge] adding timestamp; fixing name

* [CorreioDaFeiraBridge] formatting fixes
 2023-06-20 12:46:24 +02:00
rmscoelho
5a0bacbd8a
[New Bridge] Videocardz.com bridge (#3442) 
* [New Bridge] Videocardz.com Bridge

* [New Bridge] Videocardz.com Bridge

* [Videocardz.com] cache timeout increase

* [VideoCardzBridge] cache timeout change

* [VideoCardzBridge] formatting

* [VideoCardBridge] formatting fixes

* [VideoCardzBridge] formatting fixes
 2023-06-20 12:45:50 +02:00
rmscoelho
0c808dc3a1
[New Bridge] Bridge for sports website A Bola (#3441) 
* [New Bridge] Bridge for sports website A Bola

* [ABolaBridge] add thumbnail

* [ABolaBridge] formatting

* [ABolaBridge] formatting fixes

* [ABolaBridge] formatting fixes

* [ABolaBridge] formatting fixes
 2023-06-20 12:45:34 +02:00
rmscoelho
98b72b2c5c
[New Bridge] Correio da Feira (regional newspaper) (#3443) 2023-06-20 05:57:22 +02:00
somini
1e470ef341
[PresidenciaPTBridge]: Fix title search (#3438) 
This was changed on the site itself, in the last few days.
 2023-06-17 06:13:09 +02:00
Nick McCarthy
d9490c6518
GoogleScholarV2Bridge (#3415) 
* Added google scholar v2 bridge with more functionality

* Corrected Sort By interpretation (this is weird on Googles part)

* Remove some debug statements

* Merged GoogleScholarBridge and GoogleScholarV2Bridge into GoogleScholarBridge with two contexts.

* Left V2 in Bridge Name

* Lint

* Update GoogleScholarBridge.php

* Update GoogleScholarBridge.php

* Lint.

* ;
 2023-06-10 18:35:04 +02:00
Jisagi
eb799e59a6
[NyaaTorrentsBridge] Add custom fields (#3420) 
* Update NyaaTorrentsBridge.php

* lint

* lint #2

* Sir Lint the Third

* Add torrent id to custom fields

* Proposed improvements
 2023-06-10 18:28:00 +02:00
Eugene Molotov
ec1a3f4fe3
[YoutubeBridge] Unassign maintainer (#3431) 2023-06-10 18:27:49 +02:00
Eugene Molotov
80376830c5
[VkBridge] Handle some secondary attachments (#3430) 2023-06-10 18:27:32 +02:00
Shikiryu
e859497d6a
[PicalaBridge] Fix article without image (#3429) 
Co-authored-by: Clement Desmidt <clement@desmidt.fr>
 2023-06-09 17:30:11 +02:00
Simon Alberny
95071d0134
Add RemixAudioBridge (#3424) 2023-06-07 22:37:38 +02:00
Simon Alberny
3f8165207e
Add RainLoopBridge (#3423) 2023-06-07 22:36:51 +02:00
Simon Alberny
08be0ad7a5
Add GoAccessBridge (#3422) 2023-06-07 22:36:21 +02:00
Simon Alberny
6fa1f349d9
Add AllocineFRSortiesBridge (#3421) 2023-06-07 22:35:54 +02:00
July
54957d2a03
[GameBananaBridge] Load all full quality screenshots (#3419) 
Replaces the low quality preview images used previously
 2023-06-06 20:00:55 +02:00
Tone
819e453064
remove newsletter ad from finanzflussBridge (#3417) 
* remove newsletter ad

* whitespace
 2023-06-02 20:28:29 +02:00
Dag
1636a84c25
fix(spotify): use non-predictable cache key (#3330) 
* refactor

* fix(spotify): use non-predictable cache key
 2023-06-02 20:22:28 +02:00
Dag
ee498eadf9
fix: move debug mode to config (#3324) 
* fix: move debug mode to config

* fix: also move debug_whitelist to .ini config

* fix: move logic back to Debug class

* docs

* docs

* fix: disable debug mode by default

* fix: restore previous behavior for alerts

* fix: center-align alert text
 2023-06-02 20:22:09 +02:00
Ryan Stafford
c5cd229445
[YoutubeBridge] Set icon (#3416) 2023-06-01 21:26:47 +02:00
July
845a8f7936
[MangaDexBridge] Add option to add chapter images to entries (#3412) 2023-05-28 18:23:01 +02:00
piyushpaliwal
227c7b8968
Sleeper.com Alerts. Fixes #2234 (#3411) 
* Sleeper.com Alerts. Fixes #2234

* fix: linter issue
 2023-05-28 01:31:45 +02:00
July
01f731cfa4
[GameBananaBridge] Create new bridge (#3410) 2023-05-26 18:19:34 +02:00
mrnoname1000
b5dbec4cc1
[AllSidesBridge] New bridge (#3405) 2023-05-20 04:15:56 +02:00
Tone
ecd717cf58
removing a-collapse (#3394) 
it is only used for ads for their magazine
e.g.: https://www.heise.de/news/Eventtipps-fuer-Fotografen-und-Fotografiebegeisterte-9010049.html?seite=all
 2023-05-12 23:41:08 +02:00
Tone
0c540b4637
added script to deleted elements in CaschyBridge (#3391) 
* added script to deleted elements

Now it works much better with included content like twitter, e.g. in this article:
https://stadt-bremerhaven.de/1password-mit-android-14-wird-man-passkeys-in-chrome-und-apps-unterstuetzen/

* Update CaschyBridge.php

* Update CaschyBridge.php
 2023-05-11 21:25:13 +02:00
mrnoname1000
d0f7f5e2d8
[New Bridge] FiderBridge (#3378) 
* [core] Add config parameter to markdownToHtml

* [FiderBridge] New bridge
 2023-05-11 21:24:12 +02:00
July
dc4134ed1d
[ScribbleHubBridge] Add CloudFlare error handling (#3361) 
* [ScribbleHubBridge] Set html defaultLinkTo

* [ScrubbleHubBridge] Add CloudFlare error handling
 2023-05-11 01:33:21 +02:00
vincentvd1
723768c828
Add bridge for Magellantv articles (#3368) 
* [MagellantvBrdige] added first version

* [MagellantvBridge]  cleanup, added tags and fixed bugs

* [MagellantvBridge] fix linting issues

* [MagellantvBridge] more linting fixes

* [MagellantvBridge] removed tabs
 2023-05-11 01:30:25 +02:00
Tone
e7bda080b4
added iframe to $bad (#3380) 
iframe can't be rendered in feed reader, so we can delete it
 2023-05-10 22:14:34 +02:00
Joseph
8fd677f4ae
[GithubTrendingBridge] Fix items (#3381) 2023-05-10 22:14:21 +02:00
Dag
88f646cf12
fix(TwitterBridge): trim screen name before passing it to twitter client (#3389) 2023-05-10 21:59:50 +02:00
Dag
49d105fd70
fix(TwitterBridge): remove ampersand from screen name, api dont like it (#3388) 2023-05-10 21:55:47 +02:00
Dag
ff49c9f731
fix(TwitterBridge): repair fetching of tweets by username (#3385) 
* feat: alpha version of new twitter bridge

* fix: refetch guest_token if expired

* fix: purge cache

* fix: safeguards

* fix

* fix: two notices

* fix

* fix: use factory to create cache

* fix: fail properly instead of die()
 2023-05-10 21:45:44 +02:00
Tone
f26808d22c
added article categories for CaschyBridge (#3379) 
* added article categories

* whitespace
 2023-05-08 16:21:39 +02:00
Tone
a1b6bca581
added article categories for GolemBridge (#3377) 
* added article categories for GolemBridge

* tabs are bad, spaces good

* fixed duplicate categories on multi-page articles
 2023-05-08 16:21:03 +02:00
Tone
ec091fb747
fixed authors and added categories for HeiseBridge (#3376) 2023-05-07 12:33:45 +02:00
mrnoname1000
887f4bbe15
[BugzillaBridge] Explicitly request JSON (#3364) 2023-04-27 19:24:29 +02:00
Paul Prechtel
212c56fde5
[HeiseBridge] Handle heise+ articles better (#3358) 
- Stop parsing paywalled heise+ articles, as they had garbage content
  and anyways not the full article.
- Link to archive.today to access the full article without account.
  (Automatically getting the full article from archive.ph was not feasible
  b/c of captchas and problems extracting the actual content)
 2023-04-20 23:02:08 +02:00
sysadminstory
00e716d84d
[PepperBridgeAbstract] Fix "no results" check (#3357) 
CSS class for "no results" text has changed, so the bridge has been
updated accordingly.
 2023-04-20 11:22:53 +02:00
July
f0c96008bc
[ScribbleHubBridge] Create new bridge (#3353) 
* [ScribbleHubBridge] Create new bridge

* [ScribbleHubBridge] Improve 'Series' filtering

* [ScribbleHubBridge] Properly fetch feed name

* [ScribbleHubBridge] Fix feed name and set feed URI

* [ScribbleHubBridge] Fix linting violations with phpcbf

* [ScribbleHubBridge] Properly handle html encoding in titles
 2023-04-19 20:35:04 +02:00
Eugene Molotov
343fd36671
[core] Remove hardcoded maximum duration of 24 hours in loadCacheValue (#3355) 2023-04-19 17:53:35 +02:00
Paul Prechtel
4068668de9
[ZeitBridge] Re-add paywall workaround (#3352) 
Additionally to the Googlebot User-Agent, a Googlebot IP address has to
be used. For now, we can use `X-Forwarded-For` for this.
 2023-04-18 18:41:40 +02:00
Eugene Molotov
7c4591c550
[VkBridge] Add detectParameters (#3351) 2023-04-18 18:41:11 +02:00
Paul Prechtel
0718fdc829
[ZeitBridge] Revert User-Agent (#3350) 
The Googlebot User-Agent is no longer sufficient to circumvent the
paywall.
 2023-04-17 15:33:14 +02:00
Dawid Wróbel
7eca527160
[eBayBridge] New bridge (#3349) 
Fixes #3268
 2023-04-15 18:40:49 +02:00
Korytov Pavel
1ed7bdcddf
[InternationalInstituteForStrategicStudiesBridge] Repair and improve bridge (#3338) 
* [InternationalInstituteForStrategicStudiesBridge] Repair and improve bridge

* [InternationalInstituteForStrategicStudiesBridge] Fix lint
 2023-04-08 22:09:07 +02:00
Paroleen
8486c0f8ca
[SpotifyBridge] Add podcasts feed (#3329) 
Co-authored-by: Matteo Parolin <matteoparolin99@gmail.com>
 2023-03-24 20:34:51 +01:00
Eugene Molotov
c8af9f9055
[VkBridge] Make timestamps more accurate (#3325) 2023-03-22 20:32:15 +01:00
realansgar
307f5865c0
[ARDAudiothekBridge] fix feed icon not showing in RSS feeds (#3274) 
* [ARDAudiothekBridge] fix feed icon not showing in RSS feeds

* [ARDAudiothekBridge] Fix lint errors
 2023-03-21 18:24:28 +01:00
Dag
9e9a697b8b
feat: add config option "path" for file cache (#3297) 2023-03-20 19:10:01 +01:00