Commit Graph
3654 Commits
Author SHA1 Message Date
Rongrong cc48b48bc8 feat(route): add wechat/data258 (#9571)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-20 21:43:34 +08:00
Levi Zim a43542ee2d feat(route): /sdu/wh/jwc/:column? for 山东大学(威海)教务处 (#9585)
* feat: extractor for https://jwc.wh.sdu.edu.cn/

* feat(route): /sdu/wh/jwc for 山东大学(威海)教务处

* feat(radar): 山东大学(威海)教务处

* fix(radar): match wildcard path for 山东大学(威海)新闻网

* docs: for route /sdu/wh/jwc

* fix: update maintainer.js
2022-04-20 21:13:12 +08:00
yuxinliu-alexandAlex Liu fccb91838d fix(route): 央视新闻-专题 支持获取Author字段 (#9568)
* fix(route): 央视新闻-专题 支持获取Author字段

* refactor: migrate to v2

* fix: date parsing in /cctv/photo/jx

* fix: special date parsing

fix: xwlb not working

fix: mzzlbg item description

fix: news use https

fix: xinwen1j1 not working

* feat: add radar

Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
yuxinliu-alexandalex 80aab00fdb feat(route): 国家广播电视总局 (#9566)
* feat(route): 国家广播电视总局

* move the nrta to lib\v2\gov

* fix: feed link

* fix: radar

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:51:52 +08:00
yuxinliu-alexandalex 5f4cf8a2f0 feat(route): 参考消息 (#9564)
* feat(route): 参考消息

* fixed the router's & ref bugs

* docs: fix example

* fix: prefer https

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:17:42 +08:00
yuxinliu-alexandalex 103a14ba06 fix(route): cnbeta去除广告并添加Author字段 (#9562)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 18:39:20 +08:00
Fatpandac 9b459f02aa fix(route): npm/package fix route params (#9578) 2022-04-19 18:38:00 +08:00
8d2d835cd1 fix(route): 新华社新闻_新华网获取Pubdate字段 (#9570)
* 新华网修复部分文章无法获取pubDate问题

* fix(route): 新华社新闻_新华网获取Pubdate字段

Co-authored-by: alex <yuxin2@mgtv.com>
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-19 02:37:57 +08:00
任平生 f3e069d399 fix(utils): 支持微信公众号单图片文章抓取; 增加输出阅读原文链接 (#9557)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接
2022-04-19 01:29:45 +08:00
Fatpandac 864016c598 fix(route): dongqiudi/top_news cannot convert undefined or null to ob… (#9558)
* fix(route): dongqiudi/top_news cannot convert undefined or null to object

* refactor: migrate to v2

* refactor: daily parseDate cache.tryGet

* fix: legacy url.parse, cache article

* refactor: result use parseDate

* refactor: `cache.get` to `cache.tryGet`

* fix: add radar

* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
yuxinliu-alexandalex 3edf239759 fix(route): 观察网源支持获取Author字段 (#9561)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-18 20:00:59 +08:00
Bin Wang 6b7381e1e3 feat(core): add custom fields to atom feed (#9355)
* Add custom fields to atom feed

Atom allows to extend the xml with custom namespaces. This commit is
a first commit that tries to add some custom RSSHub fields to atom feed.

In this commit, I added three very common fields: upvotes, downvotes
and comments. Lots of websites has these common fields, like Youtube,
Twitter, Reddit, HackerNews and so on. Within these fields, RSS readers
can have more information to sort the contents, and can display these
information to user in a better format.

The document has been updated to reflect these new fields. I also changed
Bilibili video route as an example to show how to add number of comments
to the generated feed.

* docs: interactions
2022-04-18 02:54:32 +08:00
尹傲雄 1e11388c90 fix(route): update zju/grs (#9551)
* update zju/grs in university

* refactor: migrate to v2

* fix: add radar

* fix: not working routes

* fix: add migration note

* docs: remove N/A types from physics table

* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
FledgeShiu fafb2d2ed4 fix(route): chinacerf (#9554)
* fix(route): chinacerf

* Remove redundant `await`.
2022-04-17 21:42:03 +08:00
331405d69e feat(route): 黄健宏博客 (#9553)
* ✨ feat(route): add blog: huangz

* 🐞 fix(route): huangz url missing

* 📃 docs(radar): update docs url

* 📃 docs(radar): fix url

* ✨ feat(route): add maintainer.js

* 🐞 fix(radar): fix huangz blog radar source

* Update lib/v2/huangz/index.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update index.js

* style: auto format

* docs: fix link break

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-17 21:33:27 +08:00
Fatpandac cff988ad9f feat(route): add Eagle's blog and refactor to V2 (#9546)
* feat(route): add Eagle's blog and refactor to V2

* fix: remove deprecated eagle radar rules

* fix: changelog date and guid

* fix(route): add language option
2022-04-17 21:24:17 +08:00
Levi ZimandTony 958be6266e feat(route): 山东大学(威海)新闻网 (#9537)
* feat(sduwh): add extractors.

* feat(route): add route for 山东大学(威海)新闻网

* docs: for route sduwh/news

* docs: for route sduwh/news

(cherry picked from commit 831830167a)

* feat(radar): for route 山东大学(威海)新闻网

* refactor: change `got.get` to `got`.

* refactor: prefer `parseDate()` to `new Date()`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: incomplete URL substring sanitization.

Make CodeQL happy.

* fix(radar): fix target field.

* fix: change route /sduwh to /sdu/wh

* fix: remove superfluous slash character in url.

* feat: look for exact date first.

* feat: extract exact date from news extractor.

* feat: extract exact date from view extractor.

* feat: extractor for www.sdrj.sdu.edu.cn

* refactor: semantic separation of sduwh with sdu

* feat(radar): more accurate name

* docs: update documentation

* refactor: migrate to v2

* refactor: fix deprecated url.resolve

* fix: update docs url

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: sdu not working routes

* fix: accurate `ctx.state.data.url`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling for extractors.

* fix: timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling.

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
5622641efa feat(route): 首席经济学家论坛 (#9550)
* add(route): 首席经济学家论坛

* fix(route) : merge from FledgeXu

* fix(route) : merge from FledgeXu

* (fix) typo

* feat(route): remove radar from radar-rules.js

* Update lib/v2/chinacef/hot.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/router.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/maintainer.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update hot.js

* Update experts.js

Co-authored-by: linkai <linkai@mochasoft.com.cn>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-16 23:30:10 +08:00
Tony 658570be69 fix(route): taptap topic review (#9540)
* fix(route): taptap topic review

* fix: review url

* refactor: use utility

* docs: add back warning
2022-04-15 22:04:49 +08:00
FledgeShiu a0f067ca71 feat(route): 首席经济学家 (#9543)
* Add chinacef router.

* Update the document.

* Move to V2.

* Fix document errors and improve the code.
2022-04-15 21:07:21 +08:00
任平生 eb467afae1 fix(utils): 支持将微信公众号转载文章的正文抓取回来 (#9534)
* feat: 修正日期时间匹配规则、移除一些不必要评论元素

* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像

* fix(route)(wechat): 支持将微信公众号转载文章的正文抓取回来
2022-04-15 19:23:09 +08:00
Tony edb6e5deec fix(route): add debug json output and cookie support (#9539)
* fix(route): add debug json output and cookie support

* Update lib/v2/qbittorrent/news.js
2022-04-14 14:19:33 -09:00
stanly0726 996b66fdf2 fix(core): issue #8162 (#9533)
* fixing issue #8162

* fixing issue #8162

* change max width value of class .debu-item

* remove duplicated css

* max width

* Update welcome.art
2022-04-14 01:16:26 +08:00
github-actions[bot] 472e0d8f19 style: auto format 2022-04-13 10:11:44 +00:00
Fatpandac 56ccda8f72 fix(route): add the title to the first article and refactor to V2 (#9532) 2022-04-13 18:09:17 +08:00
Ethan Shen 6f98d3cee6 fix(route): 果壳网科学人 (#9531)
* fix(route): 果壳网科学人

* ref: use got instead of got.get

* ref: rename channel.js
2022-04-13 17:50:11 +08:00
Fatpandac d63ece212f fix(route): yystv change selector path, add radar and refactor to V2 (#9529)
* fix(route): change selector path, add radar and refactor to V2

* fix: use parse-date utils

* fix: use https
2022-04-13 17:23:23 +08:00
任平生 ae66123996 fix(route)(fortunechina): 修正财富中文网双语文章中文内容重复的问题 (#9526)
* feat: 修正日期时间匹配规则、移除一些不必要评论元素

* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像
2022-04-12 23:11:35 +08:00
Tony bafb3534e1 feat(utils): random user agent (#9449)
* feat(utils): random ua

* chore: bump rand-user-agent to 1.0.58(no more deps)
2022-04-12 17:51:07 +08:00
Ethan ShenandTony 55ecc71784 feat(route): add 科学网用户博客 (#9525)
* feat(route): add 科学网用户博客

* update lib/v2/sciencenet/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-12 04:56:50 +01:00
Tony fb2a407b02 feat(route): qbittorrent news (#9524) 2022-04-11 23:17:09 +01:00
Ethan Shen 12760cad1d feat(route): add 大连理工大学盘锦校区 (#9515)
* feat(route): add 大连理工大学盘锦校区

* fix typo
2022-04-11 20:33:11 +08:00
Ethan Shen 4c9b820f2e feat(route): add 大连理工大学盘锦校区教学事务办公室 (#9509) 2022-04-11 07:33:46 +08:00
Ethan Shen a25fd4b67f fix(utils): wrong date with same weekday in parse-date (#9506) 2022-04-10 23:40:35 +08:00
Ethan Shen 0c3888787a feat(route): add 大连理工大学 (#8580)
* feat(route): add 大连理工大学

* add radar

* fix: add maintainer

* fix typo

* docs: fix url

* fix: incomplete multi-character sanitization
2022-04-10 23:39:24 +08:00
Odin Zhangandgithub-actions[bot] c5741650d2 feat(route): add bookfere (#9501)
* feat(route): add bookfere

* style: auto format

* fix(route): change bookfere to v2

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-09 23:43:08 +08:00
Fatpandac ef8e2e187a fix(radar): fix docs URL (#9504) 2022-04-09 19:06:49 +08:00
Jigsaw 69210f7cad fix(route)(twreporter): title,author,pubDate (#9502)
* fix(route): twreporter title,author,pubDate

* refactor: migrate to v2

* fix: missing maintainer
2022-04-09 19:06:03 +08:00
Fatpandac 928b089cc8 feat(route): add 逛丢 (#9503)
* feat(route): add 逛丢

* fix(route): fix path
2022-04-09 14:18:49 +08:00
Rongrong 2dab2ad5bc fix(route)(wechat/ce): anti-crawler and pubDate (#9495)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-09 00:00:02 +08:00
Chenxing LuoandTony ef94bcde8e feat(route): add two blogs: Stratechery & Miris Whispers (#9496)
* Add two blogs

* fix(utils): add parseDate timezone common-config

* Update lib/v2/stratechery/index.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/blog.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/en/blog.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/miris/blog.js
2022-04-08 23:48:28 +08:00
NathanDaiandTony 6996efd070 fix(route):雪球 基金净值数据来源调整为蛋卷基金 (#9489)
* 雪球基金净值更新调整为蛋卷基金

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* refactor: migrate to v2

* fix: parseDate

* fix: fund unnecessary String()

* feat: add radar

* fix: stock comments template

* style: add a linebreak

* docs: fund example path
2022-04-08 23:38:33 +08:00
Rongrong 74e1f88a32 feat(core)(utils/wechat-mp): normalize URL (#9497)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-08 18:42:52 +08:00
Rongrong eb9026e470 fix(route)(wechat/ershicimi): outdated URL (#9494)
* fix(route)(wechat/ershicimi): outdated URL

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* fix: pubDate
2022-04-08 18:08:48 +08:00
Tony c49b558e3e fix(route): RSSHub sponsors title and description (#9500) 2022-04-08 17:31:55 +08:00
Tony f97cdb291c fix: lack of config error url (#9490) 2022-04-07 22:34:33 +08:00
Rongrong a79cc20ec1 feat(utils): add utils for WeChat MP (#9487)
Motivation:
There are multiple routes that need to fetch articles from WeChat MP.
However, letting them fetch articles by themselves could potentially
lead to cache key collisions. Even if cache key collisions do not occur,
un-normalized URL could potentially lead to duplicated requests.
What's more, articles from WeChat MP have weird formats and need to be
fixed. Creating a universal function to do this work can create some
ease for new route contributors.

Note:
In order to make this PR atomic as much as possible, I did not touch
those broken routes. Once this PR is merged, I will try to fix them.

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-07 21:46:15 +08:00
Rongrong e0b7ca676d fix(route)(twitter)(web API): retweet un-extracted (#9488)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-07 20:38:54 +08:00
zytomorrowandGitHub Action e7558e88b1 fix(route): sichuan/deyang 政府公开信息 (#9480)
* fead: add 雪球股票评论

* style: auto format

* fix: 修复雪球评论转发时未带原文

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* route: 雪球评论标题长度自定义

* style: auto format

* fix: 风之动漫域名更换

* fix: 风之漫画新域名适配

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* fix: 雪球股票评论格式调整

* fix: 风之动漫域名更换

* fix: 风之动漫link修复

* fix: 雪球股票评论正文使用art模板,日期解析调整

* feat(route): add 德阳考试中心

* feat(route): add 德阳考试中心

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量使用通用参数控制

* fix: 风之动漫获取数量使用通用参数控制

* style: auto format

* fix: dykszx

* fix: 德阳考试中心 ssl证书过期

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* tmp1

* tmp2:

* tmp3

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* Revert "feat(route):  add 政府公开信息"

This reverts commit c9d59af9e09b14f7357014382037b7f378d65ea7.

* feat(route):  add 政府公开信息

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* fix(route): add ipv6 support

* fix(route): add ipv6 support

Co-authored-by: GitHub Action <action@github.com>
2022-04-07 18:00:06 +08:00
github-actions[bot] 1261a74eec style: auto format 2022-04-06 15:32:46 +00:00