titlefetching.md: add citation

Thanks koobs on #limnoria
This commit is contained in:
Aminda Suomalainen 2021-06-15 10:08:31 +03:00
parent 0bf910595e
commit 8c0947f08e
Signed by: Mikaela
GPG Key ID: 99392F62BAE30723

View File

@ -20,7 +20,7 @@ config supybot.protocols.http.peekSize 1048576
* sets user-agent to "Limnoria UrlPreviewBot" instead of ['Mozilla/5.0 (compatible; utils.web python module)' from 2005](https://github.com/ProgVal/Limnoria/blame/2990fcd302afdc6a3b741594017c3959fd5da2fd/src/utils/web.py#L120)
* I have heard that it's bad to pretend to be something you aren't and
Twitter will only give you HTMl `<title>`s if your user-agent contains
`UrlPreviewBot`
`UrlPreviewBot` [thanks Tulir's Synapse patch](https://mau.dev/maunium/synapse/-/commit/55d926999cffee893cb4951890a33985beaf70ba)
* search for html titles from the first MEGABYTE of the webpage as modern
web is horrible (looking at you hs.fi & youtube.com)