Mikaela/Limnoria
1
0
Fork 0
mirror of https://github.com/Mikaela/Limnoria.git synced 2024-12-27 05:03:07 +01:00
Code Issues Projects Releases Wiki Activity
11,204 Commits 3 Branches 126 Tags 40 MiB
b5beb5f981
Commit Graph

151 Commits

Author SHA1 Message Date
Valentin Lorentz
c457b52067 Deduplicate setting Accept-Language HTTP header. 
This adds a new function conf.defaultHttpHeaders that can be used by plugins
to get all the default HTTP headers for a given network/channel.
 2020-01-14 19:03:12 +01:00
Tasos Sahanidis
ae5ad2ceab Web: Implement protocols.http.requestLanguage 2020-01-14 18:48:11 +01:00
Valentin Lorentz
8491d0b944 Web: Lower log level when title could not be found. 2019-12-15 18:43:51 +01:00
Valentin Lorentz
dc2068deca Web: Remove leading space if the prefix is empty. 2019-12-15 17:27:47 +01:00
Valentin Lorentz
1a1707420b Web: Add early returns on exception when snarfing titles. 
Closes GH-1390.
 2019-11-22 18:17:53 +01:00
James Lu
9291fbd4a0 All plugins: set Limnoria contributors as maintainer 2019-11-16 11:41:13 -08:00
Rodrigo Nascimento Hernandez
7466058c8f Web: Catch more errors in getTitle. 2019-11-01 09:06:45 +01:00
Valentin Lorentz
c1ae3f5c81 all plugins: Use msg.channel instead of msg.args[0] + give network name to self.registryValue. 2019-08-24 23:35:01 +02:00
Valentin Lorentz
0f82f89eec Web: Fix encoding issue on Python 2. Closes GH-1359. 2019-02-01 21:02:57 +01:00
James Lu
2242aadde9 Web: add trailing space for snarferPrefix at runtime 
Before, the trailing space in the default snarferPrefix value disappears after a reload because spaces at the end of config lines are ignored.
 2018-07-22 04:01:21 +00:00
Valentin Lorentz
cd479717b8 Web: Add supybot.plugins.snarfMultipleUrls. Also, fix Web's test cases. 2018-04-14 21:50:32 +02:00
Valentin Lorentz
e2180a1e08 Add variable supybot.plugins.Web.snarferPrefix. 2018-03-02 01:26:00 +01:00
Ken Spencer
76c73a57b9 Use a prefix-less help string, don't assume a '@' prefix (#1309) 
* Use a prefix-less help string, don't assume a '@' prefix

* Nickometer: follow through on plugin.py with ` -> '
 2017-10-25 21:19:37 +02:00
Tasos Sahanidis
8dbf37a173
Web: Fix exception raised due to lack of Content-Type 2017-09-20 04:57:47 +03:00
Johannes Löthberg
07f98d3619 Add timeout to web title command 
Signed-off-by: Johannes Löthberg <johannes@kyriasis.com>
 2016-12-08 10:11:15 +01:00
Valentin Lorentz
9fe4abec48 Web: Use a timeout to fetch pages. Closes GH-1275. 
This is required because the sandbox is not used anymore,
since 9c57199838.
 2016-12-08 00:48:11 +01:00
Valentin Lorentz
b9b36d4de5 Improve decorator. 2016-12-08 00:37:12 +01:00
Valentin Lorentz
4acb692f17 Web: Use new-style command wrap (as a decorator). 2016-12-08 00:36:30 +01:00
Valentin Lorentz
9c57199838 Web: Disable the fetch sandbox on Python versions with the _MAXHEADERS fix. 
Partial fix to GH-1271.
 2016-11-11 12:13:02 +01:00
James Lu
66736b22d5 Web: optionally hide the domain in titleSnarfer 
This adds a snarferShowDomain option to optionally hide the domain ("(at site.abc)" text) in titleSnarfer output. Closes #1236.
 2016-08-09 11:22:00 -07:00
James Lu
e2dedcc5a4 Web: normalize whitespace in titles 
Sample link: http://googleblog.blogspot.com/2015/08/android-wear-now-works-with-iphones.html
Before: <bot> 'Title: \nOfficial Google Blog: Android Wear now works with iPhones\n (at googleblog.blogspot.com)'
After: <bot> Title: Official Google Blog: Android Wear now works with iPhones (at googleblog.blogspot.com)
 2015-12-29 17:12:26 -08:00
Valentin Lorentz
bc19a9fc7f Web: fix syntax. 2015-11-30 07:45:05 +00:00
Valentin Lorentz
eaf9e40dc2 Web: increase subprocess memory limit and catch MemoryError appropriately. 2015-11-29 18:34:54 +00:00
Valentin Lorentz
a070b658a0 Web: Fix title fetching. 2015-11-29 17:59:57 +00:00
Valentin Lorentz
1f57c31665 Web: Fix NameError with snarferShowTargetDomain. Closes GH-1177. 2015-10-25 16:20:31 +01:00
Valentin Lorentz
e3ff413734 Web & core: Merge features of Web's title parser and utils.web.HtmlToText + don't unescape HTML twice. Closes GH-1176. 2015-10-23 07:41:36 +02:00
Jussi Timperi
1f96471d93 Web: Correct capitalization in testTitle. 2015-10-22 17:19:03 +03:00
Jussi Timperi
5cf1b34f55 Web: Use title instead of parser.title. 2015-10-22 17:13:47 +03:00
Jussi Timperi
df7689cc2e Web & utils.web: Force HTMLParser to process all buffered data. 
Python issue 23144.
 2015-10-22 16:56:53 +03:00
Valentin Lorentz
526ffb0ccb Web: Fix code factorization (576a96fb71). Closes GH-1173. 2015-10-17 15:41:20 +02:00
James Lu
6e96f8f8bf Web: actually return the whitespace-stripped title 2015-10-04 12:54:41 -07:00
Valentin Lorentz
20ef13ef9f Web: Ignore SVG titles. Closes GH-1147. 2015-08-29 21:08:35 +02:00
Valentin Lorentz
576a96fb71 Web: Factorize the code of the title snarfer and the title command. 2015-08-29 21:04:38 +02:00
Valentin Lorentz
c3a2c800f1 Remove need for 2to3. 2015-08-11 16:50:23 +02:00
Valentin Lorentz
054953891f Web: check URL whitelist in snarfer. 2015-08-11 14:46:47 +00:00
Valentin Lorentz
be6bc1a734 Remove need for fix_unicode. 2015-08-10 18:52:51 +02:00
Valentin Lorentz
6ceec0c541 Web: HTMLParseError is deprecated/unused since Python 3.3 and removed in Python 3.5. 2015-08-10 18:16:02 +02:00
Valentin Lorentz
c0ac84bb53 Remove need for fix_import, fix_types, and fix_urllib. 2015-08-10 17:55:25 +02:00
Valentin Lorentz
216c5d213f Replace sys.version_info[0] usages with minisix.PY{2,3}. 2015-08-09 00:23:03 +02:00
Valentin Lorentz
a81d3ddae6 Web: add option for having titlesnarfer immune to defaultignore. Closes GH-1101 2015-05-15 12:39:30 +02:00
Valentin Lorentz
d06d744f11 Squashed commit of the following: 
commit 47ede7f658c17857fd291a1a40df3b3c18e36473
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:51:45 2014 +0200

    Misc: update l10n-fi

    Sorry, I forgot to commit this before PR.

commit 6b5d61e5a5ae323dcc2c8366ea68236fd09bccae
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:42:37 2014 +0200

    Web: update l10n-fi

    [CI SKIP]

commit e103515083d9448bd80520c02c895ea8a1f33107
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:41:15 2014 +0200

    URL: update l10n-fi

commit 942d1db0aa1deb8e5d2a4f81a62edefc30a6ce27
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:33:52 2014 +0200

    Factoids: update l10n-fi

    [CI SKIP]

commit dae8da0c7568c63ebc3986503ac86a5d6466c6e9
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:32:46 2014 +0200

    Conditional: update l10n-fi

commit 7bd2d8cc65b3908c6ffe5b1eb9250987484c247a
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:20:23 2014 +0200

    Todo: update l10n-fi

commit ee37330b8fdd3a32fd5156ab0e792d76176b0515
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:19:17 2014 +0200

    Nickometer: update l10n-fi

commit 81271aa71846469de61d1be4b5cb442a26f955b9
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:16:30 2014 +0200

    NickAuth: update l10n-fi

commit 7d9bfeaffaef0c1f1fee7ed7d84064ba02bfdfb1
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:14:04 2014 +0200

    Note: update l10n-fi

commit 9ab5c2c3803413b1e775121a733ddf0408065764
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:10:09 2014 +0200

    Google: update l10n-fi

    "This is a simple plugin to provide access to the Google services we
    all know and love from our favorite IRC bot." :D

commit 897a7b79c45108e70b2ba1a4f7156029a043a17d
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:07:13 2014 +0200

    Herald: update l10n-fi

commit 2825cd6a32d4cc843a748d0ea6162760064cdc77
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 14:00:59 2014 +0200

    Misc: update l10n-fi

    [SKIP CI]

commit fba930cd3982d5ba92ba1b1ec1c194911a01e875
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:58:51 2014 +0200

    Utilities: update l10n-fi

commit 21c875b3fc66176f2c65fd1291e3a6360e8708f3
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:57:25 2014 +0200

    Aka: update l10n-fi

commit 05005f464db107f8ad18becc3855e263f04634c8
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:51:15 2014 +0200

    Config: update l10n-fi

commit 8e57df072c9af0dda1ac2b048712f5e973163c7d
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:50:20 2014 +0200

    Karma: add l10n-fi

commit d2f6c6802fc327d2f308ef71ac2640df244463d1
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:47:28 2014 +0200

    Alias: update l10n-fi

    [CI SKIP]

commit b97484dd74e553606de26cab987c69bc160781a9
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:45:23 2014 +0200

    Topic: update l10n-fi

commit 6dc04aca97a2a107821f53c5d067133122323df3
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:43:41 2014 +0200

    Time: update l10n-fi

commit e0f04cb4334f854524da711993ae7041f151b1c8
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:38:44 2014 +0200

    Scheduler: update l10n-fi

commit bcd8ede5ad263963b6fa67fac204cf8f2ab3cafa
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:37:28 2014 +0200

    Filter: update l10n-fi

commit 32619add01f26332f3c5b559003c94711c4a299b
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:26:11 2014 +0200

    Internet: update l10n-fi

commit a3c3342db39ae8404df8d89478b5c23f6642847d
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:12:05 2014 +0200

    Web: update l10n-fi

    [CI SKIP]

commit 77476fd14b970969ef6d64cfe6930e3812e6f88e
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:10:23 2014 +0200

    Unix: update l10n-fi

commit db5d59b4514becf128b6ec0dbec8f4543cb069ea
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:09:19 2014 +0200

    ChannelStats: update l10n-fi

commit 827c225fe5141cd3fa5060b19e8e19aafc8a2895
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:08:02 2014 +0200

    Quote: update l10n-fi

commit 615019735eae74f95413622d0e42a7cd7d610da1
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:06:22 2014 +0200

    Seen: update l10n-fi

commit 36c4606fd82b207f93658fda320890eb26bec6d4
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 13:03:52 2014 +0200

    MoobotFactoids: update l10n-fi

commit c1c958a6dbb14b2f039771cb4179c5ba36d10026
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:23:33 2014 +0200

    Dict: update l10n-fi

    [CI SKIP]

commit 9d98da8e3d3fdd0f2204bd92e5c57313e8fc3477
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:21:58 2014 +0200

    ShrinkURL: update l10n-fi

commit a5d6a7325b753e4ea2bfbb29374be89207fc59fd
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:20:04 2014 +0200

    String: update l10n-fi

commit 95f88c750ebcbaf66512d940b089298a67e19851
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:19:06 2014 +0200

    Admin: update l10n-fi

commit ba52e93038468f785148ba31cb87c974fe64cddb
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:17:45 2014 +0200

    Relay: update l10n-fi

commit 0ae032bf4d4562c91164560cefe2e4d88be1ed74
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:16:42 2014 +0200

    Math: update l10n-fi

commit c16cc0fa114d063d75c3b043dc5b357a470ce46e
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:14:54 2014 +0200

    Channel: update l10n-fi

    [CI SKIP]

commit 738a3c91d66cfc822697bc4d35f0bc3ea44a8191
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:13:28 2014 +0200

    ChannelLogger: update l10n-fi

commit 843dc98cea02cc4027d2ea6824258e12a69cb828
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:12:14 2014 +0200

    RSS: update l10n-fi

commit 903b50150d42202c382cb20f18fefd17d62ae0ad
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:09:44 2014 +0200

    Protector: add l10n-fi

    [CI SKIP]

commit d5488599151814e0a26ab43d4e2d0545a2910a0c
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:08:08 2014 +0200

    QuoteGrabs: update l10n-fi

commit 2586497f74555a092969e07190e544374effa634
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:04:30 2014 +0200

    Lart: update l10n-fi

    [CI SKIP]

commit 276d76eb3c6ba64d6b5bccd54897d01059a86fcd
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 12:03:18 2014 +0200

    Anonymous: update l10n-fi

commit b98c6a51c9f2e12b0207d68baa7f4311e7c276be
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:44:16 2014 +0200

    User: update l10n-fi

    [CI SKIP]

commit 218a53ffcbfc854678cac3a4af033753f1f48fa6
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:42:13 2014 +0200

    News: update l10n-fi

commit 0b68eda84131448fbe585983f4320c163574e2d2
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:40:41 2014 +0200

    Format: update l10n-fi

commit 9c390ed244c2b152f343d56837e56bedab7d7698
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:39:03 2014 +0200

    AutoMode: update l10n-fi

commit 4523e154792fdead7a26b19a3178c1c1e86082a7
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:37:49 2014 +0200

    Status: update l10n-fi

commit 28d6c4b0c5072273d8d37c9bf87b671aba6d5df4
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:36:33 2014 +0200

    Games: update l10n-fi

    [CI SKIP]

commit 52e21367d99e908b1c650f2f379659037251c4eb
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:34:22 2014 +0200

    Network: update l10n-fi

    [CI SKIP]

commit 7876a8f1e1ae35a13df9299e24c996a887542481
Author: Mikaela Suomalainen <mikaela.suomalainen@outlook.com>
Date:   Sat Dec 20 11:28:18 2014 +0200

    core: update l10n-fi
 2014-12-20 14:37:27 +01:00
Mikaela Suomalainen
64c0e38635 Web: fix unmatched parenthesis and add missing dot 2014-12-20 13:14:33 +02:00
Valentin Lorentz
ba12692fb4 Web: Add support for charrefs. Closes GH-923. 2014-12-11 09:59:08 +01:00
Valentin Lorentz
95c15922e4 Remove outated output. 2014-12-11 09:50:17 +01:00
Valentin Lorentz
10529328ac Web: Remove test broken if accessing slashdot from France. 2014-12-11 09:50:11 +01:00
James Lu
a755238ef4 Add/improve help for Debug + plugins from F-W: 
- Debug
- Factoids
- Format
- Games
- Google
- Herald
- Internet
- Karma
- Lart
- Math
- Misc
- MoobotFactoids
- Network
- News
- NickAuth
- Nickometer
- Note
- Owner
- Protector
- Quote
- QuoteGrabs
- Relay
- Scheduler
- Seen
- ShrinkUrl
- Status
- String
- Time
- Todo
- Topic
- URL
- Unix
- User
- Utilities
- Web
 2014-11-30 12:07:41 -08:00
Valentin Lorentz
8ab29fb291 Web: Add explicit error when page encoding cannot be guessed. 2014-10-13 01:13:15 +00:00
Mikaela Suomalainen
72d60db0eb Web: update l10n-fi & messages.pot 2014-08-01 19:50:48 +03:00
Valentin Lorentz
8cd0b4c1e3 Web: Increase timeout to 10 and improve error message. 2014-07-30 11:18:54 +00:00
Valentin Lorentz
2ea9e7187f Time & User & Web: Fix metadata of translation files. 2014-06-08 12:16:52 +02:00