Valentin Lorentz
db05081ff6
commands: fix _checkUrl
2021-08-25 23:28:25 +02:00
Valentin Lorentz
be88530fa4
commands: Disallow IRIs from 'url' and 'httpUrl' converters.
...
urllib doesn't support IRIs, and gives out a cryptic
'UnicodeEncodeError: 'ascii' codec can't encode character ...'
if we don't validate it.
2021-08-25 21:54:55 +02:00
Valentin Lorentz
db7ef3f025
all: Add generic 'The Limnoria Contributors' to copyright notices.
...
No need to bother with details (that are all outdated / out of sync
anyway), just look up the git history.
2021-08-01 21:54:49 +02:00
Valentin Lorentz
5195ff8e12
Web: Add new @location command, to follow HTTP redirects.
...
Useful to un-tinify URLs.
2020-10-13 22:28:52 +02:00
Valentin Lorentz
9891b0fca4
Replace failUnless/failIf with assertTrue/assertFalse.
...
The old names are deprecated.
2020-01-26 11:14:18 +01:00
Valentin Lorentz
cd479717b8
Web: Add supybot.plugins.snarfMultipleUrls. Also, fix Web's test cases.
2018-04-14 21:50:32 +02:00
Valentin Lorentz
e3ff413734
Web & core: Merge features of Web's title parser and utils.web.HtmlToText + don't unescape HTML twice. Closes GH-1176.
2015-10-23 07:41:36 +02:00
Jussi Timperi
1f96471d93
Web: Correct capitalization in testTitle.
2015-10-22 17:19:03 +03:00
Valentin Lorentz
a81d3ddae6
Web: add option for having titlesnarfer immune to defaultignore. Closes GH-1101
2015-05-15 12:39:30 +02:00
Valentin Lorentz
ba12692fb4
Web: Add support for charrefs. Closes GH-923.
2014-12-11 09:59:08 +01:00
Valentin Lorentz
95c15922e4
Remove outated output.
2014-12-11 09:50:17 +01:00
Valentin Lorentz
10529328ac
Web: Remove test broken if accessing slashdot from France.
2014-12-11 09:50:11 +01:00
Valentin Lorentz
c1c23f66f4
Continue accelerating the 2to3 step (remove fix_print).
2014-01-20 15:31:09 +01:00
Valentin Lorentz
18cc1ff3bb
Revert "Web: Disable @title and @doctype for non-HTML documents." (incompatible with Python 2)
...
This reverts commit 34b0e5faad
2013-08-15 00:14:34 +00:00
Valentin Lorentz
34b0e5faad
Web: Disable @title and @doctype for non-HTML documents.
2013-08-09 18:03:02 +02:00
Valentin Lorentz
dbedcbb6c9
Web: Disable testWhitelist if --no-network is given.
2013-07-09 09:18:33 +02:00
Daniel Folkinshteyn
944f9c3e3f
Web: create a cofigurable url whitelist
...
Prevent various forms of abuse that result via the Web plugin, such as fetching or titling
malicious content, or revealing bot IP.
Conflicts:
plugins/Web/plugin.py
plugins/Web/test.py
2013-06-27 07:09:22 +02:00
Valentin Lorentz
2177429618
Web: Remove netcraft (which does not seem to want bots).
2013-01-05 19:14:58 +01:00
Valentin Lorentz
5f1d7cc097
Web: Fix test of snarfing (Microsoft changes the title based on location of the computer).
2013-01-05 18:03:13 +01:00
James McCoy
d73a801d8f
Web: Remove/update non-functional tests
...
Signed-off-by: James McCoy <jamessan@users.sourceforge.net>
2012-09-05 21:35:56 -04:00
James Vega
0a4c66071b
Adjust testTitle to take into account /.'s slight change
2009-03-11 13:37:26 -04:00
James Vega
ee9aaa89d6
plugins/Web: Swtich the title parser back to HTMLParser sing sgmllib's parser spins on invalid input.
2006-09-13 19:40:51 +00:00
James Vega
855453a743
plugins/Web/test.py: Bump the timeout since we're fetching a lot of information from other sources, which may take a while.
2006-05-03 13:30:27 +00:00
James Vega
a3e4fc5b1d
Change the modeline to use softtabstop instead of tabstop.
2006-02-11 15:52:51 +00:00
James Vega
b375ea9792
plugins/Web: Fixed the title-retrieval parser to actually retrieve the entire title.
2005-07-19 13:55:37 +00:00
James Vega
fcfda73f64
Bug #1190350 , Don't grab fake title.
2005-04-30 12:53:42 +00:00
James Vega
9971e991fe
Fix the modelines.
2005-03-23 20:07:45 +00:00
Jeremy Fincher
0c2da03a67
Added the Web plugin (from pieces of Http, Fun, and URL) in the new plugin format.
2005-02-01 09:41:54 +00:00
