将URL规范化为标准Unicode编码
Sweepatic-urlnorm的Python项目详细描述
urlnorm.py
将URL规范化为标准Unicode表示形式
urlnorm通过以下方式规范化url:
- lowercasing the scheme and hostname
- converting the hostname to IDN format
- taking out default port if present (e.g., http://www.foo.com:80/)
- collapsing the path (./, ../, etc)
- removing the last character in the hostname if it is ‘.’
- unquoting any % escaped characters (where possible)
安装
pip install urlnorm
示例
>>> import urlnorm >>> urlnorm.norm("http://xn--q-bga.com./u/u/../%72/l/") u'http://q\xe9.com/u/r/l/'