CVS commit: pkgsrc/www/py-w3lib

["Adam Ciarcinski" <adam%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   adam
Date:           Sun Jan 14 20:49:07 UTC 2024

Modified Files:
        pkgsrc/www/py-w3lib: Makefile PLIST distinfo

Log Message:
py-w3lib: updated to 2.1.2

2.1.2 (2023-08-03)
------------------

- Fix test failures on Python 3.11.4+
- Fix an incorrect type hint
- Add project URLs to setup.py

2.1.1 (2022-12-09)
------------------

- :func:`~w3lib.url.safe_url_string`, :func:`~w3lib.url.safe_download_url`
  and :func:`~w3lib.url.canonicalize_url` now strip whitespace and control
  characters urls according to the URL living standard.

2.1.0 (2022-11-28)
------------------

-   Dropped Python 3.6 support, and made Python 3.11 support official.

-   :func:`~w3lib.url.safe_url_string` now generates safer URLs.

    To make URLs safer for the `URL living standard`_:

    .. _URL living standard: https://url.spec.whatwg.org/

    -   ``;=`` are percent-encoded in the URL username.

    -   ``;:=`` are percent-encoded in the URL password.

    -   ``'`` is percent-encoded in the URL query if the URL scheme is `special
        <https://url.spec.whatwg.org/#special-scheme>`__.

    To make URLs safer for `RFC 2396`_ and `RFC 3986`_, ``|[]`` are
    percent-encoded in URL paths, queries, and fragments.

    .. _RFC 2396: https://www.ietf.org/rfc/rfc2396.txt
    .. _RFC 3986: https://www.ietf.org/rfc/rfc3986.txt

-   :func:`~w3lib.encoding.html_to_unicode` now checks for the `byte order
    mark`_ before inspecting the ``Content-Type`` header when determining the
    content encoding, in line with the `URL living standard`_.

    .. _byte order mark: https://en.wikipedia.org/wiki/Byte_order_mark

-   :func:`~w3lib.url.canonicalize_url` now strips spaces from the input URL,
    to be more in line with the `URL living standard`_.

-   :func:`~w3lib.html.get_base_url` now ignores HTML comments.

-   Fixed :func:`~w3lib.url.safe_url_string` re-encoding percent signs on
    the URL username and password even when they were being used as part of an
    escape sequence.

-   Fixed :func:`~w3lib.http.basic_auth_header` using the wrong flavor of
    base64 encoding, which could prevent authentication in rare cases.

-   Fixed :func:`~w3lib.html.replace_entities` raising :exc:`OverflowError` in
    some cases due to `a bug in CPython
    <https://github.com/python/cpython/issues/76763>`__.

-   Improved typing and fixed typing issues.

-   Made CI and test improvements.

-   Adopted a Code of Conduct.

2.0.1 (2022-08-11)
------------------
Minor documentation fix (release date is set in the changelog).

2.0.0 (2022-08-11)
------------------

Backwards incompatible changes:

- Python 2 is no longer supported; Python 3.6+ is required now
- :func:`w3lib.url.safe_url_string` and :func:`w3lib.url.canonicalize_url`
  no longer convert "%23" to "#" when it appears in the URL path. This is a bug
  fix. It's listed as a backward-incomatible change because in some cases the
  output of :func:`w3lib.url.canonicalize_url` is going to change, and so, if
  this output is used to generate URL fingerprints, new fingerprints might be
  incompatible with those created with the previous w3lib versions

Deprecation removals

- The ``w3lib.form`` module is removed.
- The ``w3lib.html.remove_entities`` function is removed.
- The ``w3lib.url.urljoin_rfc`` function is removed.

The following functions are deprecated, and will be removed in future releases:

- ``w3lib.util.str_to_unicode``
- ``w3lib.util.unicode_to_str``
- ``w3lib.util.to_native_str``

Other improvements and bug fixes:

- Type annotations are added
- Added support for Python 3.9 and 3.10
- Fixed :func:`w3lib.html.get_meta_refresh` for ``<meta>`` tags where
  ``http-equiv`` is written after ``content``
- Fixed :func:`w3lib.url.safe_url_string` for IDNA domains with ports
- :func:`w3lib.url.url_query_cleaner` no longer adds an unneeded ``#`` when
  ``keep_fragments=True`` is passed, and the URL doesn't have a fragment

- Removed a workaround for an ancient pathname2url bug
- CI is migrated to GitHub Actions
- The code is formatted using black

1.22.0 (2020-05-13)
-------------------

- Python 3.4 is no longer supported
- :func:`w3lib.url.safe_url_string` now supports an optional ``quote_path``
  parameter to disable the percent-encoding of the URL path
- :func:`w3lib.url.add_or_replace_parameter` and
  :func:`w3lib.url.add_or_replace_parameters` no longer remove duplicate
  parameters from the original query string that are not being added or
  replaced
- :func:`w3lib.html.remove_tags` now raises a :exc:`ValueError` exception
  instead of :exc:`AssertionError` when using both the ``which_ones`` and the
  ``keep`` parameters
- Test improvements
- Documentation improvements
- Code cleanup


To generate a diff of this commit:
cvs rdiff -u -r1.8 -r1.9 pkgsrc/www/py-w3lib/Makefile \
    pkgsrc/www/py-w3lib/distinfo
cvs rdiff -u -r1.1 -r1.2 pkgsrc/www/py-w3lib/PLIST

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/www/py-w3lib/Makefile
diff -u pkgsrc/www/py-w3lib/Makefile:1.8 pkgsrc/www/py-w3lib/Makefile:1.9
--- pkgsrc/www/py-w3lib/Makefile:1.8    Tue Jan  4 20:55:37 2022
+++ pkgsrc/www/py-w3lib/Makefile        Sun Jan 14 20:49:07 2024
@@ -1,8 +1,7 @@
-# $NetBSD: Makefile,v 1.8 2022/01/04 20:55:37 wiz Exp $
+# $NetBSD: Makefile,v 1.9 2024/01/14 20:49:07 adam Exp $
 
-DISTNAME=      w3lib-1.22.0
+DISTNAME=      w3lib-2.1.2
 PKGNAME=       ${PYPKGPREFIX}-${DISTNAME}
-PKGREVISION=   1
 CATEGORIES=    www python
 MASTER_SITES=  ${MASTER_SITE_PYPI:=w/w3lib/}
 
@@ -11,9 +10,12 @@ HOMEPAGE=    https://github.com/scrapy/w3li
 COMMENT=       Python library of web-related functions
 LICENSE=       modified-bsd
 
-DEPENDS+=      ${PYPKGPREFIX}-six>=1.4.1:../../lang/py-six
+TOOL_DEPENDS+= ${PYPKGPREFIX}-setuptools-[0-9]*:../../devel/py-setuptools
+TOOL_DEPENDS+= ${PYPKGPREFIX}-wheel-[0-9]*:../../devel/py-wheel
 
 USE_LANGUAGES= # none
 
-.include "../../lang/python/egg.mk"
+PYTHON_VERSIONS_INCOMPATIBLE=  27
+
+.include "../../lang/python/wheel.mk"
 .include "../../mk/bsd.pkg.mk"
Index: pkgsrc/www/py-w3lib/distinfo
diff -u pkgsrc/www/py-w3lib/distinfo:1.8 pkgsrc/www/py-w3lib/distinfo:1.9
--- pkgsrc/www/py-w3lib/distinfo:1.8    Tue Oct 26 11:30:50 2021
+++ pkgsrc/www/py-w3lib/distinfo        Sun Jan 14 20:49:07 2024
@@ -1,5 +1,5 @@
-$NetBSD: distinfo,v 1.8 2021/10/26 11:30:50 nia Exp $
+$NetBSD: distinfo,v 1.9 2024/01/14 20:49:07 adam Exp $
 
-BLAKE2s (w3lib-1.22.0.tar.gz) = 03142dd4be57d6d9a5924d29b4f3e52e886760923e44c259ec34c32a1b72a6fa
-SHA512 (w3lib-1.22.0.tar.gz) = fbc2bbc06808ec5d28e300ce00e2a59cc07a3a15e4a3690d3b6a105b6f33e6e02fab057b27733d9ea69bc99ebc1e7e8e628e1408a00194991ea05f35dae8bf10
-Size (w3lib-1.22.0.tar.gz) = 39121 bytes
+BLAKE2s (w3lib-2.1.2.tar.gz) = bde1df67a19b5fbd7febbb02446e472ca4108931f9a4e5f02588778a538d23b3
+SHA512 (w3lib-2.1.2.tar.gz) = cfff2520cab24b84c93223125de3fb813e4d40d23a022f7fc34196c3033adb5dfc01358d62566dcc4b763d40b271e1428eba0250ba997228d07f35cd3721e37e
+Size (w3lib-2.1.2.tar.gz) = 48715 bytes

Index: pkgsrc/www/py-w3lib/PLIST
diff -u pkgsrc/www/py-w3lib/PLIST:1.1 pkgsrc/www/py-w3lib/PLIST:1.2
--- pkgsrc/www/py-w3lib/PLIST:1.1       Mon Feb 13 21:19:51 2017
+++ pkgsrc/www/py-w3lib/PLIST   Sun Jan 14 20:49:07 2024
@@ -1,25 +1,31 @@
-@comment $NetBSD: PLIST,v 1.1 2017/02/13 21:19:51 adam Exp $
-${PYSITELIB}/${EGG_INFODIR}/PKG-INFO
-${PYSITELIB}/${EGG_INFODIR}/SOURCES.txt
-${PYSITELIB}/${EGG_INFODIR}/dependency_links.txt
-${PYSITELIB}/${EGG_INFODIR}/not-zip-safe
-${PYSITELIB}/${EGG_INFODIR}/requires.txt
-${PYSITELIB}/${EGG_INFODIR}/top_level.txt
+@comment $NetBSD: PLIST,v 1.2 2024/01/14 20:49:07 adam Exp $
+${PYSITELIB}/${WHEEL_INFODIR}/LICENSE
+${PYSITELIB}/${WHEEL_INFODIR}/METADATA
+${PYSITELIB}/${WHEEL_INFODIR}/RECORD
+${PYSITELIB}/${WHEEL_INFODIR}/WHEEL
+${PYSITELIB}/${WHEEL_INFODIR}/top_level.txt
 ${PYSITELIB}/w3lib/__init__.py
 ${PYSITELIB}/w3lib/__init__.pyc
 ${PYSITELIB}/w3lib/__init__.pyo
+${PYSITELIB}/w3lib/_infra.py
+${PYSITELIB}/w3lib/_infra.pyc
+${PYSITELIB}/w3lib/_infra.pyo
+${PYSITELIB}/w3lib/_types.py
+${PYSITELIB}/w3lib/_types.pyc
+${PYSITELIB}/w3lib/_types.pyo
+${PYSITELIB}/w3lib/_url.py
+${PYSITELIB}/w3lib/_url.pyc
+${PYSITELIB}/w3lib/_url.pyo
 ${PYSITELIB}/w3lib/encoding.py
 ${PYSITELIB}/w3lib/encoding.pyc
 ${PYSITELIB}/w3lib/encoding.pyo
-${PYSITELIB}/w3lib/form.py
-${PYSITELIB}/w3lib/form.pyc
-${PYSITELIB}/w3lib/form.pyo
 ${PYSITELIB}/w3lib/html.py
 ${PYSITELIB}/w3lib/html.pyc
 ${PYSITELIB}/w3lib/html.pyo
 ${PYSITELIB}/w3lib/http.py
 ${PYSITELIB}/w3lib/http.pyc
 ${PYSITELIB}/w3lib/http.pyo
+${PYSITELIB}/w3lib/py.typed
 ${PYSITELIB}/w3lib/url.py
 ${PYSITELIB}/w3lib/url.pyc
 ${PYSITELIB}/w3lib/url.pyo