CVS commit: pkgsrc/lang

["Adam Ciarcinski" <adam%netbsd.org@localhost>]

Module Name:    pkgsrc
Committed By:   adam
Date:           Tue Jul 14 19:12:31 UTC 2020

Modified Files:
        pkgsrc/lang/py38-html-docs: Makefile PLIST distinfo
        pkgsrc/lang/python38: Makefile PLIST dist.mk distinfo
        pkgsrc/lang/python38/patches: patch-setup.py

Log Message:
python38 py38-html-docs: updated to 3.8.4

Python 3.8.4 final

Security
bpo-41162: Audit hooks are now cleared later during finalization to avoid missing events.
bpo-29778: Ensure python3.dll is loaded from correct locations when Python is embedded (CVE-2020-15523).

Core and Builtins
bpo-41247: Always cache the running loop holder when running asyncio.set_running_loop.
bpo-41252: Fix incorrect refcounting in _ssl.c’s _servername_callback().
bpo-41218: Python 3.8.3 had a regression where compiling with ast.PyCF_ALLOW_TOP_LEVEL_AWAIT would aggressively mark list comprehension with CO_COROUTINE. Now only list comprehension making use of 
async/await will tagged as so.
bpo-41175: Guard against a NULL pointer dereference within bytearrayobject triggered by the bytearray() + bytearray() operation.
bpo-39960: The “hackcheck” that prevents sneaking around a type’s __setattr__() by calling the superclass method was rewritten to allow C implemented heap types.

Library
bpo-41235: Fix the error handling in ssl.SSLContext.load_dh_params().
bpo-41193: The write_history() atexit function of the readline completer now ignores any OSError to ignore error if the filesystem is read-only, instead of only ignoring FileNotFoundError and 
PermissionError.
bpo-41043: Fixed the use of glob() in the stdlib: literal part of the path is now always correctly escaped.
bpo-39384: Fixed email.contentmanager to allow set_content() to set a null string.

IDLE
bpo-37765: Add keywords to module name completion list. Rewrite Completions section of IDLE doc.
bpo-41152: The encoding of stdin, stdout and stderr in IDLE is now always UTF-8.

Python 3.8.4 release candidate 1

Security
bpo-41004: The __hash__() methods of ipaddress.IPv4Interface and ipaddress.IPv6Interface incorrectly generated constant hash values of 32 and 128 respectively. This resulted in always causing hash 
collisions. The fix uses hash() to generate hash values for the tuple of (address, mask length, network address).
bpo-39073: Disallow CR or LF in email.headerregistry.Address arguments to guard against header injection attacks.
Core and Builtins
bpo-41094: Fix decoding errors with audit when open files with non-ASCII names on non-UTF-8 locale.
bpo-41056: Fixes a reference to deallocated stack space during startup when constructing sys.path involving a relative symlink when code was supplied via -c. (discovered via Coverity)
bpo-35975: Stefan Behnel reported that cf_feature_version is used even when PyCF_ONLY_AST is not set. This is against the intention and against the documented behavior, so it’s been fixed.
bpo-40957: Fix refleak in _Py_fopen_obj() when PySys_Audit() fails
bpo-40870: Raise ValueError when validating custom AST’s where the constants True, False and None are used within a ast.Name node.
bpo-40826: Fix GIL usage in PyOS_Readline(): lock the GIL to set an exception and pass the Python thread state when checking if there is a pending signal.
bpo-40824: Unexpected errors in calling the __iter__ method are no longer masked by TypeError in the in operator and functions contains(), indexOf() and countOf() of the operator module.
bpo-40663: Correctly generate annotations where parentheses are omitted but required (e.g: Type[(str, int, *other))].

Library
bpo-41138: Fixed the trace module CLI for Python source files with non-UTF-8 encoding.
bpo-31938: Fix default-value signatures of several functions in the select module - by Anthony Sottile.
bpo-41068: Fixed reading files with non-ASCII names from ZIP archive directly after writing them.
bpo-41058: pdb.find_function() now correctly determines the source file encoding.
bpo-41056: Fix a NULL pointer dereference within the ssl module during a MemoryError in the keylog callback. (discovered by Coverity)
bpo-41048: mimetypes.read_mime_types() function reads the rule file using UTF-8 encoding, not the locale encoding. Patch by Srinivas Reddy Thatiparthy.
bpo-40448: ensurepip now disables the use of pip cache when installing the bundled versions of pip and setuptools. Patch by Krzysztof Konopko.
bpo-40855: The standard deviation and variance functions in the statistics module were ignoring their mu and xbar arguments.
bpo-40807: Stop codeop._maybe_compile, used by code.InteractiveInterpreter (and IDLE). from from emitting each warning three times.
bpo-40834: Fix truncate when sending str object with_xxsubinterpreters.channel_send.
bpo-38488: Update ensurepip to install pip 20.1.1 and setuptools 47.1.0.
bpo-40767: webbrowser now properly finds the default browser in pure Wayland systems by checking the WAYLAND_DISPLAY environment variable. Patch contributed by Jérémy Attali.
bpo-40795: ctypes module: If ctypes fails to convert the result of a callback or if a ctypes callback function raises an exception, sys.unraisablehook is now called with an exception set. Previously, 
the error was logged into stderr by PyErr_Print().
bpo-30008: Fix ssl code to be compatible with OpenSSL 1.1.x builds that use no-deprecated and --api=1.1.0.
bpo-40614: ast.parse() will not parse self documenting expressions in f-strings when passed feature_version is less than (3, 8).
bpo-40626: Add h5 file extension as MIME Type application/x-hdf5, as per HDF Group recommendation for HDF5 formatted data files. Patch contributed by Mark Schwab.
bpo-25872: linecache could crash with a KeyError when accessed from multiple threads. Fix by Michael Graczyk.
bpo-40597: If text content lines are longer than policy.max_line_length, always use a content-encoding to make sure they are wrapped.
bpo-40515: The ssl and hashlib modules now actively check that OpenSSL is build with thread support. Python 3.7.0 made thread support mandatory and no longer works safely with a no-thread builds.
bpo-13097: ctypes now raises an ArgumentError when a callback is invoked with more than 1024 arguments.
bpo-40457: The ssl module now support OpenSSL builds without TLS 1.0 and 1.1 methods.
bpo-39830: Add zipfile.Path to __all__ in the zipfile module.
bpo-40025: Raise TypeError when _generate_next_value_ is defined after members. Patch by Ethan Onstott.
bpo-39244: Fixed multiprocessing.context.get_all_start_methods to properly return the default method first on macOS.
bpo-39040: Fix parsing of invalid mime headers parameters by collapsing whitespace between encoded words in a bare-quote-string.
bpo-35714: struct.error is now raised if there is a null character in a struct format string.
bpo-36290: AST nodes are now raising TypeError on conflicting keyword arguments. Patch contributed by Rémi Lapeyre.
bpo-29620: assertWarns() no longer raises a RuntimeException when accessing a module’s __warningregistry__ causes importation of a new module, or when a new module is imported in another thread. 
Patch by Kernc.
bpo-34226: Fix cgi.parse_multipart without content_length. Patch by Roger Duran

Tests
bpo-41085: Fix integer overflow in the array.array.index() method on 64-bit Windows for index larger than 2**31.
bpo-38377: On Linux, skip tests using multiprocessing if the current user cannot create a file in /dev/shm/ directory. Add the skip_if_broken_multiprocessing_synchronize() function to the 
test.support module.
bpo-41009: Fix use of support.require_{linux|mac|freebsd}_version() decorators as class decorator.
bpo-41003: Fix test_copyreg when numpy is installed: test.pickletester now saves/restores warnings filters when importing numpy, to ignore filters installed by numpy.
bpo-40964: Disable remote imaplib tests, host cyrus.andrew.cmu.edu is blocking incoming connections.
bpo-40055: distutils.tests now saves/restores warnings filters to leave them unchanged. Importing tests imports docutils which imports pkg_resources which adds a warnings filter.
bpo-34401: Make test_gdb properly run on HP-UX. Patch by Michael Osipov.

Build
bpo-40204: Pin Sphinx version to 2.3.1 in Doc/Makefile.
bpo-40653: Move _dirnameW out of HAVE_SYMLINK to fix a potential compiling issue.

Windows
bpo-41074: Fixed support of non-ASCII names in functions msilib.OpenDatabase() and msilib.init_database() and non-ASCII SQL in method msilib.Database.OpenView().
bpo-40164: Updates Windows OpenSSL to 1.1.1g
bpo-39631: Changes the registered MIME type for .py files on Windows to text/x-python instead of text/plain.
bpo-40677: Manually define IO_REPARSE_TAG_APPEXECLINK in case some old Windows SDK doesn’t have it.
bpo-40650: Include winsock2.h in pytime.c for timeval.
bpo-39148: Add IPv6 support to asyncio datagram endpoints in ProactorEventLoop. Change the raised exception for unknown address families to ValueError as it’s not coming from Windows API.

macOS
bpo-39580: Avoid opening Finder window if running installer from the command line. Patch contributed by Rick Heil.
bpo-41100: Fix configure error when building on macOS 11. Note that the current Python release was released shortly after the first developer preview of macOS 11 (Big Sur); there are other known 
issues with building and running on the developer preview. Big Sur is expected to be fully supported in a future bugfix release of Python 3.8.x and with 3.9.0.
bpo-41005: fixed an XDG settings issue not allowing macos to open browser in webbrowser.py
bpo-40741: Update macOS installer to use SQLite 3.32.2.

IDLE
bpo-41144: Make Open Module open a special module such as os.path.
bpo-39885: Make context menu Cut and Copy work again when right-clicking within a selection.
bpo-40723: Make test_idle pass when run after import.

Tools/Demos
bpo-40479: Update multissltest helper to test with latest OpenSSL 1.0.2, 1.1.0, 1.1.1, and 3.0.0-alpha.
bpo-40163: Fix multissltest tool. OpenSSL has changed download URL for old releases. The multissltest tool now tries to download from current and old download URLs.


To generate a diff of this commit:
cvs rdiff -u -r1.4 -r1.5 pkgsrc/lang/py38-html-docs/Makefile \
    pkgsrc/lang/py38-html-docs/PLIST pkgsrc/lang/py38-html-docs/distinfo
cvs rdiff -u -r1.11 -r1.12 pkgsrc/lang/python38/Makefile
cvs rdiff -u -r1.4 -r1.5 pkgsrc/lang/python38/PLIST \
    pkgsrc/lang/python38/dist.mk
cvs rdiff -u -r1.7 -r1.8 pkgsrc/lang/python38/distinfo
cvs rdiff -u -r1.2 -r1.3 pkgsrc/lang/python38/patches/patch-setup.py

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

Modified files:

Index: pkgsrc/lang/py38-html-docs/Makefile
diff -u pkgsrc/lang/py38-html-docs/Makefile:1.4 pkgsrc/lang/py38-html-docs/Makefile:1.5
--- pkgsrc/lang/py38-html-docs/Makefile:1.4     Fri May 15 08:24:50 2020
+++ pkgsrc/lang/py38-html-docs/Makefile Tue Jul 14 19:12:31 2020
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.4 2020/05/15 08:24:50 adam Exp $
+# $NetBSD: Makefile,v 1.5 2020/07/14 19:12:31 adam Exp $
 
-VERS=          3.8.3
+VERS=          3.8.4
 DISTNAME=      python-${VERS}-docs-html
 PKGNAME=       py38-html-docs-${VERS}
 CATEGORIES=    lang python
Index: pkgsrc/lang/py38-html-docs/PLIST
diff -u pkgsrc/lang/py38-html-docs/PLIST:1.4 pkgsrc/lang/py38-html-docs/PLIST:1.5
--- pkgsrc/lang/py38-html-docs/PLIST:1.4        Fri May 15 08:24:50 2020
+++ pkgsrc/lang/py38-html-docs/PLIST    Tue Jul 14 19:12:31 2020
@@ -1,6 +1,6 @@
-@comment $NetBSD: PLIST,v 1.4 2020/05/15 08:24:50 adam Exp $
+@comment $NetBSD: PLIST,v 1.5 2020/07/14 19:12:31 adam Exp $
 share/doc/python3.8/.buildinfo
-share/doc/python3.8/_downloads/1fcff346614fe6f041f69d725bb36cc5/tzinfo_examples.py
+share/doc/python3.8/_downloads/7114a7f33dfa666402f17110163f1e34/tzinfo_examples.py
 share/doc/python3.8/_images/hashlib-blake2-tree.png
 share/doc/python3.8/_images/logging_flow.png
 share/doc/python3.8/_images/pathlib-inheritance.png
Index: pkgsrc/lang/py38-html-docs/distinfo
diff -u pkgsrc/lang/py38-html-docs/distinfo:1.4 pkgsrc/lang/py38-html-docs/distinfo:1.5
--- pkgsrc/lang/py38-html-docs/distinfo:1.4     Fri May 15 08:24:50 2020
+++ pkgsrc/lang/py38-html-docs/distinfo Tue Jul 14 19:12:31 2020
@@ -1,6 +1,6 @@
-$NetBSD: distinfo,v 1.4 2020/05/15 08:24:50 adam Exp $
+$NetBSD: distinfo,v 1.5 2020/07/14 19:12:31 adam Exp $
 
-SHA1 (python-3.8.3-docs-html.tar.bz2) = 6a165ebaa9ef44e8761ab79a8f8d507b7be601e5
-RMD160 (python-3.8.3-docs-html.tar.bz2) = c1b166f8503c380c6b30384d6d3f86e9f2f30f78
-SHA512 (python-3.8.3-docs-html.tar.bz2) = 5aad0ec599ac4ee478baac91c0ac38d7ac44bb8979bac9263aaafb515103420e0bb8ca4a20b8b915661d1804fc0ad02aa9cfbf00d60a5184df27b0a082109614
-Size (python-3.8.3-docs-html.tar.bz2) = 6556303 bytes
+SHA1 (python-3.8.4-docs-html.tar.bz2) = 33c3aea64c794148ab341e5753a320bbc57ed36f
+RMD160 (python-3.8.4-docs-html.tar.bz2) = 079a2a943a887b79793cad3696f54d19c5426aaf
+SHA512 (python-3.8.4-docs-html.tar.bz2) = 35ba72f82c3f2e6dadf0a122ec73fa825291873dca9bd3d0e4bf9318c02bbc8d8521e2baa9e8d635e3c8144267f04d922b591cb467c08a96b1f0eb80c20dfe34
+Size (python-3.8.4-docs-html.tar.bz2) = 6560337 bytes

Index: pkgsrc/lang/python38/Makefile
diff -u pkgsrc/lang/python38/Makefile:1.11 pkgsrc/lang/python38/Makefile:1.12
--- pkgsrc/lang/python38/Makefile:1.11  Sun May 24 03:43:16 2020
+++ pkgsrc/lang/python38/Makefile       Tue Jul 14 19:12:31 2020
@@ -1,6 +1,5 @@
-# $NetBSD: Makefile,v 1.11 2020/05/24 03:43:16 markd Exp $
+# $NetBSD: Makefile,v 1.12 2020/07/14 19:12:31 adam Exp $
 
-PKGREVISION=   1
 .include "dist.mk"
 
 PKGNAME=       python38-${PY_DISTVERSION}
@@ -22,6 +21,7 @@ PRINT_PLIST_AWK+=     /^[^@]/ && /[^\/]+\.op
 PRINT_PLIST_AWK+=      sub(/.opt-[12].pyc$$/, ".pyo")}
 
 USE_LANGUAGES=         c c++
+USE_TOOLS+=            pkg-config
 GNU_CONFIGURE=         yes
 CONFIGURE_ARGS+=       --enable-shared
 CONFIGURE_ARGS+=       --with-openssl=${BUILDLINK_PREFIX.openssl}
@@ -165,6 +165,11 @@ CHECK_INTERPRETER_SKIP+=   lib/python${PY_
 CHECK_INTERPRETER_SKIP+=       lib/python${PY_VER_SUFFIX}/test/ziptestdata/exe_with_zip
 CHECK_INTERPRETER_SKIP+=       lib/python${PY_VER_SUFFIX}/test/ziptestdata/header.sh
 
+# contain CONFIGURE_ARGS and CONFIGURE_ENV
+CHECK_WRKREF_SKIP+=    lib/python${PY_VER_SUFFIX}/_sysconfigdata*
+CHECK_WRKREF_SKIP+=    lib/python${PY_VER_SUFFIX}/__pycache__/_sysconfigdata*
+CHECK_WRKREF_SKIP+=    lib/python${PY_VER_SUFFIX}/config-${PY_VER_SUFFIX}/Makefile
+
 # Avoid error: Cannot generate ./Include/opcode.h, python not found !
 post-configure:
        touch ${WRKSRC}/Include/opcode.h

Index: pkgsrc/lang/python38/PLIST
diff -u pkgsrc/lang/python38/PLIST:1.4 pkgsrc/lang/python38/PLIST:1.5
--- pkgsrc/lang/python38/PLIST:1.4      Fri May 15 08:24:50 2020
+++ pkgsrc/lang/python38/PLIST  Tue Jul 14 19:12:31 2020
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.4 2020/05/15 08:24:50 adam Exp $
+@comment $NetBSD: PLIST,v 1.5 2020/07/14 19:12:31 adam Exp $
 bin/2to3-${PY_VER_SUFFIX}
 bin/pydoc${PY_VER_SUFFIX}
 bin/python${PY_VER_SUFFIX}
@@ -1403,8 +1403,8 @@ lib/python${PY_VER_SUFFIX}/ensurepip/__i
 lib/python${PY_VER_SUFFIX}/ensurepip/__main__.py
 lib/python${PY_VER_SUFFIX}/ensurepip/__main__.pyc
 lib/python${PY_VER_SUFFIX}/ensurepip/__main__.pyo
-lib/python${PY_VER_SUFFIX}/ensurepip/_bundled/pip-19.2.3-py2.py3-none-any.whl
-lib/python${PY_VER_SUFFIX}/ensurepip/_bundled/setuptools-41.2.0-py2.py3-none-any.whl
+lib/python${PY_VER_SUFFIX}/ensurepip/_bundled/pip-20.1.1-py2.py3-none-any.whl
+lib/python${PY_VER_SUFFIX}/ensurepip/_bundled/setuptools-47.1.0-py3-none-any.whl
 lib/python${PY_VER_SUFFIX}/ensurepip/_uninstall.py
 lib/python${PY_VER_SUFFIX}/ensurepip/_uninstall.pyc
 lib/python${PY_VER_SUFFIX}/ensurepip/_uninstall.pyo
Index: pkgsrc/lang/python38/dist.mk
diff -u pkgsrc/lang/python38/dist.mk:1.4 pkgsrc/lang/python38/dist.mk:1.5
--- pkgsrc/lang/python38/dist.mk:1.4    Fri May 15 08:24:50 2020
+++ pkgsrc/lang/python38/dist.mk        Tue Jul 14 19:12:31 2020
@@ -1,6 +1,6 @@
-# $NetBSD: dist.mk,v 1.4 2020/05/15 08:24:50 adam Exp $
+# $NetBSD: dist.mk,v 1.5 2020/07/14 19:12:31 adam Exp $
 
-PY_DISTVERSION=        3.8.3
+PY_DISTVERSION=        3.8.4
 DISTNAME=      Python-${PY_DISTVERSION}
 EXTRACT_SUFX=  .tar.xz
 DISTINFO_FILE= ${.CURDIR}/../../lang/python38/distinfo

Index: pkgsrc/lang/python38/distinfo
diff -u pkgsrc/lang/python38/distinfo:1.7 pkgsrc/lang/python38/distinfo:1.8
--- pkgsrc/lang/python38/distinfo:1.7   Fri May 15 08:24:50 2020
+++ pkgsrc/lang/python38/distinfo       Tue Jul 14 19:12:31 2020
@@ -1,9 +1,9 @@
-$NetBSD: distinfo,v 1.7 2020/05/15 08:24:50 adam Exp $
+$NetBSD: distinfo,v 1.8 2020/07/14 19:12:31 adam Exp $
 
-SHA1 (Python-3.8.3.tar.xz) = 3bafa40df1cd069c112761c388a9f2e94b5d33dd
-RMD160 (Python-3.8.3.tar.xz) = f52a96c9edac6c135114c8d0766e5f64bea7fb0f
-SHA512 (Python-3.8.3.tar.xz) = 3103bd8d944f3905eee3a2b52fd1f5c7dee380f9c5a99ad35a401fcba5a9117c3860ecec5cb47a92712c6549442fd2fa553a15c5657241dd09f5d00b9ed4f0f4
-Size (Python-3.8.3.tar.xz) = 17912964 bytes
+SHA1 (Python-3.8.4.tar.xz) = 996c56496f4ddd8f18f388a3bd584b74d2b43928
+RMD160 (Python-3.8.4.tar.xz) = 8ba05f772755a7eb4886405db075815ec443b193
+SHA512 (Python-3.8.4.tar.xz) = 37a36d014a8372742be9d0bd9dd3a275e100dc21b1515c145bc62425d4d157327b6e63ad99bc888c0b36c1da4c05676c40eb086e75072d1906e3210ec3043dcb
+Size (Python-3.8.4.tar.xz) = 18020412 bytes
 SHA1 (patch-Lib_ctypes_util.py) = 032cc99ebad93ddddfd89073c60424a952e3faa3
 SHA1 (patch-Lib_distutils_command_install.py) = 6fc6f5d918b7581fc62cd0fe55857ee932c3a341
 SHA1 (patch-Lib_distutils_sysconfig.py) = 6822eafb4dfded86d7f7353831816aeb8119e6cf
@@ -17,4 +17,4 @@ SHA1 (patch-Modules_socketmodule.h) = 13
 SHA1 (patch-Python_thread__pthread.h) = fb81eaa604b4ed7c1b64c3f4731d58a8aee257be
 SHA1 (patch-configure) = 11991489b71557cc934e268981703e9b1dbba4c6
 SHA1 (patch-pyconfig.h.in) = 4bc6e95441cb5faae94d1d52aeaaa10ae01385b6
-SHA1 (patch-setup.py) = 95dd9b0de63d32bdbd7f191cb191489d901f21cd
+SHA1 (patch-setup.py) = ee2adad91434f2739a266c8b5eaad07767b9571a

Index: pkgsrc/lang/python38/patches/patch-setup.py
diff -u pkgsrc/lang/python38/patches/patch-setup.py:1.2 pkgsrc/lang/python38/patches/patch-setup.py:1.3
--- pkgsrc/lang/python38/patches/patch-setup.py:1.2     Mon Mar 16 10:19:15 2020
+++ pkgsrc/lang/python38/patches/patch-setup.py Tue Jul 14 19:12:31 2020
@@ -1,4 +1,4 @@
-$NetBSD: patch-setup.py,v 1.2 2020/03/16 10:19:15 tnn Exp $
+$NetBSD: patch-setup.py,v 1.3 2020/07/14 19:12:31 adam Exp $
 
 Disable certain modules, so they can be built as separate packages.
 Do not look for ncursesw.
@@ -6,11 +6,11 @@ Assume panel_library is correct; this is
   which will get transformed to panel in buildlink.
 Also look for uuid/uuid.h.
 
---- setup.py.orig      2020-02-24 21:36:25.000000000 +0000
+--- setup.py.orig      2020-07-13 12:11:53.000000000 +0000
 +++ setup.py
 @@ -10,7 +10,7 @@ import sys
  import sysconfig
- from glob import glob
+ from glob import glob, escape
  
 -from distutils import log
 +from distutils import log, text_file