pkgsrc-WIP-changes archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

py-dask: Update to 2023.8.1



Module Name:	pkgsrc-wip
Committed By:	Matthew Danielson <matthewd%fastmail.us@localhost>
Pushed By:	matthewd
Date:		Thu Aug 31 14:33:49 2023 -0700
Changeset:	6b85094a257f9253834848b2868cff64d740aec0

Modified Files:
	py-dask/Makefile
	py-dask/distinfo
	py-dask/options.mk

Log Message:
py-dask: Update to 2023.8.1

2023.8.1
Released on August 18, 2023
Enhancements
    Adding support for cgroup v2 to cpu_count (GH#10419) Johan Olsson
    Support multi-column groupby with sort=True and split_out>1 (GH#10425) Richard (Rick) Zamora
    Add DataFrame.enforce_runtime_divisions method (GH#10404) Richard (Rick) Zamora
    Enable file mode="x" with a single_file=True for Dask DataFrame to_csv (GH#10443) Genevieve Buckley
Bug Fixes
    Fix ValueError when running to_csv in append mode with single_file as True (GH#10441) Ben
Maintenance
    Add default types_mapper to from_pyarrow_table_dispatch for pandas (GH#10446) Richard (Rick) Zamora

2023.8.0
Released on August 4, 2023
Enhancements
    Fix for make_timeseries performance regression (GH#10428) Irina Truong
Documentation
    Add distributed.print to debugging docs (GH#10435) James Bourbeau
    Documenting compatibility of NumPy functions with Dask functions (GH#9941) Chiara Marmo
Maintenance
    Use SPDX in license metadata (GH#10437) John A Kirkham
    Require dask[array] in dask[dataframe] (GH#10357) John A Kirkham
    Update gpuCI RAPIDS_VER to 23.10 (GH#10427)
    Simplify compatibility code (GH#10426) Hendrik Makait
    Fix compatibility variable naming (GH#10424) Hendrik Makait
    Fix a few errors with upstream pandas and pyarrow (GH#10412) Irina Truong

2023.7.1
Released on July 20, 2023
Note
This release updates Dask DataFrame to automatically convert text data using object data types to string[pyarrow] if pandas>=2 and pyarrow>=12 are installed.
This should result in significantly reduced memory consumption and increased computation performance in many workflows that deal with text data.
You can disable this change by setting the dataframe.convert-string configuration value to False with
dask.config.set({"dataframe.convert-string": False})
Enhancements
    Convert to pyarrow strings if proper dependencies are installed (GH#10400) James Bourbeau
    Avoid repartition before shuffle for p2p (GH#10421) Patrick Hoefler
    API to generate random Dask DataFrames (GH#10392) Irina Truong
    Speed up dask.bag.Bag.random_sample (GH#10356) crusaderky
    Raise helpful ValueError for invalid time units (GH#10408) Nat Tabris
    Make repartition a no-op when divisions match (divisions provided as a list) (GH#10395) Nicolas Grandemange
Bug Fixes
    Use dataframe.convert-string in read_parquet token (GH#10411) James Bourbeau
    Category dtype is lost when concatenating MultiIndex (GH#10407) Irina Truong
    Fix FutureWarning: The provided callable... (GH#10405) Irina Truong
    Enable non-categorical hive-partition columns in read_parquet (GH#10353) Richard (Rick) Zamora
    concat ignoring DataFrame withouth columns (GH#10359) Patrick Hoefler

To see a diff of this commit:
https://wip.pkgsrc.org/cgi-bin/gitweb.cgi?p=pkgsrc-wip.git;a=commitdiff;h=6b85094a257f9253834848b2868cff64d740aec0

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

diffstat:
 py-dask/Makefile   | 23 +++++++++++++----------
 py-dask/distinfo   |  6 +++---
 py-dask/options.mk |  2 +-
 3 files changed, 17 insertions(+), 14 deletions(-)

diffs:
diff --git a/py-dask/Makefile b/py-dask/Makefile
index fbdd879416..b3716198fb 100644
--- a/py-dask/Makefile
+++ b/py-dask/Makefile
@@ -1,6 +1,6 @@
 # $NetBSD$
 
-GITHUB_TAG=	2023.7.0
+GITHUB_TAG=	2023.8.1
 DISTNAME=	dask-${GITHUB_TAG}
 PKGNAME=	${PYPKGPREFIX}-${DISTNAME}
 GITHUB_PROJECT=	dask
@@ -21,19 +21,22 @@ PYTHON_VERSIONS_INCOMPATIBLE=	27 38
 TOOL_DEPENDS+=       ${PYPKGPREFIX}-wheel>=0:../../devel/py-wheel
 TOOL_DEPENDS+=       ${PYPKGPREFIX}-versioneer>=0.28:../../devel/py-versioneer
 
-DEPENDS+=	${PYPKGPREFIX}-toolz>=0.8.2:../../devel/py-toolz
-DEPENDS+=	${PYPKGPREFIX}-numpy>=1.18:../../math/py-numpy
-DEPENDS+=	${PYPKGPREFIX}-pandas>=1.0:../../math/py-pandas
-DEPENDS+=	${PYPKGPREFIX}-partd>=0.3.10:../../wip/py-partd
-DEPENDS+=	${PYPKGPREFIX}-yaml>=5.3.1:../../textproc/py-yaml
-DEPENDS+=	${PYPKGPREFIX}-distributed>=2023.6.0:../../wip/py-distributed
-DEPENDS+=	${PYPKGPREFIX}-cloudpickle>=1.1.1:../../wip/py-cloudpickle
+DEPENDS+=	${PYPKGPREFIX}-cloudpickle>=1.5.0:../../wip/py-cloudpickle
+DEPENDS+=	${PYPKGPREFIX}-click>=8.1.3:../../devel/py-click
 DEPENDS+=	${PYPKGPREFIX}-fsspec>=2022.7.1:../../sysutils/py-fsspec
-DEPENDS+=	${PYPKGPREFIX}-zict>=2.1.0:../../wip/py-zict
 DEPENDS+=	${PYPKGPREFIX}-packaging>=20.0:../../devel/py-packaging
-DEPENDS+=	${PYPKGPREFIX}-jinja2-[0-9]*:../../textproc/py-jinja2
+DEPENDS+=	${PYPKGPREFIX}-partd>=1.2.0:../../wip/py-partd
+DEPENDS+=	${PYPKGPREFIX}-yaml>=5.3.1:../../textproc/py-yaml
+DEPENDS+=	${PYPKGPREFIX}-toolz>=0.10.0:../../devel/py-toolz
+DEPENDS+=	${PYPKGPREFIX}-distributed>=${GITHUB_TAG}:../../wip/py-distributed
+# Optional Dependencies
+DEPENDS+=	${PYPKGPREFIX}-numpy>=1.21:../../math/py-numpy
+DEPENDS+=	${PYPKGPREFIX}-jinja2>=2.10.3:../../textproc/py-jinja2
+DEPENDS+=	${PYPKGPREFIX}-pandas>=1.3:../../math/py-pandas
+DEPENDS+=	${PYPKGPREFIX}-zict>=2.1.0:../../wip/py-zict
 
 TEST_DEPENDS+=	${PYPKGPREFIX}-test-[0-9]*:../../devel/py-test
+TEST_DEPENDS+=	${PYPKGPREFIX}-test-cov-[0-9]*:../../devel/py-test-cov
 TEST_DEPENDS+=	${PYPKGPREFIX}-test-rerunfailures-[0-9]*:../../devel/py-test-rerunfailures
 TEST_DEPENDS+=	${PYPKGPREFIX}-test-xdist-[0-9]*:../../devel/py-test-xdist
 TEST_DEPENDS+=	${PYPKGPREFIX}-multipledispatch>=0.6.0*:../../devel/py-multipledispatch
diff --git a/py-dask/distinfo b/py-dask/distinfo
index 213fc6cd61..7f279be978 100644
--- a/py-dask/distinfo
+++ b/py-dask/distinfo
@@ -1,5 +1,5 @@
 $NetBSD$
 
-BLAKE2s (dask-2023.7.0.tar.gz) = 1f4fbeb3a2c68b763ac1ddcf4ca267d1210c2c1c73fad3affeee561358db22d1
-SHA512 (dask-2023.7.0.tar.gz) = b46a41d0cad189572a5b9e7d849155b24079b9211480f45236932115066a7d5b44a9812462653e573d48e9c0a33d235e1ebf557556a91c78d3cdaa2ce2477907
-Size (dask-2023.7.0.tar.gz) = 8529255 bytes
+BLAKE2s (dask-2023.8.1.tar.gz) = 4e937a65e90ad7fbdb695ade7eee6ef9516de74f78661a6c368648765649e3db
+SHA512 (dask-2023.8.1.tar.gz) = 4ca231236e5d868f8fbb69b38721e495a44fbc982a53ea087ef68085c4df2cc99526b5a66b7fee93a3b63a6cd621f8448b877b98370b3dfe1a32e386dd91e73e
+Size (dask-2023.8.1.tar.gz) = 8541743 bytes
diff --git a/py-dask/options.mk b/py-dask/options.mk
index 1286994433..363a476ce6 100644
--- a/py-dask/options.mk
+++ b/py-dask/options.mk
@@ -22,7 +22,7 @@ DEPENDS+=	${PYPKGPREFIX}-cytoolz-[0-9]*:../../devel/py-cytoolz
 # TODO Also needs pyarrow
 DEPENDS+=	${PYPKGPREFIX}-fastparquet-[0-9]*:../../wip/py-fastparquet
 .  if ${OPSYS} != "NetBSD"
-DEPENDS+=	${PYPKGPREFIX}-apache-arrow-[0-9]*:../../wip/py-apache-arrow
+DEPENDS+=	${PYPKGPREFIX}-apache-arrow>7.0:../../wip/py-apache-arrow
 .  endif
 .endif
 


Home | Main Index | Thread Index | Old Index