pkgsrc-WIP-changes archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
py-dask: Update to 2023.8.1
Module Name: pkgsrc-wip
Committed By: Matthew Danielson <matthewd%fastmail.us@localhost>
Pushed By: matthewd
Date: Thu Aug 31 14:33:49 2023 -0700
Changeset: 6b85094a257f9253834848b2868cff64d740aec0
Modified Files:
py-dask/Makefile
py-dask/distinfo
py-dask/options.mk
Log Message:
py-dask: Update to 2023.8.1
2023.8.1
Released on August 18, 2023
Enhancements
Adding support for cgroup v2 to cpu_count (GH#10419) Johan Olsson
Support multi-column groupby with sort=True and split_out>1 (GH#10425) Richard (Rick) Zamora
Add DataFrame.enforce_runtime_divisions method (GH#10404) Richard (Rick) Zamora
Enable file mode="x" with a single_file=True for Dask DataFrame to_csv (GH#10443) Genevieve Buckley
Bug Fixes
Fix ValueError when running to_csv in append mode with single_file as True (GH#10441) Ben
Maintenance
Add default types_mapper to from_pyarrow_table_dispatch for pandas (GH#10446) Richard (Rick) Zamora
2023.8.0
Released on August 4, 2023
Enhancements
Fix for make_timeseries performance regression (GH#10428) Irina Truong
Documentation
Add distributed.print to debugging docs (GH#10435) James Bourbeau
Documenting compatibility of NumPy functions with Dask functions (GH#9941) Chiara Marmo
Maintenance
Use SPDX in license metadata (GH#10437) John A Kirkham
Require dask[array] in dask[dataframe] (GH#10357) John A Kirkham
Update gpuCI RAPIDS_VER to 23.10 (GH#10427)
Simplify compatibility code (GH#10426) Hendrik Makait
Fix compatibility variable naming (GH#10424) Hendrik Makait
Fix a few errors with upstream pandas and pyarrow (GH#10412) Irina Truong
2023.7.1
Released on July 20, 2023
Note
This release updates Dask DataFrame to automatically convert text data using object data types to string[pyarrow] if pandas>=2 and pyarrow>=12 are installed.
This should result in significantly reduced memory consumption and increased computation performance in many workflows that deal with text data.
You can disable this change by setting the dataframe.convert-string configuration value to False with
dask.config.set({"dataframe.convert-string": False})
Enhancements
Convert to pyarrow strings if proper dependencies are installed (GH#10400) James Bourbeau
Avoid repartition before shuffle for p2p (GH#10421) Patrick Hoefler
API to generate random Dask DataFrames (GH#10392) Irina Truong
Speed up dask.bag.Bag.random_sample (GH#10356) crusaderky
Raise helpful ValueError for invalid time units (GH#10408) Nat Tabris
Make repartition a no-op when divisions match (divisions provided as a list) (GH#10395) Nicolas Grandemange
Bug Fixes
Use dataframe.convert-string in read_parquet token (GH#10411) James Bourbeau
Category dtype is lost when concatenating MultiIndex (GH#10407) Irina Truong
Fix FutureWarning: The provided callable... (GH#10405) Irina Truong
Enable non-categorical hive-partition columns in read_parquet (GH#10353) Richard (Rick) Zamora
concat ignoring DataFrame withouth columns (GH#10359) Patrick Hoefler
To see a diff of this commit:
https://wip.pkgsrc.org/cgi-bin/gitweb.cgi?p=pkgsrc-wip.git;a=commitdiff;h=6b85094a257f9253834848b2868cff64d740aec0
Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.
diffstat:
py-dask/Makefile | 23 +++++++++++++----------
py-dask/distinfo | 6 +++---
py-dask/options.mk | 2 +-
3 files changed, 17 insertions(+), 14 deletions(-)
diffs:
diff --git a/py-dask/Makefile b/py-dask/Makefile
index fbdd879416..b3716198fb 100644
--- a/py-dask/Makefile
+++ b/py-dask/Makefile
@@ -1,6 +1,6 @@
# $NetBSD$
-GITHUB_TAG= 2023.7.0
+GITHUB_TAG= 2023.8.1
DISTNAME= dask-${GITHUB_TAG}
PKGNAME= ${PYPKGPREFIX}-${DISTNAME}
GITHUB_PROJECT= dask
@@ -21,19 +21,22 @@ PYTHON_VERSIONS_INCOMPATIBLE= 27 38
TOOL_DEPENDS+= ${PYPKGPREFIX}-wheel>=0:../../devel/py-wheel
TOOL_DEPENDS+= ${PYPKGPREFIX}-versioneer>=0.28:../../devel/py-versioneer
-DEPENDS+= ${PYPKGPREFIX}-toolz>=0.8.2:../../devel/py-toolz
-DEPENDS+= ${PYPKGPREFIX}-numpy>=1.18:../../math/py-numpy
-DEPENDS+= ${PYPKGPREFIX}-pandas>=1.0:../../math/py-pandas
-DEPENDS+= ${PYPKGPREFIX}-partd>=0.3.10:../../wip/py-partd
-DEPENDS+= ${PYPKGPREFIX}-yaml>=5.3.1:../../textproc/py-yaml
-DEPENDS+= ${PYPKGPREFIX}-distributed>=2023.6.0:../../wip/py-distributed
-DEPENDS+= ${PYPKGPREFIX}-cloudpickle>=1.1.1:../../wip/py-cloudpickle
+DEPENDS+= ${PYPKGPREFIX}-cloudpickle>=1.5.0:../../wip/py-cloudpickle
+DEPENDS+= ${PYPKGPREFIX}-click>=8.1.3:../../devel/py-click
DEPENDS+= ${PYPKGPREFIX}-fsspec>=2022.7.1:../../sysutils/py-fsspec
-DEPENDS+= ${PYPKGPREFIX}-zict>=2.1.0:../../wip/py-zict
DEPENDS+= ${PYPKGPREFIX}-packaging>=20.0:../../devel/py-packaging
-DEPENDS+= ${PYPKGPREFIX}-jinja2-[0-9]*:../../textproc/py-jinja2
+DEPENDS+= ${PYPKGPREFIX}-partd>=1.2.0:../../wip/py-partd
+DEPENDS+= ${PYPKGPREFIX}-yaml>=5.3.1:../../textproc/py-yaml
+DEPENDS+= ${PYPKGPREFIX}-toolz>=0.10.0:../../devel/py-toolz
+DEPENDS+= ${PYPKGPREFIX}-distributed>=${GITHUB_TAG}:../../wip/py-distributed
+# Optional Dependencies
+DEPENDS+= ${PYPKGPREFIX}-numpy>=1.21:../../math/py-numpy
+DEPENDS+= ${PYPKGPREFIX}-jinja2>=2.10.3:../../textproc/py-jinja2
+DEPENDS+= ${PYPKGPREFIX}-pandas>=1.3:../../math/py-pandas
+DEPENDS+= ${PYPKGPREFIX}-zict>=2.1.0:../../wip/py-zict
TEST_DEPENDS+= ${PYPKGPREFIX}-test-[0-9]*:../../devel/py-test
+TEST_DEPENDS+= ${PYPKGPREFIX}-test-cov-[0-9]*:../../devel/py-test-cov
TEST_DEPENDS+= ${PYPKGPREFIX}-test-rerunfailures-[0-9]*:../../devel/py-test-rerunfailures
TEST_DEPENDS+= ${PYPKGPREFIX}-test-xdist-[0-9]*:../../devel/py-test-xdist
TEST_DEPENDS+= ${PYPKGPREFIX}-multipledispatch>=0.6.0*:../../devel/py-multipledispatch
diff --git a/py-dask/distinfo b/py-dask/distinfo
index 213fc6cd61..7f279be978 100644
--- a/py-dask/distinfo
+++ b/py-dask/distinfo
@@ -1,5 +1,5 @@
$NetBSD$
-BLAKE2s (dask-2023.7.0.tar.gz) = 1f4fbeb3a2c68b763ac1ddcf4ca267d1210c2c1c73fad3affeee561358db22d1
-SHA512 (dask-2023.7.0.tar.gz) = b46a41d0cad189572a5b9e7d849155b24079b9211480f45236932115066a7d5b44a9812462653e573d48e9c0a33d235e1ebf557556a91c78d3cdaa2ce2477907
-Size (dask-2023.7.0.tar.gz) = 8529255 bytes
+BLAKE2s (dask-2023.8.1.tar.gz) = 4e937a65e90ad7fbdb695ade7eee6ef9516de74f78661a6c368648765649e3db
+SHA512 (dask-2023.8.1.tar.gz) = 4ca231236e5d868f8fbb69b38721e495a44fbc982a53ea087ef68085c4df2cc99526b5a66b7fee93a3b63a6cd621f8448b877b98370b3dfe1a32e386dd91e73e
+Size (dask-2023.8.1.tar.gz) = 8541743 bytes
diff --git a/py-dask/options.mk b/py-dask/options.mk
index 1286994433..363a476ce6 100644
--- a/py-dask/options.mk
+++ b/py-dask/options.mk
@@ -22,7 +22,7 @@ DEPENDS+= ${PYPKGPREFIX}-cytoolz-[0-9]*:../../devel/py-cytoolz
# TODO Also needs pyarrow
DEPENDS+= ${PYPKGPREFIX}-fastparquet-[0-9]*:../../wip/py-fastparquet
. if ${OPSYS} != "NetBSD"
-DEPENDS+= ${PYPKGPREFIX}-apache-arrow-[0-9]*:../../wip/py-apache-arrow
+DEPENDS+= ${PYPKGPREFIX}-apache-arrow>7.0:../../wip/py-apache-arrow
. endif
.endif
Home |
Main Index |
Thread Index |
Old Index