pkgsrc-WIP-cvs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

CVS commit: wip/py-netcdf4



Module name:	wip
Committed by:	jihbed
Date:		Wed Jun 10 21:42:58 UTC 2015

Modified Files:
	wip/py-netcdf4: Makefile PLIST distinfo

Log Message:

	Running test.
	
Skip to content
This repository

    Explore
    Features
    Enterprise
    Blog

25
89

    48

Unidata/netcdf4-python

netcdf4-python/Changelog
@jswhit jswhit 9 days ago reword

5 contributors
@jswhit
@shoyer
@huard
@matthew-brett
@cpaulik
1078 lines (814 sloc) 45.551 kB
 version 1.1.9 (not yet tagged)
 ==============================
 * fix for issue #391 (data is already byte-swapped to native
   endian format by the HDF4 library).
 * fix for issue #415 (copy.deepcopy does not work on
   netcdftime datetime object).
 * fix for issue #420 - len(v) where v is a scalar variable returned
   unexpected IndexError, now returns "TypeError: len() on unsized object"
   (same as numpy does for len() on a scalar array).
 * translate docstrings from epydoc markup to markdown, so
   pdoc can be used (epydoc is dead).

 version 1.1.8 (tag v1.1.8rel)
 =============================
 * v[...] now returns a numpy scalar array (not just a scalar) when
   v is a scalar netcdf variable (issue #413).
 * unix-like paths can now be used in createVariable and createGroup.
   v = nc.createVariable('/path/to/var1',('xdim','ydim'),float)
   will create a Variable named 'var1', while also creating the Groups
   'path' and 'path/to' if they do not already exist.
   Similarly, g = nc.createGroup('/path/to') acts like 'mkdir -p' in unix, creating
   the Groups 'path' and '/path/to', if they don't already exist.
   Users who relied on nc.createGroup(groupname) failing when the
   group already exists will have to modify their code, since nc.createGroup
   will now return the existing group instance.
   Dataset.__getitem__ also added.  nc['/path/to'] returns
   a Group instance, and nc['/path/to/var1'] returns a Variable
   instance.  
 * change minimum required numpy to 1.7.0, fix so all tests pass with 1.7.0.
   Added travis tests for minimum required cython, numpy (issue #404).
 * enable abbreviations to time units specification, as allowed in CF (issue
   #402). Now, instead of just 'seconds' and 'seconds', 'secs', 'sec' and 's'
   are also allowed (similar to minutes, days and hours).
 * install utility scripts in utils directory with setuptools entry points 
   (pull request #392 from @mindw).  Code for utilities moved
   to netCDF4_utils.py - makes utilities more windows-friendly.
 * make sure booleans are treated correctly in setup.cfg. Add
   use_cython (default True) to setup.cfg.  If set to False, then
   cython will not be used to compile netCDF4.pyx (existing netCDF4.c 
   will be used instead).
 * use "from Cython.Build import cythonize" instead of
   "from Cython.Distutils import build_ext" in setup.py (issue #393)
   to conform to new cython build mechanism (CEP 201, described at
   https://github.com/cython/cython/wiki/enhancements-distutils_preprocessing).
 * unicode attributes now written as strings, not bytes (using
   nc_put_att_string instead of nc_put_att_text, issue #388).
 * add __orthogonal_indexing__ attribute to Variable, Dataset and Group (issue #385) to 
   denote that Variable objects do not follow numpy indexing semantics for integer and
   boolean array indices. 
 * make sure application of scale_factor and add_offset works correctly when
   scale_factor not given (issue #381).
 * add man pages for nc3tonc4, nc4tonc3, ncinfo in man directory.
   Not installed by setup.py (contributed by Ross Gammon, issue #383).
 * replace tabs with spaces by running reindent.py on all *.py and *.pyx files
   (issue #378).
 * refactor netCDF4_utils and netCDF4 module into netCDF4 package.
   Refactoring effectively removes netCDF4 utils private attributes from
   netCDF4 namespace, so has the potential to break code using private
   attributes (issue #409).

 version 1.1.7 (tag v1.1.7rel)
 =============================
 * check to make sure cython >= 0.19 is available before trying
   to use it (otherwise compilation with fail).  Issue 367.
 * add ipython notebooks from Unidata workshop in examples directory.
 * fix ellipsis variable slicing regression (issue 371).
 * release the Global Interpreter Lock (GIL) when calling the C 
   library for read operations.  Speeds up multi-threaded reads
   (issue 369).  Caution - the HDF5 library may need to be compiled 
   with the threadsafe option to ensure that global data structures
   are not corrupted by simultaneous manipulation by different threads.
 * Make sure USE_NCCONFIG environment variable takes precedence over value
   of use_ncconfig in setup.cfg.  With this change, 'pip install netCDF4'
   with USE_NCCONFIG=1 will use environment variables to find paths to 
   libraries and include files, instead of relying on nc-config (issue #341).

 version 1.1.6 (tag v1.1.6rel)
 =============================

 * fix for issue 353 (num2date can no longer handle units like 'hours since
   2000-01-01 0').
 * fix for issue 354 (num2date no longer supports multi-dimensional arrays).
 * fix for spurious UserWarning about endian-ness mismatch (issue 364).
 * make calendar name keyword for num2date/date2num case insensitive
   (issue 362).
 * make sure units parser returns time-zone naive datetime instance that
   includes UTC offset (issue 357).  UTC offset was applied incorrectly in 
   netcdftime.date2num and num2date.  No longer need to depend on
   python-dateutil.

 version 1.1.5 (tag v1.1.5rel)
 =============================
  
 * add dependency on python-dateutil in setup.py and install docs.
 * use python datetime in num2date and date2num whenever possible. Remove
   duplicate num2date and date2num functions from netcdftime. Addresses issue
   #344. Add microsecond capability to netcdftime.datetime. Roundtrip
   accuracy of num2date/date2num now down to less than a millisecond.
 * use nc-config by default to find dependencies.  setup.py modified to handle failure
   to find nc-config more gracefully (issue #340). If you wish to use env vars to point
   to the libs, you must first move the setup.cfg file out of the way
   (rename it to setup.cfg.save), or set USE_NCCONFIG to 0.
 * if endian-ness of variable is specified, adjust datatype to reflect this when opening
   a file (issue 346).
 * fix for issue #349 (seconds outside the range 0-59 in netcdftime.num2date).

 version 1.1.4 (tag v1.1.4rel)
 =============================

 * speedup conversion of array indices to slices (issue #325).
 * fix for issue #330 (incorrect values for seconds returned by netcdftime).
 * fix reading of scalar vlen variables (issue #333).
 * setting fill_value=False in createVariable for vlen and compound variables 
   now does nothing, instead of causing an error when the Dataset is closed
   (issue #331).
 * cython will regenerate netCDF4.c when install is run, not just build.
   Makes 'pip install' do the right thing when cython is installed (issue #263).

 version 1.1.3 (tag v1.1.3rel)
 =============================

 * checked in _datetime.c to git (resolves issue #315).  Note - _datetime.c
   was *not* included in the 1.1.2 release.
 * Changed __str__ to __repr__ in MFDataset, to be consistent with Dataset
   (issue #317). IPython uses __repr__ to make use-friendly human-readable summaries
   of objects in the terminal.

 version 1.1.2 (tag v1.1.2rel)
 =============================

 * fix for issue 312 (allow slicing with objects that can be cast to ints).
 * indexing netCDF variables with integer sequences and boolean arrays now
   behave the same way (integer sequences are converted to boolean arrays
   internally). Addresses issue #300.  Since indexing using integer sequences
   does not behave exactly as before, some client code may break.  For example,
   previously when integer index arrays had the same length, and that length
   was equal to the number of dimensions of the array being indexed,
   netcdf4-python mirrored the numpy indexing behavior and treated the elements
   of the index arrays as individual sets of integer indices.  This special
   case has been removed. An IndexError is now raised when the new behavior
   would produce a different result than the old, i.e. when the
   indices in an integer sequence are not sorted, or there are duplicate
   indices in the sequence.
 * fix for issue #310 (masked arrays not returned correctly when variable
   has non native endian-ness).
 * fix for issue #306 (slicing variable with "-1" when there is only
   one element along that dimension).
 * Improved speed of num2date and date2num for standard, julian, gregorian
   and proleptic gregorian calendars by vectorizing the functions. See Issue #296
 * Fix for issue #301 ("Datestring parser chokes on years with extra space").
 * Add name property for Dimension, Variable and Group instances (to access string
   name associated with instance).
 * Allow for null byte attributes (so _FillValue='\x00' can be set manually).
   Issue 273.
 * Added __repr__ (matching __str__) for all types (pull request #291).
   IPython uses __repr__ to make use-friendly human-readable summaries
   of objects in the terminal.


 version 1.1.1 (tag v1.1.1rel)
 ==============================

 * make sure _FillValue is a byte for character arrays in Python 3 (issue
   271).
 * add numpy to install_requires in setup.py (issue #282, fixes issue #211).
   'pip install netcdf4-python' will no longer fail if numpy not installed.
 * Fix for issue 278 (UnicodeDecodeError reading netcdf.h from setup.py with
   Python 3.4).
 * Make netcdftime.datetime immutable and hashable (issue 255).
 * Fix issue with slicing of scalar VLEN arrays (issue 270).
 * Add set_auto_mask and set_auto_scale methods to control auto scaling and
   auto masking separately. (issue 269).  Also added set_auto_maskandscale,
   set_auto_scale, set_auto_mask Dataset/Group methods that recursively walk
   through all variables in the Dataset/Group.
 * Make sure file_format attribute propagated to Group instances (issue 265).
 * Fix for issue #259 ("Cannot use broadcasting to set all elements of a
   Variable to a given value").

 version 1.1.0 (tag v1.1.0rel)
 =============================

 * revert weakref change, so that previous behaviour (Dimensions and Variables
   keep strong references to parent Dataset) is the default.  New keyword
   argument 'keepweakref' for Dataset.__init__ can be set to true to get
   weak references.

 version 1.0.9 (tag v1.0.9rel)
 =============================

 * speed up the creation of new Group instances (issue 239).

 * fix logic errors in setup.py (issue 236).

 * it is now possible to create and set variable length string variables with
   numpy string datatypes (pull request 224).

 * add .travis.yml (for travis-ci testing on github), silence warnings from
   test output (issue 225).

 * modify __unicode__ for Variable and Dimension to return more useful error
   message when Dataset object has been garbage collected.

 * use weak references to group instances when creating Dimension and Variable
   objects. This prevents cyclic references messing up garbage collection (issue
   218, pull request 219).

 * accessing values from a 0-dimensional Variable now returns a 0-dimensional
   numpy array, not a 1-dimensional array (issue 220). To write code
   compatible with both the old and new (fixed) behavior, wrap values accessed
   from a 0-dimensional Variable with numpy.asscalar.

 * add an __array__ method to Variable to make numpy ufuncs faster (issue 216).

 * change download_url in setup.py to point to pypi instead of googlecode.

 * fix for date2index error when time variable has only one entry (issue 215).

 * silence warnings ("Non-trivial type declarators in shared declaration (e.g.
   mix of pointers and values). Each pointer declaration should be on its own
   line") with Cython 0.2.

 * reduced memory usage for Variable.__getitem__ under Python 2.

 version 1.0.8 (tag v1.0.8rel)
 =============================

 * change file_format Dataset attribute to data_model (keeping file_format
   for backward compatibility).  Add disk_format attribute (underlying
   disk format, one of NETCDF3, HDF4, HDF5, DAP2, DAP4, PNETCDF or UNDEFINED).
   Uses nc_inq_format_extended, added in version 4.3.1 of library.  If using
   earlier version of lib, disk_format will be set to UNDEFINED.

 * default _FillValue now ignored for byte data types (int8 and uint8) as per
   http://www.unidata.ucar.edu/software/netcdf/docs/netcdf-c/Fill-Values.html#Fill-Values
   "If you need a fill value for a byte variable, it is recommended that you
   explicitly define an appropriate _FillValue attribute, as generic utilities
   such as ncdump will not assume a default fill value for byte variables".
   ncinfo now returns fill mode information (issue 209).

 * check to see if filling was disabled before masking data equal to
   default fill value (issue 209).

 * add variable type information to Dataset.__repr__ (output of ncinfo).

 version 1.0.7 (tag v1.0.7rel)
 =============================

 * add the ability to specify the locations of hdf4,jpeg and curl libs, in
   case netCDF4 was built statically with HDF4 and/or OpenDAP support (issue
   207).

 * add 'ncinfo' utility (like 'ncdump -h' but less verbose).

 * more information displayed when Dataset or Group instance is printed.

 * fix for issue 194 (versions after 1.0.5 fail for netcdf 4.1.1, due to
   call to nc_inq_path, which was added in netcdf 4.1.2).  Fixed by adding
   compile time API check similar to what was done for nc_rename_grp.  If
   filepath Dataset method is called an exception will be raised at runtime
   if the module was built with netcdf < 4.1.2, or cython was not installed
   at build time.

 * fix for issues 202 and 206 (exception raised by numpy.isnan for character data types).

 * if dateutils not installed and time unit accuracy < 1 second requested, have
   netcdftime raise an ImportError.

 version 1.0.6 (svn revision 1312)
 ================================

 * issue warning of endian-ness of dtype argument does not match endian kwarg in
   createVariable.

 * make sure netcdf type NC_CHAR always returned in numpy array dtype 'S1'
   (sometimes arrays of type 'U1' were being returned). Fixes intermittently failing
   test tst_compoundatt.py on python 3.3.

 * fix for issue 201 (if data associated with numpy array not the
   same endian-ness as dtype, data was written incorrectly).  Now
   bytes are swapped if necessary.  Variable.endian() now returns
   'native' instead of None for NETCDF3 formatted files.  createVariable
   now enforces endian='native' for NETCDF3 files. Added tst_endian.py
   test case.

 * fix for issue 200 (library version detection failed on cygwin).

 * fix for issue 199 (nc4tonc3 utility not copying global attributes).

 * fix for issue 198 (setup.py chokes when no arguments given).

 * fix for issue 197 (slicing of netCDF variables using lists of integers).

 * create 'path' attribute for group instance using posixpath, instead
   of os.path (to ensure the unix path is used on all platforms). Issue 196.

 * fix for issue 196 (test failures on win32 due to files being deleted
   before they are closed).

 version 1.0.5 (svn revision 1278)
 ================================

 * change setup.py to compile the Cython sources directly, if
   cython is available.
   This allows for "ifdef" like capability to modify source at compile time to
   account for changes in netcdf API (e.g. the forthcoming addition of the
   nc_rename_grp in version 4.3.1).

 * added a "renameGroup" method, which raises an exception if
   the netcdf lib version linked does not support it. Requires
   netcdf >= 4.3.1.

 * support for more than one missing value (missing_value attribute
   is a vector) when converting to masked array.

 * add 'renameAttribute' method to Dataset, Group and Variable.

 * fix so that var[:] = x works if x is a scalar, and var is a netcdf variable
   with an unlimited dimension that has shape () - i.e. no data has been
   written to it yet.  Before this change, var[:] = x did not write any data.
   Now the scalar x will be written as the first entry in var along the
   unlimited dimension.

 * remove dos line feeds from nc3tonc4 (issue 181).

 * add datatype property for Variable that returns numpy dtype for primitive
   datatypes (same as dtype attribute) but returns CompoundType or VLType
   instance for compound or vlen variables (issue 178).

 * fix logic for deciding where to look for nc-config in setup.py (issue 177).

 * issue a warning and don't try to apply scale_factor or add_offset if these
   attributes are not convertible to floats (issue 176).

 * add filepath method to Dataset instance to return file path (or opendap
   URL) used to create Dataset (issue 172).

 * fix for issue 170 (opening a remote DAP dataset fails after creating
   a NETCDF4 formatted file).

 * fix for issue 169 (error in chartostring function on 64-bit windows).

 * add support for missing_value or _FillValue == NaN (issue 168).

 * added a Dimension.group() method (issue 165).

 version 1.0.4 (svn revision 1229)
 =================================

 * fixed alignment bug that could cause memory corruption
   when reading compound type variables. All users of compound
   types should upgrade.

 version 1.0.3 (svn revision 1219)
 =================================

 * don't try to write empty data array to netcdf file (fixed failing
   test with netcdf 4.3.0rc2).

 * date2num, num2date and date2index now can handle units of microseconds and milliseconds
   (for proleptic_gregorian calendar, or gregorian and standard calendars
    as long as the time origin is after 1582-10-15). Issue 159.

 * Added a _grp attribute to Dimension (issue 165).

 * don't bundle ordereddict (issue 164).

 * support reading of vlen string attributes (issue 156).

 * add --vars option to nc3tonc4 (issue 154).

 * Don't try to set fletcher32 checksum on scalar variables (it causes HDF5
   to crash).  Fixes issue 150.

 * Add --istart/--istop options to nc3tonc4 (issue 148, courtesy of
   Rich Signell).

 * fix for proleptic_gregorian in netcdftime.py (courtesy of Matthias Cuntz).

 version 1.0.2 (svn revision 1196)
 =================================

 * disable version check for HDF5, which is broken by hdf5 1.8.10.

 * make sure all files have a calendar attribute in MFTime (issue 144).

 * more robust fix to issue 90 (array shape modified by assignment to
   a netCDF variable with one more dimension), including test case.

 version 1.0.1 (svn revision 1190)
 =================================

 * fix error that occurred when retrieving data from a variable that has a
   missing_value attribute specified as a string (issue 142).

 * automatically close netcdf files when there are no references
   left to Dataset object (using __dealloc__ method).  Fixes issue 137.

 * fix for slicing of scalar vlen string variables (issue 140).

 * fix to allow writing of unicode data to a NC_CHAR variable.

 * allow for writing of large variables (> 2**32 elements). Fixes issue 130.

 version 1.0fix1
 ===============

 * fix python 3 incompatibility in setup.py (issue 125).

 version 1.0 (svn revision 1164)
 ===============================
 * add 'aggdim' keyword to MFDataset, so the name of the dimension
   to aggregate over can be specified (instead of using the unlimited
   dimension).  aggdim=None by default, which results in the previous
   behavior.  aggdim must be the leftmost dimension of all the variables
   to be aggregated.

 * raise IndexError when indexing a netcdf variable out of range
   so iterating over a variable in a for loop behaves as expected
   (as described in http://effbot.org/zone/python-for-statement.htm).
   Fixes issue 121.

 * added MacPorts portfile (so it can be installed via MacPorts
   on macosx using a "local Portfile repository"). Installs
   from svn HEAD using 'port install netcdf4-python'.

 * added experimental 'diskless' file capability (only added to the C
   lib after the 4.2 release).  Controlled by kwarg 'diskless' to
   netCDF4.Dataset (default False). diskless=True when creating a file
   results in a file that exists only in memory, closing the file
   makes the data disapper, except if persist=True keyword given in
   which case it is persisted to a disk file on close.  diskless=True
   when opening a file creates an in-memory copy of the file for faster access.

 * add the ability to specify the location of the required libs
   (and whether to use nc-config) with setup.cfg,
   instead of using environment variables.

 * fix ISO9601 date parser so it recognizes time zone offsets in time unit
   strings (contributed by David Hassel, issue 114, r1117).

 * add setncatts Dataset,Group and Variable method to add a bunch of
   attributes (given in a python dictionary) at once.  Speeds things
   up for NETCDF3 and NETCDF4_CLASSIC files a lot, since nc_redef/nc_enddef
   not need to be called for each attribute (issue 85, r1113). Adding 1000
   attributes is about 35 times faster using setncatts to add them all at once.
   Makes no difference for NETCDF4 formatted files, since nc_redef/nc_enddef
   is not called.

 * only round after apply scale_factor and add_offset if variable type is
   integer (issue 111, r1109).

 * Fixed bug with all False Boolean index (r1107).

 * added support for after, before and nearest selection method to date2index
   fast "first guess" indexing (r1106).

 * Remove white space in time units string (netcdftime._parse_date).
   An extra space in the time units of one CMIP3 model caused an error
   (r1105).

 * based on results with examples/bench_compress2.py, change
   default complevel for zlib compression from 6 to 4. If complevel=0,
   turn compression off entirely (set zlib=False) (r1102).

 version 0.9.9 (svn revision 1099)
 ================================
 * changed default unicode encoding from "latin-1" to "utf-8", since
   this is the python 3 default, and the only encoding that appears to
   work for dimension and variable names.

 * added test case for unicode attributes, variable and dimension names.

 * fixes for unicode variable, dimension and group names.

 * fix for unicode attributes in python3 (ncdump did not intrepret them as
   text strings). Issue 107.

 * add --format option to nc4tonc3 utility (can be either NETCDF3_CLASSIC or
   NETCDF3_64BIT). Fixes issue 104.

 version 0.9.8 (svn revision 1080)
 ================================
 * use numpy.ma.isMA to check for masked array (instead of checking
   for presence of 'mask' attribute).

 * fixes for AIX with ibm xlc compiler.

 * make sure unicode attributes don't get converted to ascii strings (issue
   98).

 version 0.9.7 (svn revision 1073)
 ================================
 * Added __str__ methods to Dataset, Variable, Dimension, CompoundType,
   VLType and MFDataset, so useful human-readable information is provided when these
   objects are printed in an interactive session.

 * don't try to apply scale_factor and offset if scale_factor=1 and
   add_offset=0 (to avoid making copies of large arrays).

 * changed netCDF4._default_fillvals to netCDF4.default_fillvals (to make part
   of public API).  Added to docs (issue 94).

 version 0.9.6 (svn revision 1043)
 =================================
 * changed default unicode encoding from "ascii" to "latin-1" (iso-8859-1).

 * add "unicode_error" module variable to control what happens when characters
   cannot be decoded by the encoding specified by the "default_encoding" module
   variable (which is "ascii" by default).  unicode_error = "replace" by default
   which means bad characters are replace by "?".  Previously an error was
   raised, the old behavior can be obtained by setting unicode_error = 'strict'.
   Fixes issue 92.

 * add __enter__ and __exit__ methods so you can do "with Dataset(url) as f:"
   (issue 89).

 * don't add extra singleton dimensions to rhs numpy arrays when assigning to
   a netcdf variable. Fixes issue 90.

 * coerce missing_value attribute to same type as variable (for primitive
   types). Fixes issue 91.

 version 0.9.5 (svn revision 1031)
 ================================
 * fix for compound variables on python 3.2.

 * fix slicing of masked MFDataset variables (issue 83).

 * round to nearest integer after packing with scale_factor and add_offset
   (instead of truncation) (issue 84).

 * if add_offset missing, but scale_factor present, assume add_offset zero.
   if scale_factor missing, but add_offset present, assume scale_factor one.
   (this is consistent with unidata recommendations - issue 86).

 * only try to convert strings to bytes for python 3 so Dataset can
   be subclassed (issue 87).

 version 0.9.4 (svn revision 1018)
 ================================
 * tested with python 2.7.1/3.1.3 using netcdf 4.1.2 and hdf5 1.8.6.

 * Added a 'default_encoding' module variable that controls how unicode
 strings are encoded into bytes. Default is 'ascii'.

 * now works on Python 3.

 * netCDF3 module removed. If you still need it, get it from netCDF4 0.9.3.

 * regenerated C source with Cython 0.14.1.

 * Added a MFTime class. Provide a unified interface to MFDataset time
 variable using different time units.

 * Fixed bug in netcdftime (issue 75) that occurs when time specified is within
 one second of the end of the month.

 * on unix-like systems, the environment variable USE_NCCONFIG can be set to
 tell setup.py to use the nc-config script installed by netcdf to figure out
 where all the libs and headers are (without having to specify NETCDF_DIR,
 HDF5_DIR, etc).  Only works with netcdf 4.1.2.

 version 0.9.3 (svn revision 930)
 ================================
 * fix chunk sizes bug (chunk sizes pointer should be size_t, not int).  Fixes
 issue 66. Added test in tst_compression.py

 * fixed writing of data with missing values with scale/offset packing. Added
 test (tst_masked2.py).

 * fix iso8601 regex in netcdftime date parser so it can parse 'hours since 1-1-1 ...'
 (year had to be 4 digits previously)

 version 0.9.2 (svn revision 907)
 ================================
 * fix netcdftime bug with '360_day' calendar. Fixes issue 59.

 * make sure scalar slice of 1d variable returns array scalar (not array of
   shape (1,)). Fixes issue 57.

 * updated date parser in netcdftime.  Can now handle units like
   "seconds since 1970-01-01T00:00:00Z".

 * added support in setup.py for specifying the locations of the HDF5/netcdf-4 headers
   and libs separately with environment variables (HDF5_INCDIR, HDF5_LIBDIR).i
   Patch contributed by Patrice Dumas.

 * add masked array support to num2date (dates for missing times set to None).

 * add chunk_cache keyword to createVariable.  HDF5 default is 1mb, which can
   cause problems when creating 1000's of variables.  In such cases,
   chunk_cache can be reduced, or set to zero.

 * add set_var_chunk_cache and get_var_chunk_cache Variable methods.

 * raise AttributeError when trying to set _FillValue attribute (it can only
   be reliably set on variable creation, using the fill_value keyword to
   createVariable).

version 0.9.1 (svn revision 879)
================================
 * raise ImportError if netcdf-4 < 4.1.1 or hdf5 <= 1.8.4.

 * add __netcdf4libversion__ and __hdf5libversion__ module variables.

 * make sure data is not truncated to integers before scale_factor and
   add_offset is applied (issue 46).

 * fix bug in date2num with noleap calendar in netcdftime (issue 45).

 * fix bug in 360day calendar in netcdftime (issue 44).

 * python 2.4 compatibility restored (by modifying OrderedDict).  Fixes issue
   37.

 * make sure int64 attributes cast to int32 when format=NETCDF4_CLASSIC. This
   was causing tst_multifile.py to fail on 64-bit platforms.

 * fix tutorial.py to cast 64 bit integers to 32 bit when writing to 32-bit
   integer vlen (was causing tutorial.py to fail on 64-bit platforms).

 * remove nose dependency from tst_netcdftime.py.

version 0.9 (svn revision 846)
==============================
 * fixed bug (issue 30) with date2index occurring with dates outside the support.

 * make sure that auto masking works with MFDataset.

 * fix bug (issue 34) when slicing MFDataset variables with dimensions of
   length 1.

 * used ordered dictionaries for variables, dimensions, groups etc to
   preserve creation order (makes it easier to copy files, fixes issue 28).

 * change auto_maskandscale default to True.  This means data will
   automatically be converted to and from masked arrays.  Data scaled as short
   integers using the scale_factor and add_offset attributes will also be
   automatically converted to/from float arrays.

 * add setncattr, getncattr, delncattr methods (for setting/getting/deleting netcdf
   attributes with names that clash with the reserved python attributes).

version 0.8.2 (svn revision 769)
================================
 * compound type tests re-enabled. Compound and vlen types now fully
   supported in netcdf-4.1-beta2.

 * make sure data retrieved from a netCDF variable is not coerced to a python
   scalar (it should remain a numpy scalar array).

 * fix docs to point out that an unlimited dimension can be created by setting
   size to *either* None or 0 in createDimension.

 * fix another slicing corner case.

 * remove auto pickling/unpickling into vlen strings (too cute, sometimes
   produced surprising results).

version 0.8.1 (svn revision 744)
================================
 * added 'cmptypes' and 'vltypes' Group/Dataset attributes, which contain
   dictionaries that map the names of compound and vlen types to
   CompoundType and VLType instances.

 * Experimental variable-length (vlen) data type support added.

 * changes to accomodate compound types in netcdf-4.1-beta snapshots.
   Compound types now work correctly for snapshots >= 20090603.

 * Added __len__ method and 'size' property to Variable class.

 * In date2index, replaced the brute force method by the bisection method and
   added a 'select' keyword to find the index of the date before, after or
   nearest the given date.

 * Fixed bug occurring when indexing with a numpy array of length 1.

 * Fixed bug that occured when -1 was used as a variable index.

 * enabled 'shared access' mode for NETCDF3 formatted files (mode='ws',
   'r+s' or 'as'). Writes in shared mode are unbuffered, which can
   improve performance for non-sequential access.

 * fixed bug in renameVariable that caused failure when new name is longer
   than old name, and file format is NETCDF3_64BIT or NETCDF3_CLASSIC.

version 0.8 (svn revision 685)
==============================
 * added 'stringtoarr' utility function for converting python strings
   to numpy character arrays of a specified size.

 * initial support for compound data types (which are mapped to structured
   numpy arrays). Compound data types are created with the createCompoundTYpe
   Dataset or Group method. Both attributes and variables can be compound
   types.

 * make sure 64-bit integer attributes converted to 32 bits when writing to
   a NETCDF3 formatted file.

 * added nc4tonc3 utility for converted NETCDF4_CLASSIC files to NETCDF3_64BIT
   files (useful for sharing data with colleagues that don't have netcdf-4
   capable clients).

version 0.7.7 (svn revision 626)
================================

 * David Huard reworked fancy indexing - it is now much more efficient and
   less of a memory hog. Now works differently than numpy fancy indexing - 1d
   arrays of boolean or integer indices work independently on each dimension.
   This enables things like:
   >>> tempdat = temp[[0,1,3],lats>0,lons>0]
   (retrieves 1st, 2nd and 4th levels, all Northern Hem. and Eastern
    Hem. grid points - note that this would raise an IndexError in numpy)

* added opendap test (tst_dap.py).

* bugfix for nc3tonc4 utility.

* fix MFDataset.Variable. __getattr__ to raise AttributeError instead of
  KeyError when attribute not found.

* netcdftime version number upped to 0.7.

version 0.7.6 (svn revision 574)
================================

* added date2index function, courtesy of David Huard, which finds the indices
  in a netCDF time variable corresponding to a sequence of datetime instances.

* make _get_att/_set_att raise AttributeError instead of RuntimeError, so that
  getattr(object, 'nonexistantattribute', None) works.  (thanks David Huard)

* v[:] = data now works along unlim dim, i.e. you can do this:

  file = Dataset('test.nc', "w")
  file.createDimension("time", None)     # unlimited dimension
  var = file.createVariable("var", 'd', ("time",))
  # you used to have to do this
  #var[0:10] = numpy.arange(10)
  # but now you can simply do this
  var[:] = numpy.arange(10)

version 0.7.5 (svn revision 549)
================================
* return a scalar array, not a python scalar, when a slice returns a single
  number. This is more consistent with numpy behavior, and fixes a bug
  in MFDataset slicing.
* added 'exclude' parameter to MFDataset.__init__
* added set_auto_maskandscale method to MFDataset variables.

version 0.7.4 (svn revision 540)
================================
* ensure all arithmetic is done with float64 in netcdftime (Rob Hetland).
* fixes for netcdf-4.0-beta2 ('chunking' keyword to createVariable
  replaced by 'contiguous').  Now works with netcdf-4.0-beta2 and hdf5-1.8.0
  final, but is incompatible with netcdf-4.0-beta1.

version 0.7.3.1 (svn revision 507)
==================================
* netCDF3 docs were missing from 0.7.3.
* make sure quantization function preserves fill_value of masked arrays.

version 0.7.3 (svn revision 501)
================================
* MFnetCDF4 module merged into netCDF4 and netCDF3 (now
  called MFDataset).
* added netCDF3 module for those who can't install the netCDF 4 lib.
* added set_auto_maskandscale Variable method to enable automatic
  packing and unpacking of short integers (using scale_factor
  and add_offset attributes) and automatic conversion to/from
  masked arrays (using missing_value or _FillValue attribute)
  on a per-variable basis.
  var.set_auto_maskandscale(True) turns automatic
  conversion on (it is off by default).
* automatically pack/unpack short integer variables
  if scale_factor and add_offset variable attributes are set.
* added support for masked arrays.  If you try to write a masked
  array to a variable with the missing_value or _FillValue attributes
  set, the masked array is filled with that value before being written
  to the file.  If you read data from a variable with the missing_value
  or _FillValue attribute set, a masked array is returned with the
  appropriate values masked.
* added date2num and num2date functions.
* added capability to use 'fancy indexing' with variable objects
  (i.e. using sequences of integers or booleans in slices). WARNING:
  if a sequence of integers or booleans is used to slice a netCDF4
  variable, all of the data in that dimension is read into a numpy
  array, and then the sequence is used to slice the numpy array,
  returning just the requested elements to the user.  This can
  potentially gobble a lot of memory and degrade performance
  (especially if 'fancy indexing' is done on the left-most dimension).
* added convenience functions stringtochar and chartostring for
  converting character arrays to arrays of fixed-length strings and
  vice-versa.   Example usage in examples/test_stringarr.py.

20070826 - version 0.7.1 (svn revision 400)
===========================================
* added 'endian()' and 'chunking()' Variable methods (to inquire about
  endian and chunking variable settings).

* 'ndim' attribute was not public (so it couldn't be accessed from python).
  Fixed.

* added 'endian' kwarg to createVariable (to set the endian-ness
  used in the HDF5 file).

* can now manually set HDF5 chunksizes for each dimension at
  variable creation, using 'chunksizes' kwarg to createVariable.

* added "getlibversion()" function to get info about version
  of netcdf-4 library used to build module.

* if a variable has an unsupported datatype (such as 'compound', or
  'vlen'), then instead of raising an exception, just skip it.
  Print a useful error message when an attribute with an unsupported
  datatype is accessed.

* if variable dimension is specified as 'dimname' or ('dimname')
  in createVariable, it is automatically converted to a tuple ('dimname',).
  Better error messages when specified dimension can't be found.

* createVariable accepts numpy dtype object as datatype.  dtype variable
  attribute is now a numpy dtype object.

20070723 - version 0.7 (svn revision 361)
=========================================
* renamed MFnetCDF4_classic --> MFnetCDF4.

* eliminated netCDF4_classic module (all file formats handled by
  netCDF4 module now).

* removed all user-defined data type stuff (it was hacky and made
  the code too complex - wait till there is a real use case to
  refactor and put back in).

* added 'ndim' variable attribute (number of variable dimensions).

20070424 - version 0.6.3 (svn revision 302)
===========================================
* passes all tests with netcdf-4.0-beta1/hdf5-1.8.0-beta1.

* if slice index is not a slice object, assume it's an integer (and
  try to convert to one if it is not).  This allows numpy scalar arrays
  to work as slice indices.

* (netCDF4_classic only) try to make sure file is not left in 'define mode'
  when execption is raised.

* if slicing a variable results in a array with shape (1,), just return
  a scalar (except for compound types).

* added instructions for using the netCDF4_classic module to serve
  data over http with the DAP using pydap (http://pydap.org).

* added --quiet and --chunk options to nc3tonc4.

* Turned off zlib compression by default so as not to violate the
  'principle of least surprise'.  Shuffle filter still activated
  by default when zlib compression turned on.

* Fixed bug in fletcher32 checksum activation call.  Renamed compression()
  variable method to filters(), include fletcher32 checksum flag in output.

* added utility for converting GRIB1 files to compressed
  NETCDF4_CLASSIC files (requires PyNIO).

* added 'compression()' variable method that returns a dict with
  compression filter parameter settings for that variable. (rev 237)

* reimplemented 'shape' and 'dimensions' variable attributes as
  properties.

* fixed bug when 'chunking' keyword in createVariable was set to 'sub'
  (caused Bus Error on MacOS X).

* Setting 'shuffle=0' keyword in createVariable was turning off
  zlib compression filter instead of shuffle filter.  Fixed.

20070213 - version 0.6.2
========================
* updated for compatibility with netcdf-4.0-alpha18 and hdf5 1.8.0alpha5
  (shared dimensions actually work now).

* netCDF4.createVariable can now use old single character Numeric typecodes
  for datatype specification.

* Improvements to MFDataset (now called MFnetCDF4_classic) by Rob Hetland.

20061121 - version 0.6.1
========================
* bugfixes for negative strides.

* bugfix for empty string attributes.

* support for shared dimensions (variables can use dimensions defined
  only in a parent group).  This doesn't actually work yet, because of
  a bug in netcdf-4.0-alpha17.

* now requires Pyrex (C source files generated on the fly when setup.py
  is run).

20061003 - version 0.6
======================
* if fill_value keyword to createVariable is set to the Boolean
  False (not an integer that evaluates to False), no pre-filling
  is done for that variable.

* updated to be compatible with netcdf-4.0-alpha17.
  Can now install pure-python netcdftime separately with setup-netcdftime.py.
  netcdftime will try to use numpy, but fall back to Numeric if numpy
  not installed.

* generated source files with a version of pyrex
  (from http://codespeak.net/svn/lxml/pyrex/) that produces
  extensions compatible with python 2.5.

* added new module for multi-file access of NETCDF3 and NETCDF4_CLASSIC
  files (MFDataset). Based on CDFMF from pycdf.

* implement negative strides in variable slicing
  (feature missing from Scientific.IO.NetCDF). Now variables support
  full python extended slicing syntax.

20060925 - version 0.5.1
========================
* on 64-bit systems integer attributes in netCDF4_classic failed, since there
  is no 64-bit integer data type. Fixed by downcasting to 32-bit integer.

20060920 - version 0.5
======================
* Compound type support! (members must be fixed data primitive types -
  no user-defined types or NC_STRING variables allowed).  Attributes
  are still restricted to primitive data types (no vlen or compound
  type attributes).

* Assigning single values to a slice now does the Right Thing, i.e.
  >>> data[:] = 1
  fills all the elements with 1 (instead of raising an IndexError).

* Tested with numpy 1.0b5, netcdf-4.0-alpha16, HDF5 1.7.52 alpha.

* Added renameDimension and renameVariable methods to Dataset and Group classes.

* netCDF attributes can be deleted using python del (i.e. 'del dset.foo').

* Moved examples from test and test_classic to examples and
  examples_classic directories.

* Added proper unit tests (in test and test_classic directories).

* NULL characters are removed from text attributes.

* Variable _FillValue can be set using new keyword argument 'fill_value'
  to createVariable Dataset and Group method.

* docstrings now formatted with epydoc (http://epydoc.sf.net).

* improved Scientific.IO.NetCDF compatibility for netCDF4_classic
  (typecode method, ability to use old Numeric typecodes).

* zlib=False or complevel=0 disables shuffle filter in createVariable.

* subversion repository hosted on Google projects
  (http://code.google.com/p/netcdf4-python/).

* examples_classic/bench2.py is a performance comparison with
  Scientific.IO.NetCDF (the numpy version provided by pynetcdf).

* __dict__ attribute of Dataset, Group or Variable provides a python
  dictionary with all netCDF attribute name/value pairs (just like
  Scientific.IO.NetCDF).

20060710 - version 0.4.5
========================
* fixed to work with recent svn versions of numpy

* Now requires at least numpy 0.9.8.

* Raise a AttributeError if user tries to rebind a private attribute
  (like 'variables', 'dimensions' or 'dtype').

20060629 - version 0.4.4
========================
* fixed to work with netcdf-4.0-alpha14.

* automatically cast _FillValue attribute to variable type, to
  avoid surprising error message.

20060320 - version 0.4.3
========================
updated netcdftime module yet again
added 'all_leap'/'366_day' and '360_day' calendars.
netCDFTime class renamed utime, fwd and inv methods
renamed date2num and num2date. These methods can now handle
numpy arrays as well as scalars.
a 'real' python datetime instance is returned if calendar
is gregorian, otherwise a 'datetime-like' instance is returned
(python datetime can't handle funky dates in 'all_leap' and '360_day'
calendars).

20060316 - version 0.4.2
========================
udunits module replaced by pure python version, renamed 'netcdftime'
No longer requires udunits library. Includes 4 calendars
('julian','standard'/'gregorian','proleptic_gregorian','noleap'/'365_day').
Calendar names and their interpretations follow the CF metadata convention.

20060310 - version 0.4.1
========================
udunits module included for doing time conversions.

20060306 - version 0.4
======================

netCDF4_classic module can now write NETCDF3_CLASSIC, NETCDF4_64BIT
as well as NETCDF4_CLASSIC files.  The file format is given as
an optional keyword to the Dataset constructor ('NETCDF4_CLASSIC'
is the default).  Preliminary work on compound types done - but
awaiting the next alpha of the netCDF 4 library to complete (bugs
in alpha12 prevent it from working properly if the compound type
has fields which are arrays).

20060217 - version 0.3.1
========================
refactored user-defined data type support - user-defined
data types are now described by an instance of the class
UserType.  usertype and usertype_name keyword args
eliminated from createVariable.

20060214 - version 0.3
======================
support for variable length strengths (typecode = 'S') and
variable-length, or 'ragged' arrays (vlen user-defined datatype).
Arrays of python objects can be saved as pickled strings with
datatype = 'S'.

20050128 - version 0.2.5
========================
added support for scalar variables (and assignValue, getValue
Variable methods for Scientific.IO.NetCDF compatibility).

20051123 - version 0.2.4
========================
numpy 0.9.4 compatibility
Changed data type codes from ('d', 'f', 'i', 'h', ...) to
('f8', 'f4', 'i4', 'i2', ...).

20050110 - version 0.2.3
========================
added ellipsis slicing capability

20050106 - version 0.2.2
========================
changed scipy_core to numpy.

20051228 - version 0.2.1
========================
bugfixes, added 'nc3tonc4' utility to convert netCDF version 3 files
to NETCDF4_CLASSIC files (with compression).  The converted files
can be read from netCDF 3 clients that have been re-linked to the netCDF 4
library. 'chunking' keyword added to createVariable in netCDF4 module.

20051224 - version 0.2
======================
Added netCDF4_classic module - which creates files in NETCDF4_CLASSIC
format.  These files are compatible with netCDF 3 clients which have
been linked against the netCDF 4 lib.  This module does not use any
new features of the netCDF 4 API except zlib compression.  Unlike
any other netCDF 3 python client, it can transparently compress data
with zlib compression and the HDF5 shuffle filter.

20051222 - version 0.1
======================
First release.  Supports groups, multiple unlimited dimensions, zlib
compression (plus shuffle filter and fletcher32 checksum) and all new
primitive data types.  No support for user-defined data types yet.

    Status API Training Shop Blog About 

    ? 2015 GitHub, Inc. Terms Privacy Security Contact 




To generate a diff of this commit:
cvs -z3 rdiff -u -r1.1 -r1.2 wip/py-netcdf4/Makefile wip/py-netcdf4/PLIST \
    wip/py-netcdf4/distinfo

To view a diff of this commit:
http://pkgsrc-wip.cvs.sourceforge.net/pkgsrc-wip/wip/py-netcdf4/Makefile?r1=1.1&r2=1.2
http://pkgsrc-wip.cvs.sourceforge.net/pkgsrc-wip/wip/py-netcdf4/PLIST?r1=1.1&r2=1.2
http://pkgsrc-wip.cvs.sourceforge.net/pkgsrc-wip/wip/py-netcdf4/distinfo?r1=1.1&r2=1.2

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.

------------------------------------------------------------------------------
_______________________________________________
pkgsrc-wip-cvs mailing list
pkgsrc-wip-cvs%lists.sourceforge.net@localhost
https://lists.sourceforge.net/lists/listinfo/pkgsrc-wip-cvs



Home | Main Index | Thread Index | Old Index