1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448
|
Release notes
=============
.. _release_0.7.3:
0.7.3
-----
* Add support for Python 3.9 and Update GitHub Actions.
By :user:`Jackson Maxfield <JacksonMaxfield>`, :issue:`270`.
* Remove support for Python 3.5 which is end of life. While the code base might
still be compatible; the source dist and wheel are marked as Python 3.6+ and
pip will not install them. Continuous integration on Python 3.5 has been
disabled.
By :user:`Matthias Bussonnier <Carreau>`, :issue:`266` and :issue:`267`.
.. _release_0.7.2:
0.7.2
-----
* Disable avx2 for wheel.
By :user:`Grzegorz Bokota <Czaki>`, :issue:`253`.
* Add Base64 fixtures.
By :user:`John Kirkham <jakirkham>`, :issue:`251`.
* Update docs regarding wheels.
By :user:`Josh Moore <joshmoore>`, :issue:`250`.
.. _release_0.7.1:
0.7.1
-----
* Fix build of wheels.
By :user:`Grzegorz Bokota <Czaki>`, :issue:`244`.
.. _release_0.7.0:
0.7.0
-----
* Automatically release to PyPI.
By :user:`Josh Moore <joshmoore>`, :issue:`241`.
* Build wheels on github actions.
By :user:`Grzegorz Bokota <Czaki>`, :issue:`224`.
* Add Base64 codec.
By :user:`Trevor Manz <manzt>`, :issue:`176`.
* Add partial decompression of Blosc compressed arrays.
By :user:`Andrew Fulton <andrewfulton9>`, :issue:`235`.
* Remove LegacyJSON codec.
By :user:`James Bourbeau <jrbourbeau>`, :issue:`226`.
* Remove LegacyMsgPack codec.
By :user:`James Bourbeau <jrbourbeau>`, :issue:`218`.
* Drop support for Python 2.
By :user:`James Bourbeau <jrbourbeau>`, :issue:`220`.
.. _release_0.6.4:
0.6.4
-----
* Update Cython to 0.29.14.
By :user:`John Kirkham <jakirkham>`, :issue:`168`, :issue:`177`, :issue:`204`.
* The bundled c-blosc sources have been upgraded to version 1.17.0.
This fixes compilation with newer versions of gcc.
By :user:`Joe Jevnik <llllllllll>`, :issue:`194`.
* Create ``.pep8speaks.yml``. By :user:`Alistair Miles <alimanfoo>`.
* Simplify datetime/timedelta check.
By :user:`John Kirkham <jakirkham>`, :issue:`170`, :issue:`171`.
* Update URL metadata for PyPI.
By :user:`Elliott Sales de Andrade <QuLogic>`, :issue:`178`.
* Enable pytest rewriting in test helper functions.
By :user:`Elliott Sales de Andrade <QuLogic>`, :issue:`185`.
* Rewrites the ``ensure_text`` implementation.
By :user:`John Kirkham <jakirkham>`, :issue:`201`, :issue:`205`, :issue:`206`.
* Add macOS to CI.
By :user:`Alistair Miles <alimanfoo>`, :issue:`192`.
* Fix test failures on big-endian systems.
By :user:`Elliott Sales de Andrade <QuLogic>`, :issue:`186`.
* Use unittest.mock on Python 3.
By :user:`Elliott Sales de Andrade <QuLogic>`, :issue:`179`.
* Don't mask compile errors in setup.py.
By :user:`Joe Jevnik <llllllllll>`, :issue:`197`.
* Allow pickles when loading test fixture data.
By :user:`Elliott Sales de Andrade <QuLogic>`, :issue:`193`.
* Update ``cpuinfo.py``.
By :user:`John Kirkham <jakirkham>`, :issue:`202`.
* Use ``ensure_text`` in JSON codecs.
By :user:`John Kirkham <jakirkham>`, :issue:`207`.
* Support Python 3.8.
By :user:`John Kirkham <jakirkham>`, :issue:`208`.
.. _release_0.6.3:
0.6.3
-----
* Drop support for 32-bit Windows.
By :user:`Alistair Miles <alimanfoo>`, :issue:`97`, :issue:`156`.
* Raise a ``TypeError`` if an ``object`` array is passed to ``ensure_bytes``.
By :user:`John Kirkham <jakirkham>`, :issue:`162`.
* Update Cython to 0.29.3.
By :user:`John Kirkham <jakirkham>`, :issue:`165`.
.. _release_0.6.2:
0.6.2
-----
* Handle (new) buffer protocol conforming types in ``Pickle.decode``.
By :user:`John Kirkham <jakirkham>`, :issue:`143`, :issue:`150`.
* Use (new) buffer protocol in ``MsgPack`` codec `decode()` method.
By :user:`John Kirkham <jakirkham>`, :issue:`148`.
* Use (new) buffer protocol in ``JSON`` codec `decode()` method.
By :user:`John Kirkham <jakirkham>`, :issue:`151`.
* Avoid copying into data in ``GZip``'s `decode()` method on Python 2.
By :user:`John Kirkham <jakirkham>`, :issue:`152`.
* Revert ndarray coercion of encode returned data.
By :user:`John Kirkham <jakirkham>`, :issue:`155`.
* The bundled c-blosc sources have been upgraded to version 1.15.0. By
:user:`Alistair Miles <alimanfoo>` and :user:`John Kirkham <jakirkham>`, :issue:`142`, :issue:`145`.
.. _release_0.6.1:
0.6.1
-----
* Resolved minor issue in backwards-compatibility tests (by :user:`Alistair Miles
<alimanfoo>`, :issue:`138`, :issue:`139`).
.. _release_0.6.0:
0.6.0
-----
* The encoding format used by the :class:`JSON` and :class:`MsgPack` codecs has been
changed to resolve an issue with correctly encoding and decoding some object arrays.
Now the encoded data includes the original shape of the array, which enables the
correct shape to be restored on decoding. The previous encoding format is still
supported, so that any data encoded using a previous version of numcodecs can still be
read. Thus no changes to user code and applications should be required, other
than upgrading numcodecs. By :user:`Jerome Kelleher <jeromekelleher>`; :issue:`74`,
:issue:`75`.
* Updated the msgpack dependency (by :user:`Jerome Kelleher <jeromekelleher>`;
:issue:`74`, :issue:`75`).
* Added support for ppc64le architecture by updating `cpuinfo.py` from upstream (by
:user:`Anand S <anandtrex>`; :issue:`82`).
* Allow :class:`numcodecs.blosc.Blosc` compressor to run on systems where locks are not present (by
:user:`Marcus Kinsella <mckinsel>`, :issue:`83`; and :user:`Tom White <tomwhite>`,
:issue:`93`).
* Drop Python 3.4 (by :user:`John Kirkham <jakirkham>`; :issue:`89`).
* Add Python 3.7 (by :user:`John Kirkham <jakirkham>`; :issue:`92`).
* Add codec :class:`numcodecs.gzip.GZip` to replace ``gzip`` alias for ``zlib``,
which was incorrect (by :user:`Jan Funke <funkey>`; :issue:`87`; and :user:`John Kirkham <jakirkham>`, :issue:`134`).
* Corrects handling of ``NaT`` in ``datetime64`` and ``timedelta64`` in various
compressors (by :user:`John Kirkham <jakirkham>`; :issue:`127`, :issue:`131`).
* Improvements to the compatibility layer used for normalising inputs to encode
and decode methods in most codecs. This removes unnecessary memory copies for
some codecs, and also simplifies the implementation of some codecs, improving
code readability and maintainability. By :user:`John Kirkham <jakirkham>` and
:user:`Alistair Miles <alimanfoo>`; :issue:`119`, :issue:`121`, :issue:`128`.
* Return values from encode() and decode() methods are now returned as numpy
arrays for consistency across codecs. By :user:`John Kirkham <jakirkham>`,
:issue:`136`.
* Improvements to handling of errors in the :class:`numcodecs.blosc.Blosc` and
:class:`numcodecs.lz4.LZ4` codecs when the maximum allowed size of an input
buffer is exceeded. By :user:`Jerome Kelleher <jeromekelleher>`, :issue:`80`,
:issue:`81`.
.. _release_0.5.5:
0.5.5
-----
* The bundled c-blosc sources have been upgraded to version 1.14.3 (:issue:`72`).
.. _release_0.5.4:
0.5.4
-----
* The bundled c-blosc sources have been upgraded to version 1.14.0 (:issue:`71`).
.. _release_0.5.3:
0.5.3
-----
* The test suite has been migrated to use pytest instead of nosetests
(:issue:`61`, :issue:`62`).
* The bundled c-blosc library has been updated to version 1.13.4 (:issue:`63`,
:issue:`64`).
.. _release_0.5.2:
0.5.2
-----
* Add support for encoding None values in VLen... codecs (:issue:`59`).
.. _release_0.5.1:
0.5.1
-----
* Fixed a compatibility issue with the Zlib codec to ensure it can handle
bytearray objects under Python 2.7 (:issue:`57`).
* Restricted the :class:`numcodecs.categorize.Categorize` codec to object
('O') and unicode ('U') dtypes and disallowed bytes ('S') dtypes because
these do not round-trip through JSON configuration.
.. _release_0.5.0:
0.5.0
-----
* Added new codecs for encoding arrays with variable-length unicode strings
(:class:`numcodecs.vlen.VLenUTF8`), variable-length byte strings
(:class:`numcodecs.vlen.VLenBytes`) and variable-length numerical arrays
((:class:`numcodecs.vlen.VLenArray`) (:issue:`56`).
.. _release_0.4.1:
0.4.1
-----
* Resolved an issue where providing an array with dtype ``object`` as the destination
when decoding could cause segaults with some codecs (:issue:`55`).
.. _release_0.4.0:
0.4.0
-----
* Added a new :class:`numcodecs.json.JSON` codec as an alternative for encoding of
object arrays (:issue:`54`).
.. _release_0.3.1:
0.3.1
-----
* Revert the default shuffle argument to SHUFFLE (byte shuffle) for the
:class:`numcodecs.blosc.Blosc` codec for compatibility and consistency with previous
code.
.. _release_0.3.0:
0.3.0
-----
* The :class:`numcodecs.blosc.Blosc` codec has been made robust for usage in both
multithreading and multiprocessing programs, regardless of whether Blosc has been
configured to use multiple threads internally or not (:issue:`41`, :issue:`42`).
* The :class:`numcodecs.blosc.Blosc` codec now supports an ``AUTOSHUFFLE`` argument
when encoding (compressing) which activates bit- or byte-shuffle depending on the
itemsize of the incoming buffer (:issue:`37`, :issue:`42`). This is also now the
default.
* The :class:`numcodecs.blosc.Blosc` codec now raises an exception when an invalid
compressor name is provided under all circumstances (:issue:`40`, :issue:`42`).
* The bundled version of the c-blosc library has been upgraded to version 1.12.1
(:issue:`45`, :issue:`42`).
* An improvement has been made to the system detection capabilities during compilation
of C extensions (by :user:`Prakhar Goel <newt0311>`; :issue:`36`, :issue:`38`).
* Arrays with datetime64 or timedelta64 can now be passed directly to compressor codecs
(:issue:`39`, :issue:`46`).
.. _release_0.2.1:
0.2.1
-----
The bundled c-blosc libary has been upgraded to version 1.11.3 (:issue:`34`, :issue:`35`).
.. _release_0.2.0:
0.2.0
-----
New codecs:
* The :class:`numcodecs.quantize.Quantize` codec, which provides support for reducing the precision
of floating-point data, has been ported over from Zarr (:issue:`28`, :issue:`31`).
Other changes:
* The :class:`numcodecs.zlib.Zlib` codec is now also registered under the alias 'gzip'
(:issue:`29`, :issue:`32`).
Maintenance work:
* A data fixture has been added to the test suite to add some protection against changes to codecs
that break backwards-compatibility with data encoded using a previous release of numcodecs
(:issue:`30`, :issue:`33`).
.. _release_0.1.1:
0.1.1
-----
This release includes a small modification to the setup.py script to provide greater control over
how compiler options for different instruction sets are configured (:issue:`24`,
:issue:`27`).
.. _release_0.1.0:
0.1.0
-----
New codecs:
* Two new compressor codecs :class:`numcodecs.zstd.Zstd` and :class:`numcodecs.lz4.LZ4`
have been added (:issue:`3`, :issue:`22`). These provide direct support for
compression/decompression using `Zstandard <https://github.com/facebook/zstd>`_ and
`LZ4 <https://github.com/lz4/lz4>`_ respectively.
* A new :class:`numcodecs.msgpacks.MsgPack` codec has been added which uses
`msgpack-python <https://github.com/msgpack/msgpack-python>`_ to perform encoding/decoding,
including support for arrays of Python objects
(`Jeff Reback <https://github.com/jreback>`_; :issue:`5`, :issue:`6`, :issue:`8`,
:issue:`21`).
* A new :class:`numcodecs.pickles.Pickle` codec has been added which uses the Python pickle protocol
to perform encoding/decoding, including support for arrays of Python objects
(`Jeff Reback <https://github.com/jreback>`_; :issue:`5`, :issue:`6`, :issue:`21`).
* A new :class:`numcodecs.astype.AsType` codec has been added which uses NumPy to perform type
conversion (`John Kirkham <https://github.com/jakirkham>`_; :issue:`7`, :issue:`12`,
:issue:`14`).
Other new features:
* The :class:`numcodecs.lzma.LZMA` codec is now supported on Python 2.7 if
`backports.lzma <https://pypi.python.org/pypi/backports.lzma>`_ is installed
(`John Kirkham <https://github.com/jakirkham>`_; :issue:`11`, :issue:`13`).
* The bundled c-blosc library has been upgraded to version
`1.11.2 <https://github.com/Blosc/c-blosc/releases/tag/v1.11.2>`_ (:issue:`10`,
:issue:`18`).
* An option has been added to the :class:`numcodecs.blosc.Blosc` codec to allow the block size to
be manually configured (:issue:`9`, :issue:`19`).
* The representation string for the :class:`numcodecs.blosc.Blosc` codec has been tweaked to
help with understanding the shuffle option (:issue:`4`, :issue:`19`).
* Options have been added to manually control how the C extensions are built regardless of the
architecture of the system on which the build is run. To disable support for AVX2 set the
environment variable "DISABLE_NUMCODECS_AVX2". To disable support for SSE2 set the environment
variable "DISABLE_NUMCODECS_SSE2". To disable C extensions altogether set the environment variable
"DISABLE_NUMCODECS_CEXT" (:issue:`24`, :issue:`26`).
Maintenance work:
* CI tests now run under Python 3.6 as well as 2.7, 3.4, 3.5 (:issue:`16`, :issue:`17`).
* Test coverage is now monitored via
`coveralls <https://coveralls.io/github/alimanfoo/numcodecs?branch=master>`_
(:issue:`15`, :issue:`20`).
.. _release_0.0.1:
0.0.1
-----
Fixed project description in setup.py.
.. _release_0.0.0:
0.0.0
-----
First release. This version is a port of the ``codecs`` module from `Zarr
<http://zarr.readthedocs.io>`_ 2.1.0. The following changes have been made from
the original Zarr module:
* Codec classes have been re-organized into separate modules, mostly one per
codec class, for ease of maintenance.
* Two new codec classes have been added based on 32-bit checksums:
:class:`numcodecs.checksum32.CRC32` and :class:`numcodecs.checksum32.Adler32`.
* The Blosc extension has been refactored to remove code duplications related
to handling of buffer compatibility.
|