1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
|
Third Party Integration Issues
===============================
.. contents::
:local:
:class: faq
:backlinks: none
.. _numpy_int64:
I'm getting errors related to "``numpy.int64``", "``numpy.bool_``", etc.
------------------------------------------------------------------------
The numpy_ package has its own numeric datatypes that extend from Python's
numeric types, but contain some behaviors that in some cases make them impossible
to reconcile with some of SQLAlchemy's behaviors, as well as in some cases
with those of the underlying DBAPI driver in use.
Two errors which can occur are ``ProgrammingError: can't adapt type 'numpy.int64'``
on a backend such as psycopg2, and ``ArgumentError: SQL expression object
expected, got object of type <class 'numpy.bool_'> instead``; in
more recent versions of SQLAlchemy this may be ``ArgumentError: SQL expression
for WHERE/HAVING role expected, got True``.
In the first case, the issue is due to psycopg2 not having an appropriate
lookup entry for the ``int64`` datatype such that it is not accepted directly
by queries. This may be illustrated from code based on the following::
import numpy
class A(Base):
__tablename__ = "a"
id = Column(Integer, primary_key=True)
data = Column(Integer)
# .. later
session.add(A(data=numpy.int64(10)))
session.commit()
In the latter case, the issue is due to the ``numpy.int64`` datatype overriding
the ``__eq__()`` method and enforcing that the return type of an expression is
``numpy.True`` or ``numpy.False``, which breaks SQLAlchemy's expression
language behavior that expects to return :class:`_sql.ColumnElement`
expressions from Python equality comparisons:
.. sourcecode:: pycon+sql
>>> import numpy
>>> from sqlalchemy import column, Integer
>>> print(column("x", Integer) == numpy.int64(10)) # works
{printsql}x = :x_1{stop}
>>> print(numpy.int64(10) == column("x", Integer)) # breaks
False
These errors are both solved in the same way, which is that special numpy
datatypes need to be replaced with regular Python values. Examples include
applying the Python ``int()`` function to types like ``numpy.int32`` and
``numpy.int64`` and the Python ``float()`` function to ``numpy.float32``::
data = numpy.int64(10)
session.add(A(data=int(data)))
result = session.execute(select(A.data).where(int(data) == A.data))
session.commit()
.. _numpy: https://numpy.org
SQL expression for WHERE/HAVING role expected, got True
-------------------------------------------------------
See :ref:`numpy_int64`.
|
