1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
|
Tenacity
========
Tenacity is an Apache 2.0 licensed general-purpose retrying library, written in
Python, to simplify the task of adding retry behavior to just about anything.
It originates from a fork of `Retrying`_
.. _Retrying: https://github.com/rholder/retrying
The simplest use case is retrying a flaky function whenever an `Exception`
occurs until a value is returned.
.. code-block:: python
import random
from tenacity import retry
@retry
def do_something_unreliable():
if random.randint(0, 10) > 1:
raise IOError("Broken sauce, everything is hosed!!!111one")
else:
return "Awesome sauce!"
print do_something_unreliable()
Features
--------
- Generic Decorator API
- Specify stop condition (i.e. limit by number of attempts)
- Specify wait condition (i.e. exponential backoff sleeping between attempts)
- Customize retrying on Exceptions
- Customize retrying on expected returned result
Installation
------------
To install *tenacity*, simply:
.. code-block:: bash
$ pip install tenacity
Examples
----------
As you saw above, the default behavior is to retry forever without waiting.
.. code-block:: python
@retry
def never_give_up_never_surrender():
print "Retry forever ignoring Exceptions, don't wait between retries"
Let's be a little less persistent and set some boundaries, such as the number
of attempts before giving up.
.. code-block:: python
@retry(stop=stop_after_attempt(7))
def stop_after_7_attempts():
print "Stopping after 7 attempts"
We don't have all day, so let's set a boundary for how long we should be
retrying stuff.
.. code-block:: python
@retry(stop=stop_after_delay(10))
def stop_after_10_s():
print "Stopping after 10 seconds"
Most things don't like to be polled as fast as possible, so let's just wait 2
seconds between retries.
.. code-block:: python
@retry(wait=wait_fixed(2))
def wait_2_s():
print "Wait 2 second between retries"
Some things perform best with a bit of randomness injected.
.. code-block:: python
@retry(wait=wait_random(min=1, max=2))
def wait_random_1_to_2_s():
print "Randomly wait 1 to 2 seconds between retries"
Then again, it's hard to beat exponential backoff when retrying distributed
services and other remote endpoints.
.. code-block:: python
@retry(wait=wait_exponential(multiplier=1, max=10))
def wait_exponential_1():
print "Wait 2^x * 1 second between each retry, up to 10 seconds, then 10 seconds afterwards"
Then again, it's hard to beat exponential backoff when retrying distributed
services and other remote endpoints.
.. code-block:: python
@retry(wait=wait_combine(wait_fixed(3), wait_jitter(2)))
def wait_fixed_jitter():
print "Wait at least 3 seconds, and add up to 2 seconds of random delay"
Sometimes it's necessary to build a chain of backoffs.
.. code-block:: python
@retry(wait=wait_chain(*[wait_fixed(3) for i in range(3)] +
[wait_fixed(7) for i in range(2)] +
[wait_fixed(9)]))
def wait_fixed_chained():
print "Wait 3s for 3 attempts, 7s for the next 2 attempts and 9s for all attempts thereafter"
We have a few options for dealing with retries that raise specific or general
exceptions, as in the cases here.
.. code-block:: python
@retry(retry=retry_if_exception_type(IOError))
def might_io_error():
print "Retry forever with no wait if an IOError occurs, raise any other errors"
@retry(retry_on_exception=retry_if_io_error)
def only_raise_retry_error_when_not_io_error():
print "Retry forever with no wait if an IOError occurs, raise any other errors wrapped in RetryError"
We can also use the result of the function to alter the behavior of retrying.
.. code-block:: python
def is_none_p(value):
"""Return True if value is None"""
return value is None
@retry(retry=retry_if_result(is_none_p))
def might_return_none():
print "Retry with no wait if return value is None"
We can also combine several conditions:
.. code-block:: python
def is_none_p(value):
"""Return True if value is None"""
return value is None
@retry(retry=retry_any(retry_if_result(is_none_p), retry_if_exception_type()))
def might_return_none():
print "Retry forever ignoring Exceptions with no wait if return value is None"
Any combination of stop, wait, etc. is also supported to give you the freedom
to mix and match.
It's also possible to retry explicitely at any time by raising the `TryAgain`
exception:
.. code-block:: python
@retry
def do_something():
result = something_else()
if result == 23:
raise TryAgain
While callables that "timeout" retrying raise a `RetryError` by default,
we can reraise the last attempt's exception if needed:
.. code-block:: python
@retry(reraise=True, stop=stop_after_attempts(3))
def raise_my_exception():
raise MyException("Fail")
try:
raise_my_exception()
except MyException:
# timed out retrying
Contribute
----------
#. Check for open issues or open a fresh issue to start a discussion around a
feature idea or a bug.
#. Fork `the repository`_ on GitHub to start making your changes to the
**master** branch (or branch off of it).
#. Write a test which shows that the bug was fixed or that the feature works as
expected.
.. _`the repository`: https://github.com/jd/tenacity
|
