1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
|
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
<title>Configuring locking: sizing the system</title>
<link rel="stylesheet" href="gettingStarted.css" type="text/css" />
<meta name="generator" content="DocBook XSL Stylesheets V1.73.2" />
<link rel="start" href="index.html" title="Berkeley DB Programmer's Reference Guide" />
<link rel="up" href="lock.html" title="Chapter 15. The Locking Subsystem" />
<link rel="prev" href="lock_config.html" title="Configuring locking" />
<link rel="next" href="lock_stdmode.html" title="Standard lock modes" />
</head>
<body>
<div class="navheader">
<table width="100%" summary="Navigation header">
<tr>
<th colspan="3" align="center">Configuring locking: sizing the system</th>
</tr>
<tr>
<td width="20%" align="left"><a accesskey="p" href="lock_config.html">Prev</a> </td>
<th width="60%" align="center">Chapter 15.
The Locking Subsystem
</th>
<td width="20%" align="right"> <a accesskey="n" href="lock_stdmode.html">Next</a></td>
</tr>
</table>
<hr />
</div>
<div class="sect1" lang="en" xml:lang="en">
<div class="titlepage">
<div>
<div>
<h2 class="title" style="clear: both"><a id="lock_max"></a>Configuring locking: sizing the system</h2>
</div>
</div>
</div>
<p>The lock system is sized using the following four methods:</p>
<div class="orderedlist">
<ol type="1">
<li>
<p>
<a href="../api_reference/C/envset_lk_max_locks.html" class="olink">DB_ENV->set_lk_max_locks()</a>
</p>
</li>
<li>
<p>
<a href="../api_reference/C/envset_lk_max_lockers.html" class="olink">DB_ENV->set_lk_max_lockers()</a>
</p>
</li>
<li>
<p>
<a href="../api_reference/C/envset_lk_max_objects.html" class="olink">DB_ENV->set_lk_max_objects()</a>
</p>
</li>
<li>
<p>
<a href="../api_reference/C/envset_lk_partitions.html" class="olink">DB_ENV->set_lk_partitions()</a>
</p>
</li>
</ol>
</div>
<p>The <a href="../api_reference/C/envset_lk_max_locks.html" class="olink">DB_ENV->set_lk_max_locks()</a>, <a href="../api_reference/C/envset_lk_max_lockers.html" class="olink">DB_ENV->set_lk_max_lockers()</a>, and
and <a href="../api_reference/C/envset_lk_max_objects.html" class="olink">DB_ENV->set_lk_max_objects()</a> methods specify the maximum number of
locks, lockers, and locked objects supported by the lock subsystem,
respectively. The maximum number of locks is the number of locks that
can be simultaneously requested in the system. The maximum number of
lockers is the number of lockers that can simultaneously request locks
in the system. The maximum number of lock objects is the number of
objects that can simultaneously be locked in the system. Selecting
appropriate values requires an understanding of your application and its
databases. If the values are too small, requests for locks in an
application will fail. If the values are too large, the locking
subsystem will consume more resources than is necessary. It is better
to err in the direction of allocating too many locks, lockers, and
objects because increasing the number of locks does not require large
amounts of additional resources. The default values are 1000 of
each type of object.</p>
<p>The <a href="../api_reference/C/envset_lk_partitions.html" class="olink">DB_ENV->set_lk_partitions()</a> method specifies the number of lock
table partitions. Each partition may be accessed independently by
a thread and more partitions can lead to higher levels of concurrency.
The default is to set the number of partitions to be 10 times the number
of cpus that the operating system reports at the time the environment is
created. Having more than one partition when there is only one cpu is not beneficial and
the locking system is more efficient when there is a single partition.
Operating systems (Linux, Solaris) may report thread contexts as cpus and it
may be necessary to override the default to force a single partition on
a single hyperthreaded cpu system.
Objects and locks are divided among the partitions so it best to allocate
several locks and objects per partition. The system will force there
to be at least one per partition.
If a partition runs out of locks or objects it will steal what is needed
from the other partitions. This operation could impact performance if
it occurs too often.</p>
<p>When configuring a Berkeley DB Concurrent Data Store application, the number of lock objects needed
is two per open database (one for the database lock, and one for the
cursor lock when the <a href="../api_reference/C/envset_flags.html#set_flags_DB_CDB_ALLDB" class="olink">DB_CDB_ALLDB</a> option is not specified). The
number of locks needed is one per open database handle plus one per
simultaneous cursor or non-cursor operation.</p>
<p>Configuring a Berkeley DB Transactional Data Store application is more complicated. The recommended
algorithm for selecting the maximum number of locks, lockers, and lock
objects is to run the application under stressful conditions and then
review the lock system's statistics to determine the maximum number of
locks, lockers, and lock objects that were used. Then, double these
values for safety. However, in some large applications, finer
granularity of control is necessary in order to minimize the size of the
Lock subsystem.</p>
<p>The maximum number of lockers can be estimated as follows:</p>
<div class="itemizedlist">
<ul type="disc">
<li>If the database environment is using transactions, the maximum number
of lockers can be estimated by adding the number of simultaneously
active non-transactional cursors open database handles to the number of
simultaneously active transactions and child transactions (where a child
transaction is active until it commits or aborts, not until its parent
commits or aborts).</li>
<li>If the database environment is not using transactions, the maximum
number of lockers can be estimated by adding the number of
simultaneously active non-transactional cursors and open database
handles to the number of simultaneous non-cursor operations.</li>
</ul>
</div>
<p>The maximum number of lock objects needed for a single database
operation can be estimated as follows:</p>
<div class="itemizedlist">
<ul type="disc">
<li>For Btree and Recno access methods, you will need one lock object per
level of the database tree, at a minimum. (Unless keys are quite large
with respect to the page size, neither Recno nor Btree database trees
should ever be deeper than five levels.) Then, you will need one lock
object for each leaf page of the database tree that will be
simultaneously accessed.</li>
<li>For the Queue access method, you will need one lock object per record
that is simultaneously accessed. To this, add one lock object per page
that will be simultaneously accessed. (Because the Queue access method
uses fixed-length records and the database page size is known, it is
possible to calculate the number of pages -- and, therefore, the lock
objects -- required.) Deleted records skipped by a <a href="../api_reference/C/dbcget.html#dbcget_DB_NEXT" class="olink">DB_NEXT</a> or
<a href="../api_reference/C/dbcget.html#dbcget_DB_PREV" class="olink">DB_PREV</a> operation do not require a separate lock object.
Further, if your application is using transactions, no database
operation will ever use more than three lock objects at any time.</li>
<li>For the Hash access method, you only need a single lock object.</li>
</ul>
</div>
<p>For all access methods, you should then add an additional lock object
per database for the database's metadata page.</p>
<p>Note that transactions accumulate locks over the transaction lifetime,
and the lock objects required by a single transaction is the total lock
objects required by all of the database operations in the transaction.
However, a database page (or record, in the case of the Queue access
method), that is accessed multiple times within a transaction only
requires a single lock object for the entire transaction.</p>
<p>The maximum number of locks required by an application cannot be easily
estimated. It is possible to calculate a maximum number of locks by
multiplying the maximum number of lockers, times the maximum number of
lock objects, times two (two for the two possible lock modes for each
object, read and write). However, this is a pessimal value, and real
applications are unlikely to actually need that many locks. Reviewing
the Lock subsystem statistics is the best way to determine this value.</p>
</div>
<div class="navfooter">
<hr />
<table width="100%" summary="Navigation footer">
<tr>
<td width="40%" align="left"><a accesskey="p" href="lock_config.html">Prev</a> </td>
<td width="20%" align="center">
<a accesskey="u" href="lock.html">Up</a>
</td>
<td width="40%" align="right"> <a accesskey="n" href="lock_stdmode.html">Next</a></td>
</tr>
<tr>
<td width="40%" align="left" valign="top">Configuring locking </td>
<td width="20%" align="center">
<a accesskey="h" href="index.html">Home</a>
</td>
<td width="40%" align="right" valign="top"> Standard lock modes</td>
</tr>
</table>
</div>
</body>
</html>
|
