1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
|
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<title>10.3. How to avoid mmap Cannot allocate memory error — Groonga v10.1.1-31-g1e46ba6 documentation</title>
<link rel="stylesheet" href="../_static/groonga.css" type="text/css" />
<link rel="stylesheet" href="../_static/pygments.css" type="text/css" />
<script id="documentation_options" data-url_root="../" src="../_static/documentation_options.js"></script>
<script src="../_static/jquery.js"></script>
<script src="../_static/underscore.js"></script>
<script src="../_static/doctools.js"></script>
<script src="../_static/language_data.js"></script>
<link rel="shortcut icon" href="../_static/favicon.ico"/>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
<link rel="next" title="11. Development" href="../development.html" />
<link rel="prev" title="10.2. How to analyze error messages" href="how_to_analyze_error_message.html" />
</head><body>
<div class="header">
<h1 class="title">
<a id="top-link" href="../index.html">
<span class="project">groonga</span>
<span class="separator">-</span>
<span class="description">An open-source fulltext search engine and column store.</span>
</a>
</h1>
<div class="other-language-links">
<ul>
<li><a href="../../../ja/html/troubleshooting/mmap_cannot_allocate_memory.html">日本語</a></li>
</ul>
</div>
</div>
<div class="related" role="navigation" aria-label="related navigation">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="../development.html" title="11. Development"
accesskey="N">next</a> |</li>
<li class="right" >
<a href="how_to_analyze_error_message.html" title="10.2. How to analyze error messages"
accesskey="P">previous</a> |</li>
<li class="nav-item nav-item-0"><a href="../index.html">Groonga v10.1.1-31-g1e46ba6 documentation</a> »</li>
<li class="nav-item nav-item-1"><a href="../troubleshooting.html" accesskey="U"><span class="section-number">10. </span>Troubleshooting</a> »</li>
<li class="nav-item nav-item-this"><a href=""><span class="section-number">10.3. </span>How to avoid mmap Cannot allocate memory error</a></li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body" role="main">
<div class="section" id="how-to-avoid-mmap-cannot-allocate-memory-error">
<h1><span class="section-number">10.3. </span>How to avoid mmap Cannot allocate memory error<a class="headerlink" href="#how-to-avoid-mmap-cannot-allocate-memory-error" title="Permalink to this headline">¶</a></h1>
<div class="section" id="example">
<h2><span class="section-number">10.3.1. </span>Example<a class="headerlink" href="#example" title="Permalink to this headline">¶</a></h2>
<p>There is a case following mmap error in log file:</p>
<blockquote>
<div><p>2013-06-04 08:19:34.835218|A|4e86e700|mmap(4194304,551,432017408)=Cannot allocate memory <13036498944></p>
</div></blockquote>
<p>Note that <13036498944> means total size of mmap (almost 12GB) in this case.</p>
</div>
<div class="section" id="solution">
<h2><span class="section-number">10.3.2. </span>Solution<a class="headerlink" href="#solution" title="Permalink to this headline">¶</a></h2>
<p>So you need to confirm following point of views.</p>
<ul class="simple">
<li><p>Are there enough free memory?</p></li>
<li><p>Are maximum number of mappings exceeded?</p></li>
</ul>
<p>To check there are enough free memory, you can use vmstat command.</p>
<p>To check whether maximum number of mappings are exceeded, you can investigate the value of vm.max_map_count.</p>
<p>If this issue is fixed by modifying the value of vm.max_map_count, it’s exactly the reason.</p>
<p>As groonga allocates memory chunks each 256KB, you can estimate the size of database you can handle by following formula:</p>
<blockquote>
<div><p>(database size) = vm.max_map_count * (memory chunks)</p>
</div></blockquote>
<p>If you want to handle over 16GB groonga database, you must specify at least 65536 as the value of vm.max_map_count:</p>
<blockquote>
<div><p>database size (16GB) = vm.max_map_count (65536) * memory chunks (256KB)</p>
</div></blockquote>
<p>You can modify vm.max_map_count temporary by sudo sysctl -w vm.max_map_count=65536.</p>
<p>Then save the configuration value to <code class="docutils literal notranslate"><span class="pre">/etc/sysctl.conf</span></code> or <code class="docutils literal notranslate"><span class="pre">/etc/sysctl.d/*.conf</span></code>.</p>
<p>See <a class="reference internal" href="../reference/tuning.html"><span class="doc">Tuning</span></a> documentation about tuning related parameters.</p>
</div>
</div>
<div class="clearer"></div>
</div>
</div>
</div>
<div class="sphinxsidebar" role="navigation" aria-label="main navigation">
<div class="sphinxsidebarwrapper">
<h3><a href="../index.html">Table of Contents</a></h3>
<ul>
<li><a class="reference internal" href="#">10.3. How to avoid mmap Cannot allocate memory error</a><ul>
<li><a class="reference internal" href="#example">10.3.1. Example</a></li>
<li><a class="reference internal" href="#solution">10.3.2. Solution</a></li>
</ul>
</li>
</ul>
<h4>Previous topic</h4>
<p class="topless"><a href="how_to_analyze_error_message.html"
title="previous chapter"><span class="section-number">10.2. </span>How to analyze error messages</a></p>
<h4>Next topic</h4>
<p class="topless"><a href="../development.html"
title="next chapter"><span class="section-number">11. </span>Development</a></p>
<div id="searchbox" style="display: none" role="search">
<h3 id="searchlabel">Quick search</h3>
<div class="searchformwrapper">
<form class="search" action="../search.html" method="get">
<input type="text" name="q" aria-labelledby="searchlabel" />
<input type="submit" value="Go" />
</form>
</div>
</div>
<script>$('#searchbox').show(0);</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related" role="navigation" aria-label="related navigation">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="../development.html" title="11. Development"
>next</a> |</li>
<li class="right" >
<a href="how_to_analyze_error_message.html" title="10.2. How to analyze error messages"
>previous</a> |</li>
<li class="nav-item nav-item-0"><a href="../index.html">Groonga v10.1.1-31-g1e46ba6 documentation</a> »</li>
<li class="nav-item nav-item-1"><a href="../troubleshooting.html" ><span class="section-number">10. </span>Troubleshooting</a> »</li>
<li class="nav-item nav-item-this"><a href=""><span class="section-number">10.3. </span>How to avoid mmap Cannot allocate memory error</a></li>
</ul>
</div>
<div class="footer" role="contentinfo">
© Copyright 2009-2021, Brazil, Inc.
</div>
</body>
</html>
|
