1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
|
<html>
<head>
<title>Direct Chunk Write</title>
</head>
<body>
<!--
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
* Copyright by The HDF Group. *
* Copyright by the Board of Trustees of the University of Illinois. *
* All rights reserved. *
* *
* This file is part of HDF5. The full HDF5 copyright notice, including *
* terms governing use, modification, and redistribution, is contained in *
* the files COPYING and Copyright.html. COPYING can be found at the root *
* of the source code distribution tree; Copyright.html can be found at the *
* root level of an installed copy of the electronic HDF5 document set and *
* is linked from the top-level documents page. It can also be found at *
* http://hdfgroup.org/HDF5/doc/Copyright.html. If you do not have *
* access to either file, you may request a copy from help@hdfgroup.org. *
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
-->
<br />
<p>Return to the <a href="../../Advanced.html">"Advanced Topics"</a> page.</p>
<br /><hr />
<h1>Direct Chunk Write</h1>
<!--
---------1---------2---------3---------4---------5---------6---------7---------8
-->
When a user application is working with a chunked dataset and is writing
a single chunk of data with <code>H5Dwrite</code>, the data goes through
several steps inside the HDF5 library.
The library first examines the hyperslab selection.
Then it converts the data from the datatype in memory to the datatype in the
file if they are different. Finally, the library processes the data in the
filter pipeline.
<p>
This can create an I/O bottleneck in a very high-throughput environment.
<p>
The high-level C function <code>H5DOwrite_chunk</code> provides a mechanism
enabling the application to write a data chunk directly to the file
bypassing the library’s hyperslab selection, data conversion, and
filter pipeline processes.
If an application can pre-process the data properly, the application can
use <code>H5DOwrite_chunk</code> to write the data much faster.
<p>
The following documents describe the use of this feature:
<ul>
<li>“<a
href="UsingDirectChunkWrite.pdf">Using the Direct Chunk Write
Function</a>,” a user-guide
<i>(PDF only)</i>
<li>“<a
href="DECTRISIntegrationRFC2013-1-25.pdf">RFC:
Direct Chunk Write</a>,” the design document for this feature
<i>(PDF only)</i>
<li>The <a
href="../../HL/RM_HDF5Optimized.html#H5DOwrite_chunk">
<code>H5DOwrite_chunk</code></a> function entry in the
“<a href="../../HL/RM_HDF5Optimized.html">HDF5 Optimized
Functions</a>” section of the
<a href="../../HL/index.html"><cite>HDF5 High-level APIs
Reference Manual</cite></a>
</ul>
<hr /><br />
<p>Return to the <a href="../../Advanced.html">"Advanced Topics"</a> page.</p>
<br />
<hr>
<!-- #BeginLibraryItem "/ed_libs/Footer-THGonly.lbi" -->
<address>
<table width="100%" border="0">
<tr valign="top">
<td align="left">
<address>
The HDF Group Help Desk: <img src="../../Graphics/help.png" align=top height=16>
<br>
Describes HDF5 Release 1.8.13, May 2014.
</address>
</td><td width="5%"> </td>
<td align="right">
<a href="../../Copyright.html">Copyright</a> by
<a href="http://www.hdfgroup.org">The HDF Group</a>
</td>
</tr>
</table>
</address>
<!-- #EndLibraryItem --><html><SCRIPT LANGUAGE="JAVASCRIPT">
<!--
document.writeln("Last modified: 28 February 2013");
-->
</SCRIPT>
</body>
</html>
|
