1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211
|
.TH "burst_buffer.conf" "5" "January 2022" "Slurm configuration file"
.SH "NAME"
burst_buffer.conf \- Slurm configuration file for burst buffer management.
.SH "DESCRIPTION"
\fBburst_buffer.conf\fP is an ASCII file which describes the configuration
of burst buffer resource management.
This file is only required on the head node(s), where the slurmctld daemon
executes.
The file will always be located in the same directory as the \fBslurm.conf\fR.
.LP
Parameter names are case insensitive.
Any text following a "#" in the configuration file is treated
as a comment through the end of that line.
Changes to the configuration file take effect upon restart of
Slurm daemons, daemon receipt of the SIGHUP signal, or execution
of the command "scontrol reconfigure".
.LP
The configuration parameters available include:
.TP
\fBAllowUsers\fR
Comma separated list of user names and/or IDs permitted to use burst buffers.
The options \fBAllowUsers\fR and \fBDenyUsers\fR can not both be specified.
By default all users are permitted to use burst buffers.
.IP
.\" Possible future enhancement for generic plugin
.\" .TP
.\" \fBAltPool\fR
.\" The AltPool value consists of a comma separated list of alternate pools of
.\" resources, each of which includes a name separated by a colon and a numeric
.\" value.
.\" The numeric value can include a suffix of "k", "m", "g", "t" and "p" which
.\" multiplies the numeric value by 1,024, 1,048,576, 1,073,741,824 etc.
.\" The numeric value is a 64\-bit value.
.\" for example, "AltPool=test:20g,small:4g
.\".TP
.\"\fBCreateBuffer\fR
.\"Fully qualified path name of a program which will create both persistent
.\"and per\-job burst buffers.
.\"This option is not used by the burst_buffer/datawarp plugin.
.TP
\fBDefaultPool\fR
Name of the pool used by default for resource allocations.
The default value is the first pool reported by the burst buffer infrastructure.
This option is only used by the burst_buffer/datawarp plugin.
.IP
.TP
\fBDenyUsers\fR
Colon delimited list of user names and/or IDs prevented from using burst buffers.
The options \fBAllowUsers\fR and \fBDenyUsers\fR can not both be specified.
By default all users are permitted to use burst buffers.
.IP
.\".TP
.\"\fBDestroyBuffer\fR
.\"Fully qualified path name of a program which will destroy both persistent
.\"and per\-job burst buffers.
.\"This option is not used by the burst_buffer/datawarp plugin.
.TP
\fBDirective\fR
The string that must be used by a job to request a burst buffer. This string
must be immediately preceded by a single '#' character. This is currently only
used by the lua plugin. For the lua plugin, the default value is "BB_LUA".
See burst_buffer.html for more details.
.IP
.TP
\fBFlags\fR
String used to control various functions.
Multiple options may be comma separated.
Supported options include:
.IP
.RS
.TP
\fBDisablePersistent\fR
Prevents regular users from being able to create and destroy persistent burst buffers.
This is the default behavior, only privileged users (Slurm operators and
administrators) can create or destroy persistent burst buffers.
.IP
.TP
\fBEmulateCray\fR
Emulating a Cray DataWarp system using the dw_wlm_cli script in the burst_buffer/datawarp plugin.
This is only used by the datawarp plugin.
.IP
.TP
\fBEnablePersistent\fR
Enables regular users to create and destroy persistent burst buffers.
By default, only privileged users (Slurm operators and administrators) can
create or destroy persistent burst buffers.
This is only used by the datawarp plugin.
.IP
.TP
\fBPrivateData\fR
If set, then only Slurm operators and the burst buffer owner can see burst
buffer data.
.IP
.TP
\fBTeardownFailure\fR
If set, then teardown a burst buffer after file staging error. Otherwise
preserve the burst buffer for analysis and manual teardown.
.RE
.IP
.TP
\fBGetSysState\fR
Fully qualified path name of a program which will return the current burst
buffer state.
For the DataWarp plugin, this should be the path of the \fIdw_wlm_cli\fR command
and its default value is /opt/cray/dw_wlm/default/bin/dw_wlm_cli.
This is not used by the lua plugin.
.IP
.TP
\fBGetSysStatus\fR
Fully qualified path name of a program which will return the current burst
buffer status.
For the DataWarp plugin, this should be the path of the \fIdwstat\fR command
and its default value is /opt/cray/dws/default/bin/dwstat.
This is not used by the lua plugin.
.IP
.\".TP
.\"\fBGranularity\fR
.\"Granularity of job space allocations in units of bytes.
.\"The numeric value may have a suffix of "m" (megabytes), "g" (gigabytes),
.\""t" (terabytes), "p" (petabytes), or "n" (nodes).
.\"Bytes is assumed if no suffix is supplied.
.\"This option is not used by the burst_buffer/datawarp plugin.
.TP
\fBOtherTimeout\fR
If a burst buffer operation (other than job validation, stage in, or stage out)
runs for longer than this number of seconds, the job will be placed in a held
state.
A Slurm administrator will be required to release the job.
By default there is a 300 second (5 minute) timeout for these operations.
Also see \fBStageInTimeout\fR, \fBStageOutTimeout\fR, and \fBValidateTimeout\fR
options.
For the lua plugin, the maximum timeout value is 2073600 seconds (24 days).
.IP
.TP
\fBPollInterval\fR
This option only applies to the lua plugin.
If the test_data_{in|out} hooks return success and "BUSY", then they will be
called again after waiting for the specified number of seconds. The default
value is 15 seconds.
.IP
.TP
\fBPrivateData\fR
If set to "true" then users will only be able to view burst buffers they can
use.
Slurm administrators will still be able to view all burst buffers.
By default, users can view all burst buffers.
.IP
.TP
\fBStageInTimeout\fR
If the stage in of files for a job takes more than this number of seconds,
the burst buffer will be released and the job will be placed in a held state.
A Slurm administrator will be required to release the job.
By default there is a one day timeout for the stage in process.
For the lua plugin, the maximum timeout value is 2073600 seconds (24 days).
.IP
.TP
\fBStageOutTimeout\fR
If the stage out of files for a job takes more than this number of seconds,
the burst buffer will be released and the job will be purged.
By default there is a one day timeout for the stage out process.
For the lua plugin, the maximum timeout value is 2073600 seconds (24 days).
.IP
.TP
\fBValidateTimeout\fR
If the validation of a job submission request takes more than this number of
seconds, the submission will be rejected.
The value of \fBValidateTimeout\fR must be less than the value of
\fBMessageTimeout\fR configured in the slurm.conf file or job submission
requests may fail with a response timeout error.
By default there is a 5 second timeout for the validation operations.
In the lua plugin, because the validation operation cannot be killed, this
option is not used.
.IP
.SH "COPYING"
Copyright (C) 2014\-2022 SchedMD LLC.
.LP
This file is part of Slurm, a resource management program.
For details, see <https://slurm.schedmd.com/>.
.LP
Slurm is free software; you can redistribute it and/or modify it under
the terms of the GNU General Public License as published by the Free
Software Foundation; either version 2 of the License, or (at your option)
any later version.
.LP
Slurm is distributed in the hope that it will be useful, but WITHOUT ANY
WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE. See the GNU General Public License for more
details.
.SH "SEE ALSO"
.LP
\fBslurm.conf\fR(5)
|