1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
|
COMEX/OFI provider
------------------
COMEX/OFI is provider implemented to enable Omni-Path, InfiniBand and
other interconnects. It works on top of OFI library (called also libfabric):
https://github.com/ofiwg/libfabric
COMEX/OFI provider supports set of environment variables to
configure internal engines:
COMEX_OFI_LOG_LEVEL
-----------------
COMEX_OFI_LOG_LEVEL=<level>
Possible values: 0 - error
1 - warning
2 - info
3 - debug
4 - trace
Default value: 0
Example: export COMEX_OFI_LOG_LEVEL=2
Description: set this environment variable to print logging information about the application.
Higher levels include information logged in the lower levels.
COMEX_OFI_NATIVE_ATOMICS
-----------------
COMEX_OFI_NATIVE_ATOMICS=<value>
Possible values: 0 - disable native atomics
1 - enable native atomics
Default value: 1
Example: export COMEX_OFI_NATIVE_ATOMICS=1
Description: set this environment variable to control atomics path: native or emulated.
The native path is implemented over OFI Atomics API.
The emulated path is implemented by 2 ways,
controlled over COMEX_OFI_ATOMICS_EMULATION_TYPE.
COMEX_OFI_ATOMICS_EMULATION_TYPE
-----------------
COMEX_OFI_ATOMICS_EMULATION_TYPE=<value>
Possible values: 0 - operations are performed on origin side
1 - operations are performed on target side
Default value: 1
Example: export COMEX_OFI_ATOMICS_EMULATION_TYPE=1
Description: some OFI providers have no built-in support of atomic operations
(like remote add/sub/exchange). Such operations may be implemented
using other OFI APIs. Set this environment variable to control
emulated atomics approach: on origin side or on target side.
The emulated atomics on origin side is implemented
over OFI RMA API for accumulation and OFI Atomics API for rmw.
The emulated atomics on target side is implemented
over OFI Tagged API for accumulation and rmw,
requires enabling of progress thread.
COMEX_OFI_PROGRESS_THREAD
-----------------
COMEX_OFI_PROGRESS_THREAD=<value>
Possible values: 0 - disable progress thread
1 - enable progress thread
Default value: 1
Example: export COMEX_OFI_PROGRESS_THREAD=1
Description: set this environment variable to control creation of progress thread.
COMEX_OFI_CQ_ENTRIES_COUNT
-----------------
COMEX_OFI_CQ_ENTRIES_COUNT=<value>
Possible values: 1 <= value <= 1024
Default value: 8
Example: export COMEX_OFI_CQ_ENTRIES_COUNT=16
Description: set this environment variable specify the maximum number
of entries what can be retrieved from OFI completion queue
by one fi_cq_read call.
COMEX_OFI_PROVIDER
------------------
COMEX_OFI_PROVIDER=<provider_name>
Example: export COMEX_OFI_PROVIDER=psm2
Description: set this environment variable to specify OFI provider name.
By default OFI selects provider using information about available hardware.
But in some cases user may force selection of specific provider
setting variable COMEX_OFI_PROVIDER. List of available
providers may be obtained using application "fi_info"
which is part of libfabric package.
COMEX_OFI_LIBRARY
-----------------
COMEX_OFI_LIBRARY=<path_to_libfabric.so>
Example: export COMEX_OFI_LIBRARY=/usr/local/lib/libfabric.so
Description: set this environment variable to specify path to libfabric.so.
Useful when libfabric.so is installed to non-default location.
|
