1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
|
HTCondor Annex Configuration
============================
While the configuration macros in this section may be set by the
HTCondor administrator, they are intended for the user-specific HTCondor
configuration file (usually ``~/.condor/user_config``). Although we
document every macro, we expect that users will generally only want to
change a few of them, listed in the
:ref:`cloud-computing/annex-configuration:user settings` section;
the entries required in by :tool:`condor_annex` in other sections will be
generated by its setup procedure.
Subsequent sections deal with logging
(:ref:`cloud-computing/annex-configuration:logging`), are for expert users
(:ref:`cloud-computing/annex-configuration:expert settings`), or for HTCondor
developers (:ref:`cloud-computing/annex-configuration:developer settings`).
User Settings
-------------
:macro-def:`ANNEX_DEFAULT_AWS_REGION[ANNEX]`
The default region when using AWS. Defaults to 'us-east-1'.
:macro-def:`ANNEX_DEFAULT_LEASE_DURATION[ANNEX]`
The duration of an annex if not specified on the command-line;
specified in seconds. Defaults to 50 minutes.
:macro-def:`ANNEX_DEFAULT_UNCLAIMED_TIMEOUT[ANNEX]`
How long an annex instances should stay idle before shutting down;
specified in seconds. Defaults to 15 minutes.
:macro-def:`ANNEX_DEFAULT_ODI_KEY_NAME[ANNEX]`
The name of the SSH key pair :tool:`condor_annex` should use by default.
No default.
:macro-def:`ANNEX_DEFAULT_ODI_INSTANCE_TYPE[ANNEX]`
The AWS instance type to use for on-demand instances if not
specified. No default, but the :tool:`condor_annex` setup procedure sets
this to 'm4.large'.
:macro-def:`ANNEX_DEFAULT_ODI_IMAGE_ID[ANNEX]`
The AWS AMI to use for on-demand instance if not specified. No
default, but the :tool:`condor_annex` setup procedure sets this to
'ami-35b13223'.
:macro-def:`ANNEX_DEFAULT_SFR_CONFIG_FILE[ANNEX]`
The JSON configuration file use by :tool:`condor_annex` when creating a
Spot-based annex. No default.
Logging
-------
By default, running :tool:`condor_annex` creates three logs: the
:tool:`condor_annex` log, the annex GAHP log, and the annex audit log. The
default location for these logs is the same directory as the
user-specific HTCondor configuration file (usually
~/.condor/user_config). :tool:`condor_annex` sets the :macro:`LOG`
:index:`LOG` macro to this directory when reading its
configuration.
The :tool:`condor_annex` log is a daemon-style log. It is configured as if
:tool:`condor_annex` were a daemon with subsystem type ``ANNEX``; see
:ref:`admin-manual/configuration-macros:daemon logging configuration file
entries` for details.
:tool:`condor_annex` uses special helper programs, called GAHPs, to interact
with the different cloud services. These programs do their own logging,
writing to the annex GAHP log. The annex GAHP log is configured as if it
were a daemon, but with subsystem type ``ANNEX_GAHP``; see
:ref:`admin-manual/configuration-macros:daemon logging configuration file
entries` for details.
The annex audit log records two lines for each invocation of
:tool:`condor_annex`: the command as issued and the results as returned. The
location of the audit log is set by
:macro-def:`ANNEX_AUDIT_LOG[ANNEX]`, which is the ``AUDIT``-level log for the
``ANNEX`` subsystem; see :macro:`<SUBSYS>_<LEVEL>_LOG` (in
:ref:`admin-manual/configuration-macros:daemon logging configuration file
entries`) for details. Because annex creation commands typically make extensive
use of values set in configuration, :tool:`condor_annex` will write the configuration
it used for annex creation commands into the audit log if ``ANNEX_DEBUG``
includes ``D_AUDIT:2``.
Expert Settings
---------------
:macro-def:`ANNEX_DEFAULT_EC2_URL[ANNEX]`
The AWS EC2 endpoint that :tool:`condor_annex` should use. Defaults to
'https://ec2.us-east-1.amazonaws.com'.
:macro-def:`ANNEX_DEFAULT_CWE_URL[ANNEX]`
The AWS CloudWatch Events endpoint that :tool:`condor_annex` should use.
Defaults to 'https://events.us-east-1.amazonaws.com'.
:macro-def:`ANNEX_DEFAULT_LAMBDA_URL[ANNEX]`
The AWS Lambda endpoint that :tool:`condor_annex` should use. Defaults to
'https://lambda.us-east-1.amazonaws.com'.
:macro-def:`ANNEX_DEFAULT_S3_URL[ANNEX]`
The AWS S3 endpoint that :tool:`condor_annex` should use. Defaults to
'https://s3.amazonaws.com'.
:macro-def:`ANNEX_DEFAULT_CF_URL[ANNEX]`
The AWS CloudFormation endpoint that :tool:`condor_annex` should use.
Defaults to 'https://cloudformation.us-east-1.amazonaws.com'.
:macro-def:`ANNEX_DEFAULT_ACCESS_KEY_FILE[ANNEX]`
The full path to the AWS access key file :tool:`condor_annex` should use.
No default. If "FROM INSTANCE", :tool:`condor_annex` will assume it's
running on an EC2 instance and try to use that instance's
credentials.
:macro-def:`ANNEX_DEFAULT_SECRET_KEY_FILE[ANNEX]`
The full path to the AWS secret key file :tool:`condor_annex` should use.
No default. If "FROM INSTANCE", :tool:`condor_annex` will assume it's
running on an EC2 instance and try to use that instance's
credentials.
:macro-def:`ANNEX_DEFAULT_S3_BUCKET[ANNEX]`
A private S3 bucket that the ``ANNEX_DEFAULT_ACCESS_KEY_FILE`` and
``ANNEX_DEFAULT_SECRET_KEY_FILE`` may write to. No default.
:macro-def:`ANNEX_DEFAULT_ODI_SECURITY_GROUP_IDS[ANNEX]`
The default security group for on-demand annexes. Must permit
inbound HTCondor (port 9618).
Developer Settings
------------------
:macro-def:`ANNEX_DEFAULT_CONNECTIVITY_FUNCTION_ARN[ANNEX]`
The name (or ARN) of the Lambda function on AWS which
:tool:`condor_annex` should use to check if the configured collector can
be contacted from AWS.
:macro-def:`ANNEX_DEFAULT_ODI_INSTANCE_PROFILE_ARN[ANNEX]`
The ARN of the instance profile :tool:`condor_annex` should use. No
default.
:macro-def:`ANNEX_DEFAULT_ODI_LEASE_FUNCTION_ARN[ANNEX]`
The Lambda function which implements the lease (duration) for
on-demand instances. No default.
:macro-def:`ANNEX_DEFAULT_SFR_LEASE_FUNCTION_ARN[ANNEX]`
The Lambda function which implements the lease (duration) for Spot
instances. No default.
|
