File: dccproc.0

package info (click to toggle)
dcc 1.2.74-2
  • links: PTS
  • area: main
  • in suites: sarge
  • size: 3,552 kB
  • ctags: 4,041
  • sloc: ansic: 41,034; perl: 2,310; sh: 2,186; makefile: 224
file content (345 lines) | stat: -rw-r--r-- 20,953 bytes parent folder | download | duplicates (2)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
dccproc(8)            Distributed Checksum Clearinghouse            dccproc(8)

NNAAMMEE
     ddccccpprroocc -- Distributed Checksum Clearinghouse Procmail Interface

SSYYNNOOPPSSIISS
     ddccccpprroocc [--VVddAAQQCCHHEERR] [--hh _h_o_m_e_d_i_r] [--mm _m_a_p] [--ww _w_h_i_t_e_c_l_n_t] [--TT _t_m_p_d_i_r]
             [--aa _I_P_-_a_d_d_r_e_s_s] [--ff _e_n_v___f_r_o_m] [--tt _t_a_r_g_e_t_s]
             [--xx _e_x_i_t_c_o_d_e] [--cc _t_y_p_e_,[_l_o_g_-_t_h_o_l_d_,]_r_e_j_-_t_h_o_l_d] [--gg [_n_o_t_-]_t_y_p_e]
             [--SS _h_e_a_d_e_r] [--ii _i_n_f_i_l_e] [--oo _o_u_t_f_i_l_e] [--ll _l_o_g_d_i_r]
             [--BB _d_n_s_b_l_-_o_p_t_i_o_n] [--LL _l_t_y_p_e_,_f_a_c_i_l_i_t_y_._l_e_v_e_l]

DDEESSCCRRIIPPTTIIOONN
     DDccccpprroocc copies a complete SMTP message from standard input or a file to
     standard output or another file.  As it copies the message, it computes
     the DCC checksums for the message, reports them to a DCC server, and adds
     a header line to the message.  Another program such as procmail(1) can
     use the added header line to filter mail.  Dccproc does not support any
     thresholds of its own, because equivalent effects can be achieved with
     regular expressions and you can apply dccproc several times using differ-
     ent DCC servers and then score mail based what all of the DCC servers
     say.

     Error messages are sent to stderr as well as the system log.  Connect
     stderr and stdout to the same file to see errors in context, but direct
     stderr to /dev/null to keep DCC error messages out of the mail.  The --ii
     option can also be used to separate the error messages.

     DDccccpprroocc sends reports of checksums related to mail received by DCC
     clients and queries about the total number of reports of particular
     checksums.  A DCC server receives no mail, address, headers, or other
     information, but only cryptographically secure checksums of such informa-
     tion.  A DCC server cannot determine the text or other information that
     corresponds to the checksums it receives.  It only acts as a clearing-
     house of counts of checksums computed by clients.

     For the sake of privacy for even the checksums of private mail, the
     checksums of senders of purely internal mail or other mail that is known
     to not be unsolicited bulk can be listed in a whitelist to not be
     reported to the DCC server.

     When sendmail(8) is used, dccm(8) is a better DCC interface.  Dccifd(8)
     is more efficient than ddccccpprroocc because it is a daemon, but that has costs
     in complexity.  See dccsight(8) for a way to use previously computed
     checksums.

   OOPPTTIIOONNSS
     The following options are available:

     --VV   displays the version of the DCC procmail(1) interface.

     --dd   enables debugging output from the DCC client library.  Additional --dd
          options increase the number of messages.  One causes error messages
          to be sent to STDERR as well as the system log.

     --AA   adds to existing X-DCC headers (if any) of the brand of the current
          server instead of replacing existing headers.

     --QQ   only queries the DCC server about the checksums of messages instead
          of reporting and then querying.  This is useful when ddccccpprroocc is used
          to filter mail that has already been reported to a DCC server by
          another DCC client such as dccm(8).  This can also be useful when
          applying a private white or black list to mail that has already been
          reported to a DCC server.  No single mail message should be reported
          to a DCC server more than once per recipient, such as would happen
          if ddccccpprroocc is not given --QQ when processing a stream of mail that has
          already been seen by a DCC client.  Additional reports of a message
          increase its apparent "bulkness."

     --CC   outputs only the X-DCC header and the checksums for the message.

     --HH   outputs only the X-DCC header.

     --EE   adds lines to the start of the log file turned on with --ll and --cc
          describing what might have been the envelope of the message.  All of
          the information for the envelope lines comes from arguments to
          ddccccpprroocc including --aa and --RR.  No lines are generated for which no
          information is available, such as the envelope recipient.

     --RR   says the first Received line has a standard "name (name [IP
          address])..."  format and that the address is the IP address of the
          SMTP client that would otherwise be provided with --aa.  If the local
          SMTP server adds a Received line with some other format or does not
          add a Received line, the --aa option should be used.

     --hh _h_o_m_e_d_i_r
          overrides the default DCC home directory, which is often /var/dcc.

     --mm _m_a_p
          specifies a name or path of the memory mapped parameter file instead
          of the default _m_a_p in the DCC home directory.  It should be created
          with the nneeww mmaapp operation of the cdcc(8) command.

     --ww _w_h_i_t_e_c_l_n_t
          specifies an optional file containing SMTP client IP addresses and
          SMTP headers of mail that do not need X-DCC headers and whose check-
          sums should not be reported to the DCC server.  It can also contain
          checksums of spam.  If the pathname is not absolute, it is relative
          to the DCC home directory.  Thus, individual users with private
          whitelists usually specify them with absolute paths.  Common
          whitelists shared by users must be in the DCC home directory or one
          of its subdirectories and owned by the set-UID user of ddccccpprroocc.  It
          is useful to _i_n_c_l_u_d_e a common or system-wide whitelist in private
          lists.

          The format of the ddccccpprroocc whiteclnt file is the same as the
          _w_h_i_t_e_l_i_s_t file required by dbclean(8) and dccm(8).  Unlike dccm, the
          ddccccpprroocc whitelist is optional.  Unless --ww is used, ddccccpprroocc uses only
          the whitelist in the DCC server, which is rarely sufficient.

          Because the contents of the _w_h_i_t_e_c_l_n_t file are used frequently, a
          companion file is automatically created and maintained.  It has the
          same pathname but with an added suffix of _._d_c_c_w.  It contains a mem-
          ory mapped hash table of the main file.

          A local whitelist entry ("OK) or two or more semi-whitelistings
          ("OK2") for one of the message's checksums prevents all of the mes-
          sage's checksums from being reported to the DCC server and the addi-
          tion of a _X_-_D_C_C header line by ddccccpprroocc.  Because it is run by or on
          behalf of a single user, ddccccpprroocc ignores _e_n_v___T_o entries in the
          _w_h_i_t_e_c_l_n_t file.  Users who don't want to use ddccccpprroocc shouldn't.

     --TT _t_m_p_d_i_r
          changes the default directory for temporary files from the default.
          The default is the directory specified with --ll or the system default
          if there --ll is not used.  The system default is often _/_t_m_p.

     --aa _I_P_-_a_d_d_r_e_s_s
          specifies the IP address (not the host name) of the immediately pre-
          vious SMTP client.  It is often not available.  See also --RR.

     --ff _e_n_v___f_r_o_m
          specifies the RFC 821 envelope "Mail From" value with which the mes-
          sage arrived.  It is often not available.  If --ff is not present, the
          contents of the first Return-Path: or UNIX style From_ header is
          used.  The _e_n_v___f_r_o_m string is often but need not be bracketed with
          "<>".

     --tt _t_a_r_g_e_t_s
          specifies the number of addressees of the message if other than 1.
          The string _m_a_n_y instead of a number asserts that there were too many
          addressees and that the message is unsolicited bulk email.

     --xx _e_x_i_t_c_o_d_e
          specifies the code or status with which ddccccpprroocc exits if the --cc
          thresholds are reached or the --ww _w_h_i_t_e_c_l_n_t file blacklists the mes-
          sage, unless the message is whitelisted.

          The default value is EX_NOUSER.  EX_NOUSER is 67 on many systems.
          Use 0 to always exit successfully.

     --cc _t_y_p_e_,[_l_o_g_-_t_h_o_l_d_,]_r_e_j_-_t_h_o_l_d
          sets logging and "spam" thresholds for checksum _t_y_p_e.  Each logged
          message placed in a separate file in the directory specified with
          --ll.  The checksum types are _I_P, _e_n_v___F_r_o_m, _F_r_o_m, _M_e_s_s_a_g_e_-_I_D,
          _R_e_c_e_i_v_e_d, _B_o_d_y, _F_u_z_1, and _F_u_z_2.  The string _A_L_L sets thresholds for
          all types, but is unlikely to be useful except for setting logging
          thresholds.  The string _C_M_N specifies the commonly used checksums
          _B_o_d_y, _F_u_z_1, and _F_u_z_2.  _R_e_j_-_t_h_o_l_d and _l_o_g_-_t_h_o_l_d must be numbers, the
          string _N_E_V_E_R, or the string _M_A_N_Y indicating millions of targets.
          Counts from the DCC server as large as the threshold for any single
          type are taken as sufficient evidence that the message should be
          logged or rejected.

          _L_o_g_-_t_h_o_l_d is the threshold at which messages are logged.  It can be
          handy to log messages at a lower threshold to find solicited bulk
          mail sources such as mailing lists.  Messages that reach at least
          one of their rejection thresholds or that have complicated combina-
          tions of white- and blacklisting are logged regardless of logging
          thresholds.

          _R_e_j_-_t_h_o_l_d is the threshold at which messages are considered "bulk,"
          and so should cause the X-DCC header line to contain the string
          "bulk" and ddccccpprroocc to exit with the value set by --xx.

          The checksums of locally white-listed messages are not checked with
          the DCC server and so only the number of targets of the current
          instance of a white-listed message are compared against the thresh-
          olds.

          The default is --cc _A_L_L_,_N_E_V_E_R, so that nothing is discarded or logged.
          A common choice is --cc _C_M_N_,_2_5_,_5_0 to reject or discard mail with com-
          mon bodies except as overridden by the whitelist of the DCC server
          and --gg and --ww.

     --gg [_n_o_t_-]_t_y_p_e
          indicates that white-listed, _O_K or _O_K_2, counts from the DCC server
          for a type of checksum are to be believed.  They should be ignored
          if prefixed with _n_o_t_-.  _T_y_p_e is one of the same set of strings as
          for --cc.  Only _I_P, _e_n_v___F_r_o_m, and _F_r_o_m are likely choices.  By default
          all three are honored, and hence the need for _n_o_t_-.

     --SS _h_d_r
          adds to the list of substitute or locally chosen headers that are
          checked with the --ww _w_h_i_t_e_c_l_n_t file and sent to the DCC server.  The
          checksum of the last header of type _h_d_r found in the message is
          checked.  As many as 6 different substitute headers can be speci-
          fied, but only the checksum of the first of the 6 will be sent to
          the DCC server.

     --ii _i_n_f_i_l_e
          specifies an input file for the entire message instead of standard
          input.  If not absolute, the pathname is interpreted relative to the
          directory in which ddccccpprroocc was started.

     --oo _o_u_t_f_i_l_e
          specifies an output file for the entire message including headers
          instead of standard output.  If not absolute, the pathname is inter-
          preted relative to the directory in which ddccccpprroocc was started.

     --ll _l_o_g_d_i_r
          specifies a directory for copies of messages whose checksum target
          counts exceed --cc thresholds.  The format of each file is affected by
          --EE.  If _l_o_g_d_i_r is not an absolute path, it is relative to the direc-
          tory in which ddccccpprroocc is started.  If _l_o_g_d_i_r starts with _D_?, log
          files are put into subdirectories of the form _l_o_g_d_i_r_/_J_J_J where _J_J_J
          is the current julian day.  _H_?_l_o_g_d_i_r puts logs files into subdirec-
          tories of the form _l_o_g_d_i_r_/_J_J_J_/_H_H where _H_H is the current hour.
          _M_?_l_o_g_d_i_r puts log files into subdirectories of the form
          _l_o_g_d_i_r_/_J_J_J_/_H_H_/_M_M where _M_M is the current minute.  See the FILES sec-
          tion below concerning the contents of the files.

          The directory is relative to the DCC home directory if it is not
          absolute

     --BB _d_n_s_b_l_-_o_p_t_i_o_n
          enables DNS blacklist checks of the SMTP client IP address, SMTP
          envelope Mail_From sender domain name, and of host names in URLs in
          the message body.  Body URL blacklisting has far too many false pos-
          itives to use on abuse mailboxes.  It is less effective than
          greylisting with dccm(8) or dccifd(8) but can be useful in situa-
          tions where greylisting cannot be used.

          _D_n_s_b_l_-_o_p_t_i_o_n is either of the form _s_e_t_:_o_p_t_i_o_n or of the form
          _d_o_m_a_i_n[_,_I_P_a_d_d_r[_,_b_l_t_y_p_e]].  _D_o_m_a_i_n is a DNS blacklist domain such as
          example.com that will be searched.  _I_P_a_d_d_r is the IP address in the
          DNS blacklist that indicates that the mail message is spam.
          127.0.0.1 is assumed if _I_P_a_d_d_r is absent.  IPv6 addresses can be
          specified with the usual colon (:) notation.  Names can be used
          instead of numeric addresses.  The type of DNS blacklist is speci-
          fied by _b_l_t_y_p_e as _n_a_m_e, _I_P_v_4, or _I_P_v_6.  Given an envelope sender
          domain name or a domain name in a URL of spam.domain.org and a
          blacklist of type _n_a_m_e, spam.domain.org.example.com will be tried.
          Blacklist types of _I_P_v_4 and _I_P_v_6 require that the domain name in a
          URL be resolved into an IPv4 or IPv6 address.  The address is then
          written as a reversed string of decimal octets to check the DNS
          blacklist, as in 2.0.0.127.example.com,

          More than one blacklist can be specified.  They are searched in
          order.  All searching is stopped at the first positive result.  Pos-
          itive results are ignored after being logged unless an _o_p_t_i_o_n
          _D_N_S_B_L_-_o_n line appears in the global or per-user _w_h_i_t_e_c_l_n_t file.

          --BB _s_e_t_:_d_e_b_u_g sends more messages about all DNS resolutions to the
          system log.

          --BB _s_e_t_:_m_s_g_-_s_e_c_s_=_S limits ddccccpprroocc to _S seconds total for checking all
          DNS blacklists.  The default is 20.

          --BB _s_e_t_:_U_R_L_-_s_e_c_s_=_S limits ddccccpprroocc to at most _S seconds resolving and
          checking any single URL.  The default is 5.  Some spam contains
          dozens of URLs and that some "spamvertised" URLs contain host names
          that need minutes to resolve.  Busy mail systems cannot afford to
          spend minutes checking each incoming mail message.  In order to use
          typical single-threaded DNS resolver libraries, dccm(8) and
          dccifd(8) use fleets of helper processes.

          --BB _s_e_t_:_n_o_-_e_n_v_e_l_o_p_e says that SMTP client IP addresses and sender
          Mail_From domain names should not be checked in the following black-
          lists.  --BB _s_e_t_:_e_n_v_e_l_o_p_e restores the default for subsequently named
          blacklists.

          --BB _s_e_t_:_n_o_-_b_o_d_y says that URLs in the message body should not be
          checked in the in the following blacklists.  --BB _s_e_t_:_b_o_d_y restores
          the default for later blacklists.

          --BB _s_e_t_:_n_o_-_M_X says MX servers of sender Mail_From domain names and
          host names in URLs should not be checked in the following black-
          lists.  --BB _s_e_t_:_M_X restores the default.

     --LL _l_t_y_p_e_,_f_a_c_i_l_i_t_y_._l_e_v_e_l
          specifies how messages should be logged.  _L_t_y_p_e must be _e_r_r_o_r or
          _i_n_f_o to indicate which of the two types of messages are being con-
          trolled.  _L_e_v_e_l must be a syslog(3) level among _E_M_E_R_G, _A_L_E_R_T, _C_R_I_T,
          _E_R_R, _W_A_R_N_I_N_G, _N_O_T_I_C_E, _I_N_F_O, and _D_E_B_U_G.  _F_a_c_i_l_i_t_y must be among _A_U_T_H,
          _A_U_T_H_P_R_I_V, _C_R_O_N, _D_A_E_M_O_N, _F_T_P, _K_E_R_N, _L_P_R, _M_A_I_L, _N_E_W_S, _U_S_E_R, _U_U_C_P, and
          _L_O_C_A_L_0 through _L_O_C_A_L_7.  The default is equivalent to
                --LL _i_n_f_o_,_M_A_I_L_._N_O_T_I_C_E --LL _e_r_r_o_r_,_M_A_I_L_._E_R_R
          Something like this turns off the log messages:
                --LL _n_o_t_i_c_e_,_M_A_I_L_._d_e_b_u_g --LL _e_r_r_o_r_,_M_A_I_L_._D_E_B_U_G

     ddccccpprroocc exits 0 on success and with the --xx value if the --cc thresholds are
     reached or the --ww _w_h_i_t_e_c_l_n_t file blacklists the message.  If at all pos-
     sible, the input mail message is output to standard output or the --oo
     _o_u_t_f_i_l_e despite errors.  If possible, error messages are put into the
     system log instead of being mixed with the output mail message.  The exit
     status is zero for errors so that the mail message will not be rejected.

FFIILLEESS
     /var/dcc   DCC home directory in which other files are found.
     map        memory mapped file in the DCC home directory of information
                concerning DCC servers.
     whiteclnt  contains the client whitelist in the format described in
                dcc(8).
     whiteclnt.dccw
                is a memory mapped hash table corresponding to the _w_h_i_t_e_c_l_n_t
                file.
     tmpdir     contains temporary files created and deleted as ddccccpprroocc pro-
                cesses the message.
     logdir     is an optional directory specified with --ll and containing
                marked mail.  Each file in the directory contains one message,
                at least one of whose checksums reached one of its --cc thresh-
                olds.  The entire body of the SMTP message including its
                header is followed by the checksums for the message.

EEXXAAMMPPLLEESS
     The following procmailrc(5) rule adds an X-DCC header to passing mail

         :0 f
         | /usr/local/bin/dccproc -ERw whiteclnt

     This procmailrc(5) recipe rejects mail with total counts of 10 or larger
     for the commonly used checksums:

         :0 fW
         | /usr/local/bin/dccproc -ERw whiteclnt -ccmn,10
         :0 e
         {
             EXITCODE=67
             :0
             /dev/null
         }

SSEEEE AALLSSOO
     cdcc(8), dcc(8), dbclean(8), dccd(8), dblist(8), dccifd(8), dccm(8),
     dccsight(8), mail(1), procmail(1).

HHIISSTTOORRYY
     Implementation of ddccccpprroocc was started at Rhyolite Software in 2000.  This
     describes version 1.2.74.

BBUUGGSS
     ddccccpprroocc uses --cc where dccm(8) uses --tt.

FreeBSD 4.9                     March 20, 2005                     FreeBSD 4.9