File: rfc1564.txt

package info (click to toggle)
doc-rfc 20181229-2
  • links: PTS, VCS
  • area: non-free
  • in suites: buster
  • size: 570,944 kB
  • sloc: xml: 285,646; sh: 107; python: 90; perl: 42; makefile: 14
file content (1179 lines) | stat: -rw-r--r-- 46,205 bytes parent folder | download | duplicates (5)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179






Network Working Group                                          P. Barker
Request for Comments: 1564                     University College London
Category: Informational                                       R. Hedberg
                                              Technical University Delft
                                                            January 1994


                              DSA Metrics
                            (OSI-DS 34 (v3))

Status of this Memo

   This memo provides information for the Internet community.  This memo
   does not specify an Internet standard of any kind.  Distribution of
   this memo is unlimited.

Abstract

   This document defines a set of criteria by which a DSA implementation
   may be judged.  Particular issues covered include conformance to
   standards; performance; demonstrated interoperability.  The intention
   is that the replies to the questions posed provide a fairly full
   description of a DSA. Some of the questions will yield answers which
   are purely descriptive; others, however, are intended to elicit
   answers which give some measure of the utility of the DSA. The marks
   awarded for a DSA in each particular area should give a good
   indication of the DSA's capabilities, and its suitability for
   particular uses.

   Please send comments to the authors or to the discussion group
   <osi-ds@CS.UCL.AC.UK>.

Table of Contents

   1.   Overview                                                      2
   2.   General Information                                           3
   3.   Conformance to OSI Standards                                  4
        3.1    Directory protocols.............................       4
        3.2    Implementors' agreements and profiles  .........       6
        3.3    Protocol stacks.................................       6
        3.4    DIT structure  .................................       7
   4.   Other protocols                                               7
   5.   Extensions to the 1988 Standard                               7
        5.1    Schema .........................................       7
        5.2    Support for replication.........................       8
        5.3    Support for access control .....................       8
        5.4    Miscellaneous  .................................       9
   6.   Miscellaneous characteristics                                10



Barker & Hedberg                                                [Page 1]

RFC 1564                      DSA Metrics                   January 1994


   7.   Management tools                                             11
        7.1    Dynamic system management  .....................      11
        7.2    Static system management  ......................      12
        7.3    Data management.................................      12
   8.   Operational Use                                              12
   9.   Interoperability                                             12
   10.  Performance                                                  13
        10.1   Speed for various operations  ..................      14
            10.1.1   Bind .....................................      14
            10.1.2   List .....................................      15
            10.1.3   Search  ..................................      15
            10.1.4   Read .....................................      16
            10.1.5   Add entry.................................      16
            10.1.6   Modify entry .............................      16
            10.1.7   Modify RDN  ..............................      16
            10.1.8   Query rate  ..............................      17
        10.2   The results.....................................      17
        10.3   Environment used for benchmarking  .............      17
   11. Security Considerations                                       21
   12. Authors' Addresses                                            21

1.  Overview

   The purpose of this document is to define some metrics by which DSA
   products can be measured.  Such metrics are valuable as whilst an
   X.500 DSA must conform to the specification in the standard - this is
   a sine qua non - protocol conformance is not in itself the hallmark
   of a usable implementation.  A DSA must perform operations within a
   reasonable time; a DSA must offer good throughput of queries; a DSA
   must be able to handle a reasonable volume of data; if modification
   operations are provided, some sort of access control must be
   provided; a DSA and its data must be manageable.

   In many respects, it is almost impossible to say that one DSA is
   better than other from looking at the responses to questions in this
   document.  For some, the cost or level of support will be the key
   criterion.  For another user, the flexibility of the schema
   management facilities, or the feasibility of running the DSA over an
   existing relational database, will be of prime importance.  In many
   respects DSAs will just be different, rather than better or worse.
   However, all other things being equal, the look-up speed of a DSA is
   very obviously measurable, and there is a substantial number of
   questions on the speed of the various X.500 operations, and in
   particular on the look-up operations.

   Throughout this document, some of the questions posed are annotated
   with a square-bracketed points score and an explanation as to how the
   points should be allocated.  For example, a question might be



Barker & Hedberg                                                [Page 2]

RFC 1564                      DSA Metrics                   January 1994


   appended with "[2 if yes]", indicating score 2 points for an
   affirmative answer to that question.  These points scores should be
   collated in Table 1 at the end of the document.  The questions on DSA
   performance are judged to be important enough to have a separate
   table for those results:  they appear in Table 2 (and optionally
   Table 3).  Together, these tables constitute a measure of the DSA.

   The metrics are on a section by section basis, which should help the
   reader who is seeking, for example, a DSA with fast look-up
   capabilities and extensive access control facilities, to focus on the
   critical aspects of a DSA for their particular requirement.  No
   conclusions should be inferred from adding the scores together into
   one overall grand total and comparing such totals for different DSAs,
   as no attempt is made to assign weights to the different
   characteristics.

   Whilst much of this document should usually be completed by the
   developers or suppliers of an implementation, the section on
   performance could be completed by anyone running the implementation.
   Indeed, it will be beneficial if several sets of performance figures
   can be gathered for each implementation, for a variety of hardware
   platforms.

2.  General Information

   This section contains general information about the implementation
   under discussion.

   1.  Name of the information provider ................................
    ....................................................................

   2.  Name of the implementation ......................................

   3.  Version number of the DSA described in this document ............

   4.  Are there plans to implement the additional features describe in
       the 1992/3 standard?  [6 for full implementation, 4 if both
       access control and replication to be implemented, 2 for some
       1992 features] ..................................................

   5.  Name and address of supplier or person to contact ...............
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................




Barker & Hedberg                                                [Page 3]

RFC 1564                      DSA Metrics                   January 1994


   6.  Describe the hardware and software platforms supported by the DSA
       [up to 4 points may be awarded for this question]

      (a)  Hardware (If appropriate, can summarise as, for example
           "generic UNIX platform") ..................................

      (b)  O/S (state version if critical)

           i.  UNIX) (be sure to indicate which flavour - e.g.,
               SYSV [1], BSD [1], SUNOS, etc) ..........................

          ii.  VMS) [1] ................................................

         iii.  MS-DOS [1] ..............................................

          iv.  Macintosh [1] ...........................................

           v.  Other) [1] ..............................................

   7.  Name any other software required to run the system which is not
       supplied with the operating system or with the DSA software
       itself.  Examples might include a database package, or
       communications software .........................................
    ....................................................................

   8.  Is this DSA an integrated part of a software package, and in such
       case which ?  ...................................................
    ....................................................................

   9.  Is the software free?  If the DSA needs other packages, are these
       also freely available?  [3 if completely free, 1 if requires
       commercial software package] ....................................
    ....................................................................

   10. Is commercial support available for this implementation?  [3] ...

   11. Is free, best effort support available from the developers?  [2].

   12. Is free support available via user groups or email lists?  [2] ..

3.  Conformance to OSI Standards

3.1  Directory protocols

   13. Does the DSA implement DAP?

      (a)  Read ASE? [2] ...............................................




Barker & Hedberg                                                [Page 4]

RFC 1564                      DSA Metrics                   January 1994


      (b)  Search ASE? [2] .............................................

      (c)  Modify ASE? [2] .............................................

   14. Does the DSA implement DSP?

      (a)  Chained read ASE? [2] .......................................

      (b)  Chained search ASE? [2] .....................................

      (c)  Chained modify ASE? [2] .....................................

   15. Statement requirements according to section 9.2.1 in X.519.

      (a)  Supported application-contexts?  ............................

      (b)  Capable of acting as first-level DSA? [1] ...................

      (c)  Chained mode supported?  [1] ................................

      (d)  Security-level(s) supported?  [1 for strong + 1 for protected
           simple + 1 for simple authentication] .......................

      (e)  All attribute types according to X.520?  [1] ................

      (f)  All object classes according to X.521?  [1] .................

   16. Does the implementation meet the conformance clauses in section
       9.2.2 and 9.2.3 of X.519?
       Static requirements [2 if yes on all]

      (a)  Abstract syntaxes of application contexts ...................

      (b)  Abstract syntaxes of information framework ..................

      (c)  Minimal knowledge ...........................................

      (d)  Support of root context .....................................

      (e)  Abstract syntax - attribute types ...........................

      (f)  Abstract syntax - object classes ............................

       Dynamic requirements [2 if yes on all]

      (a)  Mapping onto underlying services ............................

      (b)  Distributed operations - referrals ..........................



Barker & Hedberg                                                [Page 5]

RFC 1564                      DSA Metrics                   January 1994


      (c)  DirectoryAccessAC - referrals ...............................

      (d)  DirectorySystemAC - referrals ...............................

      (e)  Chained mode ................................................

   17. Please list all conformance testing work applied to the
       implementation (specify conformance test version number).  [2 if
       any testing]
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................

3.2  Implementors' agreements and profiles

   Does the DSA conform to the following implementors' agreements?  If
   so, state parts and version numbers.

   18. EWOS? [1] .......................................................
    ....................................................................
    ....................................................................

   19. OIW? [1] ........................................................
    ....................................................................
    ....................................................................

   Does the DSA conform to the following profiles?  If so, state which
   version numbers.

   20. UK GOSIP? [1] ...................................................

   21. US GOSIP? [1] ...................................................


   State any other GOSIP profiles to which the DSA conforms ............

3.3  Protocol stacks

   22. Which of the following transport and network layer protocols does
       the DSA support:

      (a)  TP.x over CONS (state transport class)?  [2] ................

      (b)  TP.4 over CLNS? [2] .........................................

      (c)  TP.x over X.25(1980) (state transport class)?  [2] ..........




Barker & Hedberg                                                [Page 6]

RFC 1564                      DSA Metrics                   January 1994


3.4  DIT structure

   23. A suggested DIT structure, detailing an object class hierarchy, is
       presented in X.521.  Does the DSA:

      (a)  Enforce this hierarchy?  ....................................

      (b)  Allow the enforcement of this hierarchy?  ...................

   24. Are structure rules optional or mandatory?  .....................

4.  Other protocols

   25. Not everybody uses OSI protocols at the network layer.  Does the
       DSA support other "network" layer protocols?

      (a)  TP.0 over RFC1006 over TCP/IP [3] ...........................

      (b)  State any other options supported.  .........................
        ................................................................

   26. Does the DSA also run over any lightweight stack?  If so,
       describe it with reference to the OSI seven layer model [1] .....

   27. Can local DUAs access the DSA directly by some method of
       inter-process communications?  [1] ..............................
    ....................................................................

5.  Extensions to the 1988 Standard

5.1  Schema

   28. Does the DSA fully support RFC1274, "The COSINE and Internet
       X.500 Schema"?  [2] ............................................
       If not, please supply a list of all those object classes,
       attribute types and attribute syntaxes in RFC1274 which are
       supported on a separate sheet.  This might be summarised by
       saying, for example, "all those with standard attribute
       syntaxes", or "all except fooBar".

   29. Does the DSA implement the schema management defined in the 1992
       standard?  [2] ..................................................

   30. If not, is the schema stored in the Directory?  In a distributed
       manner[2] or centralised[1] ?  ..................................

   31. Can a DSA manager extend the schema and add new




Barker & Hedberg                                                [Page 7]

RFC 1564                      DSA Metrics                   January 1994


      (a)  Attribute types with existing syntaxes?  With compilation
           [1], or without compilation [2] .............................

      (b)  Attribute syntaxes?  With compilation [1], or without
           compilation [2] .............................................

      (c)  Attribute sets?  With compilation [1], or without compilation
           [2] .........................................................
        ................................................................

      (d)  Object classes?  With compilation [1], or without compilation
           [2] .........................................................
        ................................................................

   32. Is it possible to add in or modify DIT structure rules, with
       compilation [1], without compilation [2] ........................

5.2  Support for replication

   33. Does the DSA support the replication mechanisms as described in
       the 1992 standard [2]?
    ....................................................................

   34. Does the DSA support any other replication mechanisms?  .........

      (a)  Replication part of RFC1276 [2] .............................

      (b)  Other (please give a reference to any description of the
           mechanisms, and indicate whether these mechanisms are used by
           any other implementations) [1 for any mechanism] ............
        ................................................................
        ................................................................
        ................................................................

   35. If the DSA supports replication, does it support:

      (a)  Replication of a single entry?  [2] .........................

      (b)  Replication of a set of sibling entries?  [2] ...............

      (c)  Replication of a subtree?  [2] ..............................

5.3  Support for access control

   36. Does the DSA support access control as described in the 1992
       standard [3]?  ..................................................

   37. If not, does the DSA have any access control mechanisms at all?



Barker & Hedberg                                                [Page 8]

RFC 1564                      DSA Metrics                   January 1994


       [2] .............................................................

   38. If yes, does the access control scheme support the following:

      (a)  Allow a user to maintain their own entry?  [1] ..............

      (b)  Allow a user to maintain some attributes in their own entry,
           but not all attributes?  [1] ................................

      (c)  Give management rights to a DSA manager in a fashion analogous
           to the privileges given to a UNIX super-user?  [1] ..........

      (d)  Give management rights to a data manager on a per subtree
           basis?  [1] .................................................

      (e)  Give management rights (to an entry, group of entries,
           subtree, etc) to a group of users?  [1] .....................

      (f)  Give access rights to users on the basis of the leading
           portion of their Distinguished Name?  [1] ...................

      (g)  Is it possible to define a protection mechanism for each
           individual attribute type in one entry?  [1] ................

      (h)  Maximum number of Distinguished Names that can be defined for
           one access right to one attribute in one entry? If unlimited,
           state the constraints.  [1 if more than 6 DNs are feasible] :

      (i)  Does the DSA support the extended access control techniques
           described in "An Access Control approach for Searching and
           Listing" by Hardcastle-Kille and Howes, in the Internet
           Draft, OSI-DS 21?  [2]
        ................................................................

      (j)  If there are features of the access control mechanisms which
           are not brought out by the above questions, please describe
           these additional features [up to 2 for wonderful additional
           features!]  .................................................
        ................................................................
        ................................................................
        ................................................................

5.4  Miscellaneous

   39. Does the DSA fully support RFC1276, "Replication and Distributed
       Operations extensions to provide an Internet Directory using
       X.500"?  [2] .... If not, please give a list of features that are
       supported.



Barker & Hedberg                                                [Page 9]

RFC 1564                      DSA Metrics                   January 1994


    ....................................................................
    ....................................................................

   40. If the DSA uses RFC1006 and/or X.25(1980) at the network layer,
       does the DSA conform to RFC1277, "Encoding Network Addresses to
       support operation over non-OSI lower layers" [3] ...............

6.  Miscellaneous characteristics

   41. Does the DSA use its own database, or can it be used in
       conjunction with a general-purpose database package such as
       Oracle?  [1 for own, 1 for ability to map onto general purpose
       databases, 1 if any such mappings have been made] ...............
    ....................................................................

   42. If the DSA runs as a static server, state the start-up time for a
       DSA with a database of 20000 entries.  If this varies widely
       according to configuration options, give figures for the various
       options.  .......................................................
    ....................................................................

   43. What is the maximum number of simultaneous associations that the
       DSA may have open?  [1 if more than 15 associations] ............

   44. Maximum database size, in entries, megabytes, or as appropriate.
       If none, state what the constraints are.  [1 if a database of
       more than 100,000 entries is feasible] ..........................

   45. What is the run-time size of an entry as specified in section 10
       (on performance)?  This should be the marginal size of an entry
       and thus should include the overhead of default indexes, etc.  ..

   46. What is the on-disk database size of an entry as specified in
       section 10 on performance?  .....................................

   47. Does the DSA make of indexing?  [2 if yes] ......................

       If so:

      (a)  Can the database be fully inverted?  [1] ....................
           If not, state for which:

           i.  attributes indexes are automatically built ..............
            ............................................................
            ............................................................

          ii.  attributes/attribute syntaxes indexes may be built ......
            ............................................................



Barker & Hedberg                                               [Page 10]

RFC 1564                      DSA Metrics                   January 1994


            ............................................................

      (b)  Does the index improve performance on:

           i.  Exact match [1] .........................................

          ii.  Leading substring match [1] .............................

         iii.  Approximate match [1] ...................................

          iv.  Any substring match [1] .................................

           v.  Trailing substring match [1] ............................

      (c)  What is the increase in run-time size of an entry when adding
           an index?
        ................................................................

      (d)  What is the increase in on-disk database size of adding
           another index?
        ................................................................

   48. What sort of approximate match algorithm does the DSA use?
       Describe it briefly .............................................
    ....................................................................
    ....................................................................
    ....................................................................

   49. Does the DSA attempt to use relay DSAs (which have access to more
       than one network) in order to achieve connectivity with DSAs
       which are not on the same network?  [2] .........................

7.  Management tools

7.1  Dynamic system management

   50. Are there tools for monitoring DSA activity, using:

      (a)  DAP? [1] ....................................................

      (b)  CMIP? [1] ...................................................

      (c)  SNMP? [1] ...................................................

   51. Are there tools for controlling a run-time DSA? [2] .............






Barker & Hedberg                                               [Page 11]

RFC 1564                      DSA Metrics                   January 1994


7.2  Static system management

   52. If knowledge information is stored within the DIT, are there
       tools for knowledge management?  [2] ............................

   53. Are there tools for checking that attributes with Distinguished
       Name syntax contain values of entries in the DIT (i.e., they do
       not contain "dangling pointers")?  [1] ........................

7.3  Data management

   54. If the DSA doesn't use a general-purpose database package, what
       data management tools are available?  ...........................
    ....................................................................

   55. Are there any tools for arboriculture - the moving, copying or
       deleting of DIT subtrees?  [2] ..................................

8.  Operational Use

   The DSA may have lots of wonderful features -- on paper!  But has the
   DSA been shown to work in practice?  The following measures are
   intended to give some measure of confidence that the DSA's viability
   has been demonstrated.

   56. How many entries in the largest DSA in use in operational use?  :

   57. What is the largest set of DSAs supporting an organisation?  ....

   58. What is the estimated number of organisations using this
       implementation for service use?  [8 if more than 100
       organisations, 5 if more than 50 organisations, 3 if more than 20
       organisations, 2 if more than 5 organisations, 1 if more than 1
       organisation] ...................................................

   59. Is this DSA used commercially with an installed base of more than
       10 customers?  [2] ..............................................

9.  Interoperability

   The X.500 Directory is the OSI Directory.  OSI stands for Open
   Systems Interconnection -- DSAs have to be able to inter-operate.
   They also have to be seen to interoperate.

   60. Is this DSA in use in X.500 pilots?  ............................

      (a)  Is this DSA in use anywhere in the COSINE/Internet Pilot? [3]




Barker & Hedberg                                               [Page 12]

RFC 1564                      DSA Metrics                   January 1994


        ................................................................

      (b)  Is this DSA in use in any other major pilot?  [2] ...........

   61. Name any other systems which you believe the system to
       interoperate with.  (It is not sufficient to say "any system
       which supports the conformance clauses ...")  ..................
    ....................................................................
    ....................................................................
    ....................................................................

   62. Please name all interoperability testing applied to the
       implementation, specify test suite and what other implementation
       that was used [1 per implementation, up to maximum of 5] ........
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................
    ....................................................................

10.  Performance

   This section should give an outline to the expected performance of
   the DSA. A number of operations are timed in order to give a feel for
   the DSA's speed and throughput.  Note that all operations should be
   resolvable within a single DSA. Chaining and referral are not
   assessed, although it should be possible to infer, albeit
   approximately, the speed of distributed operations.

   i.  The tests should be made against an organisational database of
       20000 entries.  Some tests are against subsets of this data, and
       so the database should be set up according to the following
       instructions.

       Create an organisational DSA with 20000 entries below the
       organisation node.  Sub-divide this data into a number of
       organisational units, one of which should contain 1000 entries,
       another of which should contain 100 entries, and a third which
       should contain just 10 entries.  The entries, which should
       differ, should be created with the following attributes:

       (a)  Common Name

       (b)  Surname

       (c)  Telephone number

       (d)  Postal Address (of 100 characters)



Barker & Hedberg                                               [Page 13]

RFC 1564                      DSA Metrics                   January 1994


       (e)  Object class

    ii. In all the tests, two timings should be taken.  In order to
        normalise the test results as much as possible, it is suggested
        that these tests be undertaken on an otherwise lightly loaded
        machine.

       (a)  A typical "cold start" reading should be given.  In this
            case the system will not have the advantage of any benefits
            that derive from operating system paging, or caching.

       (b)  A best possible figure should be given, which indicates the
            upper limit of DSA performance.

   iii. The timings should relate to the default set-up, and should be
        entered in Table 2.  If significant performance gains can be made
        by use of configuration options, such as building extra indexes
        to support searches, measures of the improved performance may
        also be given, and should be entered in Table 3.
        Attention should be also drawn to any optimisations, heuristic or
        otherwise, which are not evidenced in the following tests.

    iv. Please note that the tests should be made using a DUA and DSA
        with full 7-layer stacks, rather than some lightweight protocol.

10.1  Speed for various operations

   The tests are described, one subsection per operation.  The results
   should be entered in Table 2 (and Table 3 if a non-default set-up is
   also measured).

10.1.1  Bind

   The time it takes for a DUA to bind to the Directory.  This time
   should include all the initialisation time a DUA process needs before
   it can query the Directory: e.g., reading of tailor files, schema
   information, etc.  Give the bind time for each of the following
   levels of authentication.  State "n/a" if the implementation does not
   support a particular level of authentication.

   63. Anonymous

   64. Simple

   65. Simple protected

   66. Strong




Barker & Hedberg                                               [Page 14]

RFC 1564                      DSA Metrics                   January 1994


10.1.2  List

   Give the time for listing a set of organisational unit sibling
   entries.

   67. 10 entries

   68. 1000 entries

10.1.3  Search

   In this section, two sets of search operations should be performed on
   the DSA.

   i.  A single level search of 100 entries within an organisational
       unit.

   ii. An organisation subtree search, on the subtree of 20000 entries.

   The following searches should be tried.  Unless otherwise stated, the
   "XXX" or "YYY" part of the search filter should be chosen in such a
   way as to return a single result.  Unless stated otherwise the
   results should return all attributes for the entry.

   69. Exact match for a surname:

           surname=XXX

   70. Leading substring match for a common name:

           commonName=XXX*

   71. Any substring match for a common name:

           commonName=*XXX*

   72. Trailing substring match for a common name:

           commonName=*XXX

   73. Approximate match for a common name:

           commonName"=XXX

   74. More complex filter, searching by object class and two other
       attribute types:





Barker & Hedberg                                               [Page 15]

RFC 1564                      DSA Metrics                   January 1994


           objectClass=person AND
           (commonName=XXX* OR telephoneNumber=*YYY)

   75. Search returning all entries (i.e., 100 entries in the single
       level search, and all 20000 entries in the subtree search:

           objectClass=*

       In this case, no attribute values should be returned in the
       result set.

10.1.4  Read

   76. A single read operation, returning all attributes.

10.1.5  Add entry

   77. Add an entry beneath an entry which has:

      (a)  0 children

      (b)  10 children

      (c)  1000 children

10.1.6  Modify entry

   Modify an attribute value, other than an RDN value, for an entry
   which has

   1.  10 siblings

   2.  1000 siblings

   78. Modify an entry

      (a)  Add description attribute

      (b)  Remove description attribute

10.1.7  Modify RDN

   Modify an RDN value for an entry with the following number of
   siblings.







Barker & Hedberg                                               [Page 16]

RFC 1564                      DSA Metrics                   January 1994


   79. Modify RDN

      (a)  10 siblings

      (b)  1000 siblings

10.1.8  Query rate

   As the time taken for a single read will usually be negligible, the
   following list and set of reads should give a clearer indication of
   the query rate.

   80. A list to return 100 entries for persons, and then a read of each
       entry returning all attribute values.

10.2  The results

   The results of the tests just described should be entered in Table 2
   (and optionally Table 3), at the end of the document.

10.3  Environment used for benchmarking

   Date of test.........................................................
   Name of tester ......................................................
   The results will be directly correlated to the test set-up used, and
   in particular, the hardware.  Please answer the following questions
   to describe the test environment:

      (a)  Processor (make and model) ..................................

      (b)  Processor speed (MIPS) ......................................

      (c)  Primary memory available ....................................

      (d)  If disk-based DSA, disk I/O interface and disk speed ........

      (e)  O/S version .................................................

      (f)  Network type and bandwidth (e.g., 10 Mbit Ethernet) .........

      (g)  Protocols in transport layer and below (e.g., TP 0, RFC1006,
           TCP/IP) .....................................................

      (h)  How/where timings obtained?

            o  C procedural interface ..................................

            o  DUA shell (e.g., Quipu's DISH) ..........................



Barker & Hedberg                                               [Page 17]

RFC 1564                      DSA Metrics                   January 1994


          +-------------------------------------------------+
          |             Section            ||    Points     |
          +--------------------------------||---------------+
          | No.||Description               |Maximum|Scored  |
          +----||--------------------------|-------|--------+
          |    ||                          |       |        |
          |   2||General Information       |  20   |        |
          +----||--------------------------|-------|--------+
          |    ||                          |       |        |
          |   3||Conformance to OSI        |  35   |        |
          +----||--------------------------|-------|--------+
          |    ||          |               |       |        |
          |   4||Other protocols           |   5   |        |
          +----||--------------------------|-------|--------+
          |    ||          |               |       |        |
          |   5||Extensions| Schema        |  16   |        |
          +----||          |---------------|-------|--------+
          |    ||          |               |       |        |
          |    ||to the    |Replication    |  10   |        |
          +----||          |---------------|-------|--------+
          |    ||          |               |       |        |
          |    ||1988      |Access Control |  15   |        |
          +----||          |---------------|-------|--------+
          |    ||          |               |       |        |
          |    ||standard  |Miscellaneous  |   5   |        |
          +----||--------------------------|-------|--------+
          |    ||Miscellaneous             |       |        |
          |   6||characteristics           |  15   |        |
          +----||--------------------------|-------|--------+
          |    ||                          |       |        |
          |   7||Management tools          |  10   |        |
          +----||--------------------------|-------|--------+
          |    ||                          |       |        |
          |   8||Operational use           |  10   |        |
          +----||--------------------------|-------|--------+
          |    ||                          |       |        |
          |   9||Interoperability          |  10   |        |
          +----||--------------------------|-------|--------+
          |    ||                          |  see  |        |
          |  10||Performance               |table 2|        |
          +-------------------------------------------------+

                          Table 1:  DSA Metrics








Barker & Hedberg                                               [Page 18]

RFC 1564                      DSA Metrics                   January 1994


        +------------------------------------------------------+
        | Operation         ||   Cold DSA    ||     Optimum    |
        |                   ||               ||   Performance  |
        +-------------------||---------------||----------------+
        | Bind              ||               ||                |
        |    --Anonymous    ||.............. || .............. |
        |    --Simple       ||.............. || .............. |
        |    --Simple Prot  ||.............. || .............. |
        |    --Strong       ||.............. || .............. |
        +-------------------||---------------||----------------+
        | List              ||               ||                |
        |    -- 10 entries  ||.............. || .............. |
        |    -- 1000 entries||.............. || .............. |
        +-------------------||---------------||----------------+
        | Search             |single|subtree |single|subtree   |
        |                    |level |        |level |          |
        |                    |------|--------|------|----------|
        |    -- exact        |....  |......  |..... | ......   |
        |    -- leading sub  |....  |......  |..... | ......   |
        |    -- any sub      |....  |......  |..... | ......   |
        |    -- trailing sub |....  |......  |..... | ......   |
        |    -- approx       |....  |......  |..... | ......   |
        |    -- complex      |....  |......  |..... | ......   |
        |    -- return all   |....  |......  |..... | ......   |
        +--------------------|------|--------|------|----------|
        | Read              ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Add               ||               ||                |
        |     0 siblings    ||.............. || .............. |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Modify            ||               ||                |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Modify RDN        ||               ||                |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Query rate        ||.............. || .............. |
        +-------------------||---------------||----------------+

            Table 2:  Speed of operations - default set-up







Barker & Hedberg                                               [Page 19]

RFC 1564                      DSA Metrics                   January 1994


        +------------------------------------------------------+
        | Operation         ||   Cold DSA    ||     Optimum    |
        |                   ||               ||   Performance  |
        +-------------------||---------------||----------------+
        | Bind              ||               ||                |
        |    --Anonymous    ||.............. || .............. |
        |    --Simple       ||.............. || .............. |
        |    --Simple Prot  ||.............. || .............. |
        |    --Strong       ||.............. || .............. |
        +-------------------||---------------||----------------+
        | List              ||               ||                |
        |    -- 10 entries  ||.............. || .............. |
        |    -- 1000 entries||.............. || .............. |
        +-------------------||---------------||----------------+
        | Search             |single|subtree |single|subtree   |
        |                    |level |        |level |          |
        |                    |------|--------|------|----------|
        |    -- exact        |....  |......  |..... | ......   |
        |    -- leading sub  |....  |......  |..... | ......   |
        |    -- any sub      |....  |......  |..... | ......   |
        |    -- trailing sub |....  |......  |..... | ......   |
        |    -- approx       |....  |......  |..... | ......   |
        |    -- complex      |....  |......  |..... | ......   |
        |    -- return all   |....  |......  |..... | ......   |
        +--------------------|------|--------|------|----------|
        | Read              ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Add               ||               ||                |
        |     0 siblings    ||.............. || .............. |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Modify            ||               ||                |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Modify RDN        ||               ||                |
        |     10 siblings   ||.............. || .............. |
        |     1000 siblings ||.............. || .............. |
        +-------------------||---------------||----------------+
        | Query rate        ||.............. || .............. |
        +-------------------||---------------||----------------+

          Table 3:  Speed of operations - non-default set-up







Barker & Hedberg                                               [Page 20]

RFC 1564                      DSA Metrics                   January 1994


Security Considerations

   Security issues are not discussed in this memo.

Authors' Addresses

   Paul Barker
   Department of Computer Science
   University College London
   Gower Street
   London
   WC1E 6BT
   United Kingdom

   Phone: +44 71 380 7366
   Fax:   +44 71 387 1397
   EMail: P.Barker@cs.ucl.ac.uk


   Roland Hedberg
   Rekencentrum
   Delft Technical University
   Michiel de Ruyterweg 10-12
   Postbus 354, 2600 AJ Delft
   The Netherlands

   Phone: +31 15 785210
   EMail: Roland.Hedberg@rc.tudelft.nl

   OR

   Roland Hedberg
   Umdac
   University of Umea
   s-901 87 Umea
   Sweden

   Phone: +46 90 165204
   EMail: Roland.Hedberg@umdac.umu.se












Barker & Hedberg                                               [Page 21]