1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 1845 1846 1847 1848 1849 1850 1851 1852 1853 1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1878 1879 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2070 2071 2072 2073 2074 2075 2076 2077 2078 2079 2080 2081 2082 2083 2084 2085 2086 2087 2088 2089 2090 2091 2092 2093 2094 2095 2096 2097 2098 2099 2100 2101 2102 2103 2104 2105 2106 2107 2108 2109 2110 2111 2112 2113 2114 2115 2116 2117 2118 2119 2120 2121 2122 2123 2124 2125 2126 2127 2128 2129 2130 2131 2132 2133 2134 2135 2136 2137 2138 2139 2140 2141 2142 2143 2144 2145 2146 2147 2148 2149 2150 2151 2152 2153 2154 2155 2156 2157 2158 2159 2160 2161 2162 2163 2164 2165 2166 2167 2168 2169 2170 2171 2172 2173 2174 2175 2176 2177 2178 2179 2180 2181 2182 2183 2184 2185 2186 2187 2188 2189 2190 2191 2192 2193 2194 2195 2196 2197 2198 2199 2200 2201 2202 2203 2204 2205 2206 2207 2208 2209 2210 2211 2212 2213 2214 2215 2216 2217 2218 2219 2220 2221 2222 2223 2224 2225 2226 2227 2228 2229 2230 2231 2232 2233 2234 2235 2236 2237 2238 2239 2240 2241 2242 2243 2244 2245 2246 2247 2248 2249 2250 2251 2252 2253 2254 2255 2256 2257 2258 2259 2260 2261 2262 2263 2264 2265 2266 2267 2268 2269 2270 2271 2272 2273 2274 2275 2276 2277 2278 2279 2280 2281 2282 2283 2284 2285 2286 2287 2288 2289 2290 2291 2292 2293 2294 2295 2296 2297 2298 2299 2300 2301 2302 2303 2304 2305 2306 2307 2308 2309 2310 2311 2312 2313 2314 2315 2316 2317 2318 2319 2320 2321 2322 2323 2324 2325 2326 2327 2328 2329 2330 2331 2332 2333 2334 2335 2336 2337 2338 2339 2340 2341 2342 2343 2344 2345 2346 2347 2348 2349 2350 2351 2352 2353 2354 2355 2356 2357 2358 2359 2360 2361 2362 2363 2364 2365 2366 2367 2368 2369 2370 2371 2372 2373 2374 2375 2376 2377 2378 2379 2380 2381 2382 2383 2384 2385 2386 2387 2388 2389 2390 2391 2392 2393 2394 2395 2396 2397 2398 2399 2400 2401 2402 2403 2404 2405 2406 2407 2408 2409 2410 2411 2412 2413 2414 2415 2416 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 2465 2466 2467 2468 2469 2470 2471 2472 2473 2474 2475 2476 2477 2478 2479 2480 2481 2482 2483 2484 2485 2486 2487 2488 2489 2490 2491 2492 2493 2494 2495 2496 2497 2498 2499 2500 2501 2502 2503 2504 2505 2506 2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 2582 2583 2584 2585 2586 2587 2588 2589 2590 2591 2592 2593 2594 2595 2596 2597 2598 2599 2600 2601 2602 2603 2604 2605 2606 2607 2608 2609 2610 2611 2612 2613 2614 2615 2616 2617 2618 2619 2620 2621 2622 2623 2624 2625 2626 2627 2628 2629 2630 2631 2632 2633 2634 2635 2636 2637 2638 2639 2640 2641 2642 2643 2644 2645 2646 2647 2648 2649 2650 2651 2652 2653 2654 2655 2656 2657 2658 2659 2660 2661 2662 2663 2664 2665 2666 2667 2668 2669 2670 2671 2672 2673 2674 2675 2676 2677 2678 2679 2680 2681 2682 2683 2684 2685 2686 2687 2688 2689 2690 2691 2692 2693 2694 2695 2696 2697 2698 2699 2700 2701 2702 2703 2704 2705 2706 2707 2708 2709 2710 2711 2712 2713 2714 2715 2716 2717 2718 2719 2720 2721 2722 2723 2724 2725 2726 2727 2728 2729 2730 2731 2732 2733 2734 2735 2736 2737 2738 2739 2740 2741 2742 2743 2744 2745 2746 2747 2748 2749 2750 2751 2752 2753 2754 2755 2756 2757 2758 2759 2760 2761 2762 2763 2764 2765 2766 2767 2768 2769 2770 2771 2772 2773 2774 2775 2776 2777 2778 2779 2780 2781 2782 2783 2784 2785 2786 2787 2788 2789 2790 2791 2792 2793 2794 2795 2796 2797 2798 2799 2800 2801 2802 2803 2804 2805 2806 2807 2808 2809 2810 2811 2812 2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 2888 2889 2890 2891 2892 2893 2894 2895 2896 2897 2898 2899 2900 2901 2902 2903 2904 2905 2906 2907 2908 2909 2910 2911 2912 2913 2914 2915 2916 2917 2918 2919 2920 2921 2922 2923 2924 2925 2926 2927 2928 2929 2930 2931 2932 2933 2934 2935 2936 2937 2938 2939 2940 2941 2942 2943 2944 2945 2946 2947 2948 2949 2950 2951 2952 2953 2954 2955 2956 2957 2958 2959 2960 2961 2962 2963 2964 2965 2966 2967 2968 2969 2970 2971 2972 2973 2974 2975 2976 2977 2978 2979 2980 2981 2982 2983 2984 2985 2986 2987 2988 2989 2990 2991 2992 2993 2994 2995 2996 2997 2998 2999 3000 3001 3002 3003 3004 3005 3006 3007 3008 3009 3010 3011 3012 3013 3014 3015 3016 3017 3018 3019 3020 3021 3022 3023 3024 3025 3026 3027 3028 3029 3030 3031 3032 3033 3034 3035 3036 3037 3038 3039 3040 3041 3042 3043 3044 3045 3046 3047 3048 3049 3050 3051 3052 3053 3054 3055 3056 3057 3058 3059 3060 3061 3062 3063 3064 3065 3066 3067 3068 3069 3070 3071 3072 3073 3074 3075 3076 3077 3078 3079 3080 3081 3082 3083 3084 3085 3086 3087 3088 3089 3090 3091 3092 3093 3094 3095 3096 3097 3098 3099 3100 3101 3102 3103 3104 3105 3106 3107 3108 3109 3110 3111 3112 3113 3114 3115 3116 3117 3118 3119 3120 3121 3122 3123 3124 3125 3126 3127 3128 3129 3130 3131 3132 3133 3134 3135 3136 3137 3138 3139 3140 3141 3142 3143 3144 3145 3146 3147 3148 3149 3150 3151 3152 3153 3154 3155 3156 3157 3158 3159 3160 3161 3162 3163 3164 3165 3166 3167 3168 3169 3170 3171 3172 3173 3174 3175 3176 3177 3178 3179 3180 3181 3182 3183 3184 3185 3186 3187 3188 3189 3190 3191 3192 3193 3194 3195 3196 3197 3198 3199 3200 3201 3202 3203 3204 3205 3206 3207 3208 3209 3210 3211 3212 3213 3214 3215 3216 3217 3218 3219 3220 3221 3222 3223 3224 3225 3226 3227 3228 3229 3230 3231 3232 3233 3234 3235 3236 3237 3238 3239 3240 3241 3242 3243 3244 3245 3246 3247 3248 3249 3250 3251 3252 3253 3254 3255 3256 3257 3258 3259 3260 3261 3262 3263 3264 3265 3266 3267 3268 3269 3270 3271 3272 3273 3274 3275 3276 3277 3278 3279 3280 3281 3282 3283 3284 3285 3286 3287 3288 3289 3290 3291 3292 3293 3294 3295 3296 3297 3298 3299 3300 3301 3302 3303 3304 3305 3306 3307 3308 3309 3310 3311 3312 3313 3314 3315 3316 3317 3318 3319 3320 3321 3322 3323 3324 3325 3326 3327 3328 3329 3330 3331 3332 3333 3334 3335 3336 3337 3338 3339 3340 3341 3342 3343 3344 3345 3346 3347 3348 3349 3350 3351 3352 3353 3354 3355 3356 3357 3358 3359 3360 3361 3362 3363 3364 3365 3366 3367 3368 3369 3370 3371 3372 3373 3374 3375 3376 3377 3378 3379 3380 3381 3382 3383 3384 3385 3386 3387 3388 3389 3390 3391 3392 3393 3394 3395 3396 3397 3398 3399 3400 3401 3402 3403 3404 3405 3406 3407 3408 3409 3410 3411 3412 3413 3414 3415 3416 3417 3418 3419 3420 3421 3422 3423 3424 3425 3426 3427 3428 3429 3430 3431 3432 3433 3434 3435 3436 3437 3438 3439 3440 3441 3442 3443 3444 3445 3446 3447 3448 3449 3450 3451 3452 3453 3454 3455 3456 3457 3458 3459 3460 3461 3462 3463 3464 3465 3466 3467 3468 3469 3470 3471 3472 3473 3474 3475 3476 3477 3478 3479 3480 3481 3482 3483 3484 3485 3486 3487 3488 3489 3490 3491 3492 3493 3494 3495 3496 3497 3498 3499 3500 3501 3502 3503 3504 3505 3506 3507 3508 3509 3510 3511 3512 3513 3514 3515 3516 3517 3518 3519 3520 3521 3522 3523 3524 3525 3526 3527 3528 3529 3530 3531 3532 3533 3534 3535 3536 3537 3538 3539 3540 3541 3542 3543 3544 3545 3546 3547 3548 3549 3550 3551 3552 3553 3554 3555 3556 3557 3558 3559 3560 3561 3562 3563 3564 3565 3566 3567 3568 3569 3570 3571 3572 3573 3574 3575 3576 3577 3578 3579 3580 3581 3582 3583 3584 3585 3586 3587 3588 3589 3590 3591 3592 3593 3594 3595 3596 3597 3598 3599 3600 3601 3602 3603 3604 3605 3606 3607 3608 3609 3610 3611 3612 3613 3614 3615 3616 3617 3618 3619 3620 3621 3622 3623 3624 3625 3626 3627 3628 3629 3630 3631 3632 3633 3634 3635 3636 3637 3638 3639 3640 3641 3642 3643 3644 3645 3646 3647 3648 3649 3650 3651 3652 3653 3654 3655 3656 3657 3658 3659 3660 3661 3662 3663 3664 3665 3666 3667 3668 3669 3670 3671 3672 3673 3674 3675 3676 3677 3678 3679 3680 3681 3682 3683 3684 3685 3686 3687 3688 3689 3690 3691 3692 3693 3694 3695 3696 3697 3698 3699 3700 3701 3702 3703 3704 3705 3706 3707 3708 3709 3710 3711 3712 3713 3714 3715 3716 3717 3718 3719 3720 3721 3722 3723 3724 3725 3726 3727 3728 3729 3730 3731 3732 3733 3734 3735 3736 3737 3738 3739 3740 3741 3742 3743 3744 3745 3746 3747 3748 3749 3750 3751 3752 3753 3754 3755 3756 3757 3758 3759 3760 3761 3762 3763 3764 3765 3766 3767 3768 3769 3770 3771 3772 3773 3774 3775 3776 3777 3778 3779 3780 3781 3782 3783 3784 3785 3786 3787 3788 3789 3790 3791 3792 3793 3794 3795 3796 3797 3798 3799 3800 3801 3802 3803 3804 3805 3806 3807 3808 3809 3810 3811 3812 3813 3814 3815 3816 3817 3818 3819 3820 3821 3822 3823 3824 3825 3826 3827 3828 3829 3830 3831 3832 3833 3834 3835 3836 3837 3838 3839 3840 3841 3842 3843 3844 3845 3846 3847 3848 3849 3850 3851 3852 3853 3854 3855 3856 3857 3858 3859 3860 3861 3862 3863 3864 3865 3866 3867 3868 3869 3870 3871 3872 3873 3874 3875 3876 3877 3878 3879 3880 3881 3882 3883 3884 3885 3886 3887 3888 3889 3890 3891 3892 3893 3894 3895 3896 3897 3898 3899 3900 3901 3902 3903 3904 3905 3906 3907 3908 3909 3910 3911 3912 3913 3914 3915 3916 3917 3918 3919 3920 3921 3922 3923 3924 3925 3926 3927 3928 3929 3930 3931 3932 3933 3934 3935 3936 3937 3938 3939 3940 3941 3942 3943 3944 3945 3946 3947 3948 3949 3950 3951 3952 3953 3954 3955 3956 3957 3958 3959 3960 3961 3962 3963 3964 3965 3966 3967 3968 3969 3970 3971 3972 3973 3974 3975 3976 3977 3978 3979 3980 3981 3982 3983 3984 3985 3986 3987 3988 3989 3990 3991 3992 3993 3994 3995 3996 3997 3998 3999 4000 4001 4002 4003 4004 4005 4006 4007 4008 4009 4010 4011 4012 4013 4014 4015 4016 4017 4018 4019 4020 4021 4022 4023 4024 4025 4026 4027 4028 4029 4030 4031 4032 4033 4034 4035 4036 4037 4038 4039 4040 4041 4042 4043 4044 4045 4046 4047 4048 4049 4050 4051 4052 4053 4054 4055 4056 4057 4058 4059 4060 4061 4062 4063 4064 4065 4066 4067 4068 4069 4070 4071 4072 4073 4074 4075 4076 4077 4078 4079 4080 4081 4082 4083 4084 4085 4086 4087 4088 4089 4090 4091 4092 4093 4094 4095 4096 4097 4098 4099 4100 4101 4102 4103 4104 4105 4106 4107 4108 4109 4110 4111 4112 4113 4114 4115 4116 4117 4118 4119 4120 4121 4122 4123 4124 4125 4126 4127 4128 4129 4130 4131 4132 4133 4134 4135 4136 4137 4138 4139 4140 4141 4142 4143 4144 4145 4146 4147 4148 4149 4150 4151 4152 4153 4154 4155 4156 4157 4158 4159 4160 4161 4162 4163 4164 4165 4166 4167 4168 4169 4170 4171 4172 4173 4174 4175 4176 4177 4178 4179 4180 4181 4182 4183 4184 4185 4186 4187 4188 4189 4190 4191 4192 4193 4194 4195 4196 4197 4198 4199 4200 4201 4202 4203 4204 4205 4206 4207 4208 4209 4210 4211 4212 4213 4214 4215 4216 4217 4218 4219 4220 4221 4222 4223 4224 4225 4226 4227 4228 4229 4230 4231 4232 4233 4234 4235 4236 4237 4238 4239 4240 4241 4242 4243 4244 4245 4246 4247 4248 4249 4250 4251 4252 4253 4254 4255 4256 4257 4258 4259 4260 4261 4262 4263 4264 4265 4266 4267 4268 4269 4270 4271 4272 4273 4274 4275 4276 4277 4278 4279 4280 4281 4282 4283 4284 4285 4286 4287 4288 4289 4290 4291 4292 4293 4294 4295 4296 4297 4298 4299 4300 4301 4302 4303 4304 4305 4306 4307 4308 4309 4310 4311 4312 4313 4314 4315 4316 4317 4318 4319 4320 4321 4322 4323 4324 4325 4326 4327 4328 4329 4330 4331 4332 4333 4334 4335 4336 4337 4338 4339 4340 4341 4342 4343 4344 4345 4346 4347 4348 4349 4350 4351 4352 4353 4354 4355 4356 4357 4358 4359 4360 4361 4362 4363 4364 4365 4366 4367 4368 4369 4370 4371 4372 4373 4374 4375 4376 4377 4378 4379 4380 4381 4382 4383 4384 4385 4386 4387 4388 4389 4390 4391 4392 4393 4394 4395 4396 4397 4398 4399 4400 4401 4402 4403 4404 4405 4406 4407 4408 4409 4410 4411 4412 4413 4414 4415 4416 4417 4418 4419 4420 4421 4422 4423 4424 4425 4426 4427 4428 4429 4430 4431 4432 4433 4434 4435 4436 4437 4438 4439 4440 4441 4442 4443 4444 4445 4446 4447 4448 4449 4450 4451 4452 4453 4454 4455 4456 4457 4458 4459 4460 4461 4462 4463 4464 4465 4466 4467 4468 4469 4470 4471 4472 4473 4474 4475 4476 4477 4478 4479 4480 4481 4482 4483 4484 4485 4486 4487 4488 4489 4490 4491 4492 4493 4494 4495 4496 4497 4498 4499 4500 4501 4502 4503 4504 4505 4506 4507 4508 4509 4510 4511 4512 4513 4514 4515 4516 4517 4518 4519 4520 4521 4522 4523 4524 4525 4526 4527 4528 4529 4530 4531 4532 4533 4534 4535 4536 4537 4538 4539 4540 4541 4542 4543 4544 4545 4546 4547 4548 4549 4550 4551 4552 4553 4554 4555 4556 4557 4558 4559 4560 4561 4562 4563 4564 4565 4566 4567 4568 4569 4570 4571 4572 4573 4574 4575 4576 4577 4578 4579 4580 4581 4582 4583 4584 4585 4586 4587 4588 4589 4590 4591 4592 4593 4594 4595 4596 4597 4598 4599 4600 4601 4602 4603 4604 4605 4606 4607 4608 4609 4610 4611 4612 4613 4614 4615 4616 4617 4618 4619 4620 4621 4622 4623 4624 4625 4626 4627 4628 4629 4630 4631 4632 4633 4634 4635 4636 4637 4638 4639 4640 4641 4642 4643 4644 4645 4646 4647 4648 4649 4650 4651 4652 4653 4654 4655 4656 4657 4658 4659 4660 4661 4662 4663 4664 4665 4666 4667 4668 4669 4670 4671 4672 4673 4674 4675 4676 4677 4678 4679 4680 4681 4682 4683 4684 4685 4686 4687 4688 4689 4690 4691 4692 4693 4694 4695 4696 4697 4698 4699 4700 4701 4702 4703 4704 4705 4706 4707 4708 4709 4710 4711 4712 4713 4714 4715 4716 4717 4718 4719 4720 4721 4722 4723 4724 4725 4726 4727 4728 4729 4730 4731 4732 4733 4734 4735 4736 4737 4738 4739 4740 4741 4742 4743 4744 4745 4746 4747 4748 4749 4750 4751 4752 4753 4754 4755 4756 4757 4758 4759 4760 4761 4762 4763 4764 4765 4766 4767 4768 4769 4770 4771 4772 4773 4774 4775 4776 4777 4778 4779 4780 4781 4782 4783 4784 4785 4786 4787 4788 4789 4790 4791 4792 4793 4794 4795 4796 4797 4798 4799 4800 4801 4802 4803 4804 4805 4806 4807 4808 4809 4810 4811 4812 4813 4814 4815 4816 4817 4818 4819 4820 4821 4822 4823 4824 4825 4826 4827 4828 4829 4830 4831 4832 4833 4834 4835 4836 4837 4838 4839 4840 4841 4842 4843 4844 4845 4846 4847 4848 4849 4850 4851 4852 4853 4854 4855 4856 4857 4858 4859 4860 4861 4862 4863 4864 4865 4866 4867 4868 4869 4870 4871 4872 4873 4874 4875 4876 4877 4878 4879 4880 4881 4882 4883 4884 4885 4886 4887 4888 4889 4890 4891 4892 4893 4894 4895 4896 4897 4898 4899 4900 4901 4902 4903 4904 4905 4906 4907 4908 4909 4910 4911 4912 4913 4914 4915 4916 4917 4918 4919 4920 4921 4922 4923 4924 4925 4926 4927 4928 4929 4930 4931 4932 4933 4934 4935 4936 4937 4938 4939 4940 4941 4942 4943 4944 4945 4946 4947 4948 4949 4950 4951 4952 4953 4954 4955 4956 4957 4958 4959 4960 4961 4962 4963 4964 4965 4966 4967 4968 4969 4970 4971 4972 4973 4974 4975 4976 4977 4978 4979 4980 4981 4982 4983 4984 4985 4986 4987 4988 4989 4990 4991 4992 4993 4994 4995 4996 4997 4998 4999 5000 5001 5002 5003 5004 5005 5006 5007 5008 5009 5010 5011 5012 5013 5014 5015 5016 5017 5018 5019 5020 5021 5022 5023 5024 5025 5026 5027 5028 5029 5030 5031 5032 5033 5034 5035 5036 5037 5038 5039 5040 5041 5042 5043 5044 5045 5046 5047 5048 5049 5050 5051 5052 5053 5054 5055 5056 5057 5058 5059 5060 5061 5062 5063 5064 5065 5066 5067 5068 5069 5070 5071 5072 5073 5074 5075 5076 5077 5078 5079 5080 5081 5082 5083 5084 5085 5086 5087 5088 5089 5090 5091 5092 5093 5094 5095 5096 5097 5098 5099 5100 5101 5102 5103 5104 5105 5106 5107 5108 5109 5110 5111 5112 5113 5114 5115 5116 5117 5118 5119 5120 5121 5122 5123 5124 5125 5126 5127 5128 5129 5130 5131 5132 5133 5134 5135 5136 5137 5138 5139 5140 5141 5142 5143 5144 5145 5146 5147 5148 5149 5150 5151 5152 5153 5154 5155 5156 5157 5158 5159 5160 5161 5162 5163 5164 5165 5166 5167 5168 5169 5170 5171 5172 5173 5174 5175 5176 5177 5178 5179 5180 5181 5182 5183 5184 5185 5186 5187 5188 5189 5190 5191 5192 5193 5194 5195 5196 5197 5198 5199 5200 5201 5202 5203 5204 5205 5206 5207 5208 5209 5210 5211 5212 5213 5214 5215 5216 5217 5218 5219 5220 5221 5222 5223 5224 5225 5226 5227 5228 5229 5230 5231 5232 5233 5234 5235 5236 5237 5238 5239 5240 5241 5242 5243 5244 5245 5246 5247 5248 5249 5250 5251 5252 5253 5254 5255 5256 5257 5258 5259 5260 5261 5262 5263 5264 5265 5266 5267 5268 5269 5270 5271 5272 5273 5274 5275 5276 5277 5278 5279 5280 5281 5282 5283 5284 5285 5286 5287 5288 5289 5290 5291 5292 5293 5294 5295 5296 5297 5298 5299 5300 5301 5302 5303 5304 5305 5306 5307 5308 5309 5310 5311 5312 5313 5314 5315 5316 5317 5318 5319 5320 5321 5322 5323 5324 5325 5326 5327 5328 5329 5330 5331 5332 5333 5334 5335 5336 5337 5338 5339 5340 5341 5342 5343 5344 5345 5346 5347 5348 5349 5350 5351 5352 5353 5354 5355 5356 5357 5358 5359 5360 5361 5362 5363 5364 5365 5366 5367 5368 5369 5370 5371 5372 5373 5374 5375 5376 5377 5378 5379 5380 5381 5382 5383 5384 5385 5386 5387 5388 5389 5390 5391 5392 5393 5394 5395 5396 5397 5398 5399 5400 5401 5402 5403 5404 5405 5406 5407 5408 5409 5410 5411 5412 5413 5414 5415 5416 5417 5418 5419 5420 5421 5422 5423 5424 5425 5426 5427 5428 5429 5430 5431 5432 5433 5434 5435 5436 5437 5438 5439 5440 5441 5442 5443 5444 5445 5446 5447 5448 5449 5450 5451 5452 5453 5454 5455 5456 5457 5458 5459 5460 5461 5462 5463 5464 5465 5466 5467 5468 5469 5470 5471 5472 5473 5474 5475 5476 5477 5478 5479 5480 5481 5482 5483 5484 5485 5486 5487 5488 5489 5490 5491 5492 5493 5494 5495 5496 5497 5498 5499 5500 5501 5502 5503 5504 5505 5506 5507 5508 5509 5510 5511 5512 5513 5514 5515 5516 5517 5518 5519 5520 5521 5522 5523 5524 5525 5526 5527 5528 5529 5530 5531 5532 5533 5534 5535 5536 5537 5538 5539 5540 5541 5542 5543 5544 5545 5546 5547 5548 5549 5550 5551 5552 5553 5554 5555 5556 5557 5558 5559 5560 5561 5562 5563 5564 5565 5566 5567 5568 5569 5570 5571 5572 5573 5574 5575 5576 5577 5578 5579 5580 5581 5582 5583 5584 5585 5586 5587 5588 5589 5590 5591 5592 5593 5594 5595 5596 5597 5598 5599 5600 5601 5602 5603 5604 5605 5606 5607 5608 5609 5610 5611 5612 5613 5614 5615 5616 5617 5618 5619 5620 5621 5622 5623 5624 5625 5626 5627 5628 5629 5630 5631 5632 5633 5634 5635 5636 5637 5638 5639 5640 5641 5642 5643 5644 5645 5646 5647 5648 5649 5650 5651 5652 5653 5654 5655 5656 5657 5658 5659 5660 5661 5662 5663 5664 5665 5666 5667 5668 5669 5670 5671 5672 5673 5674 5675 5676 5677 5678 5679 5680 5681 5682 5683 5684 5685 5686 5687 5688 5689 5690 5691 5692 5693 5694 5695 5696 5697 5698 5699 5700 5701 5702 5703 5704 5705 5706 5707 5708 5709 5710 5711 5712 5713 5714 5715 5716 5717 5718 5719 5720 5721 5722 5723 5724 5725 5726 5727 5728 5729 5730 5731 5732 5733 5734 5735 5736 5737 5738 5739 5740 5741 5742 5743 5744 5745 5746 5747 5748 5749 5750 5751 5752 5753 5754 5755 5756 5757 5758 5759 5760 5761 5762 5763 5764 5765 5766 5767 5768 5769 5770 5771 5772 5773 5774 5775 5776 5777 5778 5779 5780 5781 5782 5783 5784 5785 5786 5787 5788 5789 5790 5791 5792 5793 5794 5795 5796 5797 5798 5799 5800 5801 5802 5803 5804 5805 5806 5807 5808 5809 5810 5811 5812 5813 5814 5815 5816 5817 5818 5819 5820 5821 5822 5823 5824 5825 5826 5827 5828 5829 5830 5831 5832 5833 5834 5835 5836 5837 5838 5839 5840 5841 5842 5843 5844 5845 5846 5847 5848 5849 5850 5851 5852 5853 5854 5855 5856 5857 5858 5859 5860 5861 5862 5863 5864 5865 5866 5867 5868 5869 5870 5871 5872 5873 5874 5875 5876 5877 5878 5879 5880 5881 5882 5883 5884 5885 5886 5887 5888 5889 5890 5891 5892 5893 5894 5895 5896 5897 5898 5899 5900 5901 5902 5903 5904 5905 5906 5907 5908 5909 5910 5911 5912 5913 5914 5915 5916 5917 5918 5919 5920 5921 5922 5923 5924 5925 5926 5927 5928 5929 5930 5931 5932 5933 5934 5935 5936 5937 5938 5939 5940 5941 5942 5943 5944 5945 5946 5947 5948 5949 5950 5951 5952 5953 5954 5955 5956 5957 5958 5959 5960 5961 5962 5963 5964 5965 5966 5967 5968 5969 5970 5971 5972 5973 5974 5975 5976 5977 5978 5979 5980 5981 5982 5983 5984 5985 5986 5987 5988 5989 5990 5991 5992 5993 5994 5995 5996 5997 5998 5999 6000 6001 6002 6003 6004 6005 6006 6007 6008 6009 6010 6011 6012 6013 6014 6015 6016 6017 6018 6019 6020 6021 6022 6023 6024 6025 6026 6027 6028 6029 6030 6031 6032 6033 6034 6035 6036 6037 6038 6039 6040 6041 6042 6043 6044 6045 6046 6047 6048 6049 6050 6051 6052 6053 6054 6055 6056 6057 6058 6059 6060 6061 6062 6063 6064 6065 6066 6067 6068 6069 6070 6071 6072 6073 6074 6075 6076 6077 6078 6079 6080 6081 6082 6083 6084 6085 6086 6087 6088 6089 6090 6091 6092 6093 6094 6095 6096 6097 6098 6099 6100 6101 6102 6103 6104 6105 6106 6107 6108 6109 6110 6111 6112 6113 6114 6115 6116 6117 6118 6119 6120 6121 6122 6123 6124 6125 6126 6127 6128 6129 6130 6131 6132 6133 6134 6135 6136 6137 6138 6139 6140 6141 6142 6143 6144 6145 6146 6147 6148 6149 6150 6151 6152 6153 6154 6155 6156 6157 6158 6159 6160 6161 6162 6163 6164 6165 6166 6167 6168 6169 6170 6171 6172 6173 6174 6175 6176 6177 6178 6179 6180 6181 6182 6183 6184 6185 6186 6187 6188 6189 6190 6191 6192 6193 6194 6195 6196 6197 6198 6199 6200 6201 6202 6203 6204 6205 6206 6207 6208 6209 6210 6211 6212 6213 6214 6215 6216 6217 6218 6219 6220 6221 6222 6223 6224 6225 6226 6227 6228 6229 6230 6231 6232 6233 6234 6235 6236 6237 6238 6239 6240 6241 6242 6243 6244 6245 6246 6247 6248 6249 6250 6251 6252 6253 6254 6255 6256 6257 6258 6259 6260 6261 6262 6263 6264 6265 6266 6267 6268 6269 6270 6271 6272 6273 6274 6275 6276 6277 6278 6279 6280 6281 6282 6283 6284 6285 6286 6287 6288 6289 6290 6291 6292 6293 6294 6295 6296 6297 6298 6299 6300 6301 6302 6303 6304 6305 6306 6307 6308 6309 6310 6311 6312 6313 6314 6315 6316 6317 6318 6319 6320 6321 6322 6323 6324 6325 6326 6327 6328 6329 6330 6331 6332 6333 6334 6335 6336 6337 6338 6339 6340 6341 6342 6343 6344 6345 6346 6347 6348 6349 6350 6351 6352 6353 6354 6355 6356 6357 6358 6359 6360 6361 6362 6363 6364 6365 6366 6367 6368 6369 6370 6371 6372 6373 6374 6375 6376 6377 6378 6379 6380 6381 6382 6383 6384 6385 6386 6387 6388 6389 6390 6391 6392 6393 6394 6395 6396 6397 6398 6399 6400 6401 6402 6403 6404 6405 6406 6407 6408 6409 6410 6411 6412 6413 6414 6415 6416 6417 6418 6419 6420 6421 6422 6423 6424 6425 6426 6427 6428 6429 6430 6431 6432 6433 6434 6435 6436 6437 6438 6439 6440 6441 6442 6443 6444 6445 6446 6447 6448 6449 6450 6451 6452 6453 6454 6455 6456 6457 6458 6459 6460 6461 6462 6463 6464 6465 6466 6467 6468 6469 6470 6471 6472 6473 6474 6475 6476 6477 6478 6479 6480 6481 6482 6483 6484 6485 6486 6487 6488 6489 6490 6491 6492 6493 6494 6495 6496 6497 6498 6499 6500 6501 6502 6503 6504 6505 6506 6507 6508 6509 6510 6511 6512 6513 6514 6515 6516 6517 6518 6519 6520 6521 6522 6523 6524 6525 6526 6527 6528 6529 6530 6531 6532 6533 6534 6535 6536 6537 6538 6539 6540 6541 6542 6543 6544 6545 6546 6547 6548 6549 6550 6551 6552 6553 6554 6555 6556 6557 6558 6559 6560 6561 6562 6563 6564 6565 6566 6567 6568 6569 6570 6571 6572 6573 6574 6575 6576 6577 6578 6579 6580 6581 6582 6583 6584 6585 6586 6587 6588 6589 6590 6591 6592 6593 6594 6595 6596 6597 6598 6599 6600 6601 6602 6603 6604 6605 6606 6607 6608 6609 6610 6611 6612 6613 6614 6615 6616 6617 6618 6619 6620 6621 6622 6623 6624 6625 6626 6627 6628 6629 6630 6631 6632 6633 6634 6635 6636 6637 6638 6639 6640 6641 6642 6643 6644 6645 6646 6647 6648 6649 6650 6651 6652 6653 6654 6655 6656 6657 6658 6659 6660 6661 6662 6663 6664 6665 6666 6667 6668 6669 6670 6671 6672 6673 6674 6675 6676 6677 6678 6679 6680 6681 6682 6683 6684 6685 6686 6687 6688 6689 6690 6691 6692 6693 6694 6695 6696 6697 6698 6699 6700 6701 6702 6703 6704 6705 6706 6707 6708 6709 6710 6711 6712 6713 6714 6715 6716 6717 6718 6719 6720 6721 6722 6723 6724 6725 6726 6727 6728 6729 6730 6731 6732 6733 6734 6735 6736 6737 6738 6739 6740 6741 6742 6743 6744 6745 6746 6747 6748 6749 6750 6751 6752 6753 6754 6755 6756 6757 6758 6759 6760 6761 6762 6763 6764 6765 6766 6767 6768 6769 6770 6771 6772 6773 6774 6775 6776 6777 6778 6779 6780 6781 6782 6783 6784 6785 6786 6787 6788 6789 6790 6791 6792 6793 6794 6795 6796 6797 6798 6799 6800 6801 6802 6803 6804 6805 6806 6807 6808 6809 6810 6811 6812 6813 6814 6815 6816 6817 6818 6819 6820 6821 6822 6823 6824 6825 6826 6827 6828 6829 6830 6831 6832 6833 6834 6835 6836 6837 6838 6839 6840 6841 6842 6843 6844 6845 6846 6847 6848 6849 6850 6851 6852 6853 6854 6855 6856 6857 6858 6859 6860 6861 6862 6863 6864 6865 6866 6867 6868 6869 6870 6871 6872 6873 6874 6875 6876 6877 6878 6879 6880 6881 6882 6883 6884 6885 6886 6887 6888 6889 6890 6891 6892 6893 6894 6895 6896 6897 6898 6899 6900 6901 6902 6903 6904 6905 6906 6907 6908 6909 6910 6911 6912 6913 6914 6915 6916 6917 6918 6919 6920 6921 6922 6923 6924 6925 6926 6927 6928 6929 6930 6931 6932 6933 6934 6935 6936 6937 6938 6939 6940 6941 6942 6943 6944 6945 6946 6947 6948 6949 6950 6951 6952 6953 6954 6955 6956 6957 6958 6959 6960 6961 6962 6963 6964 6965 6966 6967 6968 6969 6970 6971 6972 6973 6974 6975 6976 6977 6978 6979 6980 6981 6982 6983 6984 6985 6986 6987 6988 6989 6990 6991 6992 6993 6994 6995 6996 6997 6998 6999 7000 7001 7002 7003 7004 7005 7006 7007 7008 7009 7010 7011 7012 7013 7014 7015 7016 7017 7018 7019 7020 7021 7022 7023 7024 7025 7026 7027 7028 7029 7030 7031 7032 7033 7034 7035 7036 7037 7038 7039 7040 7041 7042 7043 7044 7045 7046 7047 7048 7049 7050 7051 7052 7053 7054 7055 7056 7057 7058 7059 7060 7061 7062 7063 7064 7065 7066 7067 7068 7069 7070 7071 7072 7073 7074 7075 7076 7077 7078 7079 7080 7081 7082 7083 7084 7085 7086 7087 7088 7089 7090 7091 7092 7093 7094 7095 7096 7097 7098 7099 7100 7101 7102 7103 7104 7105 7106 7107 7108 7109 7110 7111 7112 7113 7114 7115 7116 7117 7118 7119 7120 7121 7122 7123 7124 7125 7126 7127 7128 7129 7130 7131 7132 7133 7134 7135 7136 7137 7138 7139 7140 7141 7142 7143 7144 7145 7146 7147 7148 7149 7150 7151 7152 7153 7154 7155 7156 7157 7158 7159 7160 7161 7162 7163 7164 7165 7166 7167 7168 7169 7170 7171 7172 7173 7174 7175 7176 7177 7178 7179 7180 7181 7182 7183 7184 7185 7186 7187 7188 7189 7190 7191 7192 7193 7194 7195 7196 7197 7198 7199 7200 7201 7202 7203 7204 7205 7206 7207 7208 7209 7210 7211 7212 7213 7214 7215 7216 7217 7218 7219 7220 7221 7222 7223 7224 7225 7226 7227 7228 7229 7230 7231 7232 7233 7234 7235 7236 7237 7238 7239 7240 7241 7242 7243 7244 7245 7246 7247 7248 7249 7250 7251 7252 7253 7254 7255 7256 7257 7258 7259 7260 7261 7262 7263 7264 7265 7266 7267 7268 7269 7270 7271 7272 7273 7274 7275 7276 7277 7278 7279 7280 7281 7282 7283 7284 7285 7286 7287 7288 7289 7290 7291 7292 7293 7294 7295 7296 7297 7298 7299 7300 7301 7302 7303 7304 7305 7306 7307 7308 7309 7310 7311 7312 7313 7314 7315 7316 7317 7318 7319 7320 7321 7322 7323 7324 7325 7326 7327 7328 7329 7330 7331 7332 7333 7334 7335 7336 7337 7338 7339 7340 7341 7342 7343 7344 7345 7346 7347 7348 7349 7350 7351 7352 7353 7354 7355 7356 7357 7358 7359 7360 7361 7362 7363 7364 7365 7366 7367 7368 7369 7370 7371 7372 7373 7374 7375 7376 7377 7378 7379 7380 7381 7382 7383 7384 7385 7386 7387 7388 7389 7390 7391 7392 7393 7394 7395 7396 7397 7398 7399 7400 7401 7402 7403 7404 7405 7406 7407 7408 7409 7410 7411 7412 7413 7414 7415 7416 7417 7418 7419 7420 7421 7422 7423 7424 7425 7426 7427 7428 7429 7430 7431 7432 7433 7434 7435 7436 7437 7438 7439 7440 7441 7442 7443 7444 7445 7446 7447 7448 7449 7450 7451 7452 7453 7454 7455 7456 7457 7458 7459 7460 7461 7462 7463 7464 7465 7466 7467 7468 7469 7470 7471 7472 7473 7474 7475 7476 7477 7478 7479 7480 7481 7482 7483 7484 7485 7486 7487 7488 7489 7490 7491 7492 7493 7494 7495 7496 7497 7498 7499 7500 7501 7502 7503 7504 7505 7506 7507 7508 7509 7510 7511 7512 7513 7514 7515 7516 7517 7518 7519 7520 7521 7522 7523 7524 7525 7526 7527 7528 7529 7530 7531 7532 7533 7534 7535 7536 7537 7538 7539 7540 7541 7542 7543 7544 7545 7546 7547 7548 7549 7550 7551 7552 7553 7554 7555 7556 7557 7558 7559 7560 7561 7562 7563 7564 7565 7566 7567 7568 7569 7570 7571 7572 7573 7574 7575 7576 7577 7578 7579 7580 7581 7582 7583 7584 7585 7586 7587 7588 7589 7590 7591 7592 7593 7594 7595 7596 7597 7598 7599 7600 7601 7602 7603 7604 7605 7606 7607 7608 7609 7610 7611 7612 7613 7614 7615 7616 7617 7618 7619 7620 7621 7622 7623 7624 7625 7626 7627 7628 7629 7630 7631 7632 7633 7634 7635 7636 7637 7638 7639 7640 7641 7642 7643 7644 7645 7646 7647 7648 7649 7650 7651 7652 7653 7654 7655 7656 7657 7658 7659 7660 7661 7662 7663 7664 7665 7666 7667 7668 7669 7670 7671 7672 7673 7674 7675 7676 7677 7678 7679 7680 7681 7682 7683 7684 7685 7686 7687 7688 7689 7690 7691 7692 7693 7694 7695 7696 7697 7698 7699 7700 7701 7702 7703 7704 7705 7706 7707 7708 7709 7710 7711 7712 7713 7714 7715 7716 7717 7718 7719 7720 7721 7722 7723 7724 7725 7726 7727 7728 7729 7730 7731 7732 7733 7734 7735 7736 7737 7738 7739 7740 7741 7742 7743 7744 7745 7746 7747 7748 7749 7750 7751 7752 7753 7754 7755 7756 7757 7758 7759 7760 7761 7762 7763 7764 7765 7766 7767 7768 7769 7770 7771 7772 7773 7774 7775 7776 7777 7778 7779 7780 7781 7782 7783 7784 7785 7786 7787 7788 7789 7790 7791 7792 7793 7794 7795 7796 7797 7798 7799 7800 7801 7802 7803 7804 7805 7806 7807 7808 7809 7810 7811 7812 7813 7814 7815 7816 7817 7818 7819 7820 7821 7822 7823 7824 7825 7826 7827 7828 7829 7830 7831 7832 7833 7834 7835 7836 7837 7838 7839 7840 7841 7842 7843 7844 7845 7846 7847 7848 7849 7850 7851 7852 7853 7854 7855 7856 7857 7858 7859 7860 7861 7862 7863 7864 7865 7866 7867 7868 7869 7870 7871 7872 7873 7874 7875 7876 7877 7878 7879 7880 7881 7882 7883 7884 7885 7886 7887 7888 7889 7890 7891 7892 7893 7894 7895 7896 7897 7898 7899 7900 7901 7902 7903 7904 7905 7906 7907 7908 7909 7910 7911 7912 7913 7914 7915 7916 7917 7918 7919 7920 7921 7922 7923 7924 7925 7926 7927 7928 7929 7930 7931 7932 7933 7934 7935 7936 7937 7938 7939 7940 7941 7942 7943 7944 7945 7946 7947 7948 7949 7950 7951 7952 7953 7954 7955 7956 7957 7958 7959 7960 7961 7962 7963 7964 7965 7966 7967 7968 7969 7970 7971 7972 7973 7974 7975 7976 7977 7978 7979 7980 7981 7982 7983 7984 7985 7986 7987 7988 7989 7990 7991 7992 7993 7994 7995 7996 7997 7998 7999 8000 8001 8002 8003 8004 8005 8006 8007 8008 8009 8010 8011 8012 8013 8014 8015 8016 8017 8018 8019 8020 8021 8022 8023 8024 8025 8026 8027 8028 8029 8030 8031 8032 8033 8034 8035 8036 8037 8038 8039 8040 8041 8042 8043 8044 8045 8046 8047 8048 8049 8050 8051 8052 8053 8054 8055 8056 8057 8058 8059 8060 8061 8062 8063 8064 8065 8066 8067 8068 8069 8070 8071 8072 8073 8074 8075 8076 8077 8078 8079 8080 8081 8082 8083 8084 8085 8086 8087 8088 8089 8090 8091 8092 8093 8094 8095 8096 8097 8098 8099 8100 8101 8102 8103 8104 8105 8106 8107 8108 8109 8110 8111 8112 8113 8114 8115 8116 8117 8118 8119 8120 8121 8122 8123 8124 8125 8126 8127 8128 8129 8130 8131 8132 8133 8134 8135 8136 8137 8138 8139 8140 8141 8142 8143 8144 8145 8146 8147 8148 8149 8150 8151 8152 8153 8154 8155 8156 8157 8158 8159 8160 8161 8162 8163 8164 8165 8166 8167 8168 8169 8170 8171 8172 8173 8174 8175 8176 8177 8178 8179 8180 8181 8182 8183 8184 8185 8186 8187 8188 8189 8190 8191 8192 8193 8194 8195 8196 8197 8198 8199 8200 8201 8202 8203 8204 8205 8206 8207 8208 8209 8210 8211 8212 8213 8214 8215 8216 8217 8218 8219 8220 8221 8222 8223 8224 8225 8226 8227 8228 8229 8230 8231 8232 8233 8234 8235 8236 8237 8238 8239 8240 8241 8242 8243 8244 8245 8246 8247 8248 8249 8250 8251 8252 8253 8254 8255 8256 8257 8258 8259 8260 8261 8262 8263 8264 8265 8266 8267 8268 8269 8270 8271 8272 8273 8274 8275 8276 8277 8278 8279 8280 8281 8282 8283 8284 8285 8286 8287 8288 8289 8290 8291 8292 8293 8294 8295 8296 8297 8298 8299 8300 8301 8302 8303 8304 8305 8306 8307 8308 8309 8310 8311 8312 8313 8314 8315 8316 8317 8318 8319 8320 8321 8322 8323 8324 8325 8326 8327 8328 8329 8330 8331 8332 8333 8334 8335 8336 8337 8338 8339 8340 8341 8342 8343 8344 8345 8346 8347 8348 8349 8350 8351 8352 8353 8354 8355 8356 8357 8358 8359 8360 8361 8362 8363 8364 8365 8366 8367 8368 8369 8370 8371 8372 8373 8374 8375 8376 8377 8378 8379 8380 8381 8382 8383 8384 8385 8386 8387 8388 8389 8390 8391 8392 8393 8394 8395 8396 8397 8398 8399 8400 8401 8402 8403 8404 8405 8406 8407 8408 8409 8410 8411 8412 8413 8414 8415 8416 8417 8418 8419 8420 8421 8422 8423 8424 8425 8426 8427 8428 8429 8430 8431 8432 8433 8434 8435 8436 8437 8438 8439 8440 8441 8442 8443 8444 8445 8446 8447 8448 8449 8450 8451 8452 8453 8454 8455 8456 8457 8458 8459 8460 8461 8462 8463 8464 8465 8466 8467 8468 8469 8470 8471 8472 8473 8474 8475 8476 8477 8478 8479 8480 8481 8482 8483 8484 8485 8486 8487 8488 8489 8490 8491 8492 8493 8494 8495 8496 8497 8498 8499 8500 8501 8502 8503 8504 8505 8506 8507 8508 8509 8510 8511 8512 8513 8514 8515 8516 8517 8518 8519 8520 8521 8522 8523 8524 8525 8526 8527 8528 8529 8530 8531 8532 8533 8534 8535 8536 8537 8538 8539 8540 8541 8542 8543 8544 8545 8546 8547 8548 8549 8550 8551 8552 8553 8554 8555 8556 8557 8558 8559 8560 8561 8562 8563 8564 8565 8566 8567 8568 8569 8570 8571 8572 8573 8574 8575 8576 8577 8578 8579 8580 8581 8582 8583 8584 8585 8586 8587 8588 8589 8590 8591 8592 8593 8594 8595 8596 8597 8598 8599 8600 8601 8602 8603 8604 8605 8606 8607 8608 8609 8610 8611 8612 8613 8614 8615 8616 8617 8618 8619 8620 8621 8622 8623 8624 8625 8626 8627 8628 8629 8630 8631 8632 8633 8634 8635 8636 8637 8638 8639 8640 8641 8642 8643 8644 8645 8646 8647 8648 8649 8650 8651 8652 8653 8654 8655 8656 8657 8658 8659 8660 8661 8662 8663 8664 8665 8666 8667 8668 8669 8670 8671 8672 8673 8674 8675 8676 8677 8678 8679 8680 8681 8682 8683 8684 8685 8686 8687 8688 8689 8690 8691 8692 8693 8694 8695 8696 8697 8698 8699 8700 8701 8702 8703 8704 8705 8706 8707 8708 8709 8710 8711 8712 8713 8714 8715 8716 8717 8718 8719 8720 8721 8722 8723 8724 8725 8726 8727 8728 8729 8730 8731 8732 8733 8734 8735 8736 8737 8738 8739 8740 8741 8742 8743 8744 8745 8746 8747 8748 8749 8750 8751 8752 8753 8754 8755 8756 8757 8758 8759 8760 8761 8762 8763 8764 8765 8766 8767 8768 8769 8770 8771 8772 8773 8774 8775 8776 8777 8778 8779 8780 8781 8782 8783 8784 8785 8786 8787 8788 8789 8790 8791 8792 8793 8794 8795 8796 8797 8798 8799 8800 8801 8802 8803 8804 8805 8806 8807 8808 8809 8810 8811 8812 8813 8814 8815 8816 8817 8818 8819 8820 8821 8822 8823 8824 8825 8826 8827 8828 8829 8830 8831 8832 8833 8834 8835 8836 8837 8838 8839 8840 8841 8842 8843 8844 8845 8846 8847 8848 8849 8850 8851 8852 8853 8854 8855 8856 8857 8858 8859 8860 8861 8862 8863 8864 8865 8866 8867 8868 8869 8870 8871 8872 8873 8874 8875 8876 8877 8878 8879 8880 8881 8882 8883 8884 8885 8886 8887 8888 8889 8890 8891 8892 8893 8894 8895 8896 8897 8898 8899 8900 8901 8902 8903 8904 8905 8906 8907 8908 8909 8910 8911 8912 8913 8914 8915 8916 8917 8918 8919 8920 8921 8922 8923 8924 8925 8926 8927 8928 8929 8930 8931 8932 8933 8934 8935 8936 8937 8938 8939 8940 8941 8942 8943 8944 8945 8946 8947 8948 8949 8950 8951 8952 8953 8954 8955 8956 8957 8958 8959 8960 8961 8962 8963 8964 8965 8966 8967 8968 8969 8970 8971 8972 8973 8974 8975 8976 8977 8978 8979 8980 8981 8982 8983 8984 8985 8986 8987 8988 8989 8990 8991 8992 8993 8994 8995 8996 8997 8998 8999 9000 9001 9002 9003 9004 9005 9006 9007 9008 9009 9010 9011 9012 9013 9014 9015 9016 9017 9018 9019 9020 9021 9022 9023 9024 9025 9026 9027 9028 9029 9030 9031 9032 9033 9034 9035 9036 9037 9038 9039 9040 9041 9042 9043 9044 9045 9046 9047 9048 9049 9050 9051 9052 9053 9054 9055 9056 9057 9058 9059 9060 9061 9062 9063 9064 9065 9066 9067 9068 9069 9070 9071 9072 9073 9074 9075 9076 9077 9078 9079 9080 9081 9082 9083 9084 9085 9086 9087 9088 9089 9090 9091 9092 9093 9094 9095 9096 9097 9098 9099 9100 9101 9102 9103 9104 9105 9106 9107 9108 9109 9110 9111 9112 9113 9114 9115 9116 9117 9118 9119 9120 9121 9122 9123 9124 9125 9126 9127 9128 9129 9130 9131 9132 9133 9134 9135 9136 9137 9138 9139 9140 9141 9142 9143 9144 9145 9146 9147 9148 9149 9150 9151 9152 9153 9154 9155 9156 9157 9158 9159 9160 9161 9162 9163 9164 9165 9166 9167 9168 9169 9170 9171 9172 9173 9174 9175 9176 9177 9178 9179 9180 9181 9182 9183 9184 9185 9186 9187 9188 9189 9190 9191 9192 9193 9194 9195 9196 9197 9198 9199 9200 9201 9202 9203 9204 9205 9206 9207 9208 9209 9210 9211 9212 9213 9214 9215 9216 9217 9218 9219 9220 9221 9222 9223 9224 9225 9226 9227 9228 9229 9230 9231 9232 9233 9234 9235 9236 9237 9238 9239 9240 9241 9242 9243 9244 9245 9246 9247 9248 9249 9250 9251 9252 9253 9254 9255 9256 9257 9258 9259 9260 9261 9262 9263 9264 9265 9266 9267 9268 9269 9270 9271 9272 9273 9274 9275 9276 9277 9278 9279 9280 9281 9282 9283 9284 9285 9286 9287 9288 9289 9290 9291 9292 9293 9294 9295 9296 9297 9298 9299 9300 9301 9302 9303 9304 9305 9306 9307 9308 9309 9310 9311 9312 9313 9314 9315 9316 9317 9318 9319 9320 9321 9322 9323 9324 9325 9326 9327 9328 9329 9330 9331 9332 9333 9334 9335 9336 9337 9338 9339 9340 9341 9342 9343 9344 9345 9346 9347 9348 9349 9350 9351 9352 9353 9354 9355 9356 9357 9358 9359 9360 9361 9362 9363 9364 9365 9366 9367 9368 9369 9370 9371 9372 9373 9374 9375 9376 9377 9378 9379 9380 9381 9382 9383 9384 9385 9386 9387 9388 9389 9390 9391 9392 9393 9394 9395 9396 9397 9398 9399 9400 9401 9402 9403 9404 9405 9406 9407 9408 9409 9410 9411 9412 9413 9414 9415 9416 9417 9418 9419 9420 9421 9422 9423 9424 9425 9426 9427 9428 9429 9430 9431 9432 9433 9434 9435 9436 9437 9438 9439 9440 9441 9442 9443 9444 9445 9446 9447 9448 9449 9450 9451 9452 9453 9454 9455 9456 9457 9458 9459 9460 9461
|
<pre>Network Working Group J. Lazzaro
Request for Comments: 4695 J. Wawrzynek
Category: Standards Track UC Berkeley
November 2006
<span class="h1">RTP Payload Format for MIDI</span>
Status of This Memo
This document specifies an Internet standards track protocol for the
Internet community, and requests discussion and suggestions for
improvements. Please refer to the current edition of the "Internet
Official Protocol Standards" (STD 1) for the standardization state
and status of this protocol. Distribution of this memo is unlimited.
Copyright Notice
Copyright (C) The IETF Trust (2006).
Abstract
This memo describes a Real-time Transport Protocol (RTP) payload
format for the MIDI (Musical Instrument Digital Interface) command
language. The format encodes all commands that may legally appear on
a MIDI 1.0 DIN cable. The format is suitable for interactive
applications (such as network musical performance) and content-
delivery applications (such as file streaming). The format may be
used over unicast and multicast UDP and TCP, and it defines tools for
graceful recovery from packet loss. Stream behavior, including the
MIDI rendering method, may be customized during session setup. The
format also serves as a mode for the mpeg4-generic format, to support
the MPEG 4 Audio Object Types for General MIDI, Downloadable Sounds
Level 2, and Structured Audio.
Table of Contents
<a href="#section-1">1</a>. Introduction ....................................................<a href="#page-4">4</a>
<a href="#section-1.1">1.1</a>. Terminology ................................................<a href="#page-5">5</a>
<a href="#section-1.2">1.2</a>. Bitfield Conventions .......................................<a href="#page-6">6</a>
<a href="#section-2">2</a>. Packet Format ...................................................<a href="#page-6">6</a>
<a href="#section-2.1">2.1</a>. RTP Header .................................................<a href="#page-7">7</a>
<a href="#section-2.2">2.2</a>. MIDI Payload ..............................................<a href="#page-11">11</a>
<a href="#section-3">3</a>. MIDI Command Section ...........................................<a href="#page-12">12</a>
<a href="#section-3.1">3.1</a>. Timestamps ...............................................<a href="#page-14">14</a>
<a href="#section-3.2">3.2</a>. Command Coding ...........................................<a href="#page-16">16</a>
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 1]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-2" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<a href="#section-4">4</a>. The Recovery Journal System ....................................<a href="#page-22">22</a>
<a href="#section-5">5</a>. Recovery Journal Format ........................................<a href="#page-24">24</a>
<a href="#section-6">6</a>. Session Description Protocol ...................................<a href="#page-28">28</a>
<a href="#section-6.1">6.1</a>. Session Descriptions for Native Streams ...................<a href="#page-29">29</a>
<a href="#section-6.2">6.2</a>. Session Descriptions for mpeg4-generic Streams ............<a href="#page-30">30</a>
<a href="#section-6.3">6.3</a>. Parameters ................................................<a href="#page-33">33</a>
<a href="#section-7">7</a>. Extensibility ..................................................<a href="#page-34">34</a>
<a href="#section-8">8</a>. Congestion Control .............................................<a href="#page-35">35</a>
<a href="#section-9">9</a>. Security Considerations ........................................<a href="#page-35">35</a>
<a href="#section-10">10</a>. Acknowledgements ..............................................<a href="#page-36">36</a>
<a href="#section-11">11</a>. IANA Considerations ...........................................<a href="#page-37">37</a>
<a href="#section-11.1">11.1</a>. rtp-midi Media Type Registration .........................<a href="#page-37">37</a>
<a href="#section-11.1.1">11.1.1</a>. Repository Request for "audio/rtp-midi" ...........<a href="#page-40">40</a>
<a href="#section-11.2">11.2</a>. mpeg4-generic Media Type Registration ....................<a href="#page-41">41</a>
11.2.1. Repository Request for Mode rtp-midi for
mpeg4-generic .....................................<a href="#page-44">44</a>
<a href="#section-11.3">11.3</a>. asc Media Type Registration ..............................<a href="#page-46">46</a>
<a href="#appendix-A">A</a>. The Recovery Journal Channel Chapters ..........................<a href="#page-48">48</a>
<a href="#appendix-A.1">A.1</a>. Recovery Journal Definitions ..............................<a href="#page-48">48</a>
<a href="#appendix-A.2">A.2</a>. Chapter P: MIDI Program Change ............................<a href="#page-52">52</a>
<a href="#appendix-A.3">A.3</a>. Chapter C: MIDI Control Change ............................<a href="#page-53">53</a>
<a href="#appendix-A.3.1">A.3.1</a>. Log Inclusion Rules ................................<a href="#page-54">54</a>
<a href="#appendix-A.3.2">A.3.2</a>. Controller Log Format ..............................<a href="#page-55">55</a>
<a href="#appendix-A.3.3">A.3.3</a>. Log List Coding Rules ..............................<a href="#page-57">57</a>
<a href="#appendix-A.3.4">A.3.4</a>. The Parameter System ...............................<a href="#page-60">60</a>
<a href="#appendix-A.4">A.4</a>. Chapter M: MIDI Parameter System ..........................<a href="#page-62">62</a>
<a href="#appendix-A.4.1">A.4.1</a>. Log Inclusion Rules ................................<a href="#page-64">64</a>
<a href="#appendix-A.4.2">A.4.2</a>. Log Coding Rules ...................................<a href="#page-65">65</a>
<a href="#appendix-A.4.2.1">A.4.2.1</a>. The Value Tool .............................<a href="#page-67">67</a>
<a href="#appendix-A.4.2.2">A.4.2.2</a>. The Count Tool .............................<a href="#page-70">70</a>
<a href="#appendix-A.5">A.5</a>. Chapter W: MIDI Pitch Wheel ...............................<a href="#page-71">71</a>
<a href="#appendix-A.6">A.6</a>. Chapter N: MIDI NoteOff and NoteOn ........................<a href="#page-71">71</a>
<a href="#appendix-A.6.1">A.6.1</a>. Header Structure ...................................<a href="#page-73">73</a>
<a href="#appendix-A.6.2">A.6.2</a>. Note Structures ....................................<a href="#page-74">74</a>
<a href="#appendix-A.7">A.7</a>. Chapter E: MIDI Note Command Extras .......................<a href="#page-75">75</a>
<a href="#appendix-A.7.1">A.7.1</a>. Note Log Format ....................................<a href="#page-76">76</a>
<a href="#appendix-A.7.2">A.7.2</a>. Log Inclusion Rules ................................<a href="#page-76">76</a>
<a href="#appendix-A.8">A.8</a>. Chapter T: MIDI Channel Aftertouch ........................<a href="#page-77">77</a>
<a href="#appendix-A.9">A.9</a>. Chapter A: MIDI Poly Aftertouch ...........................<a href="#page-78">78</a>
<a href="#appendix-B">B</a>. The Recovery Journal System Chapters ...........................<a href="#page-79">79</a>
<a href="#appendix-B.1">B.1</a>. System Chapter D: Simple System Commands ..................<a href="#page-79">79</a>
<a href="#appendix-B.1.1">B.1.1</a>. Undefined System Commands ..........................<a href="#page-80">80</a>
<a href="#appendix-B.2">B.2</a>. System Chapter V: Active Sense Command ....................<a href="#page-83">83</a>
<a href="#appendix-B.3">B.3</a>. System Chapter Q: Sequencer State Commands ................<a href="#page-83">83</a>
<a href="#appendix-B.3.1">B.3.1</a>. Non-compliant Sequencers ...........................<a href="#page-85">85</a>
<a href="#appendix-B.4">B.4</a>. System Chapter F: MIDI Time Code Tape Position ............<a href="#page-86">86</a>
<a href="#appendix-B.4.1">B.4.1</a>. Partial Frames .....................................<a href="#page-88">88</a>
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 2]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-3" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<a href="#appendix-B.5">B.5</a>. System Chapter X: System Exclusive ........................<a href="#page-89">89</a>
<a href="#appendix-B.5.1">B.5.1</a>. Chapter Format .....................................<a href="#page-90">90</a>
<a href="#appendix-B.5.2">B.5.2</a>. Log Inclusion Semantics ............................<a href="#page-92">92</a>
<a href="#appendix-B.5.3">B.5.3</a>. TCOUNT and COUNT Fields ............................<a href="#page-95">95</a>
<a href="#appendix-C">C</a>. Session Configuration Tools ....................................<a href="#page-95">95</a>
<a href="#appendix-C.1">C.1</a>. Configuration Tools: Stream Subsetting ....................<a href="#page-97">97</a>
<a href="#appendix-C.2">C.2</a>. Configuration Tools: The Journalling System ..............<a href="#page-101">101</a>
<a href="#appendix-C.2.1">C.2.1</a>. The j_sec Parameter ...............................<a href="#page-102">102</a>
<a href="#appendix-C.2.2">C.2.2</a>. The j_update Parameter ............................<a href="#page-103">103</a>
<a href="#appendix-C.2.2.1">C.2.2.1</a>. The anchor Sending Policy .................<a href="#page-104">104</a>
<a href="#appendix-C.2.2.2">C.2.2.2</a>. The closed-loop Sending Policy ............<a href="#page-104">104</a>
<a href="#appendix-C.2.2.3">C.2.2.3</a>. The open-loop Sending Policy ..............<a href="#page-108">108</a>
<a href="#appendix-C.2.3">C.2.3</a>. Recovery Journal Chapter Inclusion Parameters .....<a href="#page-110">110</a>
<a href="#appendix-C.3">C.3</a>. Configuration Tools: Timestamp Semantics .................<a href="#page-115">115</a>
<a href="#appendix-C.3.1">C.3.1</a>. The comex Algorithm ...............................<a href="#page-115">115</a>
<a href="#appendix-C.3.2">C.3.2</a>. The async Algorithm ...............................<a href="#page-116">116</a>
<a href="#appendix-C.3.3">C.3.3</a>. The buffer Algorithm ..............................<a href="#page-117">117</a>
<a href="#appendix-C.4">C.4</a>. Configuration Tools: Packet Timing Tools .................<a href="#page-118">118</a>
<a href="#appendix-C.4.1">C.4.1</a>. Packet Duration Tools .............................<a href="#page-119">119</a>
<a href="#appendix-C.4.2">C.4.2</a>. The guardtime Parameter ...........................<a href="#page-120">120</a>
<a href="#appendix-C.5">C.5</a>. Configuration Tools: Stream Description ..................<a href="#page-121">121</a>
<a href="#appendix-C.6">C.6</a>. Configuration Tools: MIDI Rendering ......................<a href="#page-128">128</a>
<a href="#appendix-C.6.1">C.6.1</a>. The multimode Parameter ...........................<a href="#page-129">129</a>
<a href="#appendix-C.6.2">C.6.2</a>. Renderer Specification ............................<a href="#page-129">129</a>
<a href="#appendix-C.6.3">C.6.3</a>. Renderer Initialization ...........................<a href="#page-131">131</a>
<a href="#appendix-C.6.4">C.6.4</a>. MIDI Channel Mapping ..............................<a href="#page-133">133</a>
<a href="#appendix-C.6.4.1">C.6.4.1</a>. The smf_info Parameter ....................<a href="#page-134">134</a>
C.6.4.2. The smf_inline, smf_url, and smf_cid
Parameters ................................<a href="#page-136">136</a>
<a href="#appendix-C.6.4.3">C.6.4.3</a>. The chanmask Parameter ....................<a href="#page-136">136</a>
<a href="#appendix-C.6.5">C.6.5</a>. The audio/asc Media Type ..........................<a href="#page-137">137</a>
<a href="#appendix-C.7">C.7</a>. Interoperability .........................................<a href="#page-139">139</a>
<a href="#appendix-C.7.1">C.7.1</a>. MIDI Content Streaming Applications ...............<a href="#page-139">139</a>
<a href="#appendix-C.7.2">C.7.2</a>. MIDI Network Musical Performance Applications .....<a href="#page-142">142</a>
<a href="#appendix-D">D</a>. Parameter Syntax Definitions ..................................<a href="#page-150">150</a>
<a href="#appendix-E">E</a>. A MIDI Overview for Networking Specialists ....................<a href="#page-156">156</a>
<a href="#appendix-E.1">E.1</a>. Commands Types ...........................................<a href="#page-159">159</a>
<a href="#appendix-E.2">E.2</a>. Running Status ...........................................<a href="#page-159">159</a>
<a href="#appendix-E.3">E.3</a>. Command Timing ...........................................<a href="#page-160">160</a>
<a href="#appendix-E.4">E.4</a>. AudioSpecificConfig Templates for MMA Renderers ..........<a href="#page-160">160</a>
References .......................................................<a href="#page-165">165</a>
Normative References .............................................<a href="#page-165">165</a>
Informative References ...........................................<a href="#page-166">166</a>
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 3]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-4" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h2"><a class="selflink" id="section-1" href="#section-1">1</a>. Introduction</span>
The Internet Engineering Task Force (IETF) has developed a set of
focused tools for multimedia networking ([<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]
[<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>] [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]). These tools can be combined in different ways
to support a variety of real-time applications over Internet Protocol
(IP) networks.
For example, a telephony application might use the Session Initiation
Protocol (SIP, [<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>]) to set up a phone call. Call setup would
include negotiations to agree on a common audio codec [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>].
Negotiations would use the Session Description Protocol (SDP,
[<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]) to describe candidate codecs.
After a call is set up, audio data would flow between the parties
using the Real Time Protocol (RTP, [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]) under any applicable
profile (for example, the Audio/Visual Profile (AVP, [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>])).
The tools used in this telephony example (SIP, SDP, RTP) might be
combined in a different way to support a content streaming
application, perhaps in conjunction with other tools, such as the
Real Time Streaming Protocol (RTSP, [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]).
The MIDI (Musical Instrument Digital Interface) command language
[<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] is widely used in musical applications that are analogous to
the examples described above. On stage and in the recording studio,
MIDI is used for the interactive remote control of musical
instruments, an application similar in spirit to telephony. On web
pages, Standard MIDI Files (SMFs, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]) rendered using the General
MIDI standard [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] provide a low-bandwidth substitute for audio
streaming.
This memo is motivated by a simple premise: if MIDI performances
could be sent as RTP streams that are managed by IETF session tools,
a hybridization of the MIDI and IETF application domains may occur.
For example, interoperable MIDI networking may foster network music
performance applications, in which a group of musicians, located at
different physical locations, interact over a network to perform as
they would if they were located in the same room [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>]. As a second
example, the streaming community may begin to use MIDI for low-
bitrate audio coding, perhaps in conjunction with normative sound
synthesis methods [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>].
To enable MIDI applications to use RTP, this memo defines an RTP
payload format and its media type. Sections <a href="#section-2">2</a>-<a href="#section-5">5</a> and Appendices A-B
define the RTP payload format. <a href="#section-6">Section 6</a> and Appendices C-D define
the media types identifying the payload format, the parameters needed
for configuration, and how the parameters are utilized in SDP.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 4]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-5" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<a href="#appendix-C">Appendix C</a> also includes interoperability guidelines for the example
applications described above: network musical performance using SIP
(Appendix C.7.2) and content-streaming using RTSP (Appendix C.7.1).
Another potential application area for RTP MIDI is MIDI networking
for professional audio equipment and electronic musical instruments.
We do not offer interoperability guidelines for this application in
this memo. However, RTP MIDI has been designed with stage and studio
applications in mind, and we expect that efforts to define a stage
and studio framework will rely on RTP MIDI for MIDI transport
services.
Some applications may require MIDI media delivery at a certain
service quality level (latency, jitter, packet loss, etc). RTP
itself does not provide service guarantees. However, applications
may use lower-layer network protocols to configure the quality of the
transport services that RTP uses. These protocols may act to reserve
network resources for RTP flows [<a href="./rfc2205" title=""Resource ReSerVation Protocol (RSVP) -- Version 1 Functional Specification"">RFC2205</a>] or may simply direct RTP
traffic onto a dedicated "media network" in a local installation.
Note that RTP and the MIDI payload format do provide tools that
applications may use to achieve the best possible real-time
performance at a given service level.
This memo normatively defines the syntax and semantics of the MIDI
payload format. However, this memo does not define algorithms for
sending and receiving packets. An ancillary document [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>]
provides informative guidance on algorithms. Supplemental
information may be found in related conference publications [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>]
[<a href="#ref-GRAME" title=""Real Time Musical Events Streaming over Internet"">GRAME</a>].
Throughout this memo, the phrase "native stream" refers to a stream
that uses the rtp-midi media type. The phrase "mpeg4-generic stream"
refers to a stream that uses the mpeg4-generic media type (in mode
rtp-midi) to operate in an MPEG 4 environment [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]. <a href="#section-6">Section 6</a>
describes this distinction in detail.
<span class="h3"><a class="selflink" id="section-1.1" href="#section-1.1">1.1</a>. Terminology</span>
In this document, the key words "MUST", "MUST NOT", "REQUIRED",
"SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY",
and "OPTIONAL" are to be interpreted as described in <a href="https://www.rfc-editor.org/bcp/bcp14">BCP 14</a>, <a href="./rfc2119">RFC 2119</a>
[<a href="./rfc2119" title=""Key words for use in RFCs to Indicate Requirement Levels"">RFC2119</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 5]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-6" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-1.2" href="#section-1.2">1.2</a>. Bitfield Conventions</span>
In this document, the packet bitfields that share a common name often
have identical semantics. As most of these bitfields appear in
Appendices A-B, we define the common bitfield names in <a href="#appendix-A.1">Appendix A.1</a>.
However, a few of these common names also appear in the main text of
this document. For convenience, we list these definitions below:
o R flag bit. R flag bits are reserved for future use. Senders
MUST set R bits to 0. Receivers MUST ignore R bit values.
o LENGTH field. All fields named LENGTH (as distinct from LEN)
code the number of octets in the structure that contains it,
including the header it resides in and all hierarchical levels
below it. If a structure contains a LENGTH field, a receiver
MUST use the LENGTH field value to advance past the structure
during parsing, rather than use knowledge about the internal
format of the structure.
<span class="h2"><a class="selflink" id="section-2" href="#section-2">2</a>. Packet Format</span>
In this section, we introduce the format of RTP MIDI packets. The
description includes some background information on RTP, for the
benefit of MIDI implementors new to IETF tools. Implementors should
consult [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] for an authoritative description of RTP.
This memo assumes that the reader is familiar with MIDI syntax and
semantics. <a href="#appendix-E">Appendix E</a> provides a MIDI overview, at a level of detail
sufficient to understand most of this memo. Implementors should
consult [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] for an authoritative description of MIDI.
The MIDI payload format maps a MIDI command stream (16 voice channels
+ systems) onto an RTP stream. An RTP media stream is a sequence of
logical packets that share a common format. Each packet consists of
two parts: the RTP header and the MIDI payload. Figure 1 shows this
format (vertical space delineates the header and payload).
We describe RTP packets as "logical" packets to highlight the fact
that RTP itself is not a network-layer protocol. Instead, RTP
packets are mapped onto network protocols (such as unicast UDP,
multicast UDP, or TCP) by an application [<a href="#ref-ALF" title=""Architectural considerations for a new generation of protocols"">ALF</a>]. The interleaved mode
of the Real Time Streaming Protocol (RTSP, [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]) is an example
of an RTP mapping to TCP transport, as is [<a href="./rfc4571" title=""Framing Real-time Transport Protocol (RTP) and RTP Control Protocol (RTCP) Packets over Connection- Oriented Transport"">RFC4571</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 6]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-7" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-2.1" href="#section-2.1">2.1</a>. RTP Header</span>
[<a id="ref-RFC3550">RFC3550</a>] provides a complete description of the RTP header fields.
In this section, we clarify the role of a few RTP header fields for
MIDI applications. All fields are coded in network byte order (big-
endian).
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| V |P|X| CC |M| PT | Sequence number |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Timestamp |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| SSRC |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| MIDI command section ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Journal section ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 1 -- Packet format
The behavior of the 1-bit M field depends on the media type of the
stream. For native streams, the M bit MUST be set to 1 if the MIDI
command section has a non-zero LEN field, and MUST be set to 0
otherwise. For mpeg4-generic streams, the M bit MUST be set to 1 for
all packets (to conform to [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]).
In an RTP MIDI stream, the 16-bit sequence number field is
initialized to a randomly chosen value and is incremented by one
(modulo 2^16) for each packet sent in the stream. A related
quantity, the 32-bit extended packet sequence number, may be computed
by tracking rollovers of the 16-bit sequence number. Note that
different receivers of the same stream may compute different extended
packet sequence numbers, depending on when the receiver joined the
session.
The 32-bit timestamp field sets the base timestamp value for the
packet. The payload codes MIDI command timing relative to this
value. The timestamp units are set by the clock rate parameter. For
example, if the clock rate has a value of 44100 Hz, two packets whose
base timestamp values differ by 2 seconds have RTP timestamp fields
that differ by 88200.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 7]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-8" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Note that the clock rate parameter is not encoded within each RTP
MIDI packet. A receiver of an RTP MIDI stream becomes aware of the
clock rate as part of the session setup process. For example, if a
session management tool uses the Session Description Protocol (SDP,
[<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]) to describe a media session, the clock rate parameter is
set using the rtpmap attribute. We show examples of session setup in
<a href="#section-6">Section 6</a>.
For RTP MIDI streams destined to be rendered into audio, the clock
rate SHOULD be an audio sample rate of 32 KHz or higher. This
recommendation is due to the sensitivity of human musical perception
to small timing errors in musical note sequences, and due to the
timbral changes that occur when two near-simultaneous MIDI NoteOns
are rendered with a different timing than that desired by the content
author due to clock rate quantization. RTP MIDI streams that are not
destined for audio rendering (such as MIDI streams that control stage
lighting) MAY use a lower clock rate but SHOULD use a clock rate high
enough to avoid timing artifacts in the application.
For RTP MIDI streams destined to be rendered into audio, the clock
rate SHOULD be chosen from rates in common use in professional audio
applications or in consumer audio distribution. At the time of this
writing, these rates include 32 KHz, 44.1 KHz, 48 KHz, 64 KHz, 88.2
KHz, 96 KHz, 176.4 KHz, and 192 KHz. If the RTP MIDI session is a
part of a synchronized media session that includes another (non-MIDI)
RTP audio stream with a clock rate of 32 KHz or higher, the RTP MIDI
stream SHOULD use a clock rate that matches the clock rate of the
other audio stream. However, if the RTP MIDI stream is destined to
be rendered into audio, the RTP MIDI stream SHOULD NOT use a clock
rate lower than 32 KHz, even if this second stream has a clock rate
less than 32 KHz.
Timestamps of consecutive packets do not necessarily increment at a
fixed rate, because RTP MIDI packets are not necessarily sent at a
fixed rate. The degree of packet transmission regularity reflects
the underlying application dynamics. Interactive applications may
vary the packet sending rate to track the gestural rate of a human
performer, whereas content-streaming applications may send packets at
a fixed rate.
Therefore, the timestamps for two sequential RTP packets may be
identical, or the second packet may have a timestamp arbitrarily
larger than the first packet (modulo 2^32). <a href="#section-3">Section 3</a> places
additional restrictions on the RTP timestamps for two sequential RTP
packets, as does the guardtime parameter (Appendix C.4.2).
We use the term "media time" to denote the temporal duration of the
media coded by an RTP packet. The media time coded by a packet is
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 8]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-9" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
computed by subtracting the last command timestamp in the MIDI
command section from the RTP timestamp (modulo 2^32). If the MIDI
list of the MIDI command section of a packet is empty, the media time
coded by the packet is 0 ms. <a href="#appendix-C.4.1">Appendix C.4.1</a> discusses media time
issues in detail.
We now define RTP session semantics, in the context of sessions
specified using the session description protocol [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]. A
session description media line ("m=") specifies an RTP session. An
RTP session has an independent space of 2^32 synchronization sources.
Synchronization source identifiers are coded in the SSRC header field
of RTP session packets. The payload types that may appear in the PT
header field of RTP session packets are listed at the end of the
media line.
Several RTP MIDI streams may appear in an RTP session. Each stream
is distinguished by a unique SSRC value and has a unique sequence
number and RTP timestamp space. Multiple streams in the RTP session
may be sent by a single party. Multiple parties may send streams in
the RTP session. An RTP MIDI stream encodes data for a single MIDI
command name space (16 voice channels + Systems).
Streams in an RTP session may use different payload types, or they
may use the same payload type. However, each party may send, at
most, one RTP MIDI stream for each payload type mapped to an RTP MIDI
payload format in an RTP session. Recall that dynamic binding of
payload type numbers in [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>] lets a party map many payload type
numbers to the RTP MIDI payload format; thus a party may send many
RTP MIDI streams in a single RTP session. Pairs of streams (unicast
or multicast) that communicate between two parties in an RTP session
and that share a payload type have the same association as a MIDI
cable pair that cross-connects two devices in a MIDI 1.0 DIN network.
The RTP session architecture described above is efficient in its use
of network ports, as one RTP session (using a port pair per party)
supports the transport of many MIDI name spaces (16 MIDI channels +
systems). We define tools for grouping and labelling MIDI name
spaces across streams and sessions in <a href="#appendix-C.5">Appendix C.5</a> of this memo.
The RTP header timestamps for each stream in an RTP session have
separately and randomly chosen initialization values. Receivers use
the timing fields encoded in the RTP control protocol (RTCP,
[<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]) sender reports to synchronize the streams sent by a party.
The SSRC values for each stream in an RTP session are also separately
and randomly chosen, as described in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]. Receivers use the
CNAME field encoded in RTCP sender reports to verify that streams
were sent by the same party, and to detect SSRC collisions, as
described in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 9]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-10" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In some applications, a receiver renders MIDI commands into audio (or
into control actions, such as the rewind of a tape deck or the
dimming of stage lights). In other applications, a receiver presents
a MIDI stream to software programs via an Application Programmer
Interface (API). <a href="#appendix-C.6">Appendix C.6</a> defines session configuration tools to
specify what receivers should do with a MIDI command stream.
If a multimedia session uses different RTP MIDI streams to send
different classes of media, the streams MUST be sent over different
RTP sessions. For example, if a multimedia session uses one MIDI
stream for audio and a second MIDI stream to control a lighting
system, the audio and lighting streams MUST be sent over different
RTP sessions, each with its own media line.
Session description tools defined in <a href="#appendix-C.5">Appendix C.5</a> let a sending party
split a single MIDI name space (16 voice channels + systems) over
several RTP MIDI streams. Split transport of a MIDI command stream
is a delicate task, because correct command stream reconstruction by
a receiver depends on exact timing synchronization across the
streams.
To support split name spaces, we define the following requirements:
o A party MUST NOT send several RTP MIDI streams that share a MIDI
name space in the same RTP session. Instead, each stream MUST
be sent from a different RTP session.
o If several RTP MIDI streams sent by a party share a MIDI name
space, all streams MUST use the same SSRC value and MUST use the
same randomly chosen RTP timestamp initialization value.
These rules let a receiver identify streams that share a MIDI name
space (by matching SSRC values) and also let a receiver accurately
reconstruct the source MIDI command stream (by using RTP timestamps
to interleave commands from the two streams). Care MUST be taken by
senders to ensure that SSRC changes due to collisions are reflected
in both streams. Receivers MUST regularly examine the RTCP CNAME
fields associated with the linked streams, to ensure that the assumed
link is legitimate and not the result of an SSRC collision by another
sender.
Except for the special cases described above, a party may send many
RTP MIDI streams in the same session. However, it is sometimes
advantageous for two RTP MIDI streams to be sent over different RTP
sessions. For example, two streams may need different values for RTP
session-level attributes (such as the sendonly and recvonly
attributes). As a second example, two RTP sessions may be needed to
send two unicast streams in a multimedia session that originate on
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 10]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-11" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
different computers (with different IP numbers). Two RTP sessions
are needed in this case because transport addresses are specified on
the RTP-session or multimedia-session level, not on a payload type
level.
On a final note, in some uses of MIDI, parties send bidirectional
traffic to conduct transactions (such as file exchange). These
commands were designed to work over MIDI 1.0 DIN cable networks may
be configured in a multicast topology, which use pure "party-line"
signalling. Thus, if a multimedia session ensures a multicast
connection between all parties, bidirectional MIDI commands will work
without additional support from the RTP MIDI payload format.
<span class="h3"><a class="selflink" id="section-2.2" href="#section-2.2">2.2</a>. MIDI Payload</span>
The payload (Figure 1) MUST begin with the MIDI command section. The
MIDI command section codes a (possibly empty) list of timestamped
MIDI commands, and provides the essential service of the payload
format.
The payload MAY also contain a journal section. The journal section
provides resiliency by coding the recent history of the stream. A
flag in the MIDI command section codes the presence of a journal
section in the payload.
<a href="#section-3">Section 3</a> defines the MIDI command section. Sections <a href="#section-4">4</a>-<a href="#section-5">5</a> and
Appendices A-B define the recovery journal, the default format for
the journal section. Here, we describe how these payload sections
operate in a stream in an RTP session.
The journalling method for a stream is set at the start of a session
and MUST NOT be changed thereafter. A stream may be set to use the
recovery journal, to use an alternative journal format (none are
defined in this memo), or not to use a journal.
The default journalling method of a stream is inferred from its
transport type. Streams that use unreliable transport (such as UDP)
default to using the recovery journal. Streams that use reliable
transport (such as TCP) default to not using a journal. <a href="#appendix-C.2.1">Appendix</a>
<a href="#appendix-C.2.1">C.2.1</a> defines session configuration tools for overriding these
defaults. For all types of transport, a sender MUST transmit an RTP
packet stream with consecutive sequence numbers (modulo 2^16).
If a stream uses the recovery journal, every payload in the stream
MUST include a journal section. If a stream does not use
journalling, a journal section MUST NOT appear in a stream payload.
If a stream uses an alternative journal format, the specification for
the journal format defines an inclusion policy.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 11]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-12" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If a stream is sent over UDP transport, the Maximum Transmission Unit
(MTU) of the underlying network limits the practical size of the
payload section (for example, an Ethernet MTU is 1500 octets), for
applications where predictable and minimal packet transmission
latency is critical. A sender SHOULD NOT create RTP MIDI UDP packets
whose size exceeds the MTU of the underlying network. Instead, the
sender SHOULD take steps to keep the maximum packet size under the
MTU limit.
These steps may take many forms. The default closed-loop recovery
journal sending policy (defined in <a href="#appendix-C.2.2.2">Appendix C.2.2.2</a>) uses RTP control
protocol (RTCP, [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]) feedback to manage the RTP MIDI packet
size. In addition, <a href="#section-3.2">Section 3.2</a> and <a href="#appendix-B.5.2">Appendix B.5.2</a> provide specific
tools for managing the size of packets that code MIDI System
Exclusive (0xF0) commands. <a href="#appendix-C.5">Appendix C.5</a> defines session
configuration tools that may be used to split a dense MIDI name space
into several UDP streams (each sent in a different RTP session, per
<a href="#section-2.1">Section 2.1</a>) so that the payload fits comfortably into an MTU.
Another option is to use TCP. <a href="./rfc4696#section-4.3">Section 4.3 of [RFC4696]</a> provides
non-normative advice for packet size management.
<span class="h2"><a class="selflink" id="section-3" href="#section-3">3</a>. MIDI Command Section</span>
Figure 2 shows the format of the MIDI command section.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|B|J|Z|P|LEN... | MIDI list ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 2 -- MIDI command section
The MIDI command section begins with a variable-length header.
The header field LEN codes the number of octets in the MIDI list that
follow the header. If the header flag B is 0, the header is one
octet long, and LEN is a 4-bit field, supporting a maximum MIDI list
length of 15 octets.
If B is 1, the header is two octets long, and LEN is a 12-bit field,
supporting a maximum MIDI list length of 4095 octets. LEN is coded
in network byte order (big-endian): the 4 bits of LEN that appear in
the first header octet code the most significant 4 bits of the 12-bit
LEN value.
A LEN value of 0 is legal, and it codes an empty MIDI list.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 12]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-13" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If the J header bit is set to 1, a journal section MUST appear after
the MIDI command section in the payload. If the J header bit is set
to 0, the payload MUST NOT contain a journal section.
We define the semantics of the P header bit in <a href="#section-3.2">Section 3.2</a>.
If the LEN header field is nonzero, the MIDI list has the structure
shown in Figure 3.
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Delta Time 0 (1-4 octets long, or 0 octets if Z = 1) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| MIDI Command 0 (1 or more octets long) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Delta Time 1 (1-4 octets long) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| MIDI Command 1 (1 or more octets long) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Delta Time N (1-4 octets long) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| MIDI Command N (0 or more octets long) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 3 -- MIDI list structure
If the header flag Z is 1, the MIDI list begins with a complete MIDI
command (coded in the MIDI Command 0 field, in Figure 3) preceded by
a delta time (coded in the Delta Time 0 field). If Z is 0, the Delta
Time 0 field is not present in the MIDI list, and the command coded
in the MIDI Command 0 field has an implicit delta time of 0.
The MIDI list structure may also optionally encode a list of N
additional complete MIDI commands, each coded in a MIDI Command K
field. Each additional command MUST be preceded by a Delta Time K
field, which codes the command's delta time. We discuss exceptions
to the "command fields code complete MIDI commands" rule in <a href="#section-3.2">Section</a>
<a href="#section-3.2">3.2</a>.
The final MIDI command field (i.e., the MIDI Command N field, shown
in Figure 3) in the MIDI list MAY be empty. Moreover, a MIDI list
MAY consist a single delta time (encoded in the Delta Time 0 field)
without an associated command (which would have been encoded in the
MIDI Command 0 field). These rules enable MIDI coding features that
are explained in <a href="#section-3.1">Section 3.1</a>. We delay the explanations because an
understanding of RTP MIDI timestamps is necessary to describe the
features.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 13]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-14" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-3.1" href="#section-3.1">3.1</a>. Timestamps</span>
In this section, we describe how RTP MIDI encodes a timestamp for
each MIDI list command. Command timestamps have the same units as
RTP packet header timestamps (described in <a href="#section-2.1">Section 2.1</a> and
[<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]). Recall that RTP timestamps have units of seconds, whose
scaling is set during session configuration (see <a href="#section-6.1">Section 6.1</a> and
[<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]).
As shown in Figure 3, the MIDI list encodes time using a compact
delta-time format. The RTP MIDI delta time syntax is a modified form
of the MIDI File delta time syntax [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. RTP MIDI delta times use
1-4 octet fields to encode 32-bit unsigned integers. Figure 4 shows
the encoded and decoded forms of delta times. Note that delta time
values may be legally encoded in multiple formats; for example, there
are four legal ways to encode the zero delta time (0x00, 0x8000,
0x808000, 0x80808000).
RTP MIDI uses delta times to encode a timestamp for each MIDI
command. The timestamp for MIDI Command K is the summation (modulo
2^32) of the RTP timestamp and decoded delta times 0 through K. This
cumulative coding technique, borrowed from MIDI File delta time
coding, is efficient because it reduces the number of multi-octet
delta times.
All command timestamps in a packet MUST be less than or equal to the
RTP timestamp of the next packet in the stream (modulo 2^32).
This restriction ensures that a particular RTP MIDI packet in a
stream is uniquely responsible for encoding time starting at the
moment after the RTP timestamp encoded in the RTP packet header, and
ending at the moment before the final command timestamp encoded in
the MIDI list. The "moment before" and "moment after" qualifiers
acknowledge the "less than or equal" semantics (as opposed to
"strictly less than") in the sentence above this paragraph.
Note that it is possible to "pad" the end of an RTP MIDI packet with
time that is guaranteed to be void of MIDI commands, by setting the
"Delta Time N" field of the MIDI list to the end of the void time,
and by omitting its corresponding "MIDI Command N" field (a syntactic
construction the preamble of <a href="#section-3">Section 3</a> expressly made legal).
In addition, it is possible to code an RTP MIDI packet to express
that a period of time in the stream is void of MIDI commands. The
RTP timestamp in the header would code the start of the void time.
The MIDI list of this packet would consist of a "Delta Time 0" field
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 14]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-15" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
that coded the end of the void time. No other fields would be
present in the MIDI list (a syntactic construction the preamble of
<a href="#section-3">Section 3</a> also expressly made legal).
By default, a command timestamp indicates the execution time for the
command. The difference between two timestamps indicates the time
delay between the execution of the commands. This difference may be
zero, coding simultaneous execution. In this memo, we refer to this
interpretation of timestamps as "comex" (COMmand EXecution)
semantics. We formally define comex semantics in <a href="#appendix-C.3">Appendix C.3</a>.
The comex interpretation of timestamps works well for transcoding a
Standard MIDI File (SMF) into an RTP MIDI stream, as SMFs code a
timestamp for each MIDI command stored in the file. To transcode an
SMF that uses metric time markers, use the SMF tempo map (encoded in
the SMF as meta-events) to convert metric SMF timestamp units into
seconds-based RTP timestamp units.
The comex interpretation also works well for MIDI hardware
controllers that are coding raw sensor data directly onto an RTP MIDI
stream. Note that this controller design is preferable to a design
that converts raw sensor data into a MIDI 1.0 cable command stream
and then transcodes the stream onto an RTP MIDI stream.
The comex interpretation of timestamps is usually not the best
timestamp interpretation for transcoding a MIDI source that uses
implicit command timing (such as MIDI 1.0 DIN cables) into an RTP
MIDI stream. <a href="#appendix-C.3">Appendix C.3</a> defines alternatives to comex semantics
and describes session configuration tools for selecting the timestamp
interpretation semantics for a stream.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 15]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-16" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
One-Octet Delta Time:
Encoded form: 0ddddddd
Decoded form: 00000000 00000000 00000000 0ddddddd
Two-Octet Delta Time:
Encoded form: 1ccccccc 0ddddddd
Decoded form: 00000000 00000000 00cccccc cddddddd
Three-Octet Delta Time:
Encoded form: 1bbbbbbb 1ccccccc 0ddddddd
Decoded form: 00000000 000bbbbb bbcccccc cddddddd
Four-Octet Delta Time:
Encoded form: 1aaaaaaa 1bbbbbbb 1ccccccc 0ddddddd
Decoded form: 0000aaaa aaabbbbb bbcccccc cddddddd
Figure 4 -- Decoding delta time formats
<span class="h3"><a class="selflink" id="section-3.2" href="#section-3.2">3.2</a>. Command Coding</span>
Each non-empty MIDI Command field in the MIDI list codes one of the
MIDI command types that may legally appear on a MIDI 1.0 DIN cable.
Standard MIDI File meta-events do not fit this definition and MUST
NOT appear in the MIDI list. As a rule, each MIDI Command field
codes a complete command, in the binary command format defined in
[<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. In the remainder of this section, we describe exceptions to
this rule.
The first MIDI channel command in the MIDI list MUST include a status
octet. Running status coding, as defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], MAY be used for
all subsequent MIDI channel commands in the list. As in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>],
System Common and System Exclusive messages (0xF0 ... 0xF7) cancel
the running status state, but System Real-time messages (0xF8 ...
0xFF) do not affect the running status state. All System commands in
the MIDI list MUST include a status octet.
As we note above, the first channel command in the MIDI list MUST
include a status octet. However, the corresponding command in the
original MIDI source data stream might not have a status octet (in
this case, the source would be coding the command using running
status). If the status octet of the first channel command in the
MIDI list does not appear in the source data stream, the P (phantom)
header bit MUST be set to 1. In all other cases, the P bit MUST be
set to 0.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 16]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-17" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Note that the P bit describes the MIDI source data stream, not the
MIDI list encoding; regardless of the state of the P bit, the MIDI
list MUST include the status octet.
As receivers MUST be able to decode running status, sender
implementors should feel free to use running status to improve
bandwidth efficiency. However, senders SHOULD NOT introduce timing
jitter into an existing MIDI command stream through an inappropriate
use or removal of running status coding. This warning primarily
applies to senders whose RTP MIDI streams may be transcoded onto a
MIDI 1.0 DIN cable [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] by the receiver: both the timestamps and
the command coding (running status or not) must comply with the
physical restrictions of implicit time coding over a slow serial
line.
On a MIDI 1.0 DIN cable [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], a System Real-time command may be
embedded inside of another "host" MIDI command. This syntactic
construction is not supported in the payload format: a MIDI Command
field in the MIDI list codes exactly one MIDI command (partially or
completely).
To encode an embedded System Real-time command, senders MUST extract
the command from its host and code it in the MIDI list as a separate
command. The host command and System Real-time command SHOULD appear
in the same MIDI list. The delta time of the System Real-time
command SHOULD result in a command timestamp that encodes the System
Real-time command placement in its original embedded position.
Two methods are provided for encoding MIDI System Exclusive (SysEx)
commands in the MIDI list. A SysEx command may be encoded in a MIDI
Command field verbatim: a 0xF0 octet, followed by an arbitrary number
of data octets, followed by a 0xF7 octet.
Alternatively, a SysEx command may be encoded as multiple segments.
The command is divided into two or more SysEx command segments; each
segment is encoded in its own MIDI Command field in the MIDI list.
The payload format supports segmentation in order to encode SysEx
commands that encode information in the temporal pattern of data
octets. By encoding these commands as a series of segments, each
data octet may be associated with a distinct delta time.
Segmentation also supports the coding of large SysEx commands across
several packets.
To segment a SysEx command, first partition its data octet list into
two or more sublists. The last sublist MAY be empty (i.e., contain
no octets); all other sublists MUST contain at least one data octet.
To complete the segmentation, add the status octets defined in Figure
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 17]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-18" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
5 to the head and tail of the first, last, and any "middle" sublists.
Figure 6 shows example segmentations of a SysEx command.
A sender MAY cancel a segmented SysEx command transmission that is in
progress, by sending the "cancel" sublist shown in Figure 5. A
"cancel" sublist MAY follow a "first" or "middle" sublist in the
transmission, but MUST NOT follow a "last" sublist. The cancel MUST
be empty (thus, 0xF7 0xF4 is the only legal cancel sublist).
The cancellation feature is needed because <a href="#appendix-C.1">Appendix C.1</a> defines
configuration tools that let session parties exclude certain SysEx
commands in the stream. Senders that transcode a MIDI source onto an
RTP MIDI stream under these constraints have the responsibility of
excluding undesired commands from the RTP MIDI stream.
The cancellation feature lets a sender start the transmission of a
command before the MIDI source has sent the entire command. If a
sender determines that the command whose transmission is in progress
should not appear on the RTP stream, it cancels the command. Without
a method for cancelling a SysEx command transmission, senders would
be forced to use a high-latency store-and-forward approach to
transcoding SysEx commands onto RTP MIDI packets, in order to
validate each SysEx command before transmission.
The recommended receiver reaction to a cancellation depends on the
capabilities of the receiver. For example, a sound synthesizer that
is directly parsing RTP MIDI packets and rendering them to audio will
be aware of the fact that SysEx commands may be cancelled in RTP
MIDI. These receivers SHOULD detect a SysEx cancellation in the MIDI
list and act as if they had never received the SysEx command.
As a second example, a synthesizer may be receiving MIDI data from an
RTP MIDI stream via a MIDI DIN cable (or a software API emulation of
a MIDI DIN cable). In this case, an RTP-MIDI-aware system receives
the RTP MIDI stream and transcodes it onto the MIDI DIN cable (or its
emulation). Upon the receipt of the cancel sublist, the RTP-MIDI-
aware transcoder might have already sent the first part of the SysEx
command on the MIDI DIN cable to the receiver.
Unfortunately, the MIDI DIN cable protocol cannot directly code
"cancel SysEx in progress" semantics. However, MIDI DIN cable
receivers begin SysEx processing after the complete command arrives.
The receiver checks to see if it recognizes the command (coded in the
first few octets) and then checks to see if the command is the
correct length. Thus, in practice, a transcoder can cancel a SysEx
command by sending an 0xF7 to (prematurely) end the SysEx command --
the receiver will detect the incorrect command length and discard the
command.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 18]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-19" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<a href="#appendix-C.1">Appendix C.1</a> defines configuration tools that may be used to prohibit
SysEx command cancellation.
The relative ordering of SysEx command segments in a MIDI list must
match the relative ordering of the sublists in the original SysEx
command. By default, commands other than System Real-time MIDI
commands MUST NOT appear between SysEx command segments (Appendix C.1
defines configuration tools to change this default, to let other
commands types appear between segments). If the command segments of
a SysEx command are placed in the MIDI lists of two or more RTP
packets, the segment ordering rules apply to the concatenation of all
affected MIDI lists.
-----------------------------------------------------------
| Sublist Position | Head Status Octet | Tail Status Octet |
|-----------------------------------------------------------|
| first | 0xF0 | 0xF0 |
|-----------------------------------------------------------|
| middle | 0xF7 | 0xF0 |
|-----------------------------------------------------------|
| last | 0xF7 | 0xF7 |
|-----------------------------------------------------------|
| cancel | 0xF7 | 0xF4 |
-----------------------------------------------------------
Figure 5 -- Command segmentation status octets
[<a id="ref-MIDI">MIDI</a>] permits 0xF7 octets that are not part of a (0xF0, 0xF7) pair
to appear on a MIDI 1.0 DIN cable. Unpaired 0xF7 octets have no
semantic meaning in MIDI, apart from cancelling running status.
Unpaired 0xF7 octets MUST NOT appear in the MIDI list of the MIDI
Command section. We impose this restriction to avoid interference
with the command segmentation coding defined in Figure 5.
SysEx commands carried on a MIDI 1.0 DIN cable may use the "dropped
0xF7" construction [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. In this coding method, the 0xF7 octet is
dropped from the end of the SysEx command, and the status octet of
the next MIDI command acts both to terminate the SysEx command and
start the next command. To encode this construction in the payload
format, follow these steps:
o Determine the appropriate delta times for the SysEx command and
the command that follows the SysEx command.
o Insert the "dropped" 0xF7 octet at the end of the SysEx command,
to form the standard SysEx syntax.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 19]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-20" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o Code both commands into the MIDI list using the rules above.
o Replace the 0xF7 octet that terminates the verbatim SysEx
encoding or the last segment of the segmented SysEx encoding
with a 0xF5 octet. This substitution informs the receiver of
the original dropped 0xF7 coding.
[<a id="ref-MIDI">MIDI</a>] reserves the undefined System Common commands 0xF4 and 0xF5
and the undefined System Real-time commands 0xF9 and 0xFD for future
use. By default, undefined commands MUST NOT appear in a MIDI
Command field in the MIDI list, with the exception of the 0xF5 octets
used to code the "dropped 0xF7" construction and the 0xF4 octets used
by SysEx "cancel" sublists.
During session configuration, a stream may be customized to transport
undefined commands (Appendix C.1). For this case, we now define how
senders encode undefined commands in the MIDI list.
An undefined System Real-time command MUST be coded using the System
Real-time rules.
If the undefined System Common commands are put to use in a future
version of [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], the command will begin with an 0xF4 or 0xF5 status
octet, followed by an arbitrary number of data octets (i.e., zero or
more data bytes). To encode these commands, senders MUST terminate
the command with an 0xF7 octet and place the modified command into
the MIDI Command field.
Unfortunately, non-compliant uses of the undefined System Common
commands may appear in MIDI implementations. To model these
commands, we assume that the command begins with an 0xF4 or 0xF5
status octet, followed by zero or more data octets, followed by zero
or more trailing 0xF7 status octets. To encode the command, senders
MUST first remove all trailing 0xF7 status octets from the command.
Then, senders MUST terminate the command with an 0xF7 octet and place
the modified command into the MIDI Command field.
Note that we include the trailing octets in our model as a cautionary
measure: if such commands appeared in a non-compliant use of an
undefined System Common command, an RTP MIDI encoding of the command
that did not remove trailing octets could be mistaken for an encoding
of "middle" or "last" sublist of a segmented SysEx commands (Figure
5) under certain packet loss conditions.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 20]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-21" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Original SysEx command:
0xF0 0x01 0x02 0x03 0x04 0x05 0x06 0x07 0x08 0xF7
A two-segment segmentation:
0xF0 0x01 0x02 0x03 0x04 0xF0
0xF7 0x05 0x06 0x07 0x08 0xF7
A different two-segment segmentation:
0xF0 0x01 0xF0
0xF7 0x02 0x03 0x04 0x05 0x06 0x07 0x08 0xF7
A three-segment segmentation:
0xF0 0x01 0x02 0xF0
0xF7 0x03 0x04 0xF0
0xF7 0x05 0x06 0x07 0x08 0xF7
The segmentation with the largest number of segments:
0xF0 0x01 0xF0
0xF7 0x02 0xF0
0xF7 0x03 0xF0
0xF7 0x04 0xF0
0xF7 0x05 0xF0
0xF7 0x06 0xF0
0xF7 0x07 0xF0
0xF7 0x08 0xF0
0xF7 0xF7
Figure 6 -- Example segmentations
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 21]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-22" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h2"><a class="selflink" id="section-4" href="#section-4">4</a>. The Recovery Journal System</span>
The recovery journal is the default resiliency tool for unreliable
transport. In this section, we normatively define the roles that
senders and receivers play in the recovery journal system.
MIDI is a fragile code. A single lost command in a MIDI command
stream may produce an artifact in the rendered performance. We
normatively classify rendering artifacts into two categories:
o Transient artifacts. Transient artifacts produce immediate but
short-term glitches in the performance. For example, a lost
NoteOn (0x9) command produces a transient artifact: one note
fails to play, but the artifact does not extend beyond the end of
that note.
o Indefinite artifacts. Indefinite artifacts produce long-lasting
errors in the rendered performance. For example, a lost NoteOff
(0x8) command may produce an indefinite artifact: the note that
should have been ended by the lost NoteOff command may sustain
indefinitely. As a second example, the loss of a Control Change
(0xB) command for controller number 7 (Channel Volume) may
produce an indefinite artifact: after the loss, all notes on the
channel may play too softly or too loudly.
The purpose of the recovery journal system is to satisfy the recovery
journal mandate: the MIDI performance rendered from an RTP MIDI
stream sent over unreliable transport MUST NOT contain indefinite
artifacts.
The recovery journal system does not use packet retransmission to
satisfy this mandate. Instead, each packet includes a special
section, called the recovery journal.
The recovery journal codes the history of the stream, back to an
earlier packet called the checkpoint packet. The range of coverage
for the journal is called the checkpoint history. The recovery
journal codes the information necessary to recover from the loss of
an arbitrary number of packets in the checkpoint history. <a href="#appendix-A.1">Appendix</a>
<a href="#appendix-A.1">A.1</a> normatively defines the checkpoint packet and the checkpoint
history.
When a receiver detects a packet loss, it compares its own knowledge
about the history of the stream with the history information coded in
the recovery journal of the packet that ends the loss event. By
noting the differences in these two versions of the past, a receiver
is able to transform all indefinite artifacts in the rendered
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 22]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-23" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
performance into transient artifacts, by executing MIDI commands to
repair the stream.
We now state the normative role for senders in the recovery journal
system.
Senders prepare a recovery journal for every packet in the stream.
In doing so, senders choose the checkpoint packet identity for the
journal. Senders make this choice by applying a sending policy.
<a href="#appendix-C.2.2">Appendix C.2.2</a> normatively defines three sending policies: "closed-
loop", "open-loop", and "anchor".
By default, senders MUST use the closed-loop sending policy. If the
session description overrides this default policy, by using the
parameter j_update defined in <a href="#appendix-C.2.2">Appendix C.2.2</a>, senders MUST use the
specified policy.
After choosing the checkpoint packet identity for a packet, the
sender creates the recovery journal. By default, this journal MUST
conform to the normative semantics in <a href="#section-5">Section 5</a> and Appendices A-B in
this memo. In <a href="#appendix-C.2.3">Appendix C.2.3</a>, we define parameters that modify the
normative semantics for recovery journals. If the session
description uses these parameters, the journal created by the sender
MUST conform to the modified semantics.
Next, we state the normative role for receivers in the recovery
journal system.
A receiver MUST detect each RTP sequence number break in a stream.
If the sequence number break is due to a packet loss event (as
defined in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]), the receiver MUST repair all indefinite
artifacts in the rendered MIDI performance caused by the loss. If
the sequence number break is due to an out-of-order packet (as
defined in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]), the receiver MUST NOT take actions that
introduce indefinite artifacts (ignoring the out-of-order packet is a
safe option).
Receivers take special precautions when entering or exiting a
session. A receiver MUST process the first received packet in a
stream as if it were a packet that ends a loss event. Upon exiting a
session, a receiver MUST ensure that the rendered MIDI performance
does not end with indefinite artifacts.
Receivers are under no obligation to perform indefinite artifact
repairs at the moment a packet arrives. A receiver that uses a
playout buffer may choose to wait until the moment of rendering
before processing the recovery journal, as the "lost" packet may be a
late packet that arrives in time to use.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 23]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-24" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Next, we state the normative role for the creator of the session
description in the recovery journal system. Depending on the
application, the sender, the receivers, and other parties may take
part in creating or approving the session description.
A session description that specifies the default closed-loop sending
policy and the default recovery journal semantics satisfies the
recovery journal mandate. However, these default behaviors may not
be appropriate for all sessions. If the creators of a session
description use the parameters defined in <a href="#appendix-C.2">Appendix C.2</a> to override
these defaults, the creators MUST ensure that the parameters define a
system that satisfies the recovery journal mandate.
Finally, we note that this memo does not specify sender or receiver
recovery journal algorithms. Implementations are free to use any
algorithm that conforms to the requirements in this section. The
non-normative [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>] discusses sender and receiver algorithm
design.
<span class="h2"><a class="selflink" id="section-5" href="#section-5">5</a>. Recovery Journal Format</span>
This section introduces the structure of the recovery journal and
defines the bitfields of recovery journal headers. Appendices A-B
complete the bitfield definition of the recovery journal.
The recovery journal has a three-level structure:
o Top-level header.
o Channel and system journal headers. These headers encode
recovery information for a single voice channel (channel journal)
or for all systems commands (system journal).
o Chapters. Chapters describe recovery information for a single
MIDI command type.
Figure 7 shows the top-level structure of the recovery journal. The
recovery journals consists of a 3-octet header, followed by an
optional system journal (labeled S-journal in Figure 7) and an
optional list of channel journals. Figure 8 shows the recovery
journal header format.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 24]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-25" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Recovery journal header | S-journal ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Channel journals ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 7 -- Top-level recovery journal format
0 1 2
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|Y|A|H|TOTCHAN| Checkpoint Packet Seqnum |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 8 -- Recovery journal header
If the Y header bit is set to 1, the system journal appears in the
recovery journal, directly following the recovery journal header.
If the A header bit is set to 1, the recovery journal ends with a
list of (TOTCHAN + 1) channel journals (the 4-bit TOTCHAN header
field is interpreted as an unsigned integer).
A MIDI channel MAY be represented by (at most) one channel journal in
a recovery journal. Channel journals MUST appear in the recovery
journal in ascending channel-number order.
If A and Y are both zero, the recovery journal only contains its 3-
octet header and is considered to be an "empty" journal.
The S (single-packet loss) bit appears in most recovery journal
structures, including the recovery journal header. The S bit helps
receivers efficiently parse the recovery journal in the common case
of the loss of a single packet. <a href="#appendix-A.1">Appendix A.1</a> defines S bit
semantics.
The H bit indicates if MIDI channels in the stream have been
configured to use the enhanced Chapter C encoding (Appendix A.3.3).
By default, the payload format does not use enhanced Chapter C
encoding. In this default case, the H bit MUST be set to 0 for all
packets in the stream.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 25]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-26" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If the stream has been configured so that controller numbers for one
or more MIDI channels use enhanced Chapter C encoding, the H bit MUST
be set to 1 in all packets in the stream. In <a href="#appendix-C.2.3">Appendix C.2.3</a>, we show
how to configure a stream to use enhanced Chapter C encoding.
The 16-bit Checkpoint Packet Seqnum header field codes the sequence
number of the checkpoint packet for this journal, in network byte
order (big-endian). The choice of the checkpoint packet sets the
depth of the checkpoint history for the journal (defined in <a href="#appendix-A.1">Appendix</a>
<a href="#appendix-A.1">A.1</a>).
Receivers may use the Checkpoint Packet Seqnum field of the packet
that ends a loss event to verify that the journal checkpoint history
covers the entire loss event. The checkpoint history covers the loss
event if the Checkpoint Packet Seqnum field is less than or equal to
one plus the highest RTP sequence number previously received on the
stream (modulo 2^16).
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| CHAN |H| LENGTH |P|C|M|W|N|E|T|A| Chapters ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 9 -- Channel journal format
Figure 9 shows the structure of a channel journal: a 3-octet header,
followed by a list of leaf elements called channel chapters. A
channel journal encodes information about MIDI commands on the MIDI
channel coded by the 4-bit CHAN header field. Note that CHAN uses
the same bit encoding as the channel nibble in MIDI Channel Messages
(the cccc field in Figure E.1 of <a href="#appendix-E">Appendix E</a>).
The 10-bit LENGTH field codes the length of the channel journal. The
semantics for LENGTH fields are uniform throughout the recovery
journal, and are defined in <a href="#appendix-A.1">Appendix A.1</a>.
The third octet of the channel journal header is the Table of
Contents (TOC) of the channel journal. The TOC is a set of bits that
encode the presence of a chapter in the journal. Each chapter
contains information about a certain class of MIDI channel command:
o Chapter P: MIDI Program Change (0xC)
o Chapter C: MIDI Control Change (0xB)
o Chapter M: MIDI Parameter System (part of 0xB)
o Chapter W: MIDI Pitch Wheel (0xE)
o Chapter N: MIDI NoteOff (0x8), NoteOn (0x9)
o Chapter E: MIDI Note Command Extras (0x8, 0x9)
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 26]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-27" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o Chapter T: MIDI Channel Aftertouch (0xD)
o Chapter A: MIDI Poly Aftertouch (0xA)
Chapters appear in a list following the header, in order of their
appearance in the TOC. Appendices A.2-9 describe the bitfield format
for each chapter, and define the conditions under which a chapter
type MUST appear in the recovery journal. If any chapter types are
required for a channel, an associated channel journal MUST appear in
the recovery journal.
The H bit indicates if controller numbers on a MIDI channel have been
configured to use the enhanced Chapter C encoding (Appendix A.3.3).
By default, controller numbers on a MIDI channel do not use enhanced
Chapter C encoding. In this default case, the H bit MUST be set to 0
for all channel journal headers for the channel in the recovery
journal, for all packets in the stream.
However, if at least one controller number for a MIDI channel has
been configured to use the enhanced Chapter C encoding, the H bit for
its channel journal MUST be set to 1, for all packets in the stream.
In <a href="#appendix-C.2.3">Appendix C.2.3</a>, we show how to configure a controller number to
use enhanced Chapter C encoding.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|D|V|Q|F|X| LENGTH | System chapters ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 10 -- System journal format
Figure 10 shows the structure of the system journal: a 2-octet
header, followed by a list of system chapters. Each chapter codes
information about a specific class of MIDI Systems command:
o Chapter D: Song Select (0xF3), Tune Request (0xF6), Reset
(0xFF), undefined System commands (0xF4, 0xF5, 0xF9,
0xFD)
o Chapter V: Active Sense (0xFE)
o Chapter Q: Sequencer State (0xF2, 0xF8, 0xF9, 0xFA, 0xFB, 0xFC)
o Chapter F: MTC Tape Position (0xF1, 0xF0 0x7F 0xcc 0x01 0x01)
o Chapter X: System Exclusive (all other 0xF0)
The 10-bit LENGTH field codes the size of the system journal and
conforms to semantics described in <a href="#appendix-A.1">Appendix A.1</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 27]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-28" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The D, V, Q, F, and X header bits form a Table of Contents (TOC) for
the system journal. A TOC bit that is set to 1 codes the presence of
a chapter in the journal. Chapters appear in a list following the
header, in the order of their appearance in the TOC.
<a href="#appendix-B">Appendix B</a> describes the bitfield format for the system chapters and
defines the conditions under which a chapter type MUST appear in the
recovery journal. If any system chapter type is required to appear
in the recovery journal, the system journal MUST appear in the
recovery journal.
<span class="h2"><a class="selflink" id="section-6" href="#section-6">6</a>. Session Description Protocol</span>
RTP does not perform session management. Instead, RTP works together
with session management tools, such as the Session Initiation
Protocol (SIP, [<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>]) and the Real Time Streaming Protocol (RTSP,
[<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]).
RTP payload formats define media type parameters for use in session
management (for example, this memo defines "rtp-midi" as the media
type for native RTP MIDI streams).
In most cases, session management tools use the media type parameters
via another standard, the Session Description Protocol (SDP,
[<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]).
SDP is a textual format for specifying session descriptions. Session
descriptions specify the network transport and media encoding for RTP
sessions. Session management tools coordinate the exchange of
session descriptions between participants ("parties").
Some session management tools use SDP to negotiate details of media
transport (network addresses, ports, etc.). We refer to this use of
SDP as "negotiated usage". One example of negotiated usage is the
Offer/Answer protocol ([<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>] and <a href="#appendix-C.7.2">Appendix C.7.2</a> in this memo) as
used by SIP.
Other session management tools use SDP to declare the media encoding
for the session but use other techniques to negotiate network
transport. We refer to this use of SDP as "declarative usage". One
example of declarative usage is RTSP ([<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>] and <a href="#appendix-C.7.1">Appendix C.7.1</a> in
this memo).
Below, we show session description examples for native (<a href="#section-6.1">Section 6.1</a>)
and mpeg4-generic (<a href="#section-6.2">Section 6.2</a>) streams. In <a href="#section-6.3">Section 6.3</a>, we
introduce session configuration tools that may be used to customize
streams.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 28]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-29" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-6.1" href="#section-6.1">6.1</a>. Session Descriptions for Native Streams</span>
The session description below defines a unicast UDP RTP session (via
a media ("m=") line) whose sole payload type (96) is mapped to a
minimal native RTP MIDI stream.
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 rtp-midi/44100
The rtpmap attribute line uses the "rtp-midi" media type to specify
an RTP MIDI native stream. The clock rate specified on the rtpmap
line (in the example above, 44100 Hz) sets the scaling for the RTP
timestamp header field (see <a href="#section-2.1">Section 2.1</a>, and also [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]).
Note that this document does not specify a default clock rate value
for RTP MIDI. When RTP MIDI is used with SDP, parties MUST use the
rtpmap line to communicate the clock rate. Guidance for selecting
the RTP MIDI clock rate value appears in <a href="#section-2.1">Section 2.1</a>.
We consider the RTP MIDI stream shown above to be "minimal" because
the session description does not customize the stream with
parameters. Without such customization, a native RTP MIDI stream has
these characteristics:
1. If the stream uses unreliable transport (unicast UDP, multicast
UDP, etc.), the recovery journal system is in use, and the RTP
payload contains both the MIDI command section and the journal
section. If the stream uses reliable transport (such as TCP),
the stream does not use journalling, and the payload contains
only the MIDI command section (<a href="#section-2.2">Section 2.2</a>).
2. If the stream uses the recovery journal system, the recovery
journal system uses the default sending policy and the default
journal semantics (<a href="#section-4">Section 4</a>).
3. In the MIDI command section of the payload, command timestamps
use the default "comex" semantics (<a href="#section-3">Section 3</a>).
4. The recommended temporal duration ("media time") of an RTP
packet ranges from 0 to 200 ms, and the RTP timestamp difference
between sequential packets in the stream may be arbitrarily
large (<a href="#section-2.1">Section 2.1</a>).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 29]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-30" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
5. If more than one minimal rtp-midi stream appears in a session,
the MIDI name spaces for these streams are independent: channel
1 in the first stream does not reference the same MIDI channel
as channel 1 in the second stream (see <a href="#appendix-C.5">Appendix C.5</a> for a
discussion of the independence of minimal rtp-midi streams).
6. The rendering method for the stream is not specified. What the
receiver "does" with a minimal native MIDI stream is "out of
scope" of this memo. For example, in content creation
environments, a user may manually configure client software to
render the stream with a specific software package.
As in standard in RTP, RTP sessions managed by SIP are sendrecv by
default (parties send and receive MIDI), and RTP sessions managed by
RTSP are recvonly by default (server sends and client receives).
In sendrecv RTP MIDI sessions for the session description shown
above, the 16 voice channel + systems MIDI name space is unique for
each sender. Thus, in a two-party session, the voice channel 0 sent
by one party is distinct from the voice channel 0 sent by the other
party.
This behavior corresponds to what occurs when two MIDI 1.0 DIN
devices are cross-connected with two MIDI cables (one cable routing
MIDI Out from the first device into MIDI In of the second device, a
second cable routing MIDI In from the first device into MIDI Out of
the second device). We define this "association" formally in <a href="#section-2.1">Section</a>
<a href="#section-2.1">2.1</a>.
MIDI 1.0 DIN networks may be configured in a "party-line" multicast
topology. For these networks, the MIDI protocol itself provides
tools for addressing specific devices in transactions on a multicast
network, and for device discovery. Thus, apart from providing a 1-
to-many forward path and a many-to-1 reverse path, IETF protocols do
not need to provide any special support for MIDI multicast
networking.
<span class="h3"><a class="selflink" id="section-6.2" href="#section-6.2">6.2</a>. Session Descriptions for mpeg4-generic Streams</span>
An mpeg4-generic [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] RTP MIDI stream uses an MPEG 4 Audio
Object Type to render MIDI into audio. Three Audio Object Types
accept MIDI input:
o General MIDI (Audio Object Type ID 15), based on the General MIDI
rendering standard [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
o Wavetable Synthesis (Audio Object Type ID 14), based on the
Downloadable Sounds Level 2 (DLS 2) rendering standard [<a href="#ref-DLS2" title=""The MIDI Downloadable Sounds Specification"">DLS2</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 30]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-31" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o Main Synthetic (Audio Object Type ID 13), based on Structured
Audio and the programming language SAOL [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>].
The primary service of an mpeg4-generic stream is to code Access
Units (AUs). We define the mpeg4-generic RTP MIDI AU as the MIDI
payload shown in Figure 1 of <a href="#section-2.1">Section 2.1</a> of this memo: a MIDI command
section optionally followed by a journal section.
Exactly one RTP MIDI AU MUST be mapped to one mpeg4-generic RTP MIDI
packet. The mpeg4-generic options for placing several AUs in an RTP
packet MUST NOT be used with RTP MIDI. The mpeg4-generic options for
fragmenting and interleaving AUs MUST NOT be used with RTP MIDI. The
mpeg4-generic RTP packet payload (Figure 1 in [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]) MUST contain
empty AU Header and Auxiliary sections. These rules yield mpeg4-
generic packets that are structurally identical to native RTP MIDI
packets, an essential property for the correct operation of the
payload format.
The session description that follows defines a unicast UDP RTP
session (via a media ("m=") line) whose sole payload type (96) is
mapped to a minimal mpeg4-generic RTP MIDI stream. This example uses
the General MIDI Audio Object Type under Synthesis Profile @ Level 2.
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; profile-level-id=12;
config=7A0A0000001A4D546864000000060000000100604D54726B0000
000600FF2F000
(The a=fmtp line has been wrapped to fit the page to accommodate memo
formatting restrictions; it comprises a single line in SDP.)
The fmtp attribute line codes the four parameters (streamtype, mode,
profile-level-id, and config) that are required in all mpeg4-generic
session descriptions [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]. For RTP MIDI streams, the streamtype
parameter MUST be set to 5, the "mode" parameter MUST be set to
"rtp-midi", and the "profile-level-id" parameter MUST be set to the
MPEG-4 Profile Level for the stream. For the Synthesis Profile,
legal profile-level-id values are 11, 12, and 13, coding low (11),
medium (12), or high (13) decoder computational complexity, as
defined by MPEG conformance tests.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 31]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-32" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In a minimal RTP MIDI session description, the config value MUST be a
hexadecimal encoding [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] of the AudioSpecificConfig data block
[<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>] for the stream. AudioSpecificConfig encodes the Audio
Object Type for the stream and also encodes initialization data (SAOL
programs, DLS 2 wave tables, etc.). Standard MIDI Files encoded in
AudioSpecificConfig in a minimal session description MUST be ignored
by the receiver.
Receivers determine the rendering algorithm for the session by
interpreting the first 5 bits of AudioSpecificConfig as an unsigned
integer that codes the Audio Object Type. In our example above, the
leading config string nibbles "7A" yield the Audio Object Type 15
(General MIDI). In <a href="#appendix-E.4">Appendix E.4</a>, we derive the config string value
in the session description shown above; the starting point of the
derivation is the MPEG bitstreams defined in [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>] and
[<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>].
We consider the stream to be "minimal" because the session
description does not customize the stream through the use of
parameters, other than the 4 required mpeg4-generic parameters
described above. In <a href="#section-6.1">Section 6.1</a>, we describe the behavior of a
minimal native stream, as a numbered list of characteristics. Items
1-4 on that list also describe the minimal mpeg4-generic stream, but
items 5 and 6 require restatements, as listed below:
5. If more than one minimal mpeg4-generic stream appears in a
session, each stream uses an independent instance of the Audio
Object Type coded in the config parameter value.
6. A minimal mpeg4-generic stream encodes the AudioSpecificConfig
as an inline hexadecimal constant. If a session description is
sent over UDP, it may be impossible to transport large
AudioSpecificConfig blocks within the Maximum Transmission Size
(MTU) of the underlying network (for Ethernet, the MTU is 1500
octets). In some cases, the AudioSpecificConfig block may
exceed the maximum size of the UDP packet itself.
The comments in <a href="#section-6.1">Section 6.1</a> on SIP and RTSP stream directional
defaults, sendrecv MIDI channel usage, and MIDI 1.0 DIN multicast
networks also apply to mpeg4-generic RTP MIDI sessions.
In sendrecv sessions, each party's session description MUST use
identical values for the mpeg4-generic parameters (including the
required streamtype, mode, profile-level-id, and config parameters).
As a consequence, each party uses an identically configured MPEG 4
Audio Object Type to render MIDI commands into audio. The preamble
to <a href="#appendix-C">Appendix C</a> discusses a way to create "virtual sendrecv" sessions
that do not have this restriction.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 32]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-33" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-6.3" href="#section-6.3">6.3</a>. Parameters</span>
This section introduces parameters for session configuration for RTP
MIDI streams. In session descriptions, parameters modify the
semantics of a payload type. Parameters are specified on an fmtp
attribute line. See the session description example in <a href="#section-6.2">Section 6.2</a>
for an example of a fmtp attribute line.
The parameters add features to the minimal streams described in
Sections <a href="#section-6.1">6.1</a>-<a href="#section-2">2</a>, and support several types of services:
o Stream subsetting. By default, all MIDI commands that are legal
to appear on a MIDI 1.0 DIN cable may appear in an RTP MIDI
stream. The cm_unused parameter overrides this default by
prohibiting certain commands from appearing in the stream. The
cm_used parameter is used in conjunction with cm_unused, to
simplify the specification of complex exclusion rules. We
describe cm_unused and cm_used in <a href="#appendix-C.1">Appendix C.1</a>.
o Journal customization. The j_sec and j_update parameters
configure the use of the journal section. The ch_default,
ch_never, and ch_anchor parameters configure the semantics of
the recovery journal chapters. These parameters are described
in <a href="#appendix-C.2">Appendix C.2</a> and override the default stream behaviors 1 and
2, listed in <a href="#section-6.1">Section 6.1</a> and referenced in <a href="#section-6.2">Section 6.2</a>.
o MIDI command timestamp semantics. The tsmode, octpos, mperiod,
and linerate parameters customize the semantics of timestamps in
the MIDI command section. These parameters let RTP MIDI
accurately encode the implicit time coding of MIDI 1.0 DIN
cables. These parameters are described in <a href="#appendix-C.3">Appendix C.3</a> and
override default stream behavior 3, listed in <a href="#section-6.1">Section 6.1</a> and
referenced in <a href="#section-6.2">Section 6.2</a>
o Media time. The rtp_ptime and rtp_maxptime parameters define
the temporal duration ("media time") of an RTP MIDI packet. The
guardtime parameter sets the minimum sending rate of stream
packets. These parameters are described in <a href="#appendix-C.4">Appendix C.4</a> and
override default stream behavior 4, listed in <a href="#section-6.1">Section 6.1</a> and
referenced in <a href="#section-6.2">Section 6.2</a>.
o Stream description. The musicport parameter labels the MIDI
name space of RTP streams in a multimedia session. Musicport is
described in <a href="#appendix-C.5">Appendix C.5</a>. The musicport parameter overrides
default stream behavior 5, in Sections <a href="#section-6.1">6.1</a> and <a href="#section-6.2">6.2</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 33]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-34" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o MIDI rendering. Several parameters specify the MIDI rendering
method of a stream. These parameters are described in <a href="#appendix-C.6">Appendix</a>
<a href="#appendix-C.6">C.6</a> and override default stream behavior 6, in Sections <a href="#section-6.1">6.1</a> and
6.2.
In <a href="#appendix-C.7">Appendix C.7</a>, we specify interoperability guidelines for two RTP
MIDI application areas: content-streaming using RTSP (Appendix C.7.1)
and network musical performance using SIP (Appendix C.7.2).
<span class="h2"><a class="selflink" id="section-7" href="#section-7">7</a>. Extensibility</span>
The payload format defined in this memo exclusively encodes all
commands that may legally appear on a MIDI 1.0 DIN cable.
Many worthy uses of MIDI over RTP do not fall within the narrow scope
of the payload format. For example, the payload format does not
support the direct transport of Standard MIDI File (SMF) meta-event
and metric timing data. As a second example, the payload format does
not define transport tools for user-defined commands (apart from
tools to support System Exclusive commands [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]).
The payload format does not provide an extension mechanism to support
new features of this nature, by design. Instead, we encourage the
development of new payload formats for specialized musical
applications. The IETF session management tools [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>] [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]
support codec negotiation, to facilitate the use of new payload
formats in a backward-compatible way.
However, the payload format does provide several extensibility tools,
which we list below:
o Journalling. As described in <a href="#appendix-C.2">Appendix C.2</a>, new token values for
the j_sec and j_update parameters may be defined in IETF
standards-track documents. This mechanism supports the design
of new journal formats and the definition of new journal sending
policies.
o Rendering. The payload format may be extended to support new
MIDI renderers (Appendix C.6.2). Certain general aspects of the
RTP MIDI rendering process may also be extended, via the
definition of new token values for the render (Appendix C.6) and
smf_info (Appendix C.6.4.1) parameters.
o Undefined commands. [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] reserves 4 MIDI System commands for
future use (0xF4, 0xF5, 0xF9, 0xFD). If updates to [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]
define the reserved commands, IETF standards-track documents may
be defined to provide resiliency support for the commands.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 34]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-35" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Opaque LEGAL fields appear in System Chapter D for this purpose
(Appendix B.1.1).
A final form of extensibility involves the inclusion of the payload
format in framework documents. Framework documents describe how to
combine protocols to form a platform for interoperable applications.
For example, a stage and studio framework might define how to use SIP
[<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>], RTSP [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>], SDP [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>], and RTP [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] to
support media networking for professional audio equipment and
electronic musical instruments.
<span class="h2"><a class="selflink" id="section-8" href="#section-8">8</a>. Congestion Control</span>
The RTP congestion control requirements defined in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] apply to
RTP MIDI sessions, and implementors should carefully read the
congestion control section in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]. As noted in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>], all
transport protocols used on the Internet need to address congestion
control in some way, and RTP is not an exception.
In addition, the congestion control requirements defined in [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>]
applies to RTP MIDI sessions run under applicable profiles. The
basic congestion control requirement defined in [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>] is that RTP
sessions that use UDP transport should monitor packet loss (via RTCP
or other means) to ensure that the RTP stream competes fairly with
TCP flows that share the network.
Finally, RTP MIDI has congestion control issues that are unique for
an audio RTP payload format. In applications such as network musical
performance [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>], the packet rate is linked to the gestural rate of
a human performer. Senders MUST monitor the MIDI command source for
patterns that result in excessive packet rates and take actions
during RTP transcoding to reduce the RTP packet rate. [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>]
offers implementation guidance on this issue.
<span class="h2"><a class="selflink" id="section-9" href="#section-9">9</a>. Security Considerations</span>
Implementors should carefully read the Security Considerations
sections of the RTP [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>], AVP [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>], and other RTP profile
documents, as the issues discussed in these sections directly apply
to RTP MIDI streams. Implementors should also review the Secure
Real-time Transport Protocol (SRTP, [<a href="./rfc3711" title=""The Secure Real-time Transport Protocol (SRTP)"">RFC3711</a>]), an RTP profile that
addresses the security issues discussed in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] and [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>].
Here, we discuss security issues that are unique to the RTP MIDI
payload format.
When using RTP MIDI, authentication of incoming RTP and RTCP packets
is RECOMMENDED. Per-packet authentication may be provided by SRTP or
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 35]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-36" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
by other means. Without the use of authentication, attackers could
forge MIDI commands into an ongoing stream, damaging speakers and
eardrums. An attacker could also craft RTP and RTCP packets to
exploit known bugs in the client and take effective control of a
client machine.
Session management tools (such as SIP [<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>]) SHOULD use
authentication during the transport of all session descriptions
containing RTP MIDI media streams. For SIP, the Security
Considerations section in [<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>] provides an overview of possible
authentication mechanisms. RTP MIDI session descriptions should use
authentication because the session descriptions may code
initialization data using the parameters described in <a href="#appendix-C">Appendix C</a>. If
an attacker inserts bogus initialization data into a session
description, he can corrupt the session or forge an client attack.
Session descriptions may also code renderer initialization data by
reference, via the url (Appendix C.6.3) and smf_url (Appendix
C.6.4.2) parameters. If the coded URL is spoofed, both session and
client are open to attack, even if the session description itself is
authenticated. Therefore, URLs specified in url and smf_url
parameters SHOULD use [<a href="./rfc2818" title=""HTTP Over TLS"">RFC2818</a>].
<a href="#section-2.1">Section 2.1</a> allows streams sent by a party in two RTP sessions to
have the same SSRC value and the same RTP timestamp initialization
value, under certain circumstances. Normally, these values are
randomly chosen for each stream in a session, to make plaintext
guessing harder to do if the payloads are encrypted. Thus, <a href="#section-2.1">Section</a>
<a href="#section-2.1">2.1</a> weakens this aspect of RTP security.
<span class="h2"><a class="selflink" id="section-10" href="#section-10">10</a>. Acknowledgements</span>
We thank the networking, media compression, and computer music
community members who have commented or contributed to the effort,
including Kurt B, Cynthia Bruyns, Steve Casner, Paul Davis, Robin
Davies, Joanne Dow, Tobias Erichsen, Nicolas Falquet, Dominique
Fober, Philippe Gentric, Michael Godfrey, Chris Grigg, Todd Hager,
Michel Jullian, Phil Kerr, Young-Kwon Lim, Jessica Little, Jan van
der Meer, Colin Perkins, Charlie Richmond, Herbie Robinson, Larry
Rowe, Eric Scheirer, Dave Singer, Martijn Sipkema, William Stewart,
Kent Terry, Magnus Westerlund, Tom White, Jim Wright, Doug Wyatt, and
Giorgio Zoia. We also thank the members of the San Francisco Bay
Area music and audio community for creating the context for the work,
including Don Buchla, Chris Chafe, Richard Duda, Dan Ellis, Adrian
Freed, Ben Gold, Jaron Lanier, Roger Linn, Richard Lyon, Dana Massie,
Max Mathews, Keith McMillen, Carver Mead, Nelson Morgan, Tom
Oberheim, Malcolm Slaney, Dave Smith, Julius Smith, David Wessel, and
Matt Wright.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 36]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-37" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h2"><a class="selflink" id="section-11" href="#section-11">11</a>. IANA Considerations</span>
This section makes a series of requests to IANA. The IANA has
completed registration/assignments of the below requests.
The sub-sections that follow hold the actual, detailed requests. All
registrations in this section are in the IETF tree and follow the
rules of [<a href="./rfc4288" title=""Media Type Specifications and Registration Procedures"">RFC4288</a>] and [<a href="./rfc3555" title=""MIME Type Registration of RTP Payload Formats"">RFC3555</a>], as appropriate.
In <a href="#section-11.1">Section 11.1</a>, we request the registration of a new media type:
"audio/rtp-midi". Paired with this request is a request for a
repository for new values for several parameters associated with
"audio/rtp-midi". We request this repository in Section 11.1.1.
In <a href="#section-11.2">Section 11.2</a>, we request the registration of a new value ("rtp-
midi") for the "mode" parameter of the "mpeg4-generic" media type.
The "mpeg4-generic" media type is defined in [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>], and [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]
defines a repository for the "mode" parameter. However, we believe
we are the first to request the registration of a "mode" value, so we
believe the registry for "mode" has not yet been created by IANA.
Paired with our "mode" parameter value request for "mpeg4-generic" is
a request for a repository for new values for several parameters we
have defined for use with the "rtp-midi" mode value. We request this
repository in Section 11.2.1.
In <a href="#section-11.3">Section 11.3</a>, we request the registration of a new media type:
"audio/asc". No repository request is associated with this request.
<span class="h3"><a class="selflink" id="section-11.1" href="#section-11.1">11.1</a>. rtp-midi Media Type Registration</span>
This section requests the registration of the "rtp-midi" subtype for
the "audio" media type. We request the registration of the
parameters listed in the "optional parameters" section below (both
the "non-extensible parameters" and the "extensible parameters"
lists). We also request the creation of repositories for the
"extensible parameters"; the details of this request appear in
<a href="#section-11.1.1">Section 11.1.1</a>, below.
Media type name:
audio
Subtype name:
rtp-midi
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 37]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-38" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Required parameters:
rate: The RTP timestamp clock rate. See Sections <a href="#section-2.1">2.1</a> and <a href="#section-6.1">6.1</a>
for usage details.
Optional parameters:
Non-extensible parameters:
ch_anchor: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
ch_default: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
ch_never: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
cm_unused: See <a href="#appendix-C.1">Appendix C.1</a> for usage details.
cm_used: See <a href="#appendix-C.1">Appendix C.1</a> for usage details.
chanmask: See <a href="#appendix-C.6.4.3">Appendix C.6.4.3</a> for usage details.
cid: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
guardtime: See <a href="#appendix-C.4.2">Appendix C.4.2</a> for usage details.
inline: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
linerate: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
mperiod: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
multimode: See <a href="#appendix-C.6.1">Appendix C.6.1</a> for usage details.
musicport: See <a href="#appendix-C.5">Appendix C.5</a> for usage details.
octpos: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
rinit: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
rtp_maxptime: See <a href="#appendix-C.4.1">Appendix C.4.1</a> for usage details.
rtp_ptime: See <a href="#appendix-C.4.1">Appendix C.4.1</a> for usage details.
smf_cid: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
smf_inline: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
smf_url: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
tsmode: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
url: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
Extensible parameters:
j_sec: See <a href="#appendix-C.2.1">Appendix C.2.1</a> for usage details. See
<a href="#section-11.1.1">Section 11.1.1</a> for repository details.
j_update: See <a href="#appendix-C.2.2">Appendix C.2.2</a> for usage details. See
<a href="#section-11.1.1">Section 11.1.1</a> for repository details.
render: See <a href="#appendix-C.6">Appendix C.6</a> for usage details. See
<a href="#section-11.1.1">Section 11.1.1</a> for repository details.
subrender: See <a href="#appendix-C.6.2">Appendix C.6.2</a> for usage details. See
<a href="#section-11.1.1">Section 11.1.1</a> for repository details.
smf_info: See <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> for usage details. See
<a href="#section-11.1.1">Section 11.1.1</a> for repository details.
Encoding considerations:
The format for this type is framed and binary.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 38]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-39" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Restrictions on usage:
This type is only defined for real-time transfers of MIDI
streams via RTP. Stored-file semantics for rtp-midi may
be defined in the future.
Security considerations:
See <a href="#section-9">Section 9</a> of this memo.
Interoperability considerations:
None.
Published specification:
This memo and [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] serve as the normative specification. In
addition, references [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>], [<a href="#ref-GRAME" title=""Real Time Musical Events Streaming over Internet"">GRAME</a>], and [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>] provide
non-normative implementation guidance.
Applications that use this media type:
Audio content-creation hardware, such as MIDI controller piano
keyboards and MIDI audio synthesizers. Audio content-creation
software, such as music sequencers, digital audio workstations,
and soft synthesizers. Computer operating systems, for network
support of MIDI Application Programmer Interfaces. Content
distribution servers and terminals may use this media type for
low bit-rate music coding.
Additional information:
None.
Person & email address to contact for further information:
John Lazzaro <lazzaro@cs.berkeley.edu>
Intended usage:
COMMON.
Author:
John Lazzaro <lazzaro@cs.berkeley.edu>
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 39]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-40" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Change controller:
IETF Audio/Video Transport Working Group delegated
from the IESG.
<span class="h4"><a class="selflink" id="section-11.1.1" href="#section-11.1.1">11.1.1</a>. Repository Request for "audio/rtp-midi"</span>
For the "rtp-midi" subtype, we request the creation of repositories
for extensions to the following parameters (which are those listed as
"extensible parameters" in <a href="#section-11.1">Section 11.1</a>).
j_sec:
Registrations for this repository may only occur
via an IETF standards-track document. <a href="#appendix-C.2.1">Appendix C.2.1</a>
of this memo describes appropriate registrations for this
repository.
Initial values for this repository appear below:
"none": Defined in <a href="#appendix-C.2.1">Appendix C.2.1</a> of this memo.
"recj": Defined in <a href="#appendix-C.2.1">Appendix C.2.1</a> of this memo.
j_update:
Registrations for this repository may only occur
via an IETF standards-track document. <a href="#appendix-C.2.2">Appendix C.2.2</a>
of this memo describes appropriate registrations for this
repository.
Initial values for this repository appear below:
"anchor": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
"open-loop": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
"closed-loop": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
render:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text in the preamble of <a href="#appendix-C.6">Appendix C.6</a> for details
(the paragraph that begins "Other render token ...").
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 40]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-41" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Initial values for this repository appear below:
"unknown": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
"synthetic": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
"api": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
"null": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
subrender:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text <a href="#appendix-C.6.2">Appendix C.6.2</a> for details (the paragraph
that begins "Other subrender token ...").
Initial values for this repository appear below:
"default": Defined in <a href="#appendix-C.6.2">Appendix C.6.2</a> of this memo.
smf_info:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> for details (the
paragraph that begins "Other smf_info token ...").
Initial values for this repository appear below:
"ignore": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
"sdp_start": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
"identity": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
<span class="h3"><a class="selflink" id="section-11.2" href="#section-11.2">11.2</a>. mpeg4-generic Media Type Registration</span>
This section requests the registration of the "rtp-midi" value for
the "mode" parameter of the "mpeg4-generic" media type. The "mpeg4-
generic" media type is defined in [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>], and [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] defines a
repository for the "mode" parameter. We are registering mode rtp-
midi to support the MPEG Audio codecs [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>] that use MIDI.
In conjunction with this registration request, we request the
registration of the parameters listed in the "optional parameters"
section below (both the "non-extensible parameters" and the
"extensible parameters" lists). We also request the creation of
repositories for the "extensible parameters"; the details of this
request appear in Appendix 11.2.1, below.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 41]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-42" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Media type name:
audio
Subtype name:
mpeg4-generic
Required parameters:
The "mode" parameter is required by [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]. [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]
requests a repository for "mode", so that new values for mode
may be added. We request that the value "rtp-midi" be
added to the "mode" repository.
In mode rtp-midi, the mpeg4-generic parameter rate is
a required parameter. Rate specifies the RTP timestamp
clock rate. See Sections <a href="#section-2.1">2.1</a> and <a href="#section-6.2">6.2</a> for usage details
of rate in mode rtp-midi.
Optional parameters:
We request registration of the following parameters
for use in mode rtp-midi for mpeg4-generic.
Non-extensible parameters:
ch_anchor: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
ch_default: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
ch_never: See <a href="#appendix-C.2.3">Appendix C.2.3</a> for usage details.
cm_unused: See <a href="#appendix-C.1">Appendix C.1</a> for usage details.
cm_used: See <a href="#appendix-C.1">Appendix C.1</a> for usage details.
chanmask: See <a href="#appendix-C.6.4.3">Appendix C.6.4.3</a> for usage details.
cid: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
guardtime: See <a href="#appendix-C.4.2">Appendix C.4.2</a> for usage details.
inline: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
linerate: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
mperiod: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
multimode: See <a href="#appendix-C.6.1">Appendix C.6.1</a> for usage details.
musicport: See <a href="#appendix-C.5">Appendix C.5</a> for usage details.
octpos: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
rinit: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
rtp_maxptime: See <a href="#appendix-C.4.1">Appendix C.4.1</a> for usage details.
rtp_ptime: See <a href="#appendix-C.4.1">Appendix C.4.1</a> for usage details.
smf_cid: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
smf_inline: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 42]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-43" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
smf_url: See <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a> for usage details.
tsmode: See <a href="#appendix-C.3">Appendix C.3</a> for usage details.
url: See <a href="#appendix-C.6.3">Appendix C.6.3</a> for usage details.
Extensible parameters:
j_sec: See <a href="#appendix-C.2.1">Appendix C.2.1</a> for usage details. See
<a href="#section-11.2.1">Section 11.2.1</a> for repository details.
j_update: See <a href="#appendix-C.2.2">Appendix C.2.2</a> for usage details. See
<a href="#section-11.2.1">Section 11.2.1</a> for repository details.
render: See <a href="#appendix-C.6">Appendix C.6</a> for usage details. See
<a href="#section-11.2.1">Section 11.2.1</a> for repository details.
subrender: See <a href="#appendix-C.6.2">Appendix C.6.2</a> for usage details. See
<a href="#section-11.2.1">Section 11.2.1</a> for repository details.
smf_info: See <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> for usage details. See
<a href="#section-11.2.1">Section 11.2.1</a> for repository details.
Encoding considerations:
The format for this type is framed and binary.
Restrictions on usage:
Only defined for real-time transfers of audio/mpeg4-generic
RTP streams with mode=rtp-midi.
Security considerations:
See <a href="#section-9">Section 9</a> of this memo.
Interoperability considerations:
Except for the marker bit (<a href="#section-2.1">Section 2.1</a>), the packet formats
for audio/rtp-midi and audio/mpeg4-generic (mode rtp-midi)
are identical. The formats differ in use: audio/mpeg4-generic
is for MPEG work, and audio/rtp-midi is for all other work.
Published specification:
This memo, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], and [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>] are the normative references.
In addition, references [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>], [<a href="#ref-GRAME" title=""Real Time Musical Events Streaming over Internet"">GRAME</a>], and [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>] provide
non-normative implementation guidance.
Applications that use this media type:
MPEG 4 servers and terminals that support [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 43]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-44" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Additional information:
None.
Person & email address to contact for further information:
John Lazzaro <lazzaro@cs.berkeley.edu>
Intended usage:
COMMON.
Author:
John Lazzaro <lazzaro@cs.berkeley.edu>
Change controller:
IETF Audio/Video Transport Working Group delegated
from the IESG.
<span class="h4"><a class="selflink" id="section-11.2.1" href="#section-11.2.1">11.2.1</a>. Repository Request for Mode rtp-midi for mpeg4-generic</span>
For mode rtp-midi of the mpeg4-generic subtype, we request the
creation of repositories for extensions to the following parameters
(which are those listed as "extensible parameters" in <a href="#section-11.2">Section 11.2</a>).
j_sec:
Registrations for this repository may only occur
via an IETF standards-track document. <a href="#appendix-C.2.1">Appendix C.2.1</a>
of this memo describes appropriate registrations for this
repository.
Initial values for this repository appear below:
"none": Defined in <a href="#appendix-C.2.1">Appendix C.2.1</a> of this memo.
"recj": Defined in <a href="#appendix-C.2.1">Appendix C.2.1</a> of this memo.
j_update:
Registrations for this repository may only occur
via an IETF standards-track document. <a href="#appendix-C.2.2">Appendix C.2.2</a>
of this memo describes appropriate registrations for this
repository.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 44]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-45" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Initial values for this repository appear below:
"anchor": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
"open-loop": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
"closed-loop": Defined in <a href="#appendix-C.2.2">Appendix C.2.2</a> of this memo.
render:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text in the preamble of <a href="#appendix-C.6">Appendix C.6</a> for details
(the paragraph that begins "Other render token ...").
Initial values for this repository appear below:
"unknown": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
"synthetic": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
"null": Defined in <a href="#appendix-C.6">Appendix C.6</a> of this memo.
subrender:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text <a href="#appendix-C.6.2">Appendix C.6.2</a> for details (the paragraph
that begins "Other subrender token ..." and
subsequent paragraphs). Note that the text in
<a href="#appendix-C.6.2">Appendix C.6.2</a> contains restrictions on subrender
registrations for mpeg4-generic ("Registrations
for mpeg4-generic subrender values ...").
Initial values for this repository appear below:
"default": Defined in <a href="#appendix-C.6.2">Appendix C.6.2</a> of this memo.
smf_info:
Registrations for this repository MUST include a
specification of the usage of the proposed value.
See text in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> for details (the
paragraph that begins "Other smf_info token ...").
Initial values for this repository appear below:
"ignore": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
"sdp_start": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
"identity": Defined in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a> of this memo.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 45]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-46" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="section-11.3" href="#section-11.3">11.3</a>. asc Media Type Registration</span>
This section registers "asc" as a subtype for the "audio" media type.
We register this subtype to support the remote transfer of the
"config" parameter of the mpeg4-generic media type [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] when it
is used with mpeg4-generic mode rtp-midi (registered in Appendix 11.2
above). We explain the mechanics of using "audio/asc" to set the
config parameter in <a href="#section-6.2">Section 6.2</a> and <a href="#appendix-C.6.5">Appendix C.6.5</a> of this document.
Note that this registration is a new subtype registration and is not
an addition to a repository defined by MPEG-related memos (such as
[<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]). Also note that this request for "audio/asc" does not
register parameters, and does not request the creation of a
repository.
Media type name:
audio
Subtype name:
asc
Required parameters:
None.
Optional parameters:
None.
Encoding considerations:
The native form of the data object is binary data,
zero-padded to an octet boundary.
Restrictions on usage:
This type is only defined for data object (stored file)
transfer. The most common transports for the type are
HTTP and SMTP.
Security considerations:
See <a href="#section-9">Section 9</a> of this memo.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 46]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-47" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Interoperability considerations:
None.
Published specification:
The audio/asc data object is the AudioSpecificConfig
binary data structure, which is normatively defined in
[<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>].
Applications that use this media type:
MPEG 4 Audio servers and terminals that support
audio/mpeg4-generic RTP streams for mode rtp-midi.
Additional information:
None.
Person & email address to contact for further information:
John Lazzaro <lazzaro@cs.berkeley.edu>
Intended usage:
COMMON.
Author:
John Lazzaro <lazzaro@cs.berkeley.edu>
Change controller:
IETF Audio/Video Transport Working Group delegated
from the IESG.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 47]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-48" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h2"><a class="selflink" id="appendix-A" href="#appendix-A">A</a>. The Recovery Journal Channel Chapters</span>
<span class="h3"><a class="selflink" id="appendix-A.1" href="#appendix-A.1">A.1</a>. Recovery Journal Definitions</span>
This appendix defines the terminology and the coding idioms that are
used in the recovery journal bitfield descriptions in <a href="#section-5">Section 5</a>
(journal header structure), Appendices A.2 to A.9 (channel journal
chapters) and Appendices B.1 to B.5 (system journal chapters).
We assume that the recovery journal resides in the journal section of
an RTP packet with sequence number I ("packet I") and that the
Checkpoint Packet Seqnum field in the top-level recovery journal
header refers to a previous packet with sequence number C (an
exception is the self-referential C = I case). Unless stated
otherwise, algorithms are assumed to use modulo 2^16 arithmetic for
calculations on 16-bit sequence numbers and modulo 2^32 arithmetic
for calculations on 32-bit extended sequence numbers.
Several bitfield coding idioms appear throughout the recovery journal
system, with consistent semantics. Most recovery journal elements
begin with an "S" (Single-packet loss) bit. S bits are designed to
help receivers efficiently parse through the recovery journal
hierarchy in the common case of the loss of a single packet.
As a rule, S bits MUST be set to 1. However, an exception applies if
a recovery journal element in packet I encodes data about a command
stored in the MIDI command section of packet I - 1. In this case,
the S bit of the recovery journal element MUST be set to 0. If a
recovery journal element has its S bit set to 0, all higher-level
recovery journal elements that contain it MUST also have S bits that
are set to 0, including the top-level recovery journal header.
Other consistent bitfield coding idioms are described below:
o R flag bit. R flag bits are reserved for future use. Senders
MUST set R bits to 0. Receivers MUST ignore R bit values.
o LENGTH field. All fields named LENGTH (as distinct from LEN)
code the number of octets in the structure that contains it,
including the header it resides in and all hierarchical levels
below it. If a structure contains a LENGTH field, a receiver
MUST use the LENGTH field value to advance past the structure
during parsing, rather than use knowledge about the internal
format of the structure.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 48]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-49" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We now define normative terms used to describe recovery journal
semantics.
o Checkpoint history. The checkpoint history of a recovery journal
is the concatenation of the MIDI command sections of packets C
through I - 1. The final command in the MIDI command section for
packet I - 1 is considered the most recent command; the first
command in the MIDI command section for packet C is the oldest
command. If command X is less recent than command Y, X is
considered to be "before Y". A checkpoint history with no
commands is considered to be empty. The checkpoint history never
contains the MIDI command section of packet I (the packet
containing the recovery journal), so if C == I, the checkpoint
history is empty by definition.
o Session history. The session history of a recovery journal is
the concatenation of MIDI command sections from the first packet
of the session up to packet I - 1. The definitions of command
recency and history emptiness follow those in the checkpoint
history. The session history never contains the MIDI command
section of packet I, and so the session history of the first
packet in the session is empty by definition.
o Finished/unfinished commands. If all octets of a MIDI command
appear in the session history, the command is defined as being
finished. If some but not all octets of a command appear in the
session history, the command is defined as being unfinished.
Unfinished commands occur if segments of a SysEx command appear
in several RTP packets. For example, if a SysEx command is coded
as 3 segments, with segment 1 in packet K, segment 2 in packet K
+ 1, and segment 3 in packet K + 2, the session histories for
packets K + 1 and K + 2 contain unfinished versions of the
command. A session history contains a finished version of a
cancelled SysEx command if the history contains the cancel
sublist for the command.
o Reset State commands. Reset State (RS) commands reset renderers
to an initialized "powerup" condition. The RS commands are:
System Reset (0xFF), General MIDI System Enable (0xF0 0x7E 0xcc
0x09 0x01 0xF7), General MIDI 2 System Enable (0xF0 0x7E 0xcc
0x09 0x03 0xF7), General MIDI System Disable (0xF0 0x7E 0xcc 0x09
0x00 0xF7), Turn DLS On (0xF0 0x7E 0xcc 0x0A 0x01 0xF7), and Turn
DLS Off (0xF0 0x7E 0xcc 0x0A 0x02 0xF7). Registrations of
subrender parameter token values (Appendix C.6.2) and IETF
standards-track documents MAY specify additional RS commands.
o Active commands. Active command are MIDI commands that do not
appear before a Reset State command in the session history.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 49]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-50" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o N-active commands. N-active commands are MIDI commands that do
not appear before one of the following commands in the session
history: MIDI Control Change numbers 123-127 (numbers with All
Notes Off semantics) or 120 (All Sound Off), and any Reset State
command.
o C-active commands. C-active commands are MIDI commands that do
not appear before one of the following commands in the session
history: MIDI Control Change number 121 (Reset All Controllers)
and any Reset State command.
o Oldest-first ordering rule. Several recovery journal chapters
contain a list of elements, where each element is associated with
a MIDI command that appears in the session history. In most
cases, the chapter definition requires that list elements be
ordered in accordance with the "oldest-first ordering rule".
Below, we normatively define this rule:
Elements associated with the most recent command in the session
history coded in the list MUST appear at the end of the list.
Elements associated with the oldest command in the session
history coded in the list MUST appear at the start of the list.
All other list elements MUST be arranged with respect to these
boundary elements, to produce a list ordering that strictly
reflects the relative session history recency of the commands
coded by the elements in the list.
o Parameter system. A MIDI feature that provides two sets of
16,384 parameters to expand the 0-127 controller number space.
The Registered Parameter Names (RPN) system and the Non-
Registered Parameter Names (NRPN) system each provides 16,384
parameters.
o Parameter system transaction. The value of RPNs and NRPNs are
changed by a series of Control Change commands that form a
parameter system transaction. A canonical transaction begins
with two Control Change commands to set the parameter number
(controller numbers 99 and 98 for NRPNs, controller numbers 101
and 100 for RPNs). The transaction continues with an arbitrary
number of Data Entry (controller numbers 6 and 38), Data
Increment (controller number 96), and Data Decrement (controller
number 97) Control Change commands to set the parameter value.
The transaction ends with a second pair of (99, 98) or (101, 100)
Control Change commands that specify the null parameter (MSB
value 0x7F, LSB value 0x7F).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 50]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-51" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Several variants of the canonical transaction sequence are
possible. Most commonly, the terminal pair of (99, 98) or (101,
100) Control Change commands may specify a parameter other than
the null parameter. In this case, the command pair terminates
the first transaction and starts a second transaction. The
command pair is considered to be a part of both transactions.
This variant is legal and recommended in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. We refer to
this variant as a "type 1 variant".
Less commonly, the MSB (99 or 101) or LSB (98 or 100) command of
a (99, 98) or (101, 100) Control Change pair may be omitted.
If the MSB command is omitted, the transaction uses the MSB value
of the most recent C-active Control Change command for controller
number 99 or 101 that appears in the session history. We refer
to this variant as a "type 2 variant".
If the LSB command is omitted, the LSB value 0x00 is assumed. We
refer to this variant as a "type 3 variant". The type 2 and type
3 variants are defined as legal, but are not recommended, in
[<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
System real-time commands may appear at any point during a
transaction (even between octets of individual commands in the
transaction). More generally, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] does not forbid the
appearance of unrelated MIDI commands during an open transaction.
As a rule, these commands are considered to be "outside" the
transaction and do not affect the status of the transaction in
any way. Exceptions to this rule are commands whose semantics
act to terminate transactions: Reset State commands, and Control
Change (0xB) for controller number 121 (Reset All Controllers)
[<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>].
o Initiated parameter system transaction. A canonical parameter
system transaction whose (99, 98) or (101, 100) initial Control
Change command pair appears in the session history is considered
to be an initiated parameter system transaction. This definition
also holds for type 1 variants. For type 2 variants (dropped
MSB), a transaction whose initial LSB Control Change command
appears in the session history is an initiated transaction. For
type 3 variants (dropped LSB), a transaction is considered to be
initiated if at least one transaction command follows the initial
MSB (99 or 101) Control Change command in the session history.
The completion of a transaction does not nullify its "initiated"
status.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 51]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-52" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o Session history reference counts. Several recovery journal
chapters include a reference count field, which codes the total
number of commands of a type that appear in the session history.
Examples include the Reset and Tune Request command logs (Chapter
D, <a href="#appendix-B.1">Appendix B.1</a>) and the Active Sense command (Chapter V,
<a href="#appendix-B.2">Appendix B.2</a>). Upon the detection of a loss event, reference
count fields let a receiver deduce if any instances of the
command have been lost, by comparing the journal reference count
with its own reference count. Thus, a reference count field
makes sense, even for command types in which knowing the NUMBER
of lost commands is irrelevant (as is true with all of the
example commands mentioned above).
The chapter definitions in Appendices A.2 to A.9 and B.1 to B.5
reflect the default recovery journal behavior. The ch_default,
ch_never, and ch_anchor parameters modify these definitions, as
described in <a href="#appendix-C.2.3">Appendix C.2.3</a>.
The chapter definitions specify if data MUST be present in the
journal. Senders MAY also include non-required data in the journal.
This optional data MUST comply with the normative chapter definition.
For example, if a chapter definition states that a field codes data
from the most recent active command in the session history, the
sender MUST NOT code inactive commands or older commands in the
field.
Finally, we note that a channel journal only encodes information
about MIDI commands appearing on the MIDI channel the journal
protects. All references to MIDI commands in Appendices A.2 to A.9
should be read as "MIDI commands appearing on this channel."
<span class="h3"><a class="selflink" id="appendix-A.2" href="#appendix-A.2">A.2</a>. Chapter P: MIDI Program Change</span>
A channel journal MUST contain Chapter P if an active Program Change
(0xC) command appears in the checkpoint history. Figure A.2.1 shows
the format for Chapter P.
0 1 2
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| PROGRAM |B| BANK-MSB |X| BANK-LSB |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.2.1 -- Chapter P format
The chapter has a fixed size of 24 bits. The PROGRAM field indicates
the data value of the most recent active Program Change command in
the session history. By default, the B, BANK-MSB, X, and BANK-LSB
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 52]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-53" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
fields MUST be set to 0. Below, we define exceptions to this default
condition.
If an active Control Change (0xB) command for controller number 0
(Bank Select MSB) appears before the Program Change command in the
session history, the B bit MUST be set to 1, and the BANK-MSB field
MUST code the data value of the Control Change command.
If B is set to 1, the BANK-LSB field MUST code the data value of the
most recent Control Change command for controller number 32 (Bank
Select LSB) that preceded the Program Change command coded in the
PROGRAM field and followed the Control Change command coded in the
BANK-MSB field. If no such Control Change command exists, the BANK-
LSB field MUST be set to 0.
If B is set to 1, and if a Control Change command for controller
number 121 (Reset All Controllers) appears in the MIDI stream between
the Control Change command coded by the BANK-MSB field and the
Program Change command coded by the PROGRAM field, the X bit MUST be
set to 1.
Note that [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that Reset All Controllers does not reset
the values of controller numbers 0 (Bank Select MSB) and 32 (Bank
Select LSB). Thus, the X bit does not effect how receivers will use
the BANK-LSB and BANK-MSB values when recovering from a lost Program
Change command. The X bit serves to aid recovery in MIDI
applications where controller numbers 0 and 32 are used in a non-
standard way.
<span class="h3"><a class="selflink" id="appendix-A.3" href="#appendix-A.3">A.3</a>. Chapter C: MIDI Control Change</span>
Figure A.3.1 shows the format for Chapter C.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 8 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| LEN |S| NUMBER |A| VALUE/ALT |S| NUMBER |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|A| VALUE/ALT | .... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.3.1 -- Chapter C format
The chapter consists of a 1-octet header, followed by a variable
length list of 2-octet controller logs. The list MUST contain at
least one controller log. The 7-bit LEN field codes the number of
controller logs in the list, minus one. We define the semantics of
the controller log fields in <a href="#appendix-A.3.2">Appendix A.3.2</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 53]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-54" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
A channel journal MUST contain Chapter C if the rules defined in this
appendix require that one or more controller logs appear in the list.
<span class="h4"><a class="selflink" id="appendix-A.3.1" href="#appendix-A.3.1">A.3.1</a>. Log Inclusion Rules</span>
A controller log encodes information about a particular Control
Change command in the session history.
In the default use of the payload format, list logs MUST encode
information about the most recent active command in the session
history for a controller number. Logs encoding earlier commands MUST
NOT appear in the list.
Also, as a rule, the list MUST contain a log for the most recent
active command for a controller number that appears in the checkpoint
history. Below, we define exceptions to this rule:
o MIDI streams may transmit 14-bit controller values using paired
Most Significant Byte (MSB, controller numbers 0-31, 99, 101)
and Least Significant Byte (LSB, controller numbers 32-63, 98,
100) Control Change commands [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
If the most recent active Control Change command in the session
history for a 14-bit controller pair uses the MSB number,
Chapter C MAY omit the controller log for the most recent active
Control Change command for the associated LSB number, as the
command ordering makes this LSB value irrelevant. However, this
exception MUST NOT be applied if the sender is not certain that
the MIDI source uses 14-bit semantics for the controller number
pair. Note that some MIDI sources ignore 14-bit controller
semantics and use the LSB controller numbers as independent 7-
bit controllers.
o If active Control Change commands for controller numbers 0 (Bank
Select MSB) or 32 (Bank Select LSB) appear in the checkpoint
history, and if the command instances are also coded in the
BANK-MSB and BANK-LSB fields of the Chapter P (Appendix A.2),
Chapter C MAY omit the controller logs for the commands.
o Several controller number pairs are defined to be mutually
exclusive. Controller numbers 124 (Omni Off) and 125 (Omni On)
form a mutually exclusive pair, as do controller numbers 126
(Mono) and 127 (Poly).
If active Control Change commands for one or both members of a
mutually exclusive pair appear in the checkpoint history, a log
for the controller number of the most recent command for the
pair in the checkpoint history MUST appear in the controller
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 54]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-55" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
list. However, the list MAY omit the controller log for the
most recent active command for the other number in the pair.
If active Control Change commands for one or both members of a
mutually exclusive pair appear in the session history, and if a
log for the controller number of the most recent command for the
pair does not appear in the controller list, a log for the most
recent command for the other number of the pair MUST NOT appear
in the controller list.
o If an active Control Change command for controller number 121
(Reset All Controllers) appears in the session history, the
controller list MAY omit logs for Control Change commands that
precede the Reset All Controllers command in the session
history, under certain conditions.
Namely, a log MAY be omitted if the sender is certain that a
command stream follows the Reset All Controllers semantics
defined in [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>], and if the log codes a controller number for
which [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies a reset value.
For example, [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that controller number 1
(Modulation Wheel) is reset to the value 0, and thus a
controller log for Modulation Wheel MAY be omitted from the
controller log list. In contrast, [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that
controller number 7 (Channel Volume) is not reset, and thus a
controller log for Channel Volume MUST NOT be omitted from the
controller log list.
o <a href="#appendix-A.3.4">Appendix A.3.4</a> defines exception rules for the MIDI Parameter
System controller numbers 6, 38, and 96-101.
<span class="h4"><a class="selflink" id="appendix-A.3.2" href="#appendix-A.3.2">A.3.2</a>. Controller Log Format</span>
Figure A.3.2 shows the controller log structure of Chapter C.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NUMBER |A| VALUE/ALT |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.3.2 -- Chapter C controller log
The 7-bit NUMBER field identifies the controller number of the coded
command. The 7-bit VALUE/ALT field codes recovery information for
the command. The A bit sets the format of the VALUE/ALT field.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 55]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-56" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
A log encodes recovery information using one of the following tools:
the value tool, the toggle tool, or the count tool.
A log uses the value tool if the A bit is set to 0. The value tool
codes the 7-bit data value of a command in the VALUE/ALT field. The
value tool works best for controllers that code a continuous
quantity, such as number 1 (Modulation Wheel).
The A bit is set to 1 to code the toggle or count tool. These tools
work best for controllers that code discrete actions. Figure A.3.3
shows the controller log for these tools.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NUMBER |1|T| ALT |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.3.3 -- Controller log for ALT tools
A log uses the toggle tool if the T bit is set to 0. A log uses the
count tool if the T bit is set to 1. Both methods use the 6-bit ALT
field as an unsigned integer.
The toggle tool works best for controllers that act as on/off
switches, such as 64 (Damper Pedal (Sustain)). These controllers
code the "off" state with control values 0-63 and the "on" state with
64-127.
For the toggle tool, the ALT field codes the total number of toggles
(off->on and on->off) due to Control Change commands in the session
history, up to and including a toggle caused by the command coded by
the log. The toggle count includes toggles caused by Control Change
commands for controller number 121 (Reset All Controllers).
Toggle counting is performed modulo 64. The toggle count is reset at
the start of a session, and whenever a Reset State command (Appendix
A.1) appears in the session history. When these reset events occur,
the toggle count for a controller is set to 0 (for controllers whose
default value is 0-63) or 1 (for controllers whose default value is
64-127).
The Damper Pedal (Sustain) controller illustrates the benefits of the
toggle tool over the value tool for switch controllers. As often
used in piano applications, the "on" state of the controller lets
notes resonate, while the "off" state immediately damps notes to
silence. The loss of the "off" command in an "on->off->on" sequence
results in ringing notes that should have been damped silent. The
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 56]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-57" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
toggle tool lets receivers detect this lost "off" command, but the
value tool does not.
The count tool is conceptually similar to the toggle tool. For the
count tool, the ALT field codes the total number of Control Change
commands in the session history, up to and including the command
coded by the log. Command counting is performed modulo 64. The
command count is set to 0 at the start of the session and is reset to
0 whenever a Reset State command (Appendix A.1) appears in the
session history.
Because the count tool ignores the data value, it is a good match for
controllers whose controller value is ignored, such as number 123
(All Notes Off). More generally, the count tool may be used to code
a (modulo 64) identification number for a command.
<span class="h4"><a class="selflink" id="appendix-A.3.3" href="#appendix-A.3.3">A.3.3</a>. Log List Coding Rules</span>
In this section, we describe the organization of controller logs in
the Chapter C log list.
A log encodes information about a particular Control Change command
in the session history. In most cases, a command SHOULD be coded by
a single tool (and, thus, a single log). If a number is coded with a
single tool and this tool is the count tool, recovery Control Change
commands generated by a receiver SHOULD use the default control value
for the controller.
However, a command MAY be coded by several tool types (and, thus,
several logs, each using a different tool). This technique may
improve recovery performance for controllers with complex semantics,
such as controller number 84 (Portamento Control) or controller
number 121 (Reset All Controllers) when used with a non-zero data
octet (with the semantics described in [<a href="#ref-DLS2" title=""The MIDI Downloadable Sounds Specification"">DLS2</a>]).
If a command is encoded by multiple tools, the logs MUST be placed in
the list in the following order: count tool log (if any), followed by
value tool log (if any), followed by toggle tool log (if any).
The Chapter C log list MUST obey the oldest-first ordering rule
(defined in <a href="#appendix-A.1">Appendix A.1</a>). Note that this ordering preserves the
information necessary for the recovery of 14-bit controller values,
without precluding the use of MSB and LSB controller pairs as
independent 7-bit controllers.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 57]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-58" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In the default use of the payload format, all logs that appear in the
list for a controller number encode information about one Control
Change command -- namely, the most recent active Control Change
command in the session history for the number.
This coding scheme provides good recovery performance for the
standard uses of Control Change commands defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. However,
not all MIDI applications restrict the use of Control Change commands
to those defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
For example, consider the common MIDI encoding of rotary encoders
("infinite" rotation knobs). The mixing console MIDI convention
defined in [<a href="#ref-LCP" title=""Logic 7 Dedicated Control Surface Support"">LCP</a>] codes the position of rotary encoders as a series of
Control Change commands. Each command encodes a relative change of
knob position from the last update (expressed as a clockwise or
counter-clockwise knob turning angle).
As the knob position is encoded incrementally over a series of
Control Change commands, the best recovery performance is obtained if
the log list encodes all Control Change commands for encoder
controller numbers that appear in the checkpoint history, not only
the most recent command.
To support application areas that use Control Change commands in this
way, Chapter C may be configured to encode information about several
Control Change commands for a controller number. We use the term
"enhanced" to describe this encoding method, which we describe below.
In <a href="#appendix-C.2.3">Appendix C.2.3</a>, we show how to configure a stream to use enhanced
Chapter C encoding for specific controller numbers. In <a href="#section-5">Section 5</a> in
the main text, we show how the H bits in the recovery journal header
(Figure 8) and in the channel journal header (Figure 9) indicate the
use of enhanced Chapter C encoding.
Here, we define how to encode a Chapter C log list that uses the
enhanced encoding method.
Senders that use the enhanced encoding method for a controller number
MUST obey the rules below. These rules let a receiver determine
which logs in the list correspond to lost commands. Note that these
rules override the exceptions listed in <a href="#appendix-A.3.1">Appendix A.3.1</a>.
o If N commands for a controller number are encoded in the list,
the commands MUST be the N most recent commands for the
controller number in the session history. For example, for N =
2, the sender MUST encode the most recent command and the second
most recent command, not the most recent command and the third
most recent command.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 58]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-59" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o If a controller number uses enhanced encoding, the encoding of
the least-recent command for the controller number in the log
list MUST include a count tool log. In addition, if commands
are encoded for the controller number whose logs have S bits set
to 0, the encoding of the least-recent command with S = 0 logs
MUST include a count tool log.
The count tool is OPTIONAL for the other commands for the
controller number encoded in the list, as a receiver is able to
efficiently deduce the count tool value for these commands, for
both single-packet and multi-packet loss events.
o The use of the value and toggle tools MUST be identical for all
commands for a controller number encoded in the list. For
example, a value tool log either MUST appear for all commands
for the controller number coded in the list, or alternatively,
value tool logs for the controller number MUST NOT appear in the
list. Likewise, a toggle tool log either MUST appear for all
commands for the controller number coded in the list, or
alternatively, toggle tool logs for the controller number MUST
NOT appear in the list.
o If a command is encoded by multiple tools, the logs MUST be
placed in the list in the following order: count tool log (if
any), followed by value tool log (if any), followed by toggle
tool log (if any).
These rules permit a receiver recovering from a packet loss to use
the count tool log to match the commands encoded in the list with its
own history of the stream, as we describe below. Note that the text
below describes a non-normative algorithm; receivers are free to use
any algorithm to match its history with the log list.
In a typical implementation of the enhanced encoding method, a
receiver computes and stores count, value, and toggle tool data field
values for the most recent Control Change command it has received for
a controller number.
After a loss event, a receiver parses the Chapter C list and
processes list logs for a controller number that uses enhanced
encoding as follows.
The receiver compares the count tool ALT field for the least-recent
command for the controller number in the list against its stored
count data for the controller number, to determine if recovery is
necessary for the command coded in the list. The value and toggle
tool logs (if any) that directly follow the count tool log are
associated with this least-recent command.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 59]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-60" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
To check more-recent commands for the controller, the receiver
detects additional value and/or toggle tool logs for the controller
number in the list and infers count tool data for the command coded
by these logs. This inferred data is used to determine if recovery
is necessary for the command coded by the value and/or toggle tool
logs.
In this way, a receiver is able to execute only lost commands,
without executing a command twice. While recovering from a single
packet loss, a receiver may skip through S = 1 logs in the list, as
the first S = 0 log for an enhanced controller number is always a
count tool log.
Note that the requirements in <a href="#appendix-C.2.2.2">Appendix C.2.2.2</a> for protective sender
and receiver actions during session startup for multicast operation
are of particular importance for enhanced encoding, as receivers need
to initialize its count tool data structures with recovery journal
data in order to match commands correctly after a loss event.
Finally, we note in passing that in some applications of rotary
encoders, a good user experience may be possible without the use of
enhanced encoding. These applications are distinguished by visual
feedback of encoding position that is driven by the post-recovery
rotary encoding stream, and relatively low packet loss. In these
domains, recovery performance may be acceptable for rotary encoders
if the log list encodes only the most recent command, if both count
and value logs appear for the command.
<span class="h4"><a class="selflink" id="appendix-A.3.4" href="#appendix-A.3.4">A.3.4</a>. The Parameter System</span>
Readers may wish to review the <a href="#appendix-A.1">Appendix A.1</a> definitions of "parameter
system", "parameter system transaction", and "initiated parameter
system transaction" before reading this section.
Parameter system transactions update a MIDI Registered Parameter
Number (RPN) or Non-Registered Parameter Number (NRPN) value. A
parameter system transaction is a sequence of Control Change commands
that may use the following controllers numbers:
o Data Entry MSB (6)
o Data Entry LSB (38)
o Data Increment (96)
o Data Decrement (97)
o Non-Registered Parameter Number (NRPN) LSB (98)
o Non-Registered Parameter Number (NRPN) MSB (99)
o Registered Parameter Number (RPN) LSB (100)
o Registered Parameter Number (RPN) MSB (101)
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 60]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-61" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Control Change commands that are a part of a parameter system
transaction MUST NOT be coded in Chapter C controller logs. Instead,
these commands are coded in Chapter M, the MIDI Parameter chapter
defined in <a href="#appendix-A.4">Appendix A.4</a>.
However, Control Change commands that use the listed controllers as
general-purpose controllers (i.e., outside of a parameter system
transaction) MUST NOT be coded in Chapter M.
Instead, the controllers are coded in Chapter C controller logs. The
controller logs follow the coding rules stated in <a href="#appendix-A.3.2">Appendix A.3.2</a> and
A.3.3. The rules for coding paired LSB and MSB controllers, as
defined in <a href="#appendix-A.3.1">Appendix A.3.1</a>, apply to the pairs (6, 38), (99, 98), and
(101, 100) when coded in Chapter C.
If active Control Change commands for controller numbers 6, 38, or
96-101 appear in the checkpoint history, and these commands are used
as general-purpose controllers, the most recent general-purpose
command instance for these controller numbers MUST appear as entries
in the Chapter C controller list.
MIDI syntax permits a source to use controllers 6, 38, 96, and 97 as
parameter-system controllers and general-purpose controllers in the
same stream. An RTP MIDI sender MUST deduce the role of each Control
Change command for these controller numbers by noting the placement
of the command in the stream and MUST use this information to code
the command in Chapter C or Chapter M, as appropriate.
Specifically, active Control Change commands for controllers 6, 38,
96, and 97 act in a general-purpose way when
o no active Control Change commands that set an RPN or NRPN
parameter number appear in the session history, or
o the most recent active Control Change commands in the session
history that set an RPN or NRPN parameter number code the null
parameter (MSB value 0x7F, LSB value 0x7F), or
o a Control Change command for controller number 121 (Reset All
Controllers) appears more recently in the session history than
all active Control Change commands that set an RPN or NRPN
parameter number (see [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] for details).
Finally, we note that a MIDI source that follows the recommendations
of [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] exclusively uses numbers 98-101 as parameter system
controllers. Alternatively, a MIDI source may exclusively use 98-101
as general-purpose controllers and lose the ability perform parameter
system transactions in a stream.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 61]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-62" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In the language of [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], the general-purpose use of controllers
98-101 constitutes a non-standard controller assignment. As most
real-world MIDI sources use the standard controller assignment for
controller numbers 98-101, an RTP MIDI sender SHOULD assume these
controllers act as parameter system controllers, unless it knows that
a MIDI source uses controller numbers 98-101 in a general-purpose
way.
<span class="h3"><a class="selflink" id="appendix-A.4" href="#appendix-A.4">A.4</a>. Chapter M: MIDI Parameter System</span>
Readers may wish to review the <a href="#appendix-A.1">Appendix A.1</a> definitions for
"C-active", "parameter system", "parameter system transaction", and
"initiated parameter system transaction" before reading this
appendix.
Chapter M protects parameter system transactions for Registered
Parameter Number (RPN) and Non-Registered Parameter Number (NRPN)
values. Figure A.4.1 shows the format for Chapter M.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|P|E|U|W|Z| LENGTH |Q| PENDING | Log list ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.4.1 -- Top-level Chapter M format
Chapter M begins with a 2-octet header. If the P header bit is set
to 1, a 1-octet field follows the header, coding the 7-bit PENDING
value and its associated Q bit.
The 10-bit LENGTH field codes the size of Chapter M and conforms to
semantics described in <a href="#appendix-A.1">Appendix A.1</a>.
Chapter M ends with a list of zero or more variable-length parameter
logs. <a href="#appendix-A.4.2">Appendix A.4.2</a> defines the bitfield format of a parameter log.
<a href="#appendix-A.4.1">Appendix A.4.1</a> defines the inclusion semantics of the log list.
A channel journal MUST contain Chapter M if the rules defined in
<a href="#appendix-A.4.1">Appendix A.4.1</a> require that one or more parameter logs appear in the
list.
A channel journal also MUST contain Chapter M if the most recent
C-active Control Change command involved in a parameter system
transaction in the checkpoint history is
o an RPN MSB (101) or NRPN MSB (99) controller, or
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 62]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-63" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o an RPN LSB (100) or NRPN LSB (98) controller that completes the
coding of the null parameter (MSB value 0x7F, LSB value 0x7F).
This rule provides loss protection for partially transmitted
parameter numbers and for the null parameter numbers.
If the most recent C-active Control Change command involved in a
parameter system transaction in the session history is for the RPN
MSB or NRPN MSB controller, the P header bit MUST be set to 1, and
the PENDING field (and its associated Q bit) MUST follow the Chapter
M header. Otherwise, the P header bit MUST be set to 0, and the
PENDING field and Q bit MUST NOT appear in Chapter M.
If PENDING codes an NRPN MSB, the Q bit MUST be set to 1. If PENDING
codes an RPN MSB, the Q bit MUST be set to 0.
The E header bit codes the current transaction state of the MIDI
stream. If E = 1, an initiated transaction is in progress. Below,
we define the rules for setting the E header bit:
o If no C-active parameter system transaction Control Change
commands appear in the session history, the E bit MUST be set to
0.
o If the P header bit is set to 1, the E bit MUST be set to 0.
o If the most recent C-active parameter system transaction Control
Change command in the session history is for the NRPN LSB or RPN
LSB controller number, and if this command acts to complete the
coding of the null parameter (MSB value 0x7F, LSB value 0x7F),
the E bit MUST be set to 0.
o Otherwise, an initiated transaction is in progress, and the E
bit MUST be set to 1.
The U, W, and Z header bits code properties that are shared by all
parameter logs in the list. If these properties are set, parameter
logs may be coded with improved efficiency (we explain how in A.4.1).
By default, the U, W, and Z bits MUST be set to 0. If all parameter
logs in the list code RPN parameters, the U bit MAY be set to 1. If
all parameter logs in the list code NRPN parameters, the W bit MAY be
set to 1. If the parameter numbers of all RPN and NRPN logs in the
list lie in the range 0-127 (and thus have an MSB value of 0), the Z
bit MAY be set to 1.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 63]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-64" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Note that C-active semantics appear in the preceding paragraphs
because [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that pending Parameter System transactions
are closed by a Control Change command for controller number 121
(Reset All Controllers).
<span class="h4"><a class="selflink" id="appendix-A.4.1" href="#appendix-A.4.1">A.4.1</a>. Log Inclusion Rules</span>
Parameter logs code recovery information for a specific RPN or NRPN
parameter.
A parameter log MUST appear in the list if an active Control Change
command that forms a part of an initiated transaction for the
parameter appears in the checkpoint history.
An exception to this rule applies if the checkpoint history only
contains transaction Control Change commands for controller numbers
98-101 that act to terminate the transaction. In this case, a log
for the parameter MAY be omitted from the list.
A log MAY appear in the list if an active Control Change command that
forms a part of an initiated transaction for the parameter appears in
the session history. Otherwise, a log for the parameter MUST NOT
appear in the list.
Multiple logs for the same RPN or NRPN parameter MUST NOT appear in
the log list.
The parameter log list MUST obey the oldest-first ordering rule
(defined in <a href="#appendix-A.1">Appendix A.1</a>), with the phrase "parameter transaction"
replacing the word "command" in the rule definition.
Parameter logs associated with the RPN or NRPN null parameter (LSB =
0x7F, MSB = 0x7F) MUST NOT appear in the log list. Chapter M uses
the E header bit (Figure A.4.1) and the log list ordering rules to
code null parameter semantics.
Note that "active" semantics (rather than "C-active" semantics)
appear in the preceding paragraphs because [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that
pending Parameter System transactions are not reset by a Control
Change command for controller number 121 (Reset All Controllers).
However, the rule that follows uses C-active semantics, because it
concerns the protection of the transaction system itself, and [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>]
specifies that Reset All Controllers acts to close a transaction in
progress.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 64]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-65" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In most cases, parameter logs for RPN and NRPN parameters that are
assigned to the ch_never parameter (Appendix C.2.3) MAY be omitted
from the list. An exception applies if
o the log codes the most recent initiated transaction in the
session history, and
o a C-active command that forms a part of the transaction appears
in the checkpoint history, and
o the E header bit for the top-level Chapter M header (Figure
A.4.1) is set to 1.
In this case, a log for the parameter MUST appear in the list. This
log informs receivers recovering from a loss that a transaction is in
progress, so that the receiver is able to correctly interpret RPN or
NRPN Control Change commands that follow the loss event.
<span class="h4"><a class="selflink" id="appendix-A.4.2" href="#appendix-A.4.2">A.4.2</a>. Log Coding Rules</span>
Figure A.4.2 shows the parameter log structure of Chapter M.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 8 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| PNUM-LSB |Q| PNUM-MSB |J|K|L|M|N|T|V|R| Fields ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.4.2 -- Parameter log format
The log begins with a header, whose default size (as shown in Figure
A.4.2) is 3 octets. If the Q header bit is set to 0, the log encodes
an RPN parameter. If Q = 1, the log encodes an NRPN parameter. The
7-bit PNUM-MSB and PNUM-LSB fields code the parameter number and
reflect the Control Change command data values for controllers 99 and
98 (for NRPNs) or 101 and 100 (for RPNs).
The J, K, L, M, and N header bits form a Table of Contents (TOC) for
the log and signal the presence of fixed-sized fields that follow the
header. A header bit that is set to 1 codes the presence of a field
in the log. The ordering of fields in the log follows the ordering
of the header bits in the TOC. Appendices A.4.2.1-2 define the
fields associated with each TOC header bit.
The T and V header bits code information about the parameter log but
are not part of the TOC. A set T or V bit does not signal the
presence of any parameter log field.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 65]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-66" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If the rules in <a href="#appendix-A.4.1">Appendix A.4.1</a> state that a log for a given parameter
MUST appear in Chapter M, the log MUST code sufficient information to
protect the parameter from the loss of active parameter transaction
Control Change commands in the checkpoint history.
This rule does not apply if the parameter coded by the log is
assigned to the ch_never parameter (Appendix C.2.3). In this case,
senders MAY choose to set the J, K, L, M, and N TOC bits to 0, coding
a parameter log with no fields.
Note that logs to protect parameters that are assigned to ch_never
are REQUIRED under certain conditions (see <a href="#appendix-A.4.1">Appendix A.4.1</a>). The
purpose of the log is to inform receivers recovering from a loss that
a transaction is in progress, so that the receiver is able to
correctly interpret RPN or NRPN Control Change commands that follow
the loss event.
Parameter logs provide two tools for parameter protection: the value
tool and the count tool. Depending on the semantics of the
parameter, senders may use either tool, both tools, or neither tool
to protect a given parameter.
The value tool codes information a receiver may use to determine the
current value of an RPN or NRPN parameter. If a parameter log uses
the value tool, the V header bit MUST be set to 1, and the semantics
defined in Appendices A.4.2.1 for setting the J, K, L, and M TOC bits
MUST be followed. If a parameter log does not use the value tool,
the V bit MUST be set to 0, and the J, K, L, and M TOC bits MUST also
be set to 0.
The count tool codes the number of transactions for an RPN or NRPN
parameter. If a parameter log uses the count tool, the T header bit
MUST be set to 1, and the semantics defined in Appendices A.4.2.2 for
setting the N TOC bit MUST be followed. If a parameter log does not
use the count tool, the T bit and the N TOC bit MUST be set to 0.
Note that V and T are set if the sender uses value (V) or count (T)
tool for the log on an ongoing basis. Thus, V may be set even if J =
K = L = M = 0, and T may be set even if N = 0.
In many cases, all parameters coded in the log list are of one type
(RPN and NRPN), and all parameter numbers lie in the range 0-127. As
described in <a href="#appendix-A.4.1">Appendix A.4.1</a>, senders MAY signal this condition by
setting the top-level Chapter M header bit Z to 1 (to code the
restricted range) and by setting the U or W bit to 1 (to code the
parameter type).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 66]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-67" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If the top-level Chapter M header codes Z = 1 and either U = 1 or
W = 1, all logs in the parameter log list MUST use a modified header
format. This modification deletes bits 8-15 of the bitfield shown in
Figure A.4.2, to yield a 2-octet header. The values of the deleted
PNUM-MSB and Q fields may be inferred from the U, W, and Z bit
values.
<span class="h5"><a class="selflink" id="appendix-A.4.2.1" href="#appendix-A.4.2.1">A.4.2.1</a>. The Value Tool</span>
The value tool uses several fields to track the value of an RPN or
NRPN parameter.
The J TOC bit codes the presence of the octet shown in Figure A.4.3
in the field list.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|X| ENTRY-MSB |
+-+-+-+-+-+-+-+-+
Figure A.4.3 -- ENTRY-MSB field
The 7-bit ENTRY-MSB field codes the data value of the most recent
active Control Change command for controller number 6 (Data Entry
MSB) in the session history that appears in a transaction for the log
parameter.
The X bit MUST be set to 1 if the command coded by ENTRY-MSB precedes
the most recent Control Change command for controller 121 (Reset All
Controllers) in the session history. Otherwise, the X bit MUST be
set to 0.
A parameter log that uses the value tool MUST include the ENTRY-MSB
field if an active Control Change command for controller number 6
appears in the checkpoint history.
Note that [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] specifies that Control Change commands for
controller 121 (Reset All Controllers) do not reset RPN and NRPN
values, and thus the X bit would not play a recovery role for MIDI
systems that comply with [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>].
However, certain renderers (such as DLS 2 [<a href="#ref-DLS2" title=""The MIDI Downloadable Sounds Specification"">DLS2</a>]) specify that
certain RPN values are reset for some uses of Reset All Controllers.
The X bit (and other bitfield features of this nature in this
appendix) plays a role in recovery for renderers of this type.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 67]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-68" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The K TOC bit codes the presence of the octet shown in Figure A.4.4
in the field list.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|X| ENTRY-LSB |
+-+-+-+-+-+-+-+-+
Figure A.4.4 -- ENTRY-LSB field
The 7-bit ENTRY-LSB field codes the data value of the most recent
active Control Change command for controller number 38 (Data Entry
LSB) in the session history that appears in a transaction for the log
parameter.
The X bit MUST be set to 1 if the command coded by ENTRY-LSB precedes
the most recent Control Change command for controller 121 (Reset All
Controllers) in the session history. Otherwise, the X bit MUST be
set to 0.
As a rule, a parameter log that uses the value tool MUST include the
ENTRY-LSB field if an active Control Change command for controller
number 38 appears in the checkpoint history. However, the ENTRY-LSB
field MUST NOT appear in a parameter log if the Control Change
command associated with the ENTRY-LSB precedes a Control Change
command for controller number 6 (Data Entry MSB) that appears in a
transaction for the log parameter in the session history.
The L TOC bit codes the presence of the octets shown in Figure A.4.5
in the field list.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|G|X| A-BUTTON |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.4.5 -- A-BUTTON field
The 14-bit A-BUTTON field codes a count of the number of active
Control Change commands for controller numbers 96 and 97 (Data
Increment and Data Decrement) in the session history that appear in a
transaction for the log parameter.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 68]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-69" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The M TOC bit codes the presence of the octets shown in Figure A.4.6
in the field list.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|G|R| C-BUTTON |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.4.6 -- C-BUTTON field
The 14-bit C-BUTTON field has semantics identical to A-BUTTON, except
that Data Increment and Data Decrement Control Change commands that
precede the most recent Control Change command for controller 121
(Reset All Controllers) in the session history are not counted.
For both A-BUTTON and C-BUTTON, Data Increment and Data Decrement
Control Change commands are not counted if they precede Control
Changes commands for controller numbers 6 (Data Entry MSB) or 38
(Data Entry LSB) that appear in a transaction for the log parameter
in the session history.
The A-BUTTON and C-BUTTON fields are interpreted as unsigned
integers, and the G bit associated the field codes the sign of the
integer (G = 0 for positive or zero, G = 1 for negative).
To compute and code the count value, initialize the count value to 0,
add 1 for each qualifying Data Increment command, and subtract 1 for
each qualifying Data Decrement command. After each add or subtract,
limit the count magnitude to 16383. The G bit codes the sign of the
count, and the A-BUTTON or C-BUTTON field codes the count magnitude.
For the A-BUTTON field, if the most recent qualified Data Increment
or Data Decrement command precedes the most recent Control Change
command for controller 121 (Reset All Controllers) in the session
history, the X bit associated with A-BUTTON field MUST be set to 1.
Otherwise, the X bit MUST be set to 0.
A parameter log that uses the value tool MUST include the A-BUTTON
and C-BUTTON fields if an active Control Change command for
controller numbers 96 or 97 appears in the checkpoint history.
However, to improve coding efficiency, this rule has several
exceptions:
o If the log includes the A-BUTTON field, and if the X bit of the
A-BUTTON field is set to 1, the C-BUTTON field (and its
associated R and G bits) MAY be omitted from the log.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 69]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-70" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o If the log includes the A-BUTTON field, and if the A-BUTTON and
C-BUTTON fields (and their associated G bits) code identical
values, the C-BUTTON field (and its associated R and G bits) MAY
be omitted from the log.
<span class="h5"><a class="selflink" id="appendix-A.4.2.2" href="#appendix-A.4.2.2">A.4.2.2</a>. The Count Tool</span>
The count tool tracks the number of transactions for an RPN or NRPN
parameter. The N TOC bit codes the presence of the octet shown in
Figure A.4.7 in the field list.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|X| COUNT |
+-+-+-+-+-+-+-+-+
Figure A.4.7 -- COUNT field
The 7-bit COUNT codes the number of initiated transactions for the
log parameter that appear in the session history. Initiated
transactions are counted if they contain one or more active Control
Change commands, including commands for controllers 98-101 that
initiate the parameter transaction.
If the most recent counted transaction precedes the most recent
Control Change command for controller 121 (Reset All Controllers) in
the session history, the X bit associated with the COUNT field MUST
be set to 1. Otherwise, the X bit MUST be set to 0.
Transaction counting is performed modulo 128. The transaction count
is set to 0 at the start of a session and is reset to 0 whenever a
Reset State command (Appendix A.1) appears in the session history.
A parameter log that uses the count tool MUST include the COUNT field
if an active command that increments the transaction count (modulo
128) appears in the checkpoint history.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 70]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-71" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="appendix-A.5" href="#appendix-A.5">A.5</a>. Chapter W: MIDI Pitch Wheel</span>
A channel journal MUST contain Chapter W if a C-active MIDI Pitch
Wheel (0xE) command appears in the checkpoint history. Figure A.5.1
shows the format for Chapter W.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| FIRST |R| SECOND |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.5.1 -- Chapter W format
The chapter has a fixed size of 16 bits. The FIRST and SECOND fields
are the 7-bit values of the first and second data octets of the most
recent active Pitch Wheel command in the session history.
Note that Chapter W encodes C-active commands and thus does not
encode active commands that are not C-active (see the second-to-last
paragraph of <a href="#appendix-A.1">Appendix A.1</a> for an explanation of chapter inclusion
text in this regard).
Chapter W does not encode "active but not C-active" commands because
[<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] declares that Control Change commands for controller number
121 (Reset All Controllers) act to reset the Pitch Wheel value to 0.
If Chapter W encoded "active but not C-active" commands, a repair
operation following a Reset All Controllers command could incorrectly
repair the stream with a stale Pitch Wheel value.
<span class="h3"><a class="selflink" id="appendix-A.6" href="#appendix-A.6">A.6</a>. Chapter N: MIDI NoteOff and NoteOn</span>
In this appendix, we consider NoteOn commands with zero velocity to
be NoteOff commands. Readers may wish to review the <a href="#appendix-A.1">Appendix A.1</a>
definition of "N-active commands" before reading this appendix.
Chapter N completely protects note commands in streams that alternate
between NoteOn and NoteOff commands for a particular note number.
However, in rare applications, multiple overlapping NoteOn commands
may appear for a note number. Chapter E, described in <a href="#appendix-A.7">Appendix A.7</a>,
augments Chapter N to completely protect these streams.
A channel journal MUST contain Chapter N if an N-active MIDI NoteOn
(0x9) or NoteOff (0x8) command appears in the checkpoint history.
Figure A.6.1 shows the format for Chapter N.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 71]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-72" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 8 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|B| LEN | LOW | HIGH |S| NOTENUM |Y| VELOCITY |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NOTENUM |Y| VELOCITY | .... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| OFFBITS | OFFBITS | .... | OFFBITS |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.6.1 -- Chapter N format
Chapter N consists of a 2-octet header, followed by at least one of
the following data structures:
o A list of note logs to code NoteOn commands.
o A NoteOff bitfield structure to code NoteOff commands.
We define the header bitfield semantics in <a href="#appendix-A.6.1">Appendix A.6.1</a>. We define
the note log semantics and the NoteOff bitfield semantics in <a href="#appendix-A.6.2">Appendix</a>
<a href="#appendix-A.6.2">A.6.2</a>.
If one or more N-active NoteOn or NoteOff commands in the checkpoint
history reference a note number, the note number MUST be coded in
either the note log list or the NoteOff bitfield structure.
The note log list MUST contain an entry for all note numbers whose
most recent checkpoint history appearance is in an N-active NoteOn
command. The NoteOff bitfield structure MUST contain a set bit for
all note numbers whose most recent checkpoint history appearance is
in an N-active NoteOff command.
A note number MUST NOT be coded in both structures.
All note logs and NoteOff bitfield set bits MUST code the most recent
N-active NoteOn or NoteOff reference to a note number in the session
history.
The note log list MUST obey the oldest-first ordering rule (defined
in <a href="#appendix-A.1">Appendix A.1</a>).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 72]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-73" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h4"><a class="selflink" id="appendix-A.6.1" href="#appendix-A.6.1">A.6.1</a>. Header Structure</span>
The header for Chapter N, shown in Figure A.6.2, codes the size of
the note list and bitfield structures.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|B| LEN | LOW | HIGH |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.6.2 -- Chapter N header
The LEN field, a 7-bit integer value, codes the number of 2-octet
note logs in the note list. Zero is a valid value for LEN and codes
an empty note list.
The 4-bit LOW and HIGH fields code the number of OFFBITS octets that
follow the note log list. LOW and HIGH are unsigned integer values.
If LOW <= HIGH, there are (HIGH - LOW + 1) OFFBITS octets in the
chapter. The value pairs (LOW = 15, HIGH = 0) and (LOW = 15, HIGH =
1) code an empty NoteOff bitfield structure (i.e., no OFFBITS
octets). Other (LOW > HIGH) value pairs MUST NOT appear in the
header.
The B bit provides S-bit functionality (Appendix A.1) for the NoteOff
bitfield structure. By default, the B bit MUST be set to 1.
However, if the MIDI command section of the previous packet (packet I
- 1, with I as defined in <a href="#appendix-A.1">Appendix A.1</a>) includes a NoteOff command
for the channel, the B bit MUST be set to 0. If the B bit is set to
0, the higher-level recovery journal elements that contain Chapter N
MUST have S bits that are set to 0, including the top-level journal
header.
The LEN value of 127 codes a note list length of 127 or 128 note
logs, depending on the values of LOW and HIGH. If LEN = 127, LOW =
15, and HIGH = 0, the note list holds 128 note logs, and the NoteOff
bitfield structure is empty. For other values of LOW and HIGH, LEN =
127 codes that the note list contains 127 note logs. In this case,
the chapter has (HIGH - LOW + 1) NoteOff OFFBITS octets if LOW <=
HIGH and has no OFFBITS octets if LOW = 15 and HIGH = 1.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 73]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-74" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h4"><a class="selflink" id="appendix-A.6.2" href="#appendix-A.6.2">A.6.2</a>. Note Structures</span>
Figure A.6.3 shows the 2-octet note log structure.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NOTENUM |Y| VELOCITY |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.6.3 -- Chapter N note log
The 7-bit NOTENUM field codes the note number for the log. A note
number MUST NOT be represented by multiple note logs in the note
list.
The 7-bit VELOCITY field codes the velocity value for the most recent
N-active NoteOn command for the note number in the session history.
Multiple overlapping NoteOns for a given note number may be coded
using Chapter E, as discussed in <a href="#appendix-A.7">Appendix A.7</a>.
VELOCITY is never zero; NoteOn commands with zero velocity are coded
as NoteOff commands in the NoteOff bitfield structure.
The note log does not code the execution time of the NoteOn command.
However, the Y bit codes a hint from the sender about the NoteOn
execution time. The Y bit codes a recommendation to play (Y = 1) or
skip (Y = 0) the NoteOn command recovered from the note log. See
<a href="./rfc4696#section-4.2">Section 4.2 of [RFC4696]</a> for non-normative guidance on the use of the
Y bit.
Figure A.6.1 shows the NoteOff bitfield structure, as the list of
OFFBITS octets at the end of the chapter. A NoteOff OFFBITS octet
codes NoteOff information for eight consecutive MIDI note numbers,
with the most-significant bit representing the lowest note number.
The most-significant bit of the first OFFBITS octet codes the note
number 8*LOW; the most-significant bit of the last OFFBITS octet
codes the note number 8*HIGH.
A set bit codes a NoteOff command for the note number. In the most
efficient coding for the NoteOff bitfield structure, the first and
last octets of the structure contain at least one set bit. Note that
Chapter N does not code NoteOff velocity data.
Note that in the general case, the recovery journal does not code the
relative placement of a NoteOff command and a Change Control command
for controller 64 (Damper Pedal (Sustain)). In many cases, a
receiver processing a loss event may deduce this relative placement
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 74]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-75" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
from the history of the stream and thus determine if a NoteOff note
is sustained by the pedal. If such a determination is not possible,
receivers SHOULD err on the side of silencing pedal sustains, as
erroneously sustained notes may produce unpleasant (albeit transient)
artifacts.
<span class="h3"><a class="selflink" id="appendix-A.7" href="#appendix-A.7">A.7</a>. Chapter E: MIDI Note Command Extras</span>
Readers may wish to review the <a href="#appendix-A.1">Appendix A.1</a> definition of "N-active
commands" before reading this appendix. In this appendix, a NoteOn
command with a velocity of 0 is considered to be a NoteOff command
with a release velocity value of 64.
Chapter E encodes recovery information about MIDI NoteOn (0x9) and
NoteOff (0x8) command features that rarely appear in MIDI streams.
Receivers use Chapter E to reduce transient artifacts for streams
where several NoteOn commands appear for a note number without an
intervening NoteOff. Receivers also use Chapter E to reduce
transient artifacts for streams that use NoteOff release velocity.
Chapter E supplements the note information coded in Chapter N
(Appendix A.6).
Figure A.7.1 shows the format for Chapter E.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 8 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| LEN |S| NOTENUM |V| COUNT/VEL |S| NOTENUM |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|V| COUNT/VEL | .... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.7.1 -- Chapter E format
The chapter consists of a 1-octet header, followed by a variable-
length list of 2-octet note logs. <a href="#appendix-A.7.1">Appendix A.7.1</a> defines the
bitfield format for a note log.
The log list MUST contain at least one note log. The 7-bit LEN
header field codes the number of note logs in the list, minus one. A
channel journal MUST contain Chapter E if the rules defined in this
appendix require that one or more note logs appear in the list. The
note log list MUST obey the oldest-first ordering rule (defined in
<a href="#appendix-A.1">Appendix A.1</a>).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 75]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-76" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h4"><a class="selflink" id="appendix-A.7.1" href="#appendix-A.7.1">A.7.1</a>. Note Log Format</span>
Figure A.7.2 reproduces the note log structure of Chapter E.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NOTENUM |V| COUNT/VEL |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.7.2 -- Chapter E note log
A note log codes information about the MIDI note number coded by the
7-bit NOTENUM field. The nature of the information depends on the
value of the V flag bit.
If the V bit is set to 1, the COUNT/VEL field codes the release
velocity value for the most recent N-active NoteOff command for the
note number that appears in the session history.
If the V bit is set to 0, the COUNT/VEL field codes a reference count
of the number of NoteOn and NoteOff commands for the note number that
appear in the session history.
The reference count is set to 0 at the start of the session. NoteOn
commands increment the count by 1. NoteOff commands decrement the
count by 1. However, a decrement that generates a negative count
value is not performed.
If the reference count is in the range 0-126, the 7-bit COUNT/VEL
field codes an unsigned integer representation of the count. If the
count is greater than or equal to 127, COUNT/VEL is set to 127.
By default, the count is reset to 0 whenever a Reset State command
(Appendix A.1) appears in the session history, and whenever MIDI
Control Change commands for controller numbers 123-127 (numbers with
All Notes Off semantics) or 120 (All Sound Off) appear in the session
history.
<span class="h4"><a class="selflink" id="appendix-A.7.2" href="#appendix-A.7.2">A.7.2</a>. Log Inclusion Rules</span>
If the most recent N-active NoteOn or NoteOff command for a note
number in the checkpoint history is a NoteOff command with a release
velocity value other than 64, a note log whose V bit is set to 1 MUST
appear in Chapter E for the note number.
If the most recent N-active NoteOn or NoteOff command for a note
number in the checkpoint history is a NoteOff command, and if the
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 76]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-77" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
reference count for the note number is greater than 0, a note log
whose V bit is set to 0 MUST appear in Chapter E for the note number.
If the most recent N-active NoteOn or NoteOff command for a note
number in the checkpoint history is a NoteOn command, and if the
reference count for the note number is greater than 1, a note log
whose V bit is set to 0 MUST appear in Chapter E for the note number.
At most, two note logs MAY appear in Chapter E for a note number: one
log whose V bit is set to 0, and one log whose V bit is set to 1.
Chapter E codes a maximum of 128 note logs. If the log inclusion
rules yield more than 128 REQUIRED logs, note logs whose V bit is set
to 1 MUST be dropped from Chapter E in order to reach the 128-log
limit. Note logs whose V bit is set to 0 MUST NOT be dropped.
Most MIDI streams do not use NoteOn and NoteOff commands in ways that
would trigger the log inclusion rules. For these streams, Chapter E
would never be REQUIRED to appear in a channel journal.
The ch_never parameter (Appendix C.2.3) may be used to configure the
log inclusion rules for Chapter E.
<span class="h3"><a class="selflink" id="appendix-A.8" href="#appendix-A.8">A.8</a>. Chapter T: MIDI Channel Aftertouch</span>
A channel journal MUST contain Chapter T if an N-active and C-active
MIDI Channel Aftertouch (0xD) command appears in the checkpoint
history. Figure A.8.1 shows the format for Chapter T.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|S| PRESSURE |
+-+-+-+-+-+-+-+-+
Figure A.8.1 -- Chapter T format
The chapter has a fixed size of 8 bits. The 7-bit PRESSURE field
holds the pressure value of the most recent N-active and C-active
Channel Aftertouch command in the session history.
Chapter T only encodes commands that are C-active and N-active. We
define a C-active restriction because [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>] declares that a Control
Change command for controller 121 (Reset All Controllers) acts to
reset the channel pressure to 0 (see the discussion at the end of
<a href="#appendix-A.5">Appendix A.5</a> for a more complete rationale).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 77]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-78" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We define an N-active restriction on the assumption that aftertouch
commands are linked to note activity, and thus Channel Aftertouch
commands that are not N-active are stale and should not be used to
repair a stream.
<span class="h3"><a class="selflink" id="appendix-A.9" href="#appendix-A.9">A.9</a>. Chapter A: MIDI Poly Aftertouch</span>
A channel journal MUST contain Chapter A if a C-active Poly
Aftertouch (0xA) command appears in the checkpoint history. Figure
A.9.1 shows the format for Chapter A.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 8 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| LEN |S| NOTENUM |X| PRESSURE |S| NOTENUM |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|X| PRESSURE | .... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.9.1 -- Chapter A format
The chapter consists of a 1-octet header, followed by a variable-
length list of 2-octet note logs. A note log MUST appear for a note
number if a C-active Poly Aftertouch command for the note number
appears in the checkpoint history. A note number MUST NOT be
represented by multiple note logs in the note list. The note log
list MUST obey the oldest-first ordering rule (defined in <a href="#appendix-A.1">Appendix</a>
<a href="#appendix-A.1">A.1</a>).
The 7-bit LEN field codes the number of note logs in the list, minus
one. Figure A.9.2 reproduces the note log structure of Chapter A.
0 1
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S| NOTENUM |X| PRESSURE |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure A.9.2 -- Chapter A note log
The 7-bit PRESSURE field codes the pressure value of the most recent
C-active Poly Aftertouch command in the session history for the MIDI
note number coded in the 7-bit NOTENUM field.
As a rule, the X bit MUST be set to 0. However, the X bit MUST be
set to 1 if the command coded by the log appears before one of the
following commands in the session history: MIDI Control Change
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 78]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-79" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
numbers 123-127 (numbers with All Notes Off semantics) or 120 (All
Sound Off).
We define C-active restrictions for Chapter A because [<a href="#ref-RP015" title=""Recommended Practice 015 (RP-015): Response to Reset All Controllers"">RP015</a>]
declares that a Control Change command for controller 121 (Reset All
Controllers) acts to reset the polyphonic pressure to 0 (see the
discussion at the end of <a href="#appendix-A.5">Appendix A.5</a> for a more complete rationale).
<span class="h2"><a class="selflink" id="appendix-B" href="#appendix-B">B</a>. The Recovery Journal System Chapters</span>
<span class="h3"><a class="selflink" id="appendix-B.1" href="#appendix-B.1">B.1</a>. System Chapter D: Simple System Commands</span>
The system journal MUST contain Chapter D if an active MIDI Reset
(0xFF), MIDI Tune Request (0xF6), MIDI Song Select (0xF3), undefined
MIDI System Common (0xF4 and 0xF5), or undefined MIDI System Real-
time (0xF9 and 0xFD) command appears in the checkpoint history.
Figure B.1.1 shows the variable-length format for Chapter D.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|B|G|H|J|K|Y|Z| Command logs ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.1.1 -- System Chapter D format
The chapter consists of a 1-octet header, followed by one or more
command logs. Header flag bits indicate the presence of command logs
for the Reset (B = 1), Tune Request (G = 1), Song Select (H = 1),
undefined System Common 0xF4 (J = 1), undefined System Common 0xF5 (K
= 1), undefined System Real-time 0xF9 (Y = 1), or undefined System
Real-time 0xFD (Z = 1) commands.
Command logs appear in a list following the header, in the order that
the flag bits appear in the header.
Figure B.1.2 shows the 1-octet command log format for the Reset and
Tune Request commands.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|S| COUNT |
+-+-+-+-+-+-+-+-+
Figure B.1.2 -- Command log for Reset and Tune Request
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 79]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-80" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Chapter D MUST contain the Reset command log if an active Reset
command appears in the checkpoint history. The 7-bit COUNT field
codes the total number of Reset commands (modulo 128) present in the
session history.
Chapter D MUST contain the Tune Request command log if an active Tune
Request command appears in the checkpoint history. The 7-bit COUNT
field codes the total number of Tune Request commands (modulo 128)
present in the session history.
For these commands, the COUNT field acts as a reference count. See
the definition of "session history reference counts" in <a href="#appendix-A.1">Appendix A.1</a>
for more information.
Figure B.1.3 shows the 1-octet command log format for the Song Select
command.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|S| VALUE |
+-+-+-+-+-+-+-+-+
Figure B.1.3 -- Song Select command log format
Chapter D MUST contain the Song Select command log if an active Song
Select command appears in the checkpoint history. The 7-bit VALUE
field codes the song number of the most recent active Song Select
command in the session history.
<span class="h4"><a class="selflink" id="appendix-B.1.1" href="#appendix-B.1.1">B.1.1</a>. Undefined System Commands</span>
In this section, we define the Chapter D command logs for the
undefined System commands. [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] reserves the undefined System
commands 0xF4, 0xF5, 0xF9, and 0xFD for future use. At the time of
this writing, any MIDI command stream that uses these commands is
non-compliant with [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. However, future versions of [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] may
define these commands, and a few products do use these commands in a
non-compliant manner.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 80]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-81" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Figure B.1.4 shows the variable-length command log format for the
undefined System Common commands (0xF4 and 0xF5).
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|C|V|L|DSZ| LENGTH | COUNT | VALUE ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| LEGAL ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.1.4 -- Undefined System Common command log format
The command log codes a single command type (0xF4 or 0xF5, not both).
Chapter D MUST contain a command log if an active 0xF4 command
appears in the checkpoint history and MUST contain an independent
command log if an active 0xF5 command appears in the checkpoint
history.
Chapter D consists of a two-octet header followed by a variable
number of data fields. Header flag bits indicate the presence of the
COUNT field (C = 1), the VALUE field (V = 1), and the LEGAL field (L
= 1). The 10-bit LENGTH field codes the size of the command log and
conforms to semantics described in <a href="#appendix-A.1">Appendix A.1</a>.
The 2-bit DSZ field codes the number of data octets in the command
instance that appears most recently in the session history. If DSZ =
0-2, the command has 0-2 data octets. If DSZ = 3, the command has 3
or more command data octets.
We now define the default rules for the use of the COUNT, VALUE, and
LEGAL fields. The session configuration tools defined in <a href="#appendix-C.2.3">Appendix</a>
<a href="#appendix-C.2.3">C.2.3</a> may be used to override this behavior.
By default, if the DSZ field is set to 0, the command log MUST
include the COUNT field. The 8-bit COUNT field codes the total
number of commands of the type coded by the log (0xF4 or 0xF5)
present in the session history, modulo 256.
By default, if the DSZ field is set to 1-3, the command log MUST
include the VALUE field. The variable-length VALUE field codes a
verbatim copy the data octets for the most recent use of the command
type coded by the log (0xF4 or 0xF5) in the session history. The
most-significant bit of the final data octet MUST be set to 1, and
the most-significant bit of all other data octets MUST be set to 0.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 81]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-82" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The LEGAL field is reserved for future use. If an update to [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]
defines the 0xF4 or 0xF5 command, an IETF standards-track document
may define the LEGAL field. Until such a document appears, senders
MUST NOT use the LEGAL field, and receivers MUST use the LENGTH field
to skip over the LEGAL field. The LEGAL field would be defined by
the IETF if the semantics of the new 0xF4 or 0xF5 command could not
be protected from packet loss via the use of the COUNT and VALUE
fields.
Figure B.1.5 shows the variable-length command log format for the
undefined System Real-time commands (0xF9 and 0xFD).
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|C|L| LENGTH | COUNT | LEGAL ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.1.5 -- Undefined System Real-time command log format
The command log codes a single command type (0xF9 or 0xFD, not both).
Chapter D MUST contain a command log if an active 0xF9 command
appears in the checkpoint history and MUST contain an independent
command log if an active 0xFD command appears in the checkpoint
history.
Chapter D consists of a one-octet header followed by a variable
number of data fields. Header flag bits indicate the presence of the
COUNT field (C = 1) and the LEGAL field (L = 1). The 5-bit LENGTH
field codes the size of the command log and conforms to semantics
described in <a href="#appendix-A.1">Appendix A.1</a>.
We now define the default rules for the use of the COUNT and LEGAL
fields. The session configuration tools defined in <a href="#appendix-C.2.3">Appendix C.2.3</a>
may be used to override this behavior.
The 8-bit COUNT field codes the total number of commands of the type
coded by the log present in the session history, modulo 256. By
default, the COUNT field MUST be present in the command log.
The LEGAL field is reserved for future use. If an update to [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]
defines the 0xF9 or 0xFD command, an IETF standards-track document
may define the LEGAL field to protect the command. Until such a
document appears, senders MUST NOT use the LEGAL field, and receivers
MUST use the LENGTH field to skip over the LEGAL field. The LEGAL
field would be defined by the IETF if the semantics of the new 0xF9
or 0xFD command could not be protected from packet loss via the use
of the COUNT field.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 82]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-83" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Finally, we note that some non-standard uses of the undefined System
Real-time commands act to implement non-compliant variants of the
MIDI sequencer system. In <a href="#appendix-B.3.1">Appendix B.3.1</a>, we describe resiliency
tools for the MIDI sequencer system that provide some protection in
this case.
<span class="h3"><a class="selflink" id="appendix-B.2" href="#appendix-B.2">B.2</a>. System Chapter V: Active Sense Command</span>
The system journal MUST contain Chapter V if an active MIDI Active
Sense (0xFE) command appears in the checkpoint history. Figure B.2.1
shows the format for Chapter V.
0
0 1 2 3 4 5 6 7
+-+-+-+-+-+-+-+-+
|S| COUNT |
+-+-+-+-+-+-+-+-+
Figure B.2.1 -- System Chapter V format
The 7-bit COUNT field codes the total number of Active Sense commands
(modulo 128) present in the session history. The COUNT field acts as
a reference count. See the definition of "session history reference
counts" in <a href="#appendix-A.1">Appendix A.1</a> for more information.
<span class="h3"><a class="selflink" id="appendix-B.3" href="#appendix-B.3">B.3</a>. System Chapter Q: Sequencer State Commands</span>
This appendix describes Chapter Q, the system chapter for the MIDI
sequencer commands.
The system journal MUST contain Chapter Q if an active MIDI Song
Position Pointer (0xF2), MIDI Clock (0xF8), MIDI Start (0xFA), MIDI
Continue (0xFB), or MIDI Stop (0xFC) command appears in the
checkpoint history, and if the rules defined in this appendix require
a change in the Chapter Q bitfield contents because of the command
appearance.
Figure B.3.1 shows the variable-length format for Chapter Q.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|N|D|C|T| TOP | CLOCK | TIMETOOLS ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.3.1 -- System Chapter Q format
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 83]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-84" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Chapter Q consists of a 1-octet header followed by several optional
fields, in the order shown in Figure B.3.1.
Header flag bits signal the presence of the 16-bit CLOCK field (C =
1) and the 24-bit TIMETOOLS field (T = 1). The 3-bit TOP header
field is interpreted as an unsigned integer, as are CLOCK and
TIMETOOLS. We describe the TIMETOOLS field in <a href="#appendix-B.3.1">Appendix B.3.1</a>.
Chapter Q encodes the most recent state of the sequencer system.
Receivers use the chapter to re-synchronize the sequencer after a
packet loss episode. Chapter fields encode the on/off state of the
sequencer, the current position in the song, and the downbeat.
The N header bit encodes the relative occurrence of the Start, Stop,
and Continue commands in the session history. If an active Start or
Continue command appears most recently, the N bit MUST be set to 1.
If an active Stop appears most recently, or if no active Start, Stop,
or Continue commands appear in the session history, the N bit MUST be
set to 0.
The C header flag, the TOP header field, and the CLOCK field act to
code the current position in the sequence:
o If C = 1, the 3-bit TOP header field and the 16-bit CLOCK field
are combined to form the 19-bit unsigned quantity 65536*TOP +
CLOCK. This value encodes the song position in units of MIDI
Clocks (24 clocks per quarter note), modulo 524288. Note that
the maximum song position value that may be coded by the Song
Position Pointer command is 98303 clocks (which may be coded
with 17 bits), and that MIDI-coded songs are generally
constructed to avoid durations longer than this value. However,
the 19-bit size may be useful for real-time applications, such
as a drum machine MIDI output that is sending clock commands for
long periods of time.
o If C = 0, the song position is the start of the song. The C = 0
position is identical to the position coded by C = 1, TOP = 0,
and CLOCK = 0, for the case where the song position is less than
524288 MIDI clocks. In certain situations (defined later in
this section), normative text may require the C = 0 or the C =
1, TOP = 0, CLOCK = 0 encoding of the start of the song.
The C, TOP, and CLOCK fields MUST be set to code the current song
position, for both N = 0 and N = 1 conditions. If C = 0, the TOP
field MUST be set to 0. See [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] for a precise definition of a
song position.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 84]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-85" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The D header bit encodes information about the downbeat and acts to
qualify the song position coded by the C, TOP, and CLOCK fields.
If the D bit is set to 1, the song position represents the most
recent position in the sequence that has played. If D = 1, the next
Clock command (if N = 1) or the next (Continue, Clock) pair (if
N = 0) acts to increment the song position by one clock, and to play
the updated position.
If the D bit is set to 0, the song position represents a position in
the sequence that has not yet been played. If D = 0, the next Clock
command (if N = 1) or the next (Continue, Clock) pair (if N = 0) acts
to play the point in the song coded by the song position. The song
position is not incremented.
An example of a stream that uses D = 0 coding is one whose most
recent sequence command is a Start or Song Position Pointer command
(both N = 1 conditions). However, it is also possible to construct
examples where D = 0 and N = 0. A Start command immediately followed
by a Stop command is coded in Chapter Q by setting C = 0, D = 0,
N = 0, TOP = 0.
If N = 1 (coding Start or Continue), D = 0 (coding that the downbeat
has yet to be played), and the song position is at the start of the
song, the C = 0 song position encoding MUST be used if a Start
command occurs more recently than a Continue command in the session
history, and the C = 1, TOP = 0, CLOCK = 0 song position encoding
MUST be used if a Continue command occurs more recently than a Start
command in the session history.
<span class="h4"><a class="selflink" id="appendix-B.3.1" href="#appendix-B.3.1">B.3.1</a>. Non-compliant Sequencers</span>
The Chapter Q description in this appendix assumes that the sequencer
system counts off time with Clock commands, as mandated in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
However, a few non-compliant products do not use Clock commands to
count off time, but instead use non-standard methods.
Chapter Q uses the TIMETOOLS field to provide resiliency support for
these non-standard products. By default, the TIMETOOLS field MUST
NOT appear in Chapter Q, and the T header bit MUST be set to 0. The
session configuration tools described in <a href="#appendix-C.2.3">Appendix C.2.3</a> may be used
to select TIMETOOLS coding.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 85]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-86" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Figure B.3.2 shows the format of the 24-bit TIMETOOLS field.
0 1 2
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| TIME |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.3.2 -- TIMETOOLS format
The TIME field is a 24-bit unsigned integer quantity, with units of
milliseconds. TIME codes an additive correction term for the song
position coded by the TOP, CLOCK, and C fields. TIME is coded in
network byte order (big-endian).
A receiver computes the correct song position by converting TIME into
units of MIDI clocks and adding it to 65536*TOP + CLOCK (assuming
C = 1). Alternatively, a receiver may convert 65536*TOP + CLOCK into
milliseconds (assuming C = 1) and add it to TIME. The downbeat (D
header bit) semantics defined in <a href="#appendix-B.3">Appendix B.3</a> apply to the corrected
song position.
<span class="h3"><a class="selflink" id="appendix-B.4" href="#appendix-B.4">B.4</a>. System Chapter F: MIDI Time Code Tape Position</span>
This appendix describes Chapter F, the system chapter for the MIDI
Time Code (MTC) commands. Readers may wish to review the <a href="#appendix-A.1">Appendix</a>
<a href="#appendix-A.1">A.1</a> definition of "finished/unfinished commands" before reading this
appendix.
The system journal MUST contain Chapter F if an active System Common
Quarter Frame command (0xF1) or an active finished System Exclusive
(Universal Real Time) MTC Full Frame command (F0 7F cc 01 01 hr mn sc
fr F7) appears in the checkpoint history. Otherwise, the system
journal MUST NOT contain Chapter F.
Figure B.4.1 shows the variable-length format for Chapter F.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|C|P|Q|D|POINT| COMPLETE ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| ... | PARTIAL ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| ... |
+-+-+-+-+-+-+-+-+
Figure B.4.1 -- System Chapter F format
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 86]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-87" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Chapter F holds information about recent MTC tape positions coded in
the session history. Receivers use Chapter F to re-synchronize the
MTC system after a packet loss episode.
Chapter F consists of a 1-octet header followed by several optional
fields, in the order shown in Figure B.4.1. The C and P header bits
form a Table of Contents (TOC) and signal the presence of the 32-bit
COMPLETE field (C = 1) and the 32-bit PARTIAL field (P = 1).
The Q header bit codes information about the COMPLETE field format.
If Chapter F does not contain a COMPLETE field, Q MUST be set to 0.
The D header bit codes the tape movement direction. If the tape is
moving forward, or if the tape direction is indeterminate, the D bit
MUST be set to 0. If the tape is moving in the reverse direction,
the D bit MUST be set to 1. In most cases, the ordering of commands
in the session history clearly defines the tape direction. However,
a few command sequences have an indeterminate direction (such as a
session history consisting of one Full Frame command).
The 3-bit POINT header field is interpreted as an unsigned integer.
<a href="#appendix-B.4.1">Appendix B.4.1</a> defines how the POINT field codes information about
the contents of the PARTIAL field. If Chapter F does not contain a
PARTIAL field, POINT MUST be set to 7 (if D = 0) or 0 (if D = 1).
Chapter F MUST include the COMPLETE field if an active finished Full
Frame command appears in the checkpoint history, or if an active
Quarter Frame command that completes the encoding of a frame value
appears in the checkpoint history.
The COMPLETE field encodes the most recent active complete MTC frame
value that appears in the session history. This frame value may take
the form of a series of 8 active Quarter Frame commands (0xF1 0x0n
through 0xF1 0x7n for forward tape movement, 0xF1 0x7n through 0xF1
0x0n for reverse tape movement) or may take the form of an active
finished Full Frame command.
If the COMPLETE field encodes a Quarter Frame command series, the Q
header bit MUST be set to 1, and the COMPLETE field MUST have the
format shown in Figure B.4.2. The 4-bit fields MT0 through MT7 code
the data (lower) nibble for the Quarter Frame commands for Message
Type 0 through Message Type 7 [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. These nibbles encode a
complete frame value, in addition to fields reserved for future use
by [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 87]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-88" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| MT0 | MT1 | MT2 | MT3 | MT4 | MT5 | MT6 | MT7 |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.4.2 -- COMPLETE field format, Q = 1
In this usage, the frame value encoded in the COMPLETE field MUST be
offset by 2 frames (relative to the frame value encoded in the
Quarter Frame commands) if the frame value codes a 0xF1 0x0n through
0xF1 0x7n command sequence. This offset compensates for the two-
frame latency of the Quarter Frame encoding for forward tape
movement. No offset is applied if the frame value codes a 0xF1 0x7n
through 0xF1 0x0n Quarter Frame command sequence.
The most recent active complete MTC frame value may alternatively be
encoded by an active finished Full Frame command. In this case, the
Q header bit MUST be set to 0, and the COMPLETE field MUST have
format shown in Figure B.4.3. The HR, MN, SC, and FR fields
correspond to the hr, mn, sc, and fr data octets of the Full Frame
command.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| HR | MN | SC | FR |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.4.3 -- COMPLETE field format, Q = 0
<span class="h4"><a class="selflink" id="appendix-B.4.1" href="#appendix-B.4.1">B.4.1</a>. Partial Frames</span>
The most recent active session history command that encodes MTC frame
value data may be a Quarter Frame command other than a forward-moving
0xF1 0x7n command (which completes a frame value for forward tape
movement) or a reverse-moving 0xF1 0x1n command (which completes a
frame value for reverse tape movement).
We consider this type of Quarter Frame command to be associated with
a partial frame value. The Quarter Frame sequence that defines a
partial frame value MUST either start at Message Type 0 and increment
contiguously to an intermediate Message Type less than 7, or start at
Message Type 7 and decrement contiguously to an intermediate Message
type greater than 0. A Quarter Frame command sequence that does not
follow this pattern is not associated with a partial frame value.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 88]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-89" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Chapter F MUST include a PARTIAL field if the most recent active
command in the checkpoint history that encodes MTC frame value data
is a Quarter Frame command that is associated with a partial frame
value. Otherwise, Chapter F MUST NOT include a PARTIAL field.
The partial frame value consists of the data (lower) nibbles of the
Quarter Frame command sequence. The PARTIAL field codes the partial
frame value, using the format shown in Figure B.4.2. Message Type
fields that are not associated with a Quarter Frame command MUST be
set to 0.
The POINT header field indicates the Message Type fields in the
PARTIAL field code valid data. If P = 1, the POINT field MUST encode
the unsigned integer value formed by the lower 3 bits of the upper
nibble of the data value of the most recent active Quarter Frame
command in the session history. If D = 0 and P = 1, POINT MUST take
on a value in the range 0-6. If D = 1 and P = 1, POINT MUST take on
a value in the range 1-7.
If D = 0, MT fields (Figure B.4.2) in the inclusive range from 0 up
to and including the POINT value encode the partial frame value. If
D = 1, MT fields in the inclusive range from 7 down to and including
the POINT value encode the partial frame value. Note that, unlike
the COMPLETE field encoding, senders MUST NOT add a 2-frame offset to
the partial frame value encoded in PARTIAL.
For the default semantics, if a recovery journal contains Chapter F,
and if the session history codes a legal [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] series of Quarter
Frame and Full Frame commands, the chapter always contains a COMPLETE
or a PARTIAL field (and may contain both fields). Thus, a one-octet
Chapter F (C = P = 0) always codes the presence of an illegal command
sequence in the session history (under some conditions, the C = 1,
P = 0 condition may also code the presence of an illegal command
sequence). The illegal command sequence conditions are transient in
nature and usually indicate that a Quarter Frame command sequence
began with an intermediate Message Type.
<span class="h3"><a class="selflink" id="appendix-B.5" href="#appendix-B.5">B.5</a>. System Chapter X: System Exclusive</span>
This appendix describes Chapter X, the system chapter for MIDI System
Exclusive (SysEx) commands (0xF0). Readers may wish to review the
<a href="#appendix-A.1">Appendix A.1</a> definition of "finished/unfinished commands" before
reading this appendix.
Chapter X consists of a list of one or more command logs. Each log
in the list codes information about a specific finished or unfinished
SysEx command that appears in the session history. The system
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 89]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-90" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
journal MUST contain Chapter X if the rules defined in <a href="#appendix-B.5.2">Appendix B.5.2</a>
require that one or more logs appear in the list.
The log list is not preceded by a header. Instead, each log
implicitly encodes its own length. Given the length of the N'th list
log, the presence of the (N+1)'th list log may be inferred from the
LENGTH field of the system journal header (Figure 10 in <a href="#section-5">Section 5</a> of
the main text). The log list MUST obey the oldest-first ordering
rule (defined in <a href="#appendix-A.1">Appendix A.1</a>).
<span class="h4"><a class="selflink" id="appendix-B.5.1" href="#appendix-B.5.1">B.5.1</a>. Chapter Format</span>
Figure B.5.1 shows the bitfield format for the Chapter X command log.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|S|T|C|F|D|L|STA| TCOUNT | COUNT | FIRST ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| DATA ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure B.5.1 -- Chapter X command log format
A Chapter X command log consists of a 1-octet header, followed by the
optional TCOUNT, COUNT, FIRST, and DATA fields.
The T, C, F, and D header bits act as a Table of Contents (TOC) for
the log. If T is set to 1, the 1-octet TCOUNT field appears in the
log. If C is set to 1, the 1-octet COUNT field appears in the log.
If F is set to 1, the variable-length FIRST field appears in the log.
If D is set to 1, the variable-length DATA field appears in the log.
The L header bit sets the coding tool for the log. We define the log
coding tools in <a href="#appendix-B.5.2">Appendix B.5.2</a>.
The STA field codes the status of the command coded by the log. The
2-bit STA value is interpreted as an unsigned integer. If STA is 0,
the log codes an unfinished command. Non-zero STA values code
different classes of finished commands. An STA value of 1 codes a
cancelled command, an STA value of 2 codes a command that uses the
"dropped F7" construction, and an STA value of 3 codes all other
finished commands. <a href="#section-3.2">Section 3.2</a> in the main text describes cancelled
and "dropped F7" commands.
The S bit (Appendix A.1) of the first log in the list acts as the S
bit for Chapter X. For the other logs in the list, the S bit refers
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 90]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-91" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
to the log itself. The value of the "phantom" S bit associated with
the first log is defined by the following rules:
o If the list codes one log, the phantom S-bit value is the same
as the Chapter X S-bit value.
o If the list codes multiple logs, the phantom S-bit value is the
logical OR of the S-bit value of the first and second command
logs in the list.
In all other respects, the S bit follows the semantics defined in
<a href="#appendix-A.1">Appendix A.1</a>.
The FIRST field (present if F = 1) encodes a variable-length unsigned
integer value that sets the coverage of the DATA field.
The FIRST field (present if F = 1) encodes a variable-length unsigned
integer value that specifies which SysEx data bytes are encoded in
the DATA field of the log. The FIRST field consists of an octet
whose most-significant bit is set to 0, optionally preceded by one or
more octets whose most-significant bit is set to 1. The algorithm
shown in Figure B.5.2 decodes this format into an unsigned integer,
to yield the value dec(FIRST). FIRST uses a variable-length encoding
because dec(FIRST) references a data octet in a SysEx command, and a
SysEx command may contain an arbitrary number of data octets.
One-Octet FIRST value:
Encoded form: 0ddddddd
Decoded form: 00000000 00000000 00000000 0ddddddd
Two-Octet FIRST value:
Encoded form: 1ccccccc 0ddddddd
Decoded form: 00000000 00000000 00cccccc cddddddd
Three-Octet FIRST value:
Encoded form: 1bbbbbbb 1ccccccc 0ddddddd
Decoded form: 00000000 000bbbbb bbcccccc cddddddd
Four-Octet FIRST value:
Encoded form: 1aaaaaaa 1bbbbbbb 1ccccccc 0ddddddd
Decoded form: 0000aaaa aaabbbbb bbcccccc cddddddd
Figure B.5.2 -- Decoding FIRST field formats
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 91]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-92" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The DATA field (present if D = 1) encodes a modified version of the
data octets of the SysEx command coded by the log. Status octets
MUST NOT be coded in the DATA field.
If F = 0, the DATA field begins with the first data octet of the
SysEx command and includes all subsequent data octets for the command
that appear in the session history. If F = 1, the DATA field begins
with the (dec(FIRST) + 1)'th data octet of the SysEx command and
includes all subsequent data octets for the command that appear in
the session history. Note that the word "command" in the
descriptions above refers to the original SysEx command as it appears
in the source MIDI data stream, not to a particular MIDI list SysEx
command segment.
The length of the DATA field is coded implicitly, using the most-
significant bit of each octet. The most-significant bit of the final
octet of the DATA field MUST be set to 1. The most-significant bit
of all other DATA octets MUST be set to 0. This coding method relies
on the fact that the most-significant bit of a MIDI data octet is 0
by definition. Apart from this length-coding modification, the DATA
field encodes a verbatim copy of all data octets it encodes.
<span class="h4"><a class="selflink" id="appendix-B.5.2" href="#appendix-B.5.2">B.5.2</a>. Log Inclusion Semantics</span>
Chapter X offers two tools to protect SysEx commands: the "recency"
tool and the "list" tool. The tool definitions use the concept of
the "SysEx type" of a command, which we now define.
Each SysEx command instance in a session, excepting MTC Full Frame
commands, is said to have a "SysEx type". Types are used in equality
comparisons: two SysEx commands in a session are said to have "the
same SysEx type" or "different SysEx types".
If efficiency is not a concern, a sender may follow a simple typing
rule: every SysEx command in the session history has a different
SysEx type, and thus no two commands in the session have the same
type.
To improve efficiency, senders MAY implement exceptions to this rule.
These exceptions declare that certain sets of SysEx command instances
have the same SysEx type. Any command not covered by an exception
follows the simple rule. We list exceptions below:
o All commands with identical data octet fields (same number of
data octets, same value for each data octet) have the same type.
This rule MUST be applied to all SysEx commands in the session,
or not at all. Note that the implementation of this exception
requires no sender knowledge of the format and semantics of the
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 92]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-93" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
SysEx commands in the stream, merely the ability to count and
compare octets.
o Two instances of the same command whose semantics set or report
the value of the same "parameter" have the same type. The
implementation of this exception requires specific knowledge of
the format and semantics of SysEx commands. In practice, a
sender implementation chooses to support this exception for
certain classes of commands (such as the Universal System
Exclusive commands defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]). If a sender supports
this exception for a particular command in a class (for example,
the Universal Real Time System Exclusive message for Master
Volume, F0 F7 cc 04 01 vv vv F7, defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]), it MUST
support the exception to all instances of this particular
command in the session.
We now use this definition of "SysEx type" to define the "recency"
tool and the "list" tool for Chapter X.
By default, the Chapter X log list MUST code sufficient information
to protect the rendered MIDI performance from indefinite artifacts
caused by the loss of all finished or unfinished active SysEx
commands that appear in the checkpoint history (excluding finished
MTC Full Frame commands, which are coded in Chapter F (Appendix
B.4)).
To protect a command of a specific SysEx type with the recency tool,
senders MUST code a log in the log list for the most recent finished
active instance of the SysEx type that appears in the checkpoint
history. Additionally, if an unfinished active instance of the SysEx
type appears in the checkpoint history, senders MUST code a log in
the log list for the unfinished command instance. The L header bit
of both command logs MUST be set to 0.
To protect a command of a specific SysEx type with the list tool,
senders MUST code a log in the Chapter X log list for each finished
or unfinished active instance of the SysEx type that appears in the
checkpoint history. The L header bit of list tool command logs MUST
be set to 1.
As a rule, a log REQUIRED by the list or recency tool MUST include a
DATA field that codes all data octets that appear in the checkpoint
history for the SysEx command instance associated with the log. The
FIRST field MAY be used to configure a DATA field that minimally
meets this requirement.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 93]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-94" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
An exception to this rule applies to cancelled commands (defined in
<a href="#section-3.2">Section 3.2</a>). REQUIRED command logs associated with cancelled
commands MAY be coded with no DATA field. However, if DATA appears
in the log, DATA MUST code all data octets that appear in the
checkpoint history for the command associated with the log.
As defined by the preceding text in this section, by default all
finished or unfinished active SysEx commands that appear in the
checkpoint history (excluding finished MTC Full Frame commands) MUST
be protected by the list tool or the recency tool.
For some MIDI source streams, this default yields a Chapter X whose
size is too large. For example, imagine that a sender begins to
transcode a SysEx command with 10,000 data octets onto a UDP RTP
stream "on the fly", by sending SysEx command segments as soon as
data octets are delivered by the MIDI source. After 1000 octets have
been sent, the expansion of Chapter X yields an RTP packet that is
too large to fit in the Maximum Transmission Unit (MTU) for the
stream.
In this situation, if a sender uses the closed-loop sending policy
for SysEx commands, the RTP packet size may always be capped by
stalling the stream. In a stream stall, once the packet reaches a
maximum size, the sender refrains from sending new packets with non-
empty MIDI Command Sections until receiver feedback permits the
trimming of Chapter X. If the stream permits arbitrary commands to
appear between SysEx segments (selectable during configuration using
the tools defined in <a href="#appendix-C.1">Appendix C.1</a>), the sender may stall the SysEx
segment stream but continue to code other commands in the MIDI list.
Stalls are a workable but sub-optimal solution to Chapter X size
issues. As an alternative to stalls, senders SHOULD take preemptive
action during session configuration to reduce the anticipated size of
Chapter X, using the methods described below:
o Partitioned transport. <a href="#appendix-C.5">Appendix C.5</a> provides tools for sending
a MIDI name space over several RTP streams. Senders may use
these tools to map a MIDI source into a low-latency UDP RTP
stream (for channel commands and short SysEx commands) and a
reliable [<a href="./rfc4571" title=""Framing Real-time Transport Protocol (RTP) and RTP Control Protocol (RTCP) Packets over Connection- Oriented Transport"">RFC4571</a>] TCP stream (for bulk-data SysEx commands).
The cm_unused and cm_used parameters (Appendix C.1) may be used
to communicate the nature of the SysEx command partition. As
TCP is reliable, the RTP MIDI TCP stream would not use the
recovery journal. To minimize transmission latency for short
SysEx commands, senders may begin segmental transmission for all
SysEx commands over the UDP stream and then cancel the UDP
transmission of long commands (using tools described in <a href="#section-3.2">Section</a>
<a href="#section-3.2">3.2</a>) and resend the commands over the TCP stream.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 94]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-95" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o Selective protection. Journal protection may not be necessary
for all SysEx commands in a stream. The ch_never parameter
(Appendix C.2) may be used to communicate which SysEx commands
are excluded from Chapter X.
<span class="h4"><a class="selflink" id="appendix-B.5.3" href="#appendix-B.5.3">B.5.3</a>. TCOUNT and COUNT Fields</span>
If the T header bit is set to 1, the 8-bit TCOUNT field appears in
the command log. If the C header bit is set to 1, the 8-bit COUNT
field appears in the command log. TCOUNT and COUNT are interpreted
as unsigned integers.
The TCOUNT field codes the total number of SysEx commands of the
SysEx type coded by the log that appear in the session history, at
the moment after the (finished or unfinished) command coded by the
log enters the session history.
The COUNT field codes the total number of SysEx commands that appear
in the session history, excluding commands that are excluded from
Chapter X via the ch_never parameter (Appendix C.2), at the moment
after the (finished or unfinished) command coded by the log enters
the session history.
Command counting for TCOUNT and COUNT uses modulo-256 arithmetic.
MTC Full Frame command instances (Appendix B.4) are included in
command counting if the TCOUNT and COUNT definitions warrant their
inclusion, as are cancelled commands (<a href="#section-3.2">Section 3.2</a>).
Senders use the TCOUNT and COUNT fields to track the identity and
(for TCOUNT) the sequence position of a command instance. Senders
MUST use the TCOUNT or COUNT fields if identity or sequence
information is necessary to protect the command type coded by the
log.
If a sender uses the COUNT field in a session, the final command log
in every Chapter X in the stream MUST code the COUNT field. This
rule lets receivers resynchronize the COUNT value after a packet
loss.
<span class="h2"><a class="selflink" id="appendix-C" href="#appendix-C">C</a>. Session Configuration Tools</span>
In Sections <a href="#section-6.1">6.1</a>-<a href="#section-2">2</a> of the main text, we show session descriptions for
minimal native and mpeg4-generic RTP MIDI streams. Minimal streams
lack the flexibility to support some applications. In this appendix,
we describe how to customize stream behavior through the use of the
payload format parameters.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 95]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-96" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The appendix begins with 6 sections, each devoted to parameters that
affect a particular aspect of stream behavior:
o <a href="#appendix-C.1">Appendix C.1</a> describes the stream subsetting system (cm_unused
and cm_used).
o <a href="#appendix-C.2">Appendix C.2</a> describes the journalling system (ch_anchor,
ch_default, ch_never, j_sec, j_update).
o <a href="#appendix-C.3">Appendix C.3</a> describes MIDI command timestamp semantics
(linerate, mperiod, octpos, tsmode).
o <a href="#appendix-C.4">Appendix C.4</a> describes the temporal duration ("media time") of
an RTP MIDI packet (guardtime, rtp_maxptime, rtp_ptime).
o <a href="#appendix-C.5">Appendix C.5</a> concerns stream description (musicport).
o <a href="#appendix-C.6">Appendix C.6</a> describes MIDI rendering (chanmask, cid, inline,
multimode, render, rinit, subrender, smf_cid, smf_info,
smf_inline, smf_url, url).
The parameters listed above may optionally appear in session
descriptions of RTP MIDI streams. If these parameters are used in an
SDP session description, the parameters appear on an fmtp attribute
line. This attribute line applies to the payload type associated
with the fmtp line.
The parameters listed above add extra functionality ("features") to
minimal RTP MIDI streams. In <a href="#appendix-C.7">Appendix C.7</a>, we show how to use these
features to support two classes of applications: content-streaming
using RTSP (Appendix C.7.1) and network musical performance using SIP
(Appendix C.7.2).
The participants in a multimedia session MUST share a common view of
all of the RTP MIDI streams that appear in an RTP session, as defined
by a single media (m=) line. In some RTP MIDI applications, the
"common view" restriction makes it difficult to use sendrecv streams
(all parties send and receive), as each party has its own
requirements. For example, a two-party network musical performance
application may wish to customize the renderer on each host to match
the CPU performance of the host [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>].
We solve this problem by using two RTP MIDI streams -- one sendonly,
one recvonly -- in lieu of one sendrecv stream. The data flows in
the two streams travel in opposite directions, to control receivers
configured to use different renderers. In the third example in
<a href="#appendix-C.5">Appendix C.5</a>, we show how the musicport parameter may be used to
define virtual sendrecv streams.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 96]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-97" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
As a general rule, the RTP MIDI protocol does not handle parameter
changes during a session well, because the parameters describe
heavyweight or stateful configuration that is not easily changed once
a session has begun. Thus, parties SHOULD NOT expect that parameter
change requests during a session will be accepted by other parties.
However, implementors SHOULD support in-session parameter changes
that are easy to handle (for example, the guardtime parameter defined
in <a href="#appendix-C.4">Appendix C.4</a>) and SHOULD be capable of accepting requests for
changes of those parameters, as received by its session management
protocol (for example, re-offers in SIP [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>]).
<a href="#appendix-D">Appendix D</a> defines the Augmented Backus-Naur Form (ABNF, [<a href="./rfc4234" title=""Augmented BNF for Syntax Specifications: ABNF"">RFC4234</a>])
syntax for the payload parameters. <a href="#section-11">Section 11</a> provides information
to the Internet Assigned Numbers Authority (IANA) on the media types
and parameters defined in this document.
<a href="#appendix-C.6.5">Appendix C.6.5</a> defines the media type "audio/asc", a stored object
for initializing mpeg4-generic renderers. As described in <a href="#appendix-C.6">Appendix</a>
<a href="#appendix-C.6">C.6</a>, the audio/asc media type is assigned to the "rinit" parameter to
specify an initialization data object for the default mpeg4-generic
renderer. Note that RTP stream semantics are not defined for
"audio/asc". Therefore, the "asc" subtype MUST NOT appear on the
rtpmap line of a session description.
<span class="h3"><a class="selflink" id="appendix-C.1" href="#appendix-C.1">C.1</a>. Configuration Tools: Stream Subsetting</span>
As defined in <a href="#section-3.2">Section 3.2</a> in the main text, the MIDI list of an RTP
MIDI packet may encode any MIDI command that may legally appear on a
MIDI 1.0 DIN cable.
In this appendix, we define two parameters (cm_unused and cm_used)
that modify this default condition, by excluding certain types of
MIDI commands from the MIDI list of all packets in a stream. For
example, if a multimedia session partitions a MIDI name space into
two RTP MIDI streams, the parameters may be used to define which
commands appear in each stream.
In this appendix, we define a simple language for specifying MIDI
command types. If a command type is assigned to cm_unused, the
commands coded by the string MUST NOT appear in the MIDI list. If a
command type is assigned to cm_used, the commands coded by the string
MAY appear in the MIDI list.
The parameter list may code multiple assignments to cm_used and
cm_unused. Assignments have a cumulative effect and are applied in
the order of appearance in the parameter list. A later assignment of
a command type to the same parameter expands the scope of the earlier
assignment. A later assignment of a command type to the opposite
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 97]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-98" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
parameter cancels (partially or completely) the effect of an earlier
assignment.
To initialize the stream subsetting system, "implicit" assignments to
cm_unused and cm_used are processed before processing the actual
assignments that appear in the parameter list. The System Common
undefined commands (0xF4, 0xF5) and the System Real-Time Undefined
commands (0xF9, 0xFD) are implicitly assigned to cm_unused. All
other command types are implicitly assigned to cm_used.
Note that the implicit assignments code the default behavior of an
RTP MIDI stream as defined in <a href="#section-3.2">Section 3.2</a> in the main text (namely,
that all commands that may legally appear on a MIDI 1.0 DIN cable may
appear in the stream). Also note that assignments of the System
Common undefined commands (0xF4, 0xF5) apply to the use of these
commands in the MIDI source command stream, not the special use of
0xF4 and 0xF5 in SysEx segment encoding defined in <a href="#section-3.2">Section 3.2</a> in the
main text.
As a rule, parameter assignments obey the following syntax (see
<a href="#appendix-D">Appendix D</a> for ABNF):
<parameter> = [channel list]<command-type list>[field list]
The command-type list is mandatory; the channel and field lists are
optional.
The command-type list specifies the MIDI command types for which the
parameter applies. The command-type list is a concatenated sequence
of one or more of the letters (ABCFGHJKMNPQTVWXYZ). The letters code
the following command types:
o A: Poly Aftertouch (0xA)
o B: System Reset (0xFF)
o C: Control Change (0xB)
o F: System Time Code (0xF1)
o G: System Tune Request (0xF6)
o H: System Song Select (0xF3)
o J: System Common Undefined (0xF4)
o K: System Common Undefined (0xF5)
o N: NoteOff (0x8), NoteOn (0x9)
o P: Program Change (0xC)
o Q: System Sequencer (0xF2, 0xF8, 0xF9, 0xFA, 0xFB, 0xFC)
o T: Channel Aftertouch (0xD)
o V: System Active Sense (0xFE)
o W: Pitch Wheel (0xE)
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 98]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-99" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o X: SysEx (0xF0)
o Y: System Real-Time Undefined (0xF9)
o Z: System Real-Time Undefined (0xFD)
In addition to the letters above, the letter M may also appear in the
command-type list. The letter M refers to the MIDI parameter system
(see definition in <a href="#appendix-A.1">Appendix A.1</a> and in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]). An assignment of M
to cm_unused codes that no RPN or NRPN transactions may appear in the
MIDI list.
Note that if cm_unused is assigned the letter M, Control Change (0xB)
commands for the controller numbers in the standard controller
assignment might still appear in the MIDI list. For an explanation,
see <a href="#appendix-A.3.4">Appendix A.3.4</a> for a discussion of the "general-purpose" use of
parameter system controller numbers.
In the text below, rules that apply to "MIDI voice channel commands"
also apply to the letter M.
The letters in the command-type list MUST be uppercase and MUST
appear in alphabetical order. Letters other than
(ABCFGHJKMNPQTVWXYZ) that appear in the list MUST be ignored.
For MIDI voice channel commands, the channel list specifies the MIDI
channels for which the parameter applies. If no channel list is
provided, the parameter applies to all MIDI channels (0-15). The
channel list takes the form of a list of channel numbers (0 through
15) and dash-separated channel number ranges (i.e., 0-5, 8-12, etc).
Dots (i.e., "." characters) separate elements in the channel list.
Recall that System commands do not have a MIDI channel associated
with them. Thus, for most command-type letters that code System
commands (B, F, G, H, J, K, Q, V, Y, and Z), the channel list is
ignored.
For the command-type letter X, the appearance of certain numbers in
the channel list codes special semantics.
o The digit 0 codes that SysEx "cancel" sublists (<a href="#section-3.2">Section 3.2</a> in
the main text) MUST NOT appear in the MIDI list.
o The digit 1 codes that cancel sublists MAY appear in the MIDI
list (the default condition).
o The digit 2 codes that commands other than System Real-time MIDI
commands MUST NOT appear between SysEx command segments in the
MIDI list (the default condition).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 99]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-100" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o The digit 3 codes that any MIDI command type may appear between
SysEx command segments in the MIDI list, with the exception of
the segmented encoding of a second SysEx command (verbatim SysEx
commands are OK).
For command-type X, the channel list MUST NOT contain both digits 0
and 1, and it MUST NOT contain both digits 2 and 3. For command-type
X, channel list numbers other than the numbers defined above are
ignored. If X does not have a channel list, the semantics marked
"the default condition" in the list above apply.
The syntax for field lists in a parameter assignment follows the
syntax for channel lists. If no field list is provided, the
parameter applies to all controller or note numbers.
For command-type C (Control Change), the field list codes the
controller numbers (0-255) for which the parameter applies.
For command-type M (Parameter System), the field list codes the
Registered Parameter Numbers (RPNs) and Non-Registered Parameter
Numbers (NRPNs) for which the parameter applies. The number range
0-16383 specifies RPNs, the number range 16384-32767 specifies NRPNs
(16384 corresponds to NRPN 0, 32767 corresponds to NRPN 16383).
For command-types N (NoteOn and NoteOff) and A (Poly Aftertouch), the
field list codes the note numbers for which the parameter applies.
For command-types J and K (System Common Undefined), the field list
consists of a single digit, which specifies the number of data octets
that follow the command octet.
For command-type X (SysEx), the field list codes the number of data
octets that may appear in a SysEx command. Thus, the field list
0-255 specifies SysEx commands with 255 or fewer data octets, the
field list 256-4294967295 specifies SysEx commands with more than 255
data octets but excludes commands with 255 or fewer data octets, and
the field list 0 excludes all commands.
A secondary parameter assignment syntax customizes command-type X
(see <a href="#appendix-D">Appendix D</a> for complete ABNF):
<parameter> = "__" <h-list> ["_" <h-list>] "__"
The assignment defines the class of SysEx commands that obeys the
semantics of the assigned parameter. The command class is specified
by listing the permitted values of the first N data octets that
follow the SysEx 0xF0 command octet. Any SysEx command whose first N
data octets match the list is a member of the class.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 100]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-101" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Each <h-list> defines a data octet of the command, as a dot-separated
(".") list of one or more hexadecimal constants (such as "7F") or
dash-separated hexadecimal ranges (such as "01-1F"). Underscores
("_") separate each <h-list>. Double-underscores ("__") delineate
the data octet list.
Using this syntax, each assignment specifies a single SysEx command
class. Session descriptions may use several assignments to cm_used
and cm_unused to specify complex behaviors.
The example session description below illustrates the use of the
stream subsetting parameters:
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 rtp-midi/44100
a=fmtp:96 cm_unused=ACGHJKNMPTVWXYZ; cm_used=__7F_00-7F_01_01__
The session description configures the stream for use in clock
applications. All voice channels are unused, as are all System
Commands except those used for MIDI Time Code (command-type F, and
the Full Frame SysEx command that is matched by the string assigned
to cm_used), the System Sequencer commands (command-type Q), and
System Reset (command-type B).
<span class="h3"><a class="selflink" id="appendix-C.2" href="#appendix-C.2">C.2</a>. Configuration Tools: The Journalling System</span>
In this appendix, we define the payload format parameters that
configure stream journalling and the recovery journal system.
The j_sec parameter (Appendix C.2.1) sets the journalling method for
the stream. The j_update parameter (Appendix C.2.2) sets the
recovery journal sending policy for the stream. <a href="#appendix-C.2.2">Appendix C.2.2</a> also
defines the sending policies of the recovery journal system.
<a href="#appendix-C.2.3">Appendix C.2.3</a> defines several parameters that modify the recovery
journal semantics. These parameters change the default recovery
journal semantics as defined in <a href="#section-5">Section 5</a> and Appendices A-B.
The journalling method for a stream is set at the start of a session
and MUST NOT be changed thereafter. This requirement forbids changes
to the j_sec parameter once a session has begun.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 101]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-102" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
A related requirement, defined in the appendix sections below,
forbids the acceptance of parameter values that would violate the
recovery journal mandate. In many cases, a change in one of the
parameters defined in this appendix during an ongoing session would
result in a violation of the recovery journal mandate for an
implementation; in this case, the parameter change MUST NOT be
accepted.
<span class="h4"><a class="selflink" id="appendix-C.2.1" href="#appendix-C.2.1">C.2.1</a>. The j_sec Parameter</span>
<a href="#section-2.2">Section 2.2</a> defines the default journalling method for a stream.
Streams that use unreliable transport (such as UDP) default to using
the recovery journal. Streams that use reliable transport (such as
TCP) default to not using a journal.
The parameter j_sec may be used to override this default. This memo
defines two symbolic values for j_sec: "none", to indicate that all
stream payloads MUST NOT contain a journal section, and "recj", to
indicate that all stream payloads MUST contain a journal section that
uses the recovery journal format.
For example, the j_sec parameter might be set to "none" for a UDP
stream that travels between two hosts on a local network that is
known to provide reliable datagram delivery.
The session description below configures a UDP stream that does not
use the recovery journal:
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 rtp-midi/44100
a=fmtp:96 j_sec=none
Other IETF standards-track documents may define alternative journal
formats. These documents MUST define new symbolic values for the
j_sec parameter to signal the use of the format.
Parties MUST NOT accept a j_sec value that violates the recovery
journal mandate (see <a href="#section-4">Section 4</a> for details). If a session
description uses a j_sec value unknown to the recipient, the
recipient MUST NOT accept the description.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 102]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-103" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Special j_sec issues arise when sessions are managed by session
management tools (like RTSP, [<a href="./rfc2326" title=""Real Time Streaming Protocol (RTSP)"">RFC2326</a>]) that use SDP for "declarative
usage" purposes (see the preamble of <a href="#section-6">Section 6</a> for details). For
these session management tools, SDP does not code transport details
(such as UDP or TCP) for the session. Instead, server and client
negotiate transport details via other means (for RTSP, the SETUP
method).
In this scenario, the use of the j_sec parameter may be ill-advised,
as the creator of the session description may not yet know the
transport type for the session. In this case, the session
description SHOULD configure the journalling system using the
parameters defined in the remainder of <a href="#appendix-C.2">Appendix C.2</a>, but it SHOULD
NOT use j_sec to set the journalling status. Recall that if j_sec
does not appear in the session description, the default method for
choosing the journalling method is in effect (no journal for reliable
transport, recovery journal for unreliable transport).
However, in declarative usage situations where the creator of the
session description knows that journalling is always required or
never required, the session description SHOULD use the j_sec
parameter.
<span class="h4"><a class="selflink" id="appendix-C.2.2" href="#appendix-C.2.2">C.2.2</a>. The j_update Parameter</span>
In <a href="#section-4">Section 4</a>, we use the term "sending policy" to describe the method
a sender uses to choose the checkpoint packet identity for each
recovery journal in a stream. In the sub-sections that follow, we
normatively define three sending policies: anchor, closed-loop, and
open-loop.
As stated in <a href="#section-4">Section 4</a>, the default sending policy for a stream is
the closed-loop policy. The j_update parameter may be used to
override this default.
We define three symbolic values for j_update: "anchor", to indicate
that the stream uses the anchor sending policy, "open-loop", to
indicate that the stream uses the open-loop sending policy, and
"closed-loop", to indicate that the stream uses the closed-loop
sending policy. See <a href="#appendix-C.2.3">Appendix C.2.3</a> for examples session descriptions
that use the j_update parameter.
Parties MUST NOT accept a j_update value that violates the recovery
journal mandate (<a href="#section-4">Section 4</a>).
Other IETF standards-track documents may define additional sending
policies for the recovery journal system. These documents MUST
define new symbolic values for the j_update parameter to signal the
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 103]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-104" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
use of the new policy. If a session description uses a j_update
value unknown to the recipient, the recipient MUST NOT accept the
description.
<span class="h5"><a class="selflink" id="appendix-C.2.2.1" href="#appendix-C.2.2.1">C.2.2.1</a>. The anchor Sending Policy</span>
In the anchor policy, the sender uses the first packet in the stream
as the checkpoint packet for all packets in the stream. The anchor
policy satisfies the recovery journal mandate (<a href="#section-4">Section 4</a>), as the
checkpoint history always covers the entire stream.
The anchor policy does not require the use of the RTP control
protocol (RTCP, [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]) or other feedback from receiver to sender.
Senders do not need to take special actions to ensure that received
streams start up free of artifacts, as the recovery journal always
covers the entire history of the stream. Receivers are relieved of
the responsibility of tracking the changing identity of the
checkpoint packet, because the checkpoint packet never changes.
The main drawback of the anchor policy is bandwidth efficiency.
Because the checkpoint history covers the entire stream, the size of
the recovery journals produced by this policy usually exceeds the
journal size of alternative policies. For single-channel MIDI data
streams, the bandwidth overhead of the anchor policy is often
acceptable (see <a href="#appendix-A.4">Appendix A.4</a> of [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>]). For dense streams, the
closed-loop or open-loop policies may be more appropriate.
<span class="h5"><a class="selflink" id="appendix-C.2.2.2" href="#appendix-C.2.2.2">C.2.2.2</a>. The closed-loop Sending Policy</span>
The closed-loop policy is the default policy of the recovery journal
system. For each packet in the stream, the policy lets senders
choose the smallest possible checkpoint history that satisfies the
recovery journal mandate. As smaller checkpoint histories generally
yield smaller recovery journals, the closed-loop policy reduces the
bandwidth of a stream, relative to the anchor policy.
The closed-loop policy relies on feedback from receiver to sender.
The policy assumes that a receiver periodically informs the sender of
the highest sequence number it has seen so far in the stream, coded
in the 32-bit extension format defined in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]. For RTCP,
receivers transmit this information in the Extended Highest Sequence
Number Received (EHSNR) field of Receiver Reports. RTCP Sender or
Receiver Reports MUST be sent by any participant in a session with
closed loop sending policy, unless another feedback mechanism has
been agreed upon.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 104]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-105" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The sender may safely use receiver sequence number feedback to guide
checkpoint history management, because <a href="#section-4">Section 4</a> requires that
receivers repair indefinite artifacts whenever a packet loss event
occur.
We now normatively define the closed-loop policy. At the moment a
sender prepares an RTP packet for transmission, the sender is aware
of R >= 0 receivers for the stream. Senders may become aware of a
receiver via RTCP traffic from the receiver, via RTP packets from a
paired stream sent by the receiver to the sender, via messages from a
session management tool, or by other means. As receivers join and
leave a session, the value of R changes.
Each known receiver k (1 <= k <= R) is associated with a 32-bit
extended packet sequence number M(k), where the extension reflects
the sequence number rollover count of the sender.
If the sender has received at least one feedback report from receiver
k, M(k) is the most recent report of the highest RTP packet sequence
number seen by the receiver, normalized to reflect the rollover count
of the sender.
If the sender has not received a feedback report from the receiver,
M(k) is the extended sequence number of the last packet the sender
transmitted before it became aware of the receiver. If the sender
became aware of this receiver before it sent the first packet in the
stream, M(k) is the extended sequence number of the first packet in
the stream.
Given this definition of M(), we now state the closed-loop policy.
When preparing a new packet for transmission, a sender MUST choose a
checkpoint packet with extended sequence number N, such that M(k) >=
(N - 1) for all k, 1 <= k <= R, where R >= 1. The policy does not
restrict sender behavior in the R == 0 (no known receivers) case.
Under the closed-loop policy as defined above, a sender may transmit
packets whose checkpoint history is shorter than the session history
(as defined in <a href="#appendix-A.1">Appendix A.1</a>). In this event, a new receiver that
joins the stream may experience indefinite artifacts.
For example, if a Control Change (0xB) command for Channel Volume
(controller number 7) was sent early in a stream, and later a new
receiver joins the session, the closed-loop policy may permit all
packets sent to the new receiver to use a checkpoint history that
does not include the Channel Volume Control Change command. As a
result, the new receiver experiences an indefinite artifact, and
plays all notes on a channel too loudly or too softly.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 105]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-106" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
To address this issue, the closed-loop policy states that whenever a
sender becomes aware of a new receiver, the sender MUST determine if
the receiver would be subject to indefinite artifacts under the
closed-loop policy. If so, the sender MUST ensure that the receiver
starts the session free of indefinite artifacts.
For example, to solve the Channel Volume issue described above, the
sender may code the current state of the Channel Volume controller
numbers in the recovery journal Chapter C, until it receives the
first RTCP RR report that signals that a packet containing this
Chapter C has been received.
In satisfying this requirement, senders MAY infer the initial MIDI
state of the receiver from the session description. For example, the
stream example in <a href="#section-6.2">Section 6.2</a> has the initial state defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]
for General MIDI.
In a unicast RTP session, a receiver may safely assume that the
sender is aware of its presence of a receiver from the first packet
sent in the RTP stream. However, in other types of RTP sessions
(multicast, conference focus, RTP translator/mixer), a receiver is
often not able to determine if the sender is initially aware of its
presence as a receiver.
To address this issue, the closed-loop policy states that if a
receiver participates in a session where it may have access to a
stream whose sender is not aware of the receiver, the receiver MUST
take actions to ensure that its rendered MIDI performance does not
contain indefinite artifacts. These protections will be necessarily
incomplete. For example, a receiver may monitor the Checkpoint
Packet Seqnum for uncovered loss events, and "err on the side of
caution" with respect to handling stuck notes due to lost MIDI
NoteOff commands, but the receiver is not able to compensate for the
lack of Channel Volume initialization data in the recovery journal.
The receiver MUST NOT discontinue these protective actions until it
is certain that the sender is aware of its presence. If a receiver
is not able to ascertain sender awareness, the receiver MUST continue
these protective actions for the duration of the session.
Note that in a multicast session where all parties are expected to
send and receive, the reception of RTCP receiver reports from the
sender about the RTP stream a receiver is multicasting is evidence of
the sender's awareness that the RTP stream multicast by the sender is
being monitored by the receiver. Receivers may also obtain sender
awareness evidence from session management tools, or by other means.
In practice, ongoing observation of the Checkpoint Packet Seqnum to
determine if the sender is taking actions to prevent loss events for
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 106]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-107" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
a receiver is a good indication of sender awareness, as is the sudden
appearance of recovery journal chapters with numerous Control Change
controller data that was not foreshadowed by recent commands coded in
the MIDI list shortly after sending an RTCP RR.
The final set of normative closed-loop policy requirements concern
how senders and receivers handle unplanned disruptions of RTCP
feedback from a receiver to a sender. By "unplanned", we refer to
disruptions that are not due to the signalled termination of an RTP
stream, via an RTCP BYE or via session management tools.
As defined earlier in this section, the closed-loop policy states
that a sender MUST choose a checkpoint packet with extended sequence
number N, such that M(k) >= (N - 1) for all k, 1 <= k <= R, where R
>= 1. If the sender has received at least one feedback report from
receiver k, M(k) is the most recent report of the highest RTP packet
sequence number seen by the receiver, normalized to reflect the
rollover count of the sender.
If this receiver k stops sending feedback to the sender, the M(k)
value used by the sender reflects the last feedback report from the
receiver. As time progresses without feedback from receiver k, this
fixed M(k) value forces the sender to increase the size of the
checkpoint history, and thus increases the bandwidth of the stream.
At some point, the sender may need to take action in order to limit
the bandwidth of the stream. In most envisioned uses of RTP MIDI,
long before this point is reached, the SSRC time-out mechanism
defined in [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>] will remove the uncooperative receiver from the
session (note that the closed-loop policy does not suggest or require
any special sender behavior upon an SSRC time-out, other than the
sender actions related to changing R, described earlier in this
section).
However, in rare situations, the bandwidth of the stream (due to a
lack of feedback reports from the sender) may become too large to
continue sending the stream to the receiver before the SSRC time-out
occurs for the receiver. In this case, the closed-loop policy states
that the sender should invoke the SSRC time-out for the receiver
early.
We now discuss receiver responsibilities in the case of unplanned
disruptions of RTCP feedback from receiver to sender.
In the unicast case, if a sender invokes the SSRC time-out mechanism
for a receiver, the receiver stops receiving packets from the sender.
The sender behavior imposed by the guardtime parameter (Appendix
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 107]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-108" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
C.4.2) lets the receiver conclude that an SSRC time-out has occurred
in a reasonable time period.
In this case of a time-out, a receiver MUST keep sending RTCP
feedback, in order to re-establish the RTP flow from the sender.
Unless the receiver expects a prompt recovery of the RTP flow, the
receiver MUST take actions to ensure that the rendered MIDI
performance does not exhibit "very long transient artifacts" (for
example, by silencing NoteOns to prevent stuck notes) while awaiting
reconnection of the flow.
In the multicast case, if a sender invokes the SSRC time-out
mechanism for a receiver, the receiver may continue to receive
packets, but the sender will no longer be using the M(k) feedback
from the receiver to choose each checkpoint packet. If the receiver
does not have additional information that precludes an SSRC time-out
(such as RTCP Receiver Reports from the sender about an RTP stream
the receiver is multicasting back to the sender), the receiver MUST
monitor the Checkpoint Packet Seqnum to detect an SSRC time-out. If
an SSRC time-out is detected, the receiver MUST follow the
instructions for SSRC time-outs described for the unicast case above.
Finally, we note that the closed-loop policy is suitable for use in
RTP/RTCP sessions that use multicast transport. However, aspects of
the closed-loop policy do not scale well to sessions with large
numbers of participants. The sender state scales linearly with the
number of receivers, as the sender needs to track the identity and
M(k) value for each receiver k. The average recovery journal size is
not independent of the number of receivers, as the RTCP reporting
interval backoff slows down the rate of a full update of M(k) values.
The backoff algorithm may also increase the amount of ancillary state
used by implementations of the normative sender and receiver
behaviors defined in <a href="#section-4">Section 4</a>.
<span class="h5"><a class="selflink" id="appendix-C.2.2.3" href="#appendix-C.2.2.3">C.2.2.3</a>. The open-loop Sending Policy</span>
The open-loop policy is suitable for sessions that are not able to
implement the receiver-to-sender feedback required by the closed-loop
policy, and that are also not able to use the anchor policy because
of bandwidth constraints.
The open-loop policy does not place constraints on how a sender
chooses the checkpoint packet for each packet in the stream. In the
absence of such constraints, a receiver may find that the recovery
journal in the packet that ends a loss event has a checkpoint history
that does not cover the entire loss event. We refer to loss events
of this type as uncovered loss events.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 108]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-109" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
To ensure that uncovered loss events do not compromise the recovery
journal mandate, the open-loop policy assigns specific recovery tasks
to senders, receivers, and the creators of session descriptions. The
underlying premise of the open-loop policy is that the indefinite
artifacts produced during uncovered loss events fall into two
classes.
One class of artifacts is recoverable indefinite artifacts.
Receivers are able to repair recoverable artifacts that occur during
an uncovered loss event without intervention from the sender, at the
potential cost of unpleasant transient artifacts.
For example, after an uncovered loss event, receivers are able to
repair indefinite artifacts due to NoteOff (0x8) commands that may
have occurred during the loss event, by executing NoteOff commands
for all active NoteOns commands. This action causes a transient
artifact (a sudden silent period in the performance), but ensures
that no stuck notes sound indefinitely. We refer to MIDI commands
that are amenable to repair in this fashion as recoverable MIDI
commands.
A second class of artifacts is unrecoverable indefinite artifacts.
If this class of artifact occurs during an uncovered loss event, the
receiver is not able to repair the stream.
For example, after an uncovered loss event, receivers are not able to
repair indefinite artifacts due to Control Change (0xB) Channel
Volume (controller number 7) commands that have occurred during the
loss event. A repair is impossible because the receiver has no way
of determining the data value of a lost Channel Volume command. We
refer to MIDI commands that are fragile in this way as unrecoverable
MIDI commands.
The open-loop policy does not specify how to partition the MIDI
command set into recoverable and unrecoverable commands. Instead, it
assumes that the creators of the session descriptions are able to
come to agreement on a suitable recoverable/unrecoverable MIDI
command partition for an application.
Given these definitions, we now state the normative requirements for
the open-loop policy.
In the open-loop policy, the creators of the session description MUST
use the ch_anchor parameter (defined in <a href="#appendix-C.2.3">Appendix C.2.3</a>) to protect
all unrecoverable MIDI command types from indefinite artifacts, or
alternatively MUST use the cm_unused parameter (defined in Appendix
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 109]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-110" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
C.1) to exclude the command types from the stream. These options act
to shield command types from artifacts during an uncovered loss
event.
In the open-loop policy, receivers MUST examine the Checkpoint Packet
Seqnum field of the recovery journal header after every loss event,
to check if the loss event is an uncovered loss event. <a href="#section-5">Section 5</a>
shows how to perform this check. If an uncovered loss event has
occurred, a receiver MUST perform indefinite artifact recovery for
all MIDI command types that are not shielded by ch_anchor and
cm_unused parameter assignments in the session description.
The open-loop policy does not place specific constraints on the
sender. However, the open-loop policy works best if the sender
manages the size of the checkpoint history to ensure that uncovered
losses occur infrequently, by taking into account the delay and loss
characteristics of the network. Also, as each checkpoint packet
change incurs the risk of an uncovered loss, senders should only move
the checkpoint if it reduces the size of the journal.
<span class="h4"><a class="selflink" id="appendix-C.2.3" href="#appendix-C.2.3">C.2.3</a>. Recovery Journal Chapter Inclusion Parameters</span>
The recovery journal chapter definitions (Appendices A-B) specify
under what conditions a chapter MUST appear in the recovery journal.
In most cases, the definition states that if a certain command
appears in the checkpoint history, a certain chapter type MUST appear
in the recovery journal to protect the command.
In this section, we describe the chapter inclusion parameters. These
parameters modify the conditions under which a chapter appears the
journal. These parameters are essential to the use of the open-loop
policy (Appendix C.2.2.3) and may also be used to simplify
implementations of the closed-loop (Appendix C.2.2.2) and anchor
(Appendix C.2.2.1) policies.
Each parameter represents a type of chapter inclusion semantics. An
assignment to a parameter declares which chapters (or chapter
subsets) obey the inclusion semantics. We describe the assignment
syntax for these parameters later in this section.
A party MUST NOT accept chapter inclusion parameter values that
violate the recovery journal mandate (<a href="#section-4">Section 4</a>). All assignments of
the subsetting parameters (cm_used and cm_unused) MUST precede the
first assignment of a chapter inclusion parameter in the parameter
list.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 110]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-111" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Below, we normatively define the semantics of the chapter inclusion
parameters. For clarity, we define the action of parameters on
complete chapters. If a parameter is assigned a subset of a chapter,
the definition applies only to the chapter subset.
o ch_never. A chapter assigned to the ch_never parameter MUST NOT
appear in the recovery journal (Appendix A.4.1-2 defines
exceptions to this rule for Chapter M). To signal the exclusion
of a chapter from the journal, an assignment to ch_never MUST be
made, even if the commands coded by the chapter are assigned to
cm_unused. This rule simplifies the handling of commands types
that may be coded in several chapters.
o ch_default. A chapter assigned to the ch_default parameter MUST
follow the default semantics for the chapter, as defined in
Appendices A-B.
o ch_anchor. A chapter assigned to the ch_anchor MUST obey a
modified version of the default chapter semantics. In the
modified semantics, all references to the checkpoint history are
replaced with references to the session history, and all
references to the checkpoint packet are replaced with references
to the first packet sent in the stream.
Parameter assignments obey the following syntax (see <a href="#appendix-D">Appendix D</a> for
ABNF):
<parameter> = [channel list]<chapter list>[field list]
The chapter list is mandatory; the channel and field lists are
optional. Multiple assignments to parameters have a cumulative
effect and are applied in the order of parameter appearance in a
media description.
To determine the semantics of a list of chapter inclusion parameter
assignments, we begin by assuming an implicit assignment of all
channel and system chapters to the ch_default parameter, with the
default values for the channel list and field list for each chapter
that are defined below.
We then interpret the semantics of the actual parameter assignments,
using the rules below.
A later assignment of a chapter to the same parameter expands the
scope of the earlier assignment. In most cases, a later assignment
of a chapter to a different parameter cancels (partially or
completely) the effect of an earlier assignment.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 111]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-112" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The chapter list specifies the channel or system chapters for which
the parameter applies. The chapter list is a concatenated sequence
of one or more of the letters corresponding to the chapter types
(ACDEFMNPQTVWX). In addition, the list may contain one or more of
the letters for the sub-chapter types (BGHJKYZ) of System Chapter D.
The letters in a chapter list MUST be uppercase and MUST appear in
alphabetical order. Letters other than (ABCDEFGHJKMNPQTVWXYZ) that
appear in the chapter list MUST be ignored.
The channel list specifies the channel journals for which this
parameter applies; if no channel list is provided, the parameter
applies to all channel journals. The channel list takes the form of
a list of channel numbers (0 through 15) and dash-separated channel
number ranges (i.e., 0-5, 8-12, etc.). Dots (i.e., "." characters)
separate elements in the channel list.
Several of the systems chapters may be configured to have special
semantics. Configuration occurs by specifying a channel list for the
systems channel, using the coding described below (note that MIDI
Systems commands do not have a "channel", and thus the original
purpose of the channel list does not apply to systems chapters). The
expression "the digit N" in the text below refers to the inclusion of
N as a "channel" in the channel list for a systems chapter.
For the J and K Chapter D sub-chapters (undefined System Common), the
digit 0 codes that the parameter applies to the LEGAL field of the
associated command log (Figure B.1.4 of <a href="#appendix-B.1">Appendix B.1</a>), the digit 1
codes that the parameter applies to the VALUE field of the command
log, and the digit 2 codes that the parameter applies to the COUNT
field of the command log.
For the Y and Z Chapter D sub-chapters (undefined System Real-time),
the digit 0 codes that the parameter applies to the LEGAL field of
the associated command log (Figure B.1.5 of <a href="#appendix-B.1">Appendix B.1</a>) and the
digit 1 codes that the parameter applies to the COUNT field of the
command log.
For Chapter Q (Sequencer State Commands), the digit 0 codes that the
parameter applies to the default Chapter Q definition, which forbids
the TIME field. The digit 1 codes that the parameter applies to the
optional Chapter Q definition, which supports the TIME field.
The syntax for field lists follows the syntax for channel lists. If
no field list is provided, the parameter applies to all controller or
note numbers. For Chapter C, if no field list is provided, the
controller numbers do not use enhanced Chapter C encoding (Appendix
A.3.3).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 112]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-113" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
For Chapter C, the field list may take on values in the range 0 to
255. A field value X in the range 0-127 refers to a controller
number X, and indicates that the controller number does not use
enhanced Chapter C encoding. A field value X in the range 128-255
refers to a controller number "X minus 128" and indicates the
controller number does use the enhanced Chapter C encoding.
Assignments made to configure the Chapter C encoding method for a
controller number MUST be made to the ch_default or ch_anchor
parameters, as assignments to ch_never act to exclude the number from
the recovery journal (and thus the indicated encoding method is
irrelevant).
A Chapter C field list MUST NOT encode conflicting information about
the enhanced encoding status of a particular controller number. For
example, values 0 and 128 MUST NOT both be coded by a field list.
For Chapter M, the field list codes the Registered Parameter Numbers
(RPNs) and Non-Registered Parameter Numbers (NRPNs) for which the
parameter applies. The number range 0-16383 specifies RPNs, the
number range 16384-32767 specifies NRPNs (16384 corresponds to NRPN
0, 32767 corresponds to NRPN 16383).
For Chapters N and A, the field list codes the note numbers for which
the parameter applies. The note number range specified for Chapter N
also applies to Chapter E.
For Chapter E, the digit 0 codes that the parameter applies to
Chapter E note logs whose V bit is set to 0, and the digit 1 codes
that the parameter applies to note logs whose V bit is set to 1.
For Chapter X, the field list codes the number of data octets that
may appear in a SysEx command that is coded in the chapter. Thus,
the field list 0-255 specifies SysEx commands with 255 or fewer data
octets, the field list 256-4294967295 specifies SysEx commands with
more than 255 data octets but excludes commands with 255 or fewer
data octets, and the field list 0 excludes all commands.
A secondary parameter assignment syntax customizes Chapter X (see
<a href="#appendix-D">Appendix D</a> for complete ABNF):
<parameter> = "__" <h-list> ["_" <h-list>] "__"
The assignment defines a class of SysEx commands whose Chapter X
coding obeys the semantics of the assigned parameter. The command
class is specified by listing the permitted values of the first N
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 113]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-114" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
data octets that follow the SysEx 0xF0 command octet. Any SysEx
command whose first N data octets match the list is a member of the
class.
Each <h-list> defines a data octet of the command, as a dot-separated
(".") list of one or more hexadecimal constants (such as "7F") or
dash-separated hexadecimal ranges (such as "01-1F"). Underscores
("_") separate each <h-list>. Double-underscores ("__") delineate
the data octet list.
Using this syntax, each assignment specifies a single SysEx command
class. Session descriptions may use several assignments to the same
(or different) parameters to specify complex Chapter X behaviors.
The ordering behavior of multiple assignments follows the guidelines
for chapter parameter assignments described earlier in this section.
The example session description below illustrates the use of the
chapter inclusion parameters:
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 rtp-midi/44100
a=fmtp:96 j_update=open-loop; cm_unused=ABCFGHJKMQTVWXYZ;
cm_used=__7E_00-7F_09_01.02.03__;
cm_used=__7F_00-7F_04_01.02__; cm_used=C7.64;
ch_never=ABCDEFGHJKMQTVWXYZ; ch_never=4.11-13N;
ch_anchor=P; ch_anchor=C7.64;
ch_anchor=__7E_00-7F_09_01.02.03__;
ch_anchor=__7F_00-7F_04_01.02__
(The a=fmtp line has been wrapped to fit the page to accommodate
memo formatting restrictions; it comprises a single line in SDP.)
The j_update parameter codes that the stream uses the open-loop
policy. Most MIDI command-types are assigned to cm_unused and thus
do not appear in the stream. As a consequence, the assignments to
the first ch_never parameter reflect that most chapters are not in
use.
Chapter N for several MIDI channels is assigned to ch_never. Chapter
N for MIDI channels other than 4, 11, 12, and 13 may appear in the
recovery journal, using the (default) ch_default semantics. In
practice, this assignment pattern would reflect knowledge about a
resilient rendering method in use for the excluded channels.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 114]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-115" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The MIDI Program Change command and several MIDI Control Change
controller numbers are assigned to ch_anchor. Note that the ordering
of the ch_anchor chapter C assignment after the ch_never command acts
to override the ch_never assignment for the listed controller numbers
(7 and 64).
The assignment of command-type X to cm_unused excludes most SysEx
commands from the stream. Exceptions are made for General MIDI
System On/Off commands and for the Master Volume and Balance
commands, via the use of the secondary assignment syntax. The
cm_used assignment codes the exception, and the ch_anchor assignment
codes how these commands are protected in Chapter X.
<span class="h3"><a class="selflink" id="appendix-C.3" href="#appendix-C.3">C.3</a>. Configuration Tools: Timestamp Semantics</span>
The MIDI command section of the payload format consists of a list of
commands, each with an associated timestamp. The semantics of
command timestamps may be set during session configuration, using the
parameters we describe in this section
The parameter "tsmode" specifies the timestamp semantics for a
stream. The parameter takes on one of three token values: "comex",
"async", or "buffer".
The default "comex" value specifies that timestamps code the
execution time for a command (Appendix C.3.1) and supports the
accurate transcoding Standard MIDI Files (SMFs, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]). The "comex"
value is also RECOMMENDED for new MIDI user-interface controller
designs. The "async" value specifies an asynchronous timestamp
sampling algorithm for time-of-arrival sources (Appendix C.3.2). The
"buffer" value specifies a synchronous timestamp sampling algorithm
(Appendix C.3.3) for time-of-arrival sources.
Ancillary parameters MAY follow tsmode in a media description. We
define these parameters in Appendices C.3.2-3 below.
<span class="h4"><a class="selflink" id="appendix-C.3.1" href="#appendix-C.3.1">C.3.1</a>. The comex Algorithm</span>
The default "comex" (COMmand EXecution) tsmode value specifies the
execution time for the command. With comex, the difference between
two timestamps indicates the time delay between the execution of the
commands. This difference may be zero, coding simultaneous
execution.
The comex interpretation of timestamps works well for transcoding a
Standard MIDI File (SMF, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]) into an RTP MIDI stream, as SMFs
code a timestamp for each MIDI command stored in the file. To
transcode an SMF that uses metric time markers, use the SMF tempo map
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 115]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-116" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
(encoded in the SMF as meta-events) to convert metric SMF timestamp
units into seconds-based RTP timestamp units.
New MIDI controller designs (piano keyboard, drum pads, etc.) that
support RTP MIDI and that have direct access to sensor data SHOULD
use comex interpretation for timestamps, so that simultaneous
gestural events may be accurately coded by RTP MIDI.
Comex is a poor choice for transcoding MIDI 1.0 DIN cables [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>],
for a reason that we will now explain. A MIDI DIN cable is an
asynchronous serial protocol (320 microseconds per MIDI byte). MIDI
commands on a DIN cable are not tagged with timestamps. Instead,
MIDI DIN receivers infer command timing from the time of arrival of
the bytes. Thus, two two-byte MIDI commands that occur at a source
simultaneously are encoded on a MIDI 1.0 DIN cable with a 640
microsecond time offset. A MIDI DIN receiver is unable to tell if
this time offset existed in the source performance or is an artifact
of the serial speed of the cable. However, the RTP MIDI comex
interpretation of timestamps declares that a timestamp offset between
two commands reflects the timing of the source performance.
This semantic mismatch is the reason that comex is a poor choice for
transcoding MIDI DIN cables. Note that the choice of the RTP
timestamp rate (<a href="#section-6.1">Section 6.1</a>-2 in the main text) cannot fix this
inaccuracy issue. In the sections that follow, we describe two
alternative timestamp interpretations ("async" and "buffer") that are
a better match to MIDI 1.0 DIN cable timing, and to other MIDI time-
of-arrival sources.
The "octpos", "linerate", and "mperiod" ancillary parameters (defined
below) SHOULD NOT be used with comex.
<span class="h4"><a class="selflink" id="appendix-C.3.2" href="#appendix-C.3.2">C.3.2</a>. The async Algorithm</span>
The "async" tsmode value specifies the asynchronous sampling of a
MIDI time-of-arrival source. In asynchronous sampling, the moment an
octet is received from a source, it is labelled with a wall-clock
time value. The time value has RTP timestamp units.
The "octpos" ancillary parameter defines how RTP command timestamps
are derived from octet time values. If octpos has the token value
"first", a timestamp codes the time value of the first octet of the
command. If octpos has the token value "last", a timestamp codes the
time value of the last octet of the command. If the octpos parameter
does not appear in the media description, the sender does not know
which octet of the command the timestamp references (for example, the
sender may be relying on an operating system service that does not
specify this information).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 116]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-117" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The octpos semantics refer to the first or last octet of a command as
it appears on a time-of-arrival MIDI source, not as it appears in an
RTP MIDI packet. This distinction is significant because the RTP
coding may contain octets that are not present in the source. For
example, the status octet of the first MIDI command in a packet may
have been added to the MIDI stream during transcoding, to comply with
the RTP MIDI running status requirements (<a href="#section-3.2">Section 3.2</a>).
The "linerate" ancillary parameter defines the timespan of one MIDI
octet on the transmission medium of the MIDI source to be sampled
(such as a MIDI 1.0 DIN cable). The parameter has units of
nanoseconds, and takes on integral values. For MIDI 1.0 DIN cables,
the correct linerate value is 320000 (this value is also the default
value for the parameter).
We now show a session description example for the async algorithm.
Consider a sender that is transcoding a MIDI 1.0 DIN cable source
into RTP. The sender runs on a computing platform that assigns time
values to every incoming octet of the source, and the sender uses the
time values to label the first octet of each command in the RTP
packet. This session description describes the transcoding:
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 rtp-midi/44100
a=sendonly
a=fmtp:96 tsmode=async; linerate=320000; octpos=first
<span class="h4"><a class="selflink" id="appendix-C.3.3" href="#appendix-C.3.3">C.3.3</a>. The buffer Algorithm</span>
The "buffer" tsmode value specifies the synchronous sampling of a
MIDI time-of-arrival source.
In synchronous sampling, octets received from a source are placed in
a holding buffer upon arrival. At periodic intervals, the RTP sender
examines the buffer. The sender removes complete commands from the
buffer and codes those commands in an RTP packet. The command
timestamp codes the moment of buffer examination, expressed in RTP
timestamp units. Note that several commands may have the same
timestamp value.
The "mperiod" ancillary parameter defines the nominal periodic
sampling interval. The parameter takes on positive integral values
and has RTP timestamp units.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 117]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-118" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The "octpos" ancillary parameter, defined in <a href="#appendix-C.3.1">Appendix C.3.1</a> for
asynchronous sampling, plays a different role in synchronous
sampling. In synchronous sampling, the parameter specifies the
timestamp semantics of a command whose octets span several sampling
periods.
If octpos has the token value "first", the timestamp reflects the
arrival period of the first octet of the command. If octpos has the
token value "last", the timestamp reflects the arrival period of the
last octet of the command. The octpos semantics refer to the first
or last octet of the command as it appears on a time-of-arrival
source, not as it appears in the RTP packet.
If the octpos parameter does not appear in the media description, the
timestamp MAY reflect the arrival period of any octet of the command;
senders use this option to signal a lack of knowledge about the
timing details of the buffering process at sub-command granularity.
We now show a session description example for the buffer algorithm.
Consider a sender that is transcoding a MIDI 1.0 DIN cable source
into RTP. The sender runs on a computing platform that places source
data into a buffer upon receipt. The sender polls the buffer 1000
times a second, extracts all complete commands from the buffer, and
places the commands in an RTP packet. This session description
describes the transcoding:
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 rtp-midi/44100
a=sendonly
a=fmtp:96 tsmode=buffer; linerate=320000; octpos=last; mperiod=44
The mperiod value of 44 is derived by dividing the clock rate
specified by the rtpmap attribute (44100 Hz) by the 1000 Hz buffer
sampling rate and rounding to the nearest integer. Command
timestamps might not increment by exact multiples of 44, as the
actual sampling period might not precisely match the nominal mperiod
value.
<span class="h3"><a class="selflink" id="appendix-C.4" href="#appendix-C.4">C.4</a>. Configuration Tools: Packet Timing Tools</span>
In this appendix, we describe session configuration tools for
customizing the temporal behavior of MIDI stream packets.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 118]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-119" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h4"><a class="selflink" id="appendix-C.4.1" href="#appendix-C.4.1">C.4.1</a>. Packet Duration Tools</span>
Senders control the granularity of a stream by setting the temporal
duration ("media time") of the packets in the stream. Short media
times (20 ms or less) often imply an interactive session. Longer
media times (100 ms or more) usually indicate a content streaming
session. The RTP AVP profile [<a href="./rfc3551" title=""RTP Profile for Audio and Video Conferences with Minimal Control"">RFC3551</a>] recommends audio packet media
times in a range from 0 to 200 ms.
By default, an RTP receiver dynamically senses the media time of
packets in a stream and chooses the length of its playout buffer to
match the stream. A receiver typically sizes its playout buffer to
fit several audio packets and adjusts the buffer length to reflect
the network jitter and the sender timing fidelity.
Alternatively, the packet media time may be statically set during
session configuration. Session descriptions MAY use the RTP MIDI
parameter "rtp_ptime" to set the recommended media time for a packet.
Session descriptions MAY also use the RTP MIDI parameter
"rtp_maxptime" to set the maximum media time for a packet permitted
in a stream. Both parameters MAY be used together to configure a
stream.
The values assigned to the rtp_ptime and rtp_maxptime parameters have
the units of the RTP timestamp for the stream, as set by the rtpmap
attribute (see <a href="#section-6.1">Section 6.1</a>). Thus, if rtpmap sets the clock rate of
a stream to 44100 Hz, a maximum packet media time of 10 ms is coded
by setting rtp_maxptime=441. As stated in the <a href="#appendix-C">Appendix C</a> preamble,
the senders and receivers of a stream MUST agree on common values for
rtp_ptime and rtp_maxptime if the parameters appear in the media
description for the stream.
0 ms is a reasonable media time value for MIDI packets and is often
used in low-latency interactive applications. In a packet with a 0
ms media time, all commands execute at the instant they are coded by
the packet timestamp. The session description below configures all
packets in the stream to have 0 ms media time:
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 rtp-midi/44100
a=fmtp:96 rtp_ptime=0; rtp_maxptime=0
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 119]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-120" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The session attributes ptime and maxptime [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>] MUST NOT be used
to configure an RTP MIDI stream. Sessions MUST use rtp_ptime in lieu
of ptime and MUST use rtp_maxptime in lieu of maxptime. RTP MIDI
defines its own parameters for media time configuration because 0 ms
values for ptime and maxptime are forbidden by [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>] but are
essential for certain applications of RTP MIDI.
See the <a href="#appendix-C.7">Appendix C.7</a> examples for additional discussion about using
rtp_ptime and rtp_maxptime for session configuration.
<span class="h4"><a class="selflink" id="appendix-C.4.2" href="#appendix-C.4.2">C.4.2</a>. The guardtime Parameter</span>
RTP permits a sender to stop sending audio packets for an arbitrary
period of time during a session. When sending resumes, the RTP
sequence number series continues unbroken, and the RTP timestamp
value reflects the media time silence gap.
This RTP feature has its roots in telephony, but it is also well
matched to interactive MIDI sessions, as players may fall silent for
several seconds during (or between) songs.
Certain MIDI applications benefit from a slight enhancement to this
RTP feature. In interactive applications, receivers may use on-line
network models to guide heuristics for handling lost and late RTP
packets. These models may work poorly if a sender ceases packet
transmission for long periods of time.
Session descriptions may use the parameter "guardtime" to set a
minimum sending rate for a media session. The value assigned to
guardtime codes the maximum separation time between two sequential
packets, as expressed in RTP timestamp units.
Typical guardtime values are 500-2000 ms. This value range is not a
normative bound, and parties SHOULD be prepared to process values
outside this range.
The congestion control requirements for sender implementations
(described in <a href="#section-8">Section 8</a> and [<a href="./rfc3550" title=""RTP: A Transport Protocol for Real-Time Applications"">RFC3550</a>]) take precedence over the
guardtime parameter. Thus, if the guardtime parameter requests a
minimum sending rate, but sending at this rate would violate the
congestion control requirements, senders MUST ignore the guardtime
parameter value. In this case, senders SHOULD use the lowest minimum
sending rate that satisfies the congestion control requirements.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 120]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-121" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Below, we show a session description that uses the guardtime
parameter.
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 rtp-midi/44100
a=fmtp:96 guardtime=44100; rtp_ptime=0; rtp_maxptime=0
<span class="h3"><a class="selflink" id="appendix-C.5" href="#appendix-C.5">C.5</a>. Configuration Tools: Stream Description</span>
As we discussed in <a href="#section-2.1">Section 2.1</a>, a party may send several RTP MIDI
streams in the same RTP session, and several RTP sessions that carry
MIDI may appear in a multimedia session.
By default, the MIDI name space (16 channels + systems) of each RTP
stream sent by a party in a multimedia session is independent. By
independent, we mean three distinct things:
o If a party sends two RTP MIDI streams (A and B), MIDI voice
channel 0 in stream A is a different "channel 0" than MIDI voice
channel 0 in stream B.
o MIDI voice channel 0 in stream B is not considered to be
"channel 16" of a 32-channel MIDI voice channel space whose
"channel 0" is channel 0 of stream A.
o Streams sent by different parties over different RTP sessions,
or over the same RTP session but with different payload type
numbers, do not share the association that is shared by a MIDI
cable pair that cross-connects two devices in a MIDI 1.0 DIN
network. By default, this association is only held by streams
sent by different parties in the same RTP session that use the
same payload type number.
In this appendix, we show how to express that specific RTP MIDI
streams in a multimedia session are not independent but instead are
related in one of the three ways defined above. We use two tools to
express these relations:
o The musicport parameter. This parameter is assigned a non-
negative integer value between 0 and 4294967295. It appears in
the fmtp lines of payload types.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 121]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-122" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o The FID grouping attribute [<a href="./rfc3388" title=""Grouping of Media Lines in the Session Description Protocol (SDP)"">RFC3388</a>] signals that several RTP
sessions in a multimedia session are using the musicport
parameter to express an inter-session relationship.
If a multimedia session has several payload types whose musicport
parameters are assigned the same integer value, streams using these
payload types share an "identity relationship" (including streams
that use the same payload type). Streams in an identity relationship
share two properties:
o Identity relationship streams sent by the same party target the
same MIDI name space. Thus, if streams A and B share an
identity relationship, voice channel 0 in stream A is the same
"channel 0" as voice channel 0 in stream B.
o Pairs of identity relationship streams that are sent by
different parties share the association that is shared by a MIDI
cable pair that cross-connects two devices in a MIDI 1.0 DIN
network.
A party MUST NOT send two RTP MIDI streams that share an identity
relationship in the same RTP session. Instead, each stream MUST be
in a separate RTP session. As explained in <a href="#section-2.1">Section 2.1</a>, this
restriction is necessary to support the RTP MIDI method for the
synchronization of streams that share a MIDI name space.
If a multimedia session has several payload types whose musicport
parameters are assigned sequential values (i.e., i, i+1, ... i+k),
the streams using the payload types share an "ordered relationship".
For example, if payload type A assigns 2 to musicport and payload
type B assigns 3 to musicport, A and B are in an ordered
relationship.
Streams in an ordered relationship that are sent by the same party
are considered by renderers to form a single larger MIDI space. For
example, if stream A has a musicport value of 2 and stream B has a
musicport value of 3, MIDI voice channel 0 in stream B is considered
to be voice channel 16 in the larger MIDI space formed by the
relationship. Note that it is possible for streams to participate in
both an identity relationship and an ordered relationship.
We now state several rules for using musicport:
o If streams from several RTP sessions in a multimedia session use
the musicport parameter, the RTP sessions MUST be grouped using
the FID grouping attribute defined in [<a href="./rfc3388" title=""Grouping of Media Lines in the Session Description Protocol (SDP)"">RFC3388</a>].
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 122]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-123" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o An ordered or identity relationship MUST NOT contain both native
RTP MIDI streams and mpeg4-generic RTP MIDI streams. An
exception applies if a relationship consists of sendonly and
recvonly (but not sendrecv) streams. In this case, the sendonly
streams MUST NOT contain both types of streams, and the recvonly
streams MUST NOT contain both types of streams.
o It is possible to construct identity relationships that violate
the recovery journal mandate (for example, sending NoteOns for a
voice channel on stream A and NoteOffs for the same voice
channel on stream B). Parties MUST NOT generate (or accept)
session descriptions that exhibit this flaw.
o Other payload formats MAY define musicport media type
parameters. Formats would define these parameters so that their
sessions could be bundled into RTP MIDI name spaces. The
parameter definitions MUST be compatible with the musicport
semantics defined in this appendix.
As a rule, at most one payload type in a relationship may specify a
MIDI renderer. An exception to the rule applies to relationships
that contain sendonly and recvonly streams but no sendrecv streams.
In this case, one sendonly session and one recvonly session may each
define a renderer.
Renderer specification in a relationship may be done using the tools
described in <a href="#appendix-C.6">Appendix C.6</a>. These tools work for both native streams
and mpeg4-generic streams. An mpeg4-generic stream that uses the
<a href="#appendix-C.6">Appendix C.6</a> tools MUST set all "config" parameters to the empty
string ("").
Alternatively, for mpeg4-generic streams, renderer specification may
be done by setting one "config" parameter in the relationship to the
renderer configuration string, and all other config parameters to the
empty string ("").
We now define sender and receiver rules that apply when a party sends
several streams that target the same MIDI name space.
Senders MAY use the subsetting parameters (Appendix C.1) to predefine
the partitioning of commands between streams, or they MAY use a
dynamic partitioning strategy.
Receivers that merge identity relationship streams into a single MIDI
command stream MUST maintain the structural integrity of the MIDI
commands coded in each stream during the merging process, in the same
way that software that merges traditional MIDI 1.0 DIN cable flows is
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 123]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-124" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
responsible for creating a merged command flow compatible with
[<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>].
Senders MUST partition the name space so that the rendered MIDI
performance does not contain indefinite artifacts (as defined in
<a href="#section-4">Section 4</a>). This responsibility holds even if all streams are sent
over reliable transport, as different stream latencies may yield
indefinite artifacts. For example, stuck notes may occur in a
performance split over two TCP streams, if NoteOn commands are sent
on one stream and NoteOff commands are sent on the other.
Senders MUST NOT split a Registered Parameter Name (RPN) or Non-
Registered Parameter Name (NRPN) transaction appearing on a MIDI
channel across multiple identity relationship sessions. Receivers
MUST assume that the RPN/NRPN transactions that appear on different
identity relationship sessions are independent and MUST preserve
transactional integrity during the MIDI merge.
A simple way to safely partition voice channel commands is to place
all MIDI commands for a particular voice channel into the same
session. Safe partitioning of MIDI Systems commands may be more
complicated for sessions that extensively use System Exclusive.
We now show several session description examples that use the
musicport parameter.
Our first session description example shows two RTP MIDI streams that
drive the same General MIDI decoder. The sender partitions MIDI
commands between the streams dynamically. The musicport values
indicate that the streams share an identity relationship.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 124]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-125" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
a=group:FID 1 2
c=IN IP4 192.0.2.94
m=audio 5004 RTP/AVP 96
a=rtpmap:96 mpeg4-generic/44100
a=mid:1
a=fmtp:96 streamtype=5; mode=rtp-midi; profile-level-id=12;
config=7A0A0000001A4D546864000000060000000100604D54726B0
000000600FF2F000; musicport=12
m=audio 5006 RTP/AVP 96
a=rtpmap:96 mpeg4-generic/44100
a=mid:2
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; musicport=12
(The a=fmtp lines have been wrapped to fit the page to accommodate
memo formatting restrictions; they comprise single lines in SDP.)
Recall that <a href="#section-2.1">Section 2.1</a> defines rules for streams that target the
same MIDI name space. Those rules, implemented in the example above,
require that each stream resides in a separate RTP session, and that
the grouping mechanisms defined in [<a href="./rfc3388" title=""Grouping of Media Lines in the Session Description Protocol (SDP)"">RFC3388</a>] signal an inter-session
relationship. The "group" and "mid" attribute lines implement this
grouping mechanism.
A variant on this example, whose session description is not shown,
would use two streams in an identity relationship driving the same
MIDI renderer, each with a different transport type. One stream
would use UDP and would be dedicated to real-time messages. A second
stream would use TCP [<a href="./rfc4571" title=""Framing Real-time Transport Protocol (RTP) and RTP Control Protocol (RTCP) Packets over Connection- Oriented Transport"">RFC4571</a>] and would be used for SysEx bulk data
messages.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 125]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-126" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In the next example, two mpeg4-generic streams form an ordered
relationship to drive a Structured Audio decoder with 32 MIDI voice
channels. Both streams reside in the same RTP session.
v=0
o=lazzaro 2520644554 2838152170 IN IP6 first.example.net
s=Example
t=0 0
m=audio 5006 RTP/AVP 96 97
c=IN IP6 2001:DB80::7F2E:172A:1E24
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=13; musicport=5
a=rtpmap:97 mpeg4-generic/44100
a=fmtp:97 streamtype=5; mode=rtp-midi; config="";
profile-level-id=13; musicport=6; render=synthetic;
rinit="audio/asc";
url="http://example.com/cardinal.asc";
cid="azsldkaslkdjqpwojdkmsldkfpe"
(The a=fmtp lines have been wrapped to fit the page to accommodate
memo formatting restrictions; they comprise single lines in SDP.)
The sequential musicport values for the two sessions establish the
ordered relationship. The musicport=5 session maps to Structured
Audio extended channels range 0-15, the musicport=6 session maps to
Structured Audio extended channels range 16-31.
Both config strings are empty. The configuration data is specified
by parameters that appear in the fmtp line of the second media
description. We define this configuration method in <a href="#appendix-C.6">Appendix C.6</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 126]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-127" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The next example shows two RTP MIDI streams (one recvonly, one
sendonly) that form a "virtual sendrecv" session. Each stream
resides in a different RTP session (a requirement because sendonly
and recvonly are RTP session attributes).
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
a=group:FID 1 2
c=IN IP4 192.0.2.94
m=audio 5004 RTP/AVP 96
a=sendonly
a=rtpmap:96 mpeg4-generic/44100
a=mid:1
a=fmtp:96 streamtype=5; mode=rtp-midi; profile-level-id=12;
config=7A0A0000001A4D546864000000060000000100604D54726B0
000000600FF2F000; musicport=12
m=audio 5006 RTP/AVP 96
a=recvonly
a=rtpmap:96 mpeg4-generic/44100
a=mid:2
a=fmtp:96 streamtype=5; mode=rtp-midi; profile-level-id=12;
config=7A0A0000001A4D546864000000060000000100604D54726B0
000000600FF2F000; musicport=12
(The a=fmtp lines have been wrapped to fit the page to accommodate
memo formatting restrictions; they comprise single lines in SDP.)
To signal the "virtual sendrecv" semantics, the two streams assign
musicport to the same value (12). As defined earlier in this
section, pairs of identity relationship streams that are sent by
different parties share the association that is shared by a MIDI
cable pair that cross-connects two devices in a MIDI 1.0 network. We
use the term "virtual sendrecv" because streams sent by different
parties in a true sendrecv session also have this property.
As discussed in the preamble to <a href="#appendix-C">Appendix C</a>, the primary advantage of
the virtual sendrecv configuration is that each party can customize
the property of the stream it receives. In the example above, each
stream defines its own "config" string that could customize the
rendering algorithm for each party (in fact, the particular strings
shown in this example are identical, because General MIDI is not a
configurable MPEG 4 renderer).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 127]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-128" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h3"><a class="selflink" id="appendix-C.6" href="#appendix-C.6">C.6</a>. Configuration Tools: MIDI Rendering</span>
This appendix defines the session configuration tools for rendering.
The "render" parameter specifies a rendering method for a stream.
The parameter is assigned a token value that signals the top-level
rendering class. This memo defines four token values for render:
"unknown", "synthetic", "api", and "null":
o An "unknown" renderer is a renderer whose nature is unspecified.
It is the default renderer for native RTP MIDI streams.
o A "synthetic" renderer transforms the MIDI stream into audio
output (or sometimes into stage lighting changes or other
actions). It is the default renderer for mpeg4-generic RTP MIDI
streams.
o An "api" renderer presents the command stream to applications
via an Application Programmer Interface (API).
o The "null" renderer discards the MIDI stream.
The "null" render value plays special roles during Offer/Answer
negotiations [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>]. A party uses the "null" value in an answer
to reject an offered renderer. Note that rejecting a renderer is
independent from rejecting a payload type (coded by removing the
payload type from a media line) and rejecting a media stream (coded
by zeroing the port of a media line that uses the renderer).
Other render token values MAY be registered with IANA. The token
value MUST adhere to the ABNF for render tokens defined in <a href="#appendix-D">Appendix</a>
<a href="#appendix-D">D</a>. Registrations MUST include a complete specification of parameter
value usage, similar in depth to the specifications that appear
throughout <a href="#appendix-C.6">Appendix C.6</a> for "synthetic" and "api" render values. If
a party is offered a session description that uses a render token
value that is not known to the party, the party MUST NOT accept the
renderer. Options include rejecting the renderer (using the "null"
value), the payload type, the media stream, or the session
description.
Other parameters MAY follow a render parameter in a parameter list.
The additional parameters act to define the exact nature of the
renderer. For example, the "subrender" parameter (defined in
<a href="#appendix-C.6.2">Appendix C.6.2</a>) specifies the exact nature of the renderer.
Special rules apply to using the render parameter in an mpeg4-generic
stream. We define these rules in <a href="#appendix-C.6.5">Appendix C.6.5</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 128]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-129" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
<span class="h4"><a class="selflink" id="appendix-C.6.1" href="#appendix-C.6.1">C.6.1</a>. The multimode Parameter</span>
A media description MAY contain several render parameters. By
default, if a parameter list includes several render parameters, a
receiver MUST choose exactly one renderer from the list to render the
stream. The "multimode" parameter may be used to override this
default. We define two token values for multimode: "one" and "all":
o The default "one" value requests rendering by exactly one of the
listed renderers.
o The "all" value requests the synchronized rendering of the RTP
MIDI stream by all listed renderers, if possible.
If the multimode parameter appears in a parameter list, it MUST
appear before the first render parameter assignment.
Render parameters appear in the parameter list in order of decreasing
priority. A receiver MAY use the priority ordering to decide which
renderer(s) to retain in a session.
If the "offer" in an Offer/Answer-style negotiation [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>]
contains a parameter list with one or more render parameters, the
"answer" MUST set the render parameters of all unchosen renderers to
"null".
<span class="h4"><a class="selflink" id="appendix-C.6.2" href="#appendix-C.6.2">C.6.2</a>. Renderer Specification</span>
The render parameter (Appendix C.6 preamble) specifies, in a broad
sense, what a renderer does with a MIDI stream. In this appendix, we
describe the "subrender" parameter. The token value assigned to
subrender defines the exact nature of the renderer. Thus, "render"
and "subrender" combine to define a renderer, in the same way as MIME
types and MIME subtypes combine to define a type of media [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>].
If the subrender parameter is used for a renderer definition, it MUST
appear immediately after the render parameter in the parameter list.
At most one subrender parameter may appear in a renderer definition.
This document defines one value for subrender: the value "default".
The "default" token specifies the use of the default renderer for the
stream type (native or mpeg4-generic). The default renderer for
native RTP MIDI streams is a renderer whose nature is unspecified
(see point 6 in <a href="#section-6.1">Section 6.1</a> for details). The default renderer for
mpeg4-generic RTP MIDI streams is an MPEG 4 Audio Object Type whose
ID number is 13, 14, or 15 (see <a href="#section-6.2">Section 6.2</a> for details).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 129]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-130" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If a renderer definition does not use the subrender parameter, the
value "default" is assumed for subrender.
Other subrender token values may be registered with IANA. We now
discuss guidelines for registering subrender values.
A subrender value is registered for a specific stream type (native or
mpeg4-generic) and a specific render value (excluding "null" and
"unknown"). Registrations for mpeg4-generic subrender values are
restricted to new MPEG 4 Audio Object Types that accept MIDI input.
The syntax of the token MUST adhere to the token definition in
<a href="#appendix-D">Appendix D</a>.
For "render=synthetic" renderers, a subrender value registration
specifies an exact method for transforming the MIDI stream into audio
(or sometimes into video or control actions, such as stage lighting).
For standardized renderers, this specification is usually a pointer
to a standards document, perhaps supplemented by RTP-MIDI-specific
information. For commercial products and open-source projects, this
specification usually takes the form of instructions for interfacing
the RTP MIDI stream with the product or project software. A
"render=synthetic" registration MAY specify additional Reset State
commands for the renderer (Appendix A.1).
A "render=api" subrender value registration specifies how an RTP MIDI
stream interfaces with an API (Application Programmers Interface).
This specification is usually a pointer to programmer's documentation
for the API, perhaps supplemented by RTP-MIDI-specific information.
A subrender registration MAY specify an initialization file (referred
to in this document as an initialization data object) for the stream.
The initialization data object MAY be encoded in the parameter list
(verbatim or by reference) using the coding tools defined in <a href="#appendix-C.6.3">Appendix</a>
<a href="#appendix-C.6.3">C.6.3</a>. An initialization data object MUST have a registered
[<a href="./rfc4288" title=""Media Type Specifications and Registration Procedures"">RFC4288</a>] media type and subtype [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>].
For "render=synthetic" renderers, the data object usually encodes
initialization data for the renderer (sample files, synthesis patch
parameters, reverberation room impulse responses, etc.).
For "render=api" renderers, the data object usually encodes data
about the stream used by the API (for example, for an RTP MIDI stream
generated by a piano keyboard controller, the manufacturer and model
number of the keyboard, for use in GUI presentation).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 130]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-131" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Usually, only one initialization object is encoded for a renderer.
If a renderer uses multiple data objects, the correct receiver
interpretation of multiple data objects MUST be defined in the
subrender registration.
A subrender value registration may also specify additional
parameters, to appear in the parameter list immediately after
subrender. These parameter names MUST begin with the subrender
value, followed by an underscore ("_"), to avoid name space
collisions with future RTP MIDI parameter names (for example, a
parameter "foo_bar" defined for subrender value "foo").
We now specify guidelines for interpreting the subrender parameter
during session configuration.
If a party is offered a session description that uses a renderer
whose subrender value is not known to the party, the party MUST NOT
accept the renderer. Options include rejecting the renderer (using
the "null" value), the payload type, the media stream, or the session
description.
Receivers MUST be aware of the Reset State commands (Appendix A.1)
for the renderer specified by the subrender parameter and MUST insure
that the renderer does not experience indefinite artifacts due to the
presence (or the loss) of a Reset State command.
<span class="h4"><a class="selflink" id="appendix-C.6.3" href="#appendix-C.6.3">C.6.3</a>. Renderer Initialization</span>
If the renderer for a stream uses an initialization data object, an
"rinit" parameter MUST appear in the parameter list immediately after
the "subrender" parameter. If the renderer parameter list does not
include a subrender parameter (recall the semantics for "default" in
<a href="#appendix-C.6.2">Appendix C.6.2</a>), the "rinit" parameter MUST appear immediately after
the "render" parameter.
The value assigned to the rinit parameter MUST be the media
type/subtype [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>] for the initialization data object. If an
initialization object type is registered with several media types,
including audio, the assignment to rinit MUST use the audio media
type.
RTP MIDI supports several parameters for encoding initialization data
objects for renderers in the parameter list: "inline", "url", and
"cid".
If the "inline", "url", and/or "cid" parameters are used by a
renderer, these parameters MUST immediately follow the "rinit"
parameter.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 131]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-132" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If a "url" parameter appears for a renderer, an "inline" parameter
MUST NOT appear. If an "inline" parameter appears for a renderer, a
"url" parameter MUST NOT appear. However, neither "url" or "inline"
is required to appear. If neither "url" or "inline" parameters
follow "rinit", the "cid" parameter MUST follow "rinit".
The "inline" parameter supports the inline encoding of the data
object. The parameter is assigned a double-quoted Base64 [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>]
encoding of the binary data object, with no line breaks. <a href="#appendix-E.4">Appendix</a>
<a href="#appendix-E.4">E.4</a> shows an example that constructs an inline parameter value.
The "url" parameter is assigned a double-quoted string representation
of a Uniform Resource Locator (URL) for the data object. The string
MUST specify a HyperText Transport Protocol URL (HTTP, [<a href="./rfc2616" title=""Hypertext Transfer Protocol -- HTTP/1.1"">RFC2616</a>]).
HTTP MAY be used over TCP or MAY be used over a secure network
transport, such as the method described in [<a href="./rfc2818" title=""HTTP Over TLS"">RFC2818</a>]. The media
type/subtype for the data object SHOULD be specified in the
appropriate HTTP transport header.
The "cid" parameter supports data object caching. The parameter is
assigned a double-quoted string value that encodes a globally unique
identifier for the data object.
A cid parameter MAY immediately follow an inline parameter, in which
case the cid identifier value MUST be associated with the inline data
object.
If a url parameter is present, and if the data object for the URL is
expected to be unchanged for the life of the URL, a cid parameter MAY
immediately follow the url parameter. The cid identifier value MUST
be associated with the data object for the URL. A cid parameter
assigned to the same identifier value SHOULD be specified following
the data object type/subtype in the appropriate HTTP transport
header.
If a url parameter is present, and if the data object for the URL is
expected to change during the life of the URL, a cid parameter MUST
NOT follow the url parameter. A receiver interprets the presence of
a cid parameter as an indication that it is safe to use a cached copy
of the url data object; the absence of a cid parameter is an
indication that it is not safe to use a cached copy, as it may
change.
Finally, the cid parameter MAY be used without the inline and url
parameters. In this case, the identifier references a local or
distributed catalog of data objects.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 132]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-133" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In most cases, only one data object is coded in the parameter list
for each renderer. For example, the default renderer for mpeg4-
generic streams uses a single data object (see <a href="#appendix-C.6.5">Appendix C.6.5</a> for
example usage).
However, a subrender registration MAY permit the use of multiple data
objects for a renderer. If multiple data objects are encoded for a
renderer, each object encoding begins with an "rinit" parameter,
followed by "inline", "url", and/or "cid" parameters.
Initialization data objects MAY encapsulate a Standard MIDI File
(SMF). By default, the SMFs that are encapsulated in a data object
MUST be ignored by an RTP MIDI receiver. We define parameters to
override this default in <a href="#appendix-C.6.4">Appendix C.6.4</a>.
To end this section, we offer guidelines for registering media types
for initialization data objects. These guidelines are in addition to
the information in [<a href="./rfc4288" title=""Media Type Specifications and Registration Procedures"">RFC4288</a>] [<a href="./rfc4289" title=""Multipurpose Internet Mail Extensions (MIME) Part Four: Registration Procedures"">RFC4289</a>].
Some initialization data objects are also capable of encoding MIDI
note information and thus complete audio performances. These objects
SHOULD be registered using the "audio" media type, so that the
objects may also be used for store-and-forward rendering, and
"application" media type, to support editing tools. Initialization
objects without note storage, or initialization objects for non-audio
renderers, SHOULD be registered only for an "application" media type.
<span class="h4"><a class="selflink" id="appendix-C.6.4" href="#appendix-C.6.4">C.6.4</a>. MIDI Channel Mapping</span>
In this appendix, we specify how to map MIDI name spaces (16 voice
channels + systems) onto a renderer.
In the general case:
o A session may define an ordered relationship (Appendix C.5) that
presents more than one MIDI name space to a renderer.
o A renderer may accept an arbitrary number of MIDI name spaces,
or it may expect a specific number of MIDI name spaces.
A session description SHOULD provide a compatible MIDI name space to
each renderer in the session. If a receiver detects that a session
description has too many or too few MIDI name spaces for a renderer,
MIDI data from extra stream name spaces MUST be discarded, and extra
renderer name spaces MUST NOT be driven with MIDI data (except as
described in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a>, below).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 133]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-134" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
If a parameter list defines several renderers and assigns the "all"
token value to the multimode parameter, the same name space is
presented to each renderer. However, the "chanmask" parameter may be
used to mask out selected voice channels to each renderer. We define
"chanmask" and other MIDI management parameters in the sub-sections
below.
<span class="h5"><a class="selflink" id="appendix-C.6.4.1" href="#appendix-C.6.4.1">C.6.4.1</a>. The smf_info Parameter</span>
The smf_info parameter defines the use of the SMFs encapsulated in
renderer data objects (if any). The smf_info parameter also defines
the use of SMFs coded in the smf_inline, smf_url, and smf_cid
parameters (defined in <a href="#appendix-C.6.4.2">Appendix C.6.4.2</a>).
The smf_info parameter describes the "render" parameter that most
recently precedes it in the parameter list. The smf_info parameter
MUST NOT appear in parameter lists that do not use the "render"
parameter, and MUST NOT appear before the first use of "render" in
the parameter list.
We define three token values for smf_info: "ignore", "sdp_start", and
"identity":
o The "ignore" value indicates that the SMFs MUST be discarded.
This behavior is the default SMF rendering behavior.
o The "sdp_start" value codes that SMFs MUST be rendered, and that
the rendering MUST begin upon the acceptance of the session
description. If a receiver is offered a session description
with a renderer that uses an smf_info parameter set to
sdp_start, and if the receiver does not support rendering SMFs,
the receiver MUST NOT accept the renderer associated with the
smf_info parameter. Options include rejecting the renderer (by
setting the "render" parameter to "null"), the payload type, the
media stream, or the entire session description.
o The "identity" value indicates that the SMFs code the identity
of the renderer. The value is meant for use with the "unknown"
renderer (see <a href="#appendix-C.6">Appendix C.6</a> preamble). The MIDI commands coded
in the SMF are informational in nature and MUST NOT be presented
to a renderer for audio presentation. In typical use, the SMF
would use SysEx Identity Reply commands (F0 7E nn 06 02, as
defined in [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]) to identify devices, and use device-specific
SysEx commands to describe current state of the devices (patch
memory contents, etc.).
Other smf_info token values MAY be registered with IANA. The token
value MUST adhere to the ABNF for render tokens defined in Appendix
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 134]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-135" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
D. Registrations MUST include a complete specification of parameter
usage, similar in depth to the specifications that appear in this
appendix for "sdp_start" and "identity".
If a party is offered a session description that uses an smf_info
parameter value that is not known to the party, the party MUST NOT
accept the renderer associated with the smf_info parameter. Options
include rejecting the renderer, the payload type, the media stream,
or the entire session description.
We now define the rendering semantics for the "sdp_start" token value
in detail.
The SMFs and RTP MIDI streams in a session description share the same
MIDI name space(s). In the simple case of a single RTP MIDI stream
and a single SMF, the SMF MIDI commands and RTP MIDI commands are
merged into a single name space and presented to the renderer. The
indefinite artifact responsibilities for merged MIDI streams defined
in <a href="#appendix-C.5">Appendix C.5</a> also apply to merging RTP and SMF MIDI data.
If a payload type codes multiple SMFs, the SMF name spaces are
presented as an ordered entity to the renderer. To determine the
ordering of SMFs for a renderer (which SMF is "first", which is
"second", etc.), use the following rules:
o If the renderer uses a single data object, the order of
appearance of the SMFs in the object's internal structure
defines the order of the SMFs (the earliest SMF in the object is
"first", the next SMF in the object is "second", etc.).
o If multiple data objects are encoded for a renderer, the
appearance of each data object in the parameter list sets the
relative order of the SMFs encoded in each data object (SMFs
encoded in parameters that appear earlier in the list are
ordered before SMFs encoded in parameters that appear later in
the list).
o If SMFs are encoded in data objects parameters and in the
parameters defined in C.6.4.2, the relative order of the data
object parameters and C.6.4.2 parameters in the parameter list
sets the relative order of SMFs (SMFs encoded in parameters that
appear earlier in the list are ordered before SMFs in parameters
that appear later in the list).
Given this ordering of SMFs, we now define the mapping of SMFs to
renderer name spaces. The SMF that appears first for a renderer maps
to the first renderer name space. The SMF that appears second for a
renderer maps to the second renderer name space, etc. If the
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 135]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-136" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
associated RTP MIDI streams also form an ordered relationship, the
first SMF is merged with the first name space of the relationship,
the second SMF is merged to the second name space of the
relationship, etc.
Unless the streams and the SMFs both use MIDI Time Code, the time
offset between SMF and stream data is unspecified. This restriction
limits the use of SMFs to applications where synchronization is not
critical, such as the transport of System Exclusive commands for
renderer initialization, or human-SMF interactivity.
Finally, we note that each SMF in the sdp_start discussion above
encodes exactly one MIDI name space (16 voice channels + systems).
Thus, the use of the Device Name SMF meta event to specify several
MIDI name spaces in an SMF is not supported for sdp_start.
<span class="h5"><a class="selflink" id="appendix-C.6.4.2" href="#appendix-C.6.4.2">C.6.4.2</a>. The smf_inline, smf_url, and smf_cid Parameters</span>
In some applications, the renderer data object may not encapsulate
SMFs, but an application may wish to use SMFs in the manner defined
in <a href="#appendix-C.6.4.1">Appendix C.6.4.1</a>.
The "smf_inline", "smf_url", and "smf_cid" parameters address this
situation. These parameters use the syntax and semantics of the
inline, url, and cid parameters defined in <a href="#appendix-C.6.3">Appendix C.6.3</a>, except
that the encoded data object is an SMF.
The "smf_inline", "smf_url", and "smf_cid" parameters belong to the
"render" parameter that most recently precedes it in the session
description. The "smf_inline", "smf_url", and "smf_cid" parameters
MUST NOT appear in parameter lists that do not use the "render"
parameter and MUST NOT appear before the first use of "render" in the
parameter list. If several "smf_inline", "smf_url", or "smf_cid"
parameters appear for a renderer, the order of the parameters defines
the SMF name space ordering.
<span class="h5"><a class="selflink" id="appendix-C.6.4.3" href="#appendix-C.6.4.3">C.6.4.3</a>. The chanmask Parameter</span>
The chanmask parameter instructs the renderer to ignore all MIDI
voice commands for certain channel numbers. The parameter value is a
concatenated string of "1" and "0" digits. Each string position maps
to a MIDI voice channel number (system channels may not be masked).
A "1" instructs the renderer to process the voice channel; a "0"
instructs the renderer to ignore the voice channel.
The string length of the chanmask parameter value MUST be 16 (for a
single stream or an identity relationship) or a multiple of 16 (for
an ordered relationship).
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 136]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-137" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The chanmask parameter describes the "render" parameter that most
recently precedes it in the session description; chanmask MUST NOT
appear in parameter lists that do not use the "render" parameter and
MUST NOT appear before the first use of "render" in the parameter
list.
The chanmask parameter describes the final MIDI name spaces presented
to the renderer. The SMF and stream components of the MIDI name
spaces may not be independently masked.
If a receiver is offered a session description with a renderer that
uses the chanmask parameter, and if the receiver does not implement
the semantics of the chanmask parameter, the receiver MUST NOT accept
the renderer unless the chanmask parameter value contains only "1"s.
<span class="h4"><a class="selflink" id="appendix-C.6.5" href="#appendix-C.6.5">C.6.5</a>. The audio/asc Media Type</span>
In Appendix 11.3, we register the audio/asc media type. The data
object for audio/asc is a binary encoding of the AudioSpecificConfig
data block used to initialize mpeg4-generic streams (<a href="#section-6.2">Section 6.2</a> and
[<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>]).
An mpeg4-generic parameter list MAY use the render, subrender, and
rinit parameters with the audio/asc media type for renderer
configuration. Several restrictions apply to the use of these
parameters in mpeg4-generic parameter lists:
o An mpeg4-generic media description that uses the render
parameter MUST assign the empty string ("") to the mpeg4-generic
"config" parameter. The use of the streamtype, mode, and
profile-level-id parameters MUST follow the normative text in
<a href="#section-6.2">Section 6.2</a>.
o Sessions that use identity or ordered relationships MUST follow
the mpeg4-generic configuration restrictions in <a href="#appendix-C.5">Appendix C.5</a>.
o The render parameter MUST be assigned the value "synthetic",
"unknown", "null", or a render value that has been added to the
IANA repository for use with mpeg4-generic RTP MIDI streams.
The "api" token value for render MUST NOT be used.
o If a subrender parameter is present, it MUST immediately follow
the render parameter, and it MUST be assigned the token value
"default" or assigned a subrender value added to the IANA
repository for use with mpeg4-generic RTP MIDI streams. A
subrender parameter assignment may be left out of the renderer
configuration, in which case the implied value of subrender is
the default value of "default".
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 137]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-138" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
o If the render parameter is assigned the value "synthetic" and
the subrender parameter has the value "default" (assigned or
implied), the rinit parameter MUST be assigned the value
"audio/asc", and an AudioSpecificConfig data object MUST be
encoded using the mechanisms defined in C.6.2-3. The
AudioSpecificConfig data MUST encode one of the MPEG 4 Audio
Object Types defined for use with mpeg4-generic in <a href="#section-6.2">Section 6.2</a>.
If the subrender value is other than "default", refer to the
subrender registration for information on the use of "audio/asc"
with the renderer.
o If the render parameter is assigned the value "null" or
"unknown", the data object MAY be omitted.
Several general restrictions apply to the use of the audio/asc media
type in RTP MIDI:
o A native stream MUST NOT assign "audio/asc" to rinit. The
audio/asc media type is not intended to be a general-purpose
container for rendering systems outside of MPEG usage.
o The audio/asc media type defines a stored object type; it does
not define semantics for RTP streams. Thus, audio/asc MUST NOT
appear on an rtpmap line of a session description.
Below, we show session description examples for audio/asc. The
session description below uses the inline parameter to code the
AudioSpecificConfig block for a mpeg4-generic General MIDI stream.
We derive the value assigned to the inline parameter in <a href="#appendix-E.4">Appendix E.4</a>.
The subrender token value of "default" is implied by the absence of
the subrender parameter in the parameter list.
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; render=synthetic; rinit="audio/asc";
inline="egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA"
(The a=fmtp line has been wrapped to fit the page to accommodate
memo formatting restrictions; it comprises a single line in SDP.)
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 138]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-139" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
The session description below uses the url parameter to code the
AudioSpecificConfig block for the same General MIDI stream:
v=0
o=lazzaro 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
m=audio 5004 RTP/AVP 96
c=IN IP4 192.0.2.94
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; render=synthetic; rinit="audio/asc";
url="http://example.net/oski.asc";
cid="xjflsoeiurvpa09itnvlduihgnvet98pa3w9utnuighbuk"
(The a=fmtp line has been wrapped to fit the page to accommodate
memo formatting restrictions; it comprises a single line in SDP.)
<span class="h3"><a class="selflink" id="appendix-C.7" href="#appendix-C.7">C.7</a>. Interoperability</span>
In this appendix, we define interoperability guidelines for two
application areas:
o MIDI content-streaming applications. RTP MIDI is added to
RTSP-based content-streaming servers, so that viewers may
experience MIDI performances (produced by a specified client-
side renderer) in synchronization with other streams (video,
audio).
o Long-distance network musical performance applications. RTP
MIDI is added to SIP-based voice chat or videoconferencing
programs, as an alternative, or as an addition, to audio and/or
video RTP streams.
For each application, we define a core set of functionality that all
implementations MUST implement.
The applications we address in this section are not an exhaustive
list of potential RTP MIDI uses. We expect framework documents for
other applications to be developed, within the IETF or within other
organizations. We discuss other potential application areas for RTP
MIDI in <a href="#section-1">Section 1</a> of the main text of this memo.
<span class="h4"><a class="selflink" id="appendix-C.7.1" href="#appendix-C.7.1">C.7.1</a>. MIDI Content Streaming Applications</span>
In content-streaming applications, a user invokes an RTSP client to
initiate a request to an RTSP server to view a multimedia session.
For example, clicking on a web page link for an Internet Radio
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 139]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-140" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
channel launches an RTSP client that uses the link's RTSP URL to
contact the RTSP server hosting the radio channel.
The content may be pre-recorded (for example, on-demand replay of
yesterday's football game) or "live" (for example, football game
coverage as it occurs), but in either case the user is usually an
"audience member" as opposed to a "participant" (as the user would be
in telephony).
Note that these examples describe the distribution of audio content
to an audience member. The interoperability guidelines in this
appendix address RTP MIDI applications of this nature, not
applications such as the transmission of raw MIDI command streams for
use in a professional environment (recording studio, performance
stage, etc.).
In an RTSP session, a client accesses a session description that is
"declared" by the server, either via the RTSP DESCRIBE method, or via
other means, such as HTTP or email. The session description defines
the session from the perspective of the client. For example, if a
media line in the session description contains a non-zero port
number, it encodes the server's preference for the client's port
numbers for RTP and RTCP reception. Once media flow begins, the
server sends an RTP MIDI stream to the client, which renders it for
presentation, perhaps in synchrony with video or other audio streams.
We now define the interoperability text for content-streaming RTSP
applications.
In most cases, server interoperability responsibilities are described
in terms of limits on the "reference" session description a server
provides for a performance if it has no information about the
capabilities of the client. The reference session is a "lowest
common denominator" session that maximizes the odds that a client
will be able to view the session. If a server is aware of the
capabilities of the client, the server is free to provide a session
description customized for the client in the DESCRIBE reply.
Clients MUST support unicast UDP RTP MIDI streams that use the
recovery journal with the closed-loop or the anchor sending policies.
Clients MUST be able to interpret stream subsetting and chapter
inclusion parameters in the session description that qualify the
sending policies. Client support of enhanced Chapter C encoding is
OPTIONAL.
The reference session description offered by a server MUST send all
RTP MIDI UDP streams as unicast streams that use the recovery journal
and the closed-loop or anchor sending policies. Servers SHOULD use
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 140]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-141" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
the stream subsetting and chapter inclusion parameters in the
reference session description, to simplify the rendering task of the
client. Server support of enhanced Chapter C encoding is OPTIONAL.
Clients and servers MUST support the use of RTSP interleaved mode (a
method for interleaving RTP onto the RTSP TCP transport).
Clients MUST be able to interpret the timestamp semantics signalled
by the "comex" value of the tsmode parameter (i.e., the timestamp
semantics of Standard MIDI Files [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]). Servers MUST use the
"comex" value for the "tsmode" parameter in the reference session
description.
Clients MUST be able to process an RTP MIDI stream whose packets
encode an arbitrary temporal duration ("media time"). Thus, in
practice, clients MUST implement a MIDI playout buffer. Clients MUST
NOT depend on the presence of rtp_ptime, rtp_maxtime, and guardtime
parameters in the session description in order to process packets,
but they SHOULD be able to use these parameters to improve packet
processing.
Servers SHOULD strive to send RTP MIDI streams in the same way media
servers send conventional audio streams: a sequence of packets that
either all code the same temporal duration (non-normative example: 50
ms packets) or that code one of an integral number of temporal
durations (non-normative example: 50 ms, 100 ms, 250 ms, or 500 ms
packets). Servers SHOULD encode information about the packetization
method in the rtp_ptime and rtp_maxtime parameters in the session
description.
Clients MUST be able to examine the render and subrender parameter,
to determine if a multimedia session uses a renderer it supports.
Clients MUST be able to interpret the default "one" value of the
"multimode" parameter, to identify supported renderers from a list of
renderer descriptions. Clients MUST be able to interpret the
musicport parameter, to the degree that it is relevant to the
renderers it supports. Clients MUST be able to interpret the
chanmask parameter.
Clients supporting renderers whose data object (as encoded by a
parameter value for "inline") could exceed 300 octets in size MUST
support the url and cid parameters and thus must implement the HTTP
protocol in addition to RTSP.
Servers MUST specify complete rendering systems for RTP MIDI streams.
Note that a minimal RTP MIDI native stream does not meet this
requirement (<a href="#section-6.1">Section 6.1</a>), as the rendering method for such streams
is "not specified".
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 141]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-142" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
At the time of this memo, the only way for servers to specify a
complete rendering system is to specify an mpeg4-generic RTP MIDI
stream in mode rtp-midi (<a href="#section-6.2">Section 6.2</a> and C.6.5). As a consequence,
the only rendering systems that may be presently used are General
MIDI [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], DLS 2 [<a href="#ref-DLS2" title=""The MIDI Downloadable Sounds Specification"">DLS2</a>], or Structured Audio [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>]. Note that
the maximum inline value for General MIDI is well under 300 octets
(and thus clients need not support the "url" parameter), and that the
maximum inline values for DLS 2 and Structured Audio may be much
larger than 300 octets (and thus clients MUST support the url
parameter).
We anticipate that the owners of rendering systems (both standardized
and proprietary) will register subrender parameters for their
renderers. Once registration occurs, native RTP MIDI sessions may
use render and subrender (Appendix C.6.2) to specify complete
rendering systems for RTSP content-streaming multimedia sessions.
Servers MUST NOT use the sdp_start value for the smf_info parameter
in the reference session description, as this use would require that
clients be able to parse and render Standard MIDI Files.
Clients MUST support mpeg4-generic mode rtp-midi General MIDI (GM)
sessions, at a polyphony limited by the hardware capabilities of the
client. This requirement provides a "lowest common denominator"
rendering system for content providers to target. Note that this
requirement does not force implementors of a non-GM renderer (such as
DLS 2 or Structured Audio) to add a second rendering engine.
Instead, a client may satisfy the requirement by including a set of
voice patches that implement the GM instrument set, and using this
emulation for mpeg4-generic GM sessions.
It is RECOMMENDED that servers use General MIDI as the renderer for
the reference session description, because clients are REQUIRED to
support it. We do not require General MIDI as the reference
renderer, because for normative applications it is an inappropriate
choice. Servers using General MIDI as a "lowest common denominator"
renderer SHOULD use Universal Real-Time SysEx MIP message [<a href="#ref-SPMIDI" title=""Scalable Polyphony MIDI, Specification and Device Profiles"">SPMIDI</a>] to
communicate the priority of voices to polyphony-limited clients.
<span class="h4"><a class="selflink" id="appendix-C.7.2" href="#appendix-C.7.2">C.7.2</a>. MIDI Network Musical Performance Applications</span>
In Internet telephony and videoconferencing applications, parties
interact over an IP network as they would face-to-face. Good user
experiences require low end-to-end audio latency and tight
audiovisual synchronization (for "lip-sync"). The Session Initiation
Protocol (SIP, [<a href="./rfc3261" title=""SIP: Session Initiation Protocol"">RFC3261</a>]) is used for session management.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 142]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-143" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In this appendix section, we define interoperability guidelines for
using RTP MIDI streams in interactive SIP applications. Our primary
interest is supporting Network Musical Performances (NMP), where
musicians in different locations interact over the network as if they
were in the same room. See [<a href="#ref-NMP" title=""A Case for Network Musical Performance"">NMP</a>] for background information on NMP,
and see [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>] for a discussion of low-latency RTP MIDI
implementation techniques for NMP.
Note that the goal of NMP applications is telepresence: the parties
should hear audio that is close to what they would hear if they were
in the same room. The interoperability guidelines in this appendix
address RTP MIDI applications of this nature, not applications such
as the transmission of raw MIDI command streams for use in a
professional environment (recording studio, performance stage, etc.).
We focus on session management for two-party unicast sessions that
specify a renderer for RTP MIDI streams. Within this limited scope,
the guidelines defined here are sufficient to let applications
interoperate. We define the REQUIRED capabilities of RTP MIDI
senders and receivers in NMP sessions and define how session
descriptions exchanged are used to set up network musical performance
sessions.
SIP lets parties negotiate details of the session, using the
Offer/Answer protocol [<a href="./rfc3264" title=""An Offer/Answer Model with Session Description Protocol (SDP)"">RFC3264</a>]. However, RTP MIDI has so many
parameters that "blind" negotiations between two parties using
different applications might not yield a common session
configuration.
Thus, we now define a set of capabilities that NMP parties MUST
support. Session description offers whose options lie outside the
envelope of REQUIRED party behavior risk negotiation failure. We
also define session description idioms that the RTP MIDI part of an
offer MUST follow, in order to structure the offer for simpler
analysis.
We use the term "offerer" for the party making a SIP offer, and
"answerer" for the party answering the offer. Finally, we note that
unless it is qualified by the adjective "sender" or "receiver", a
statement that a party MUST support X implies that it MUST support X
for both sending and receiving.
If an offerer wishes to define a "sendrecv" RTP MIDI stream, it may
use a true sendrecv session or the "virtual sendrecv" construction
described in the preamble to <a href="#appendix-C">Appendix C</a> and in <a href="#appendix-C.5">Appendix C.5</a>. A true
sendrecv session indicates that the offerer wishes to participate in
a session where both parties use identically configured renderers. A
virtual sendrecv session indicates that the offerer is willing to
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 143]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-144" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
participate in a session where the two parties may be using different
renderer configurations. Thus, parties MUST be prepared to see both
real and virtual sendrecv sessions in an offer.
Parties MUST support unicast UDP transport of RTP MIDI streams.
These streams MUST use the recovery journal with the closed-loop or
anchor sending policies. These streams MUST use the stream
subsetting and chapter inclusion parameters to declare the types of
MIDI commands that will be sent on the stream (for sendonly streams)
or will be processed (for recvonly streams), including the size
limits on System Exclusive commands. Support of enhanced Chapter C
encoding is OPTIONAL.
Note that both TCP and multicast UDP support are OPTIONAL. We make
TCP OPTIONAL because we expect NMP renderers to rely on data objects
(signalled by "rinit" and associated parameters) for initialization
at the start of the session, and only to use System Exclusive
commands for interactive control during the session. These
interactive commands are small enough to be protected via the
recovery journal mechanism of RTP MIDI UDP streams.
We now discuss timestamps, packet timing, and packet sending
algorithms.
Recall that the tsmode parameter controls the semantics of command
timestamps in the MIDI list of RTP packets.
Parties MUST support clock rates of 44.1 kHz, 48 kHz, 88.2 kHz, and
96 kHz. Parties MUST support streams using the "comex", "async", and
"buffer" tsmode values. Recvonly offers MUST offer the default
"comex".
Parties MUST support a wide range of packet temporal durations: from
rtp_ptime and rtp_maxptime values of 0, to rtp_ptime and rtp_maxptime
values that code 100 ms. Thus, receivers MUST be able to implement a
playout buffer.
Offers and answers MUST present rtp_ptime, rtp_maxptime, and
guardtime values that support the latency that users would expect in
the application, subject to bandwidth constraints. As senders MUST
abide by values set for these parameters in a session description, a
receiver SHOULD use these values to size its playout buffer to
produce the lowest reliable latency for a session. Implementers
should refer to [<a href="./rfc4696" title=""An Implementation Guide for RTP MIDI"">RFC4696</a>] for information on packet sending
algorithms for latency-sensitive applications. Parties MUST be able
to implement the semantics of the guardtime parameter, for times from
5 ms to 5000 ms.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 144]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-145" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We now discuss the use of the render parameter.
Sessions MUST specify complete rendering systems for all RTP MIDI
streams. Note that a minimal RTP MIDI native stream does not meet
this requirement (<a href="#section-6.1">Section 6.1</a>), as the rendering method for such
streams is "not specified".
At the time this writing, the only way for parties to specify a
complete rendering system is to specify an mpeg4-generic RTP MIDI
stream in mode rtp-midi (<a href="#section-6.2">Section 6.2</a> and C.6.5). We anticipate that
the owners of rendering systems (both standardized and proprietary)
will register subrender values for their renderers. Once IANA
registration occurs, native RTP MIDI sessions may use render and
subrender (Appendix C.6.2) to specify complete rendering systems for
SIP network musical performance multimedia sessions.
All parties MUST support General MIDI (GM) sessions, at a polyphony
limited by the hardware capabilities of the party. This requirement
provides a "lowest common denominator" rendering system, without
which practical interoperability will be quite difficult. When using
GM, parties SHOULD use Universal Real-Time SysEx MIP message [<a href="#ref-SPMIDI" title=""Scalable Polyphony MIDI, Specification and Device Profiles"">SPMIDI</a>]
to communicate the priority of voices to polyphony-limited clients.
Note that this requirement does not force implementors of a non-GM
renderer (for mpeg4-generic sessions, DLS 2, or Structured Audio) to
add a second rendering engine. Instead, a client may satisfy the
requirement by including a set of voice patches that implement the GM
instrument set, and using this emulation for mpeg4-generic GM
sessions. We require GM support so that an offerer that wishes to
maximize interoperability may do so by offering GM if its preferred
renderer is not accepted by the answerer.
Offerers MUST NOT present several renderers as options in a session
description by listing several payload types on a media line, as
<a href="#section-2.1">Section 2.1</a> uses this construct to let a party send several RTP MIDI
streams in the same RTP session.
Instead, an offerer wishing to present rendering options SHOULD offer
a single payload type that offers several renderers. In this
construct, the parameter list codes a list of render parameters (each
followed by its support parameters). As discussed in <a href="#appendix-C.6.1">Appendix C.6.1</a>,
the order of renderers in the list declares the offerer's preference.
The "unknown" and "null" values MUST NOT appear in the offer. The
answer MUST set all render values except the desired renderer to
"null". Thus, "unknown" MUST NOT appear in the answer.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 145]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-146" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We use SHOULD instead of MUST in the first sentence in the paragraph
above, because this technique does not work in all situations
(example: an offerer wishes to offer both mpeg4-generic renderers
and native RTP MIDI renderers as options). In this case, the offerer
MUST present a series of session descriptions, each offering a single
renderer, until the answerer accepts a session description.
Parties MUST support the musicport, chanmask, subrender, rinit, and
inline parameters. Parties supporting renderers whose data object
(as encoded by a parameter value for "inline") could exceed 300
octets in size MUST support the url and cid parameters and thus must
implement HTTP protocol. Note that in mpeg4-generic, General MIDI
data objects cannot exceed 300 octets, but DLS 2 and Structured Audio
data objects may. Support for the other rendering parameters
(smf_cif, smf_info, smf_inline, smf_url) is OPTIONAL.
Thus far in this document, our discussion has assumed that the only
MIDI flows that drive a renderer are the network flows described in
the session description. In NMP applications, this assumption would
require two rendering engines: one for local use by a party, a second
for the remote party.
In practice, applications may wish to have both parties share a
single rendering engine. In this case, the session description MUST
use a virtual sendrecv session and MUST use the stream subsetting and
chapter inclusion parameters to allocate which MIDI channels are
intended for use by a party. If two parties are sharing a MIDI
channels, the application MUST ensure that appropriate MIDI merging
occurs at the input to the renderer.
We now discuss the use of (non-MIDI) audio streams in the session.
Audio streams may be used for two purposes: as a "talkback" channel
for parties to converse, or as a way to conduct a performance that
includes MIDI and audio channels. In the latter case, offers MUST
use sample rates and the packet temporal durations for the audio and
MIDI streams that support low-latency synchronized rendering.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 146]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-147" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We now show an example of an offer/answer exchange in a network
musical performance application (next page). Below, we show an offer
that complies with the interoperability text in this appendix
section.
v=0
o=first 2520644554 2838152170 IN IP4 first.example.net
s=Example
t=0 0
a=group:FID 1 2
c=IN IP4 192.0.2.94
m=audio 16112 RTP/AVP 96
a=recvonly
a=mid:1
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; cm_unused=ABCFGHJKMNPQTVWXYZ; cm_used=2NPTW;
cm_used=2C0.1.7.10.11.64.121.123; cm_used=2M0.1.2
cm_used=X0-16; ch_never=ABCDEFGHJKMNPQTVWXYZ;
ch_default=2NPTW; ch_default=2C0.1.7.10.11.64.121.123;
ch_default=2M0.1.2; cm_default=X0-16;
rtp_ptime=0; rtp_maxptime=0; guardtime=44100;
musicport=1; render=synthetic; rinit="audio/asc";
inline="egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA"
m=audio 16114 RTP/AVP 96
a=sendonly
a=mid:2
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; cm_unused=ABCFGHJKMNPQTVWXYZ; cm_used=1NPTW;
cm_used=1C0.1.7.10.11.64.121.123; cm_used=1M0.1.2
cm_used=X0-16; ch_never=ABCDEFGHJKMNPQTVWXYZ;
ch_default=1NPTW; ch_default=1C0.1.7.10.11.64.121.123;
ch_default=1M0.1.2; cm_default=X0-16;
rtp_ptime=0; rtp_maxptime=0; guardtime=44100;
musicport=1; render=synthetic; rinit="audio/asc";
inline="egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA"
(The a=fmtp lines have been wrapped to fit the page to accommodate
memo formatting restrictions; it comprises a single line in SDP.)
The owner line (o=) identifies the session owner as "first".
The session description defines two MIDI streams: a recvonly stream
on which "first" receives a performance, and a sendonly stream that
"first" uses to send a performance. The recvonly port number encodes
the ports on which "first" wishes to receive RTP (16112) and RTCP
(16113) media at IP4 address 192.0.2.94. The sendonly port number
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 147]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-148" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
encodes the port on which "first" wishes to receive RTCP for the
stream (16115).
The musicport parameters code that the two streams share and identity
relationship and thus form a virtual sendrecv stream.
Both streams are mpeg4-generic RTP MIDI streams that specify a
General MIDI renderer. The stream subsetting parameters code that
the recvonly stream uses MIDI channel 1 exclusively for voice
commands, and that the sendonly stream uses MIDI channel 2
exclusively for voice commands. This mapping permits the application
software to share a single renderer for local and remote performers.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 148]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-149" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
We now show the answer to the offer.
v=0
o=second 2520644554 2838152170 IN IP4 second.example.net
s=Example
t=0 0
a=group:FID 1 2
c=IN IP4 192.0.2.105
m=audio 5004 RTP/AVP 96
a=sendonly
a=mid:1
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; cm_unused=ABCFGHJKMNPQTVWXYZ; cm_used=2NPTW;
cm_used=2C0.1.7.10.11.64.121.123; cm_used=2M0.1.2
cm_used=X0-16; ch_never=ABCDEFGHJKMNPQTVWXYZ;
ch_default=2NPTW; ch_default=2C0.1.7.10.11.64.121.123;
ch_default=2M0.1.2; cm_default=X0-16;
rtp_ptime=0; rtp_maxptime=882; guardtime=44100;
musicport=1; render=synthetic; rinit="audio/asc";
inline="egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA"
m=audio 5006 RTP/AVP 96
a=recvonly
a=mid:2
a=rtpmap:96 mpeg4-generic/44100
a=fmtp:96 streamtype=5; mode=rtp-midi; config="";
profile-level-id=12; cm_unused=ABCFGHJKMNPQTVWXYZ; cm_used=1NPTW;
cm_used=1C0.1.7.10.11.64.121.123; cm_used=1M0.1.2
cm_used=X0-16; ch_never=ABCDEFGHJKMNPQTVWXYZ;
ch_default=1NPTW; ch_default=1C0.1.7.10.11.64.121.123;
ch_default=1M0.1.2; cm_default=X0-16;
rtp_ptime=0; rtp_maxptime=0; guardtime=88200;
musicport=1; render=synthetic; rinit="audio/asc";
inline="egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA"
(The a=fmtp lines have been wrapped to fit the page to accommodate
memo formatting restrictions; they comprise single lines in SDP.)
The owner line (o=) identifies the session owner as "second".
The port numbers for both media streams are non-zero; thus, "second"
has accepted the session description. The stream marked "sendonly"
in the offer is marked "recvonly" in the answer, and vice versa,
coding the different view of the session held by "session". The IP4
number (192.0.2.105) and the RTP (5004 and 5006) and RTCP (5005 and
5007) have been changed by "second" to match its transport wishes.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 149]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-150" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In addition, "second" has made several parameter changes:
rtp_maxptime for the sendonly stream has been changed to code 2 ms
(441 in clock units), and the guardtime for the recvonly stream has
been doubled. As these parameter modifications request capabilities
that are REQUIRED to be implemented by interoperable parties,
"second" can make these changes with confidence that "first" can
abide by them.
<span class="h2"><a class="selflink" id="appendix-D" href="#appendix-D">D</a>. Parameter Syntax Definitions</span>
In this appendix, we define the syntax for the RTP MIDI media type
parameters in Augmented Backus-Naur Form (ABNF, [<a href="./rfc4234" title=""Augmented BNF for Syntax Specifications: ABNF"">RFC4234</a>]). When
using these parameters with SDP, all parameters MUST appear on a
single fmtp attribute line of an RTP MIDI media description. For
mpeg4-generic RTP MIDI streams, this line MUST also include any
mpeg4-generic parameters (usage described in <a href="#section-6.2">Section 6.2</a>). An fmtp
attribute line may be defined (after [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]) as:
;
; SDP fmtp line definition
;
fmtp = "a=fmtp:" token SP param-assign 0*(";" SP param-assign) CRLF
where <token> codes the RTP payload type. Note that white space MUST
NOT appear between the "a=fmtp:" and the RTP payload type.
We now define the syntax of the parameters defined in <a href="#appendix-C">Appendix C</a>.
The definition takes the form of the incremental assembly of the
<param-assign> token. See [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] for the syntax of the
mpeg4-generic parameters discussed in <a href="#section-6.2">Section 6.2</a>.
;
;
; top-level definition for all parameters
;
;
;
; Parameters defined in <a href="#appendix-C.1">Appendix C.1</a>
param-assign = ("cm_unused=" (([channel-list] command-type
[f-list]) / sysex-data))
param-assign =/ ("cm_used=" (([channel-list] command-type
[f-list]) / sysex-data))
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 150]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-151" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; Parameters defined in <a href="#appendix-C.2">Appendix C.2</a>
param-assign =/ ("j_sec=" ("none" / "recj" / *ietf-extension))
param-assign =/ ("j_update=" ("anchor" / "closed-loop" /
"open-loop" / *ietf-extension))
param-assign =/ ("ch_default=" (([channel-list] chapter-list
[f-list]) / sysex-data))
param-assign =/ ("ch_never=" (([channel-list] chapter-list
[f-list]) / sysex-data))
param-assign =/ ("ch_anchor=" (([channel-list] chapter-list
[f-list]) / sysex-data))
;
; Parameters defined in <a href="#appendix-C.3">Appendix C.3</a>
param-assign =/ ("tsmode=" ("comex" / "async" / "buffer"))
param-assign =/ ("linerate=" nonzero-four-octet)
param-assign =/ ("octpos=" ("first" / "last"))
param-assign =/ ("mperiod=" nonzero-four-octet)
;
; Parameter defined in <a href="#appendix-C.4">Appendix C.4</a>
param-assign =/ ("guardtime=" nonzero-four-octet)
param-assign =/ ("rtp_ptime=" four-octet)
param-assign =/ ("rtp_maxptime=" four-octet)
;
; Parameters defined in <a href="#appendix-C.5">Appendix C.5</a>
param-assign =/ ("musicport=" four-octet)
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 151]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-152" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; Parameters defined in <a href="#appendix-C.6">Appendix C.6</a>
param-assign =/ ("chanmask=" ( 1*( 16( "0" / "1" ) )))
param-assign =/ ("cid=" double-quote cid-block
double-quote)
param-assign =/ ("inline=" double-quote base-64-block
double-quote)
param-assign =/ ("multimode=" ("all" / "one"))
param-assign =/ ("render=" ("synthetic" / "api" / "null" /
"unknown" / *extension))
param-assign =/ ("rinit=" mime-type "/" mime-subtype)
param-assign =/ ("smf_cid=" double-quote cid-block
double-quote)
param-assign =/ ("smf_info=" ("ignore" / "identity" /
"sdp_start" / *extension))
param-assign =/ ("smf_inline=" double-quote base-64-block
double-quote)
param-assign =/ ("smf_url=" double-quote uri-element
double-quote)
param-assign =/ ("subrender=" ("default" / *extension))
param-assign =/ ("url=" double-quote uri-element
double-quote)
;
; list definitions for the cm_ command-type
;
command-type = command-part1 command-part2 command-part3
command-part1 = (*1"A") (*1"B") (*1"C") (*1"F") (*1"G") (*1"H")
command-part2 = (*1"J") (*1"K") (*1"M") (*1"N") (*1"P") (*1"Q")
command-part3 = (*1"T") (*1"V") (*1"W") (*1"X") (*1"Y") (*1"Z")
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 152]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-153" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; list definitions for the ch_ chapter-list
;
chapter-list = ch-part1 ch-part2 ch-part3
ch-part1 = (*1"A") (*1"B") (*1"C") (*1"D") (*1"E") (*1"F") (*1"G")
ch-part2 = (*1"H") (*1"J") (*1"K") (*1"M") (*1"N") (*1"P") (*1"Q")
ch-part3 = (*1"T") (*1"V") (*1"W") (*1"X") (*1"Y") (*1"Z")
;
; list definitions for the ch_ channel-list
;
channel-list = midi-chan-element *("." midi-chan-element)
midi-chan-element = midi-chan / midi-chan-range
midi-chan-range = midi-chan "-" midi-chan
; decimal value of left midi-chan
; MUST be strictly less than decimal
; value of right midi-chan
midi-chan = %d0-15
;
; list definitions for the ch_ field list (f-list)
;
f-list = midi-field-element *("." midi-field-element)
midi-field-element = midi-field / midi-field-range
midi-field-range = midi-field "-" midi-field
;
; decimal value of left midi-field
; MUST be strictly less than decimal
; value of right midi-field
midi-field = four-octet
;
; large range accommodates Chapter M
; RPN (0-16383) and NRPN (16384-32767)
; parameters, and Chapter X octet sizes.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 153]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-154" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; definitions for ch_ sysex-data
;
sysex-data = "__" h-list *("_" h-list) "__"
h-list = hex-field-element *("." hex-field-element)
hex-field-element = hex-octet / hex-field-range
hex-field-range = hex-octet "-" hex-octet
;
; hexadecimal value of left hex-octet
; MUST be strictly less than hexadecimal
; value of right hex-octet
hex-octet = 2("0" / "1" / "2"/ "3" / "4" /
"5" / "6" / "7" / "8" / "9" /
"A" / "B" / "C" / "D" / "E" / "F")
;
; rewritten version of hex-octet in [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>]
; (page 23).
; note that a-f are not permitted, only A-F.
; hex-octet values MUST NOT exceed 7F.
;
; definitions for rinit parameter
;
mime-type = "audio" / "application"
mime-subtype = token
;
; See <a href="#appendix-C.6.2">Appendix C.6.2</a> for registration
; requirements for rinit type/subtypes.
;
; definitions for base64 encoding
; copied from [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]
base-64-block = *base64-unit [base64-pad]
base64-unit = 4base64-char
base64-pad = 2base64-char "==" / 3base64-char "="
base64-char = %x41-5A / %x61-7A / %x30-39 / "+" / "/"
; A-Z, a-z, 0-9, "+" and "/"
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 154]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-155" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; generic rules
;
ietf-extension = token
;
; ietf-extension may only be defined in
; standards-track RFCs.
extension = token
;
; extension may be defined by filing
; a registration with IANA.
four-octet = %d0-4294967295
; unsigned encoding of 32-bits
nonzero-four-octet = %d1-4294967295
; unsigned encoding of 32-bits, ex-zero
uri-element = URI-reference
; as defined in [<a href="./rfc3986" title=""Uniform Resource Identifier (URI): Generic Syntax"">RFC3986</a>]
double-quote = %x22
; the double-quote (") character
token = 1*token-char
; copied from [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]
token-char = %x21 / %x23-27 / %x2A-2B / %x2D-2E /
%x30-39 / %x41-5A / %x5E-7E
; copied from [<a href="./rfc4566" title=""SDP: Session Description Protocol"">RFC4566</a>]
cid-block = 1*cid-char
cid-char = token-char
cid-char =/ "@"
cid-char =/ ","
cid-char =/ ";"
cid-char =/ ":"
cid-char =/ "\"
cid-char =/ "/"
cid-char =/ "["
cid-char =/ "]"
cid-char =/ "?"
cid-char =/ "="
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 155]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-156" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
;
; add back in the tspecials [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>], except for
; double-quote and the non-email safe () <>
; note that "cid" defined above ensures that
; cid-block is enclosed with double-quotes
; external references
; URI-reference: from [<a href="./rfc3986" title=""Uniform Resource Identifier (URI): Generic Syntax"">RFC3986</a>]
;
; End of ABNF
The mpeg4-generic RTP payload [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>] defines a "mode" parameter
that signals the type of MPEG stream in use. We add a new mode
value, "rtp-midi", using the ABNF rule below:
;
; mpeg4-generic mode parameter extension
;
mode =/ "rtp-midi"
; as described in <a href="#section-6.2">Section 6.2</a> of this memo
<span class="h2"><a class="selflink" id="appendix-E" href="#appendix-E">E</a>. A MIDI Overview for Networking Specialists</span>
This appendix presents an overview of the MIDI standard, for the
benefit of networking specialists new to musical applications.
Implementors should consult [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>] for a normative description of
MIDI.
Musicians make music by performing a controlled sequence of physical
movements. For example, a pianist plays by coordinating a series of
key presses, key releases, and pedal actions. MIDI represents a
musical performance by encoding these physical gestures as a sequence
of MIDI commands. This high-level musical representation is compact
but fragile: one lost command may be catastrophic to the performance.
MIDI commands have much in common with the machine instructions of a
microprocessor. MIDI commands are defined as binary elements.
Bitfields within a MIDI command have a regular structure and a
specialized purpose. For example, the upper nibble of the first
command octet (the opcode field) codes the command type. MIDI
commands may consist of an arbitrary number of complete octets, but
most MIDI commands are 1, 2, or 3 octets in length.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 156]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-157" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Channel Voice Messages | Bitfield Pattern |
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| NoteOff (end a note) | 1000cccc 0nnnnnnn 0vvvvvvv |
|-------------------------------------------------------------|
| NoteOn (start a note) | 1001cccc 0nnnnnnn 0vvvvvvv |
|-------------------------------------------------------------|
| PTouch (Polyphonic Aftertouch) | 1010cccc 0nnnnnnn 0aaaaaaa |
|-------------------------------------------------------------|
| CControl (Controller Change) | 1011cccc 0xxxxxxx 0yyyyyyy |
|-------------------------------------------------------------|
| PChange (Program Change) | 1100cccc 0ppppppp |
|-------------------------------------------------------------|
| CTouch (Channel Aftertouch) | 1101cccc 0aaaaaaa |
|-------------------------------------------------------------|
| PWheel (Pitch Wheel) | 1110cccc 0xxxxxxx 0yyyyyyy |
-------------------------------------------------------------
Figure E.1 -- MIDI Channel Messages
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 157]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-158" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| System Common Messages | Bitfield Pattern |
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| System Exclusive | 11110000, followed by a |
| | list of 0xxxxxx octets, |
| | followed by 11110111 |
|-------------------------------------------------------------|
| MIDI Time Code Quarter Frame | 11110001 0xxxxxxx |
|-------------------------------------------------------------|
| Song Position Pointer | 11110010 0xxxxxxx 0yyyyyyy |
|-------------------------------------------------------------|
| Song Select | 11110011 0xxxxxxx |
|-------------------------------------------------------------|
| Undefined | 11110100 |
|-------------------------------------------------------------|
| Undefined | 11110101 |
|-------------------------------------------------------------|
| Tune Request | 11110110 |
|-------------------------------------------------------------|
| System Exclusive End Marker | 11110111 |
-------------------------------------------------------------
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| System Realtime Messages | Bitfield Pattern |
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Clock | 11111000 |
|-------------------------------------------------------------|
| Undefined | 11111001 |
|-------------------------------------------------------------|
| Start | 11111010 |
|-------------------------------------------------------------|
| Continue | 11111011 |
|-------------------------------------------------------------|
| Stop | 11111100 |
|-------------------------------------------------------------|
| Undefined | 11111101 |
|-------------------------------------------------------------|
| Active Sense | 11111110 |
|-------------------------------------------------------------|
| System Reset | 11111111 |
-------------------------------------------------------------
Figure E.2 -- MIDI System Messages
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 158]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-159" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Figure E.1 and E.2 show the MIDI command family. There are three
major classes of commands: voice commands (opcode field values in the
range 0x8 through 0xE), system common commands (opcode field 0xF,
commands 0xF0 through 0xF7), and system real-time commands (opcode
field 0xF, commands 0xF8 through 0xFF). Voice commands code the
musical gestures for each timbre in a composition. Systems commands
perform functions that usually affect all voice channels, such as
System Reset (0xFF).
<span class="h3"><a class="selflink" id="appendix-E.1" href="#appendix-E.1">E.1</a>. Commands Types</span>
Voice commands execute on one of 16 MIDI channels, as coded by its
4-bit channel field (field cccc in Figure E.1). In most
applications, notes for different timbres are assigned to different
channels. To support applications that require more than 16
channels, MIDI systems use several MIDI command streams in parallel,
to yield 32, 48, or 64 MIDI channels.
As an example of a voice command, consider a NoteOn command (opcode
0x9), with binary encoding 1001cccc 0nnnnnnn 0aaaaaaa. This command
signals the start of a musical note on MIDI channel cccc. The note
has a pitch coded by the note number nnnnnnn, and an onset amplitude
coded by note velocity aaaaaaa.
Other voice commands signal the end of notes (NoteOff, opcode 0x8),
map a specific timbre to a MIDI channel (PChange, opcode 0xC), or set
the value of parameters that modulate the timbral quality (all other
voice commands). The exact meaning of most voice channel commands
depends on the rendering algorithms the MIDI receiver uses to
generate sound. In most applications, a MIDI sender has a model (in
some sense) of the rendering method used by the receiver.
System commands perform a variety of global tasks in the stream,
including "sequencer" playback control of pre-recorded MIDI commands
(the Song Position Pointer, Song Select, Clock, Start, Continue, and
Stop messages), SMPTE time code (the MIDI Time Code Quarter Frame
command), and the communication of device-specific data (the System
Exclusive messages).
<span class="h3"><a class="selflink" id="appendix-E.2" href="#appendix-E.2">E.2</a>. Running Status</span>
All MIDI command bitfields share a special structure: the leading bit
of the first octet is set to 1, and the leading bit of all subsequent
octets is set to 0. This structure supports a data compression
system, called running status [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>], that improves the coding
efficiency of MIDI.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 159]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-160" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
In running status coding, the first octet of a MIDI voice command may
be dropped if it is identical to the first octet of the previous MIDI
voice command. This rule, in combination with a convention to
consider NoteOn commands with a null third octet as NoteOff commands,
supports the coding of note sequences using two octets per command.
Running status coding is only used for voice commands. The presence
of a system common message in the stream cancels running status mode
for the next voice command. However, system real-time messages do
not cancel running status mode.
<span class="h3"><a class="selflink" id="appendix-E.3" href="#appendix-E.3">E.3</a>. Command Timing</span>
The bitfield formats in Figures E.1 and E.2 do not encode the
execution time for a command. Timing information is not a part of
the MIDI command syntax itself; different applications of the MIDI
command language use different methods to encode timing.
For example, the MIDI command set acts as the transport layer for
MIDI 1.0 DIN cables [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]. MIDI cables are short asynchronous
serial lines that facilitate the remote operation of musical
instruments and audio equipment. Timestamps are not sent over a MIDI
1.0 DIN cable. Instead, the standard uses an implicit "time of
arrival" code. Receivers execute MIDI commands at the moment of
arrival.
In contrast, Standard MIDI Files (SMFs, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]), a file format for
representing complete musical performances, add an explicit timestamp
to each MIDI command, using a delta encoding scheme that is optimized
for statistics of musical performance. SMF timestamps usually code
timing using the metric notation of a musical score. SMF meta-events
are used to add a tempo map to the file, so that score beats may be
accurately converted into units of seconds during rendering.
<span class="h3"><a class="selflink" id="appendix-E.4" href="#appendix-E.4">E.4</a>. AudioSpecificConfig Templates for MMA Renderers</span>
In <a href="#section-6.2">Section 6.2</a> and <a href="#appendix-C.6.5">Appendix C.6.5</a>, we describe how session
descriptions include an AudioSpecificConfig data block to specify a
MIDI rendering algorithm for mpeg4-generic RTP MIDI streams.
The bitfield format of AudioSpecificConfig is defined in [<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>].
StructuredAudioSpecificConfig, a key data structure coded in
AudioSpecificConfig, is defined in [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>].
For implementors wishing to specify Structured Audio renderers, a
full understanding of [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>] and [<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>] is essential.
However, many implementors will limit their rendering options to the
two MIDI Manufacturers Association renderers that may be specified in
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 160]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-161" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
AudioSpecificConfig: General MIDI (GM, [<a href="#ref-MIDI" title=""The Complete MIDI 1.0 Detailed Specification"">MIDI</a>]) and Downloadable
Sounds 2 (DLS 2, [<a href="#ref-DLS2" title=""The MIDI Downloadable Sounds Specification"">DLS2</a>]).
To aid these implementors, we reproduce the AudioSpecificConfig
bitfield formats for a GM renderer and a DLS 2 renderer below. We
have checked these bitfields carefully and believe they are correct.
However, we stress that the material below is informative, and that
[<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>] and [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>] are the normative definitions for
AudioSpecificConfig.
As described in <a href="#section-6.2">Section 6.2</a>, a minimal mpeg4-generic session
description encodes the AudioSpecificConfig binary bitfield as a
hexadecimal string (whose format is defined in [<a href="./rfc3640" title=""RTP Payload Format for Transport of MPEG-4 Elementary Streams"">RFC3640</a>]) that is
assigned to the "config" parameter. As described in <a href="#appendix-C.6.3">Appendix C.6.3</a>,
a session description that uses the render parameter encodes the
AudioSpecificConfig binary bitfield as a Base64-encoded string
assigned to the "inline" parameter, or in the body of an HTTP URL
assigned to the "url" parameter.
Below, we show a simplified binary AudioSpecificConfig bitfield
format, suitable for sending and receiving GM and DLS 2 data:
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| AOTYPE |FREQIDX|CHANNEL|SACNK| FILE_BLK 1 (required) ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|1|SACNK| FILE_BLK 2 (optional) ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| ... |1|SACNK| FILE_BLK N (optional) ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0|0| (first "0" bit terminates FILE_BLK list)
+-+-+
Figure E.3 -- Simplified AudioSpecificConfig
The 5-bit AOTYPE field specifies the Audio Object Type as an unsigned
integer. The legal values for use with mpeg4-generic RTP MIDI
streams are "15" (General MIDI), "14" (DLS 2), and "13" (Structured
Audio). Thus, receivers that do not support all three mpeg4-generic
renderers may parse the first 5 bits of an AudioSpecificConfig coded
in a session description and reject sessions that specify unsupported
renderers.
The 4-bit FREQIDX field specifies the sampling rate of the renderer.
We show the mapping of FREQIDX values to sampling rates in Figure
E.4. Senders MUST specify a sampling frequency that matches the RTP
clock rate, if possible; if not, senders MUST specify the escape
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 161]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-162" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
value. Receivers MUST consult the RTP clock parameter for the true
sampling rate if the escape value is specified.
FREQIDX Sampling Frequency
0x0 96000
0x1 88200
0x2 64000
0x3 48000
0x4 44100
0x5 32000
0x6 24000
0x7 22050
0x8 16000
0x9 12000
0xa 11025
0xb 8000
0xc reserved
0xd reserved
0xe reserved
0xf escape value
Figure E.4 -- FreqIdx encoding
The 4-bit CHANNEL field specifies the number of audio channels for
the renderer. The values 0x1 to 0x5 specify 1 to 5 audio channels;
the value 0x6 specifies 5+1 surround sound, and the value 0x7
specifies 7+1 surround sound. If the rtpmap line in the session
description specifies one of these formats, CHANNEL MUST be set to
the corresponding value. Otherwise, CHANNEL MUST be set to 0x0.
The CHANNEL field is followed by a list of one or more binary file
data blocks. The 3-bit SACNK field (the chunk_type field in class
StructuredAudioSpecificConfig, defined in [<a href="#ref-MPEGSA" title=""ISO/IEC 14496 MPEG-4"">MPEGSA</a>]) specifies the
type of each data block.
For General MIDI, only Standard MIDI Files may appear in the list
(SACNK field value 2). For DLS 2, only Standard MIDI Files and DLS 2
RIFF files (SACNK field value 4) may appear. For both of these file
types, the FILE_BLK field has the format shown in Figure E.5: a 32-
bit unsigned integer value (FILE_LEN) coding the number of bytes in
the SMF or RIFF file, followed by FILE_LEN bytes coding the file
data.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 162]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-163" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| FILE_LEN (32-bit, a byte count SMF file or RIFF file) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| FILE_DATA (file contents, a list of FILE_LEN bytes) ... |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure E.5 -- The FILE_BLK field format
Note that several files may follow CHANNEL field. The "1" constant
fields in Figure E.3 code the presence of another file; the "0"
constant field codes the end of the list. The final "0" bit in
Figure E.3 codes the absence of special coding tools (see [<a href="#ref-MPEGAUDIO" title=""ISO 14496 MPEG- 4"">MPEGAUDIO</a>]
for details). Senders not using these tools MUST append this "0"
bit; receivers that do not understand these coding tools MUST ignore
all data following a "1" in this position.
The StructuredAudioSpecificConfig bitfield structure requires the
presence of one FILE_BLK. For mpeg4-generic RTP MIDI use of DLS 2,
FILE_BLKs MUST code RIFF files or SMF files. For mpeg4-generic RTP
MIDI use of General MIDI, FILE_BLKs MUST code SMF files. By default,
this SMF will be ignored (Appendix C.6.4.1). In this default case, a
GM StructuredAudioSpecificConfig bitfield SHOULD code a FILE_BLK
whose FILE_LEN is 0, and whose FILE_DATA is empty.
To complete this appendix, we derive the
StructuredAudioSpecificConfig that we use in the General MIDI session
examples in this memo. Referring to Figure E.3, we note that for GM,
AOTYPE = 15. Our examples use a 44,100 Hz sample rate (FREQIDX = 4)
and are in mono (CHANNEL = 1). For GM, a single SMF is encoded
(SACNK = 2), using the SMF shown in Figure E.6 (a 26 byte file).
--------------------------------------------
| MIDI File = <Header Chunk> <Track Chunk> |
--------------------------------------------
<Header Chunk> = <chunk type> <length> <format> <ntrks> <divsn>
4D 54 68 64 00 00 00 06 00 00 00 01 00 60
<Track Chunk> = <chunk type> <length> <delta-time> <end-event>
4D 54 72 6B 00 00 00 04 00 FF 2F 00
Figure E.6 -- SMF file encoded in the example
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 163]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-164" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Placing these constants in binary format into the data structure
shown in Figure E.3 yields the constant shown in Figure E.7.
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 1 1 1 1|0 1 0 0|0 0 0 1|0 1 0|0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 0 0 0 0 0 0 0 0 0 0 1 1 0 1 0|0 1 0 0|1 1 0 1|0 1 0 1|0 1 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 1 1 0|1 0 0 0|0 1 1 0|0 1 0 0|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 0 0 0|0 0 0 0|0 0 0 0|0 1 1 0|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 1|0 0 0 0|0 0 0 0|0 1 1 0|0 0 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 1 0 0|1 1 0 1|0 1 0 1|0 1 0 0|0 1 1 1|0 0 1 0|0 1 1 0|1 0 1 1|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|0 0 0 0|0 1 1 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0 0 0 0|0 0 0 0|1 1 1 1|1 1 1 1|0 0 1 0|1 1 1 1|0 0 0 0|0 0 0 0|
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
|0|0|
+-+-+
Figure E.7 -- AudioSpecificConfig used in GM examples
Expressing this bitfield as an ASCII hexadecimal string yields:
7A0A0000001A4D546864000000060000000100604D54726B0000000600FF2F000
This string is assigned to the "config" parameter in the minimal
mpeg4-generic General MIDI examples in this memo (such as the example
in <a href="#section-6.2">Section 6.2</a>). Expressing this string in Base64 [<a href="./rfc2045" title=""Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies"">RFC2045</a>] yields:
egoAAAAaTVRoZAAAAAYAAAABAGBNVHJrAAAABgD/LwAA
This string is assigned to the "inline" parameter in the General MIDI
example shown in <a href="#appendix-C.6.5">Appendix C.6.5</a>.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 164]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-165" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
References
Normative References
[<a id="ref-MIDI">MIDI</a>] MIDI Manufacturers Association. "The Complete MIDI 1.0
Detailed Specification", 1996.
[<a id="ref-RFC3550">RFC3550</a>] Schulzrinne, H., Casner, S., Frederick, R., and V.
Jacobson, "RTP: A Transport Protocol for Real-Time
Applications", STD 64, <a href="./rfc3550">RFC 3550</a>, July 2003.
[<a id="ref-RFC3551">RFC3551</a>] Schulzrinne, H. and S. Casner, "RTP Profile for Audio and
Video Conferences with Minimal Control", STD 65, <a href="./rfc3551">RFC</a>
<a href="./rfc3551">3551</a>, July 2003.
[<a id="ref-RFC3640">RFC3640</a>] van der Meer, J., Mackie, D., Swaminathan, V., Singer,
D., and P. Gentric, "RTP Payload Format for Transport of
MPEG-4 Elementary Streams", <a href="./rfc3640">RFC 3640</a>, November 2003.
[<a id="ref-MPEGSA">MPEGSA</a>] International Standards Organization. "ISO/IEC 14496
MPEG-4", Part 3 (Audio), Subpart 5 (Structured Audio),
2001.
[<a id="ref-RFC4566">RFC4566</a>] Handley, M., Jacobson, V., and C. Perkins, "SDP: Session
Description Protocol", <a href="./rfc4566">RFC 4566</a>, July 2006.
[<a id="ref-MPEGAUDIO">MPEGAUDIO</a>] International Standards Organization. "ISO 14496 MPEG-
4", Part 3 (Audio), 2001.
[<a id="ref-RFC2045">RFC2045</a>] Freed, N. and N. Borenstein, "Multipurpose Internet Mail
Extensions (MIME) Part One: Format of Internet Message
Bodies", <a href="./rfc2045">RFC 2045</a>, November 1996.
[<a id="ref-DLS2">DLS2</a>] MIDI Manufacturers Association. "The MIDI Downloadable
Sounds Specification", v98.2, 1998.
[<a id="ref-RFC4234">RFC4234</a>] Crocker, D. and P. Overell, "Augmented BNF for Syntax
Specifications: ABNF", <a href="./rfc4234">RFC 4234</a>, October 2005.
[<a id="ref-RFC2119">RFC2119</a>] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", <a href="https://www.rfc-editor.org/bcp/bcp14">BCP 14</a>, <a href="./rfc2119">RFC 2119</a>, March 1997.
[<a id="ref-RFC3711">RFC3711</a>] Baugher, M., McGrew, D., Naslund, M., Carrara, E., and K.
Norrman, "The Secure Real-time Transport Protocol
(SRTP)", <a href="./rfc3711">RFC 3711</a>, March 2004.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 165]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-166" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
[<a id="ref-RFC3264">RFC3264</a>] Rosenberg, J. and H. Schulzrinne, "An Offer/Answer Model
with Session Description Protocol (SDP)", <a href="./rfc3264">RFC 3264</a>, June
2002.
[<a id="ref-RFC3986">RFC3986</a>] Berners-Lee, T., Fielding, R., and L. Masinter, "Uniform
Resource Identifier (URI): Generic Syntax", STD 66, <a href="./rfc3986">RFC</a>
<a href="./rfc3986">3986</a>, January 2005.
[<a id="ref-RFC2616">RFC2616</a>] Fielding, R., Gettys, J., Mogul, J., Frystyk, H.,
Masinter, L., Leach, P., and T. Berners-Lee, "Hypertext
Transfer Protocol -- HTTP/1.1", <a href="./rfc2616">RFC 2616</a>, June 1999.
[<a id="ref-RFC3388">RFC3388</a>] Camarillo, G., Eriksson, G., Holler, J., and H.
Schulzrinne, "Grouping of Media Lines in the Session
Description Protocol (SDP)", <a href="./rfc3388">RFC 3388</a>, December 2002.
[<a id="ref-RP015">RP015</a>] MIDI Manufacturers Association. "Recommended Practice
015 (RP-015): Response to Reset All Controllers", 11/98.
[<a id="ref-RFC4288">RFC4288</a>] Freed, N. and J. Klensin, "Media Type Specifications and
Registration Procedures", <a href="https://www.rfc-editor.org/bcp/bcp13">BCP 13</a>, <a href="./rfc4288">RFC 4288</a>, December
2005.
[<a id="ref-RFC3555">RFC3555</a>] Casner, S. and P. Hoschka, "MIME Type Registration of RTP
Payload Formats", <a href="./rfc3555">RFC 3555</a>, July 2003.
Informative References
[<a id="ref-NMP">NMP</a>] Lazzaro, J. and J. Wawrzynek. "A Case for Network
Musical Performance", 11th International Workshop on
Network and Operating Systems Support for Digital Audio
and Video (NOSSDAV 2001) June 25-26, 2001, Port
Jefferson, New York.
[<a id="ref-GRAME">GRAME</a>] Fober, D., Orlarey, Y. and S. Letz. "Real Time Musical
Events Streaming over Internet", Proceedings of the
International Conference on WEB Delivering of Music 2001,
pages 147-154.
[<a id="ref-RFC3261">RFC3261</a>] Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston,
A., Peterson, J., Sparks, R., Handley, M., and E.
Schooler, "SIP: Session Initiation Protocol", <a href="./rfc3261">RFC 3261</a>,
June 2002.
[<a id="ref-RFC2326">RFC2326</a>] Schulzrinne, H., Rao, A., and R. Lanphier, "Real Time
Streaming Protocol (RTSP)", <a href="./rfc2326">RFC 2326</a>, April 1998.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 166]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-167" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
[<a id="ref-ALF">ALF</a>] Clark, D. D. and D. L. Tennenhouse. "Architectural
considerations for a new generation of protocols",
SIGCOMM Symposium on Communications Architectures and
Protocols , (Philadelphia, Pennsylvania), pp. 200--208,
IEEE, Sept. 1990.
[<a id="ref-RFC4696">RFC4696</a>] Lazzaro, J. and J. Wawrzynek, "An Implementation Guide
for RTP MIDI", <a href="./rfc4696">RFC 4696</a>, November 2006.
[<a id="ref-RFC2205">RFC2205</a>] Braden, R., Zhang, L., Berson, S., Herzog, S., and S.
Jamin, "Resource ReSerVation Protocol (RSVP) -- Version 1
Functional Specification", <a href="./rfc2205">RFC 2205</a>, September 1997.
[<a id="ref-RFC4288">RFC4288</a>] Freed, N. and J. Klensin, "Media Type Specifications and
Registration Procedures", <a href="https://www.rfc-editor.org/bcp/bcp13">BCP 13</a>, <a href="./rfc4288">RFC 4288</a>, December
2005.
[<a id="ref-RFC4289">RFC4289</a>] Freed, N. and J. Klensin, "Multipurpose Internet Mail
Extensions (MIME) Part Four: Registration Procedures",
<a href="https://www.rfc-editor.org/bcp/bcp13">BCP 13</a>, <a href="./rfc4289">RFC 4289</a>, December 2005.
[<a id="ref-RFC4571">RFC4571</a>] Lazzaro, J. "Framing Real-time Transport Protocol (RTP)
and RTP Control Protocol (RTCP) Packets over Connection-
Oriented Transport", <a href="./rfc4571">RFC 4571</a>, July 2006.
[<a id="ref-RFC2818">RFC2818</a>] Rescorla, E., "HTTP Over TLS", <a href="./rfc2818">RFC 2818</a>, May 2000.
[<a id="ref-SPMIDI">SPMIDI</a>] MIDI Manufacturers Association. "Scalable Polyphony
MIDI, Specification and Device Profiles", Document
Version 1.0a, 2002.
[<a id="ref-LCP">LCP</a>] Apple Computer. "Logic 7 Dedicated Control Surface
Support", <a href="#appendix-B">Appendix B</a>. Product manual available from
www.apple.com.
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 167]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-168" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Authors' Addresses
John Lazzaro (corresponding author)
UC Berkeley
CS Division
315 Soda Hall
Berkeley CA 94720-1776
EMail: lazzaro@cs.berkeley.edu
John Wawrzynek
UC Berkeley
CS Division
631 Soda Hall
Berkeley CA 94720-1776
EMail: johnw@cs.berkeley.edu
<span class="grey">Lazzaro & Wawrzynek Standards Track [Page 168]</span></pre>
<hr class='noprint'/><!--NewPage--><pre class='newpage'><span id="page-169" ></span>
<span class="grey"><a href="./rfc4695">RFC 4695</a> RTP Payload Format for MIDI November 2006</span>
Full Copyright Statement
Copyright (C) The IETF Trust (2006).
This document is subject to the rights, licenses and restrictions
contained in <a href="https://www.rfc-editor.org/bcp/bcp78">BCP 78</a>, and except as set forth therein, the authors
retain all their rights.
This document and the information contained herein are provided on an
"AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS
OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY, THE IETF TRUST,
AND THE INTERNET ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT
THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY
IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE.
Intellectual Property
The IETF takes no position regarding the validity or scope of any
Intellectual Property Rights or other rights that might be claimed to
pertain to the implementation or use of the technology described in
this document or the extent to which any license under such rights
might or might not be available; nor does it represent that it has
made any independent effort to identify any such rights. Information
on the procedures with respect to rights in RFC documents can be
found in <a href="https://www.rfc-editor.org/bcp/bcp78">BCP 78</a> and <a href="https://www.rfc-editor.org/bcp/bcp79">BCP 79</a>.
Copies of IPR disclosures made to the IETF Secretariat and any
assurances of licenses to be made available, or the result of an
attempt made to obtain a general license or permission for the use of
such proprietary rights by implementers or users of this
specification can be obtained from the IETF on-line IPR repository at
<a href="http://www.ietf.org/ipr">http://www.ietf.org/ipr</a>.
The IETF invites any interested party to bring to its attention any
copyrights, patents or patent applications, or other proprietary
rights that may cover technology that may be required to implement
this standard. Please address the information to the IETF at
ietf-ipr@ietf.org.
Acknowledgement
Funding for the RFC Editor function is currently provided by the
Internet Society.
Lazzaro & Wawrzynek Standards Track [Page 169]
</pre>
|