1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 1845 1846 1847 1848 1849 1850 1851 1852 1853 1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1878 1879 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052 2053 2054 2055 2056 2057 2058 2059 2060 2061 2062 2063 2064 2065 2066 2067 2068 2069 2070 2071 2072 2073 2074 2075 2076 2077 2078 2079 2080 2081 2082 2083 2084 2085 2086 2087 2088 2089 2090 2091 2092 2093 2094 2095 2096 2097 2098 2099 2100 2101 2102 2103 2104 2105 2106 2107 2108 2109 2110 2111 2112 2113 2114 2115 2116 2117 2118 2119 2120 2121 2122 2123 2124 2125 2126 2127 2128 2129 2130 2131 2132 2133 2134 2135 2136 2137 2138 2139 2140 2141 2142 2143 2144 2145 2146 2147 2148 2149 2150 2151 2152 2153 2154 2155 2156 2157 2158 2159 2160 2161 2162 2163 2164 2165 2166 2167 2168 2169 2170 2171 2172 2173 2174 2175 2176 2177 2178 2179 2180 2181 2182 2183 2184 2185 2186 2187 2188 2189 2190 2191 2192 2193 2194 2195 2196 2197 2198 2199 2200 2201 2202 2203 2204 2205 2206 2207 2208 2209 2210 2211 2212 2213 2214 2215 2216 2217 2218 2219 2220 2221 2222 2223 2224 2225 2226 2227 2228 2229 2230 2231 2232 2233 2234 2235 2236 2237 2238 2239 2240 2241 2242 2243 2244 2245 2246 2247 2248 2249 2250 2251 2252 2253 2254 2255 2256 2257 2258 2259 2260 2261 2262 2263 2264 2265 2266 2267 2268 2269 2270 2271 2272 2273 2274 2275 2276 2277 2278 2279 2280 2281 2282 2283 2284 2285 2286 2287 2288 2289 2290 2291 2292 2293 2294 2295 2296 2297 2298 2299 2300 2301 2302 2303 2304 2305 2306 2307 2308 2309 2310 2311 2312 2313 2314 2315 2316 2317 2318 2319 2320 2321 2322 2323 2324 2325 2326 2327 2328 2329 2330 2331 2332 2333 2334 2335 2336 2337 2338 2339 2340 2341 2342 2343 2344 2345 2346 2347 2348 2349 2350 2351 2352 2353 2354 2355 2356 2357 2358 2359 2360 2361 2362 2363 2364 2365 2366 2367 2368 2369 2370 2371 2372 2373 2374 2375 2376 2377 2378 2379 2380 2381 2382 2383 2384 2385 2386 2387 2388 2389 2390 2391 2392 2393 2394 2395 2396 2397 2398 2399 2400 2401 2402 2403 2404 2405 2406 2407 2408 2409 2410 2411 2412 2413 2414 2415 2416 2417 2418 2419 2420 2421 2422 2423 2424 2425 2426 2427 2428 2429 2430 2431 2432 2433 2434 2435 2436 2437 2438 2439 2440 2441 2442 2443 2444 2445 2446 2447 2448 2449 2450 2451 2452 2453 2454 2455 2456 2457 2458 2459 2460 2461 2462 2463 2464 2465 2466 2467 2468 2469 2470 2471 2472 2473 2474 2475 2476 2477 2478 2479 2480 2481 2482 2483 2484 2485 2486 2487 2488 2489 2490 2491 2492 2493 2494 2495 2496 2497 2498 2499 2500 2501 2502 2503 2504 2505 2506 2507 2508 2509 2510 2511 2512 2513 2514 2515 2516 2517 2518 2519 2520 2521 2522 2523 2524 2525 2526 2527 2528 2529 2530 2531 2532 2533 2534 2535 2536 2537 2538 2539 2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 2582 2583 2584 2585 2586 2587 2588 2589 2590 2591 2592 2593 2594 2595 2596 2597 2598 2599 2600 2601 2602 2603 2604 2605 2606 2607 2608 2609 2610 2611 2612 2613 2614 2615 2616 2617 2618 2619 2620 2621 2622 2623 2624 2625 2626 2627 2628 2629 2630 2631 2632 2633 2634 2635 2636 2637 2638 2639 2640 2641 2642 2643 2644 2645 2646 2647 2648 2649 2650 2651 2652 2653 2654 2655 2656 2657 2658 2659 2660 2661 2662 2663 2664 2665 2666 2667 2668 2669 2670 2671 2672 2673 2674 2675 2676 2677 2678 2679 2680 2681 2682 2683 2684 2685 2686 2687 2688 2689 2690 2691 2692 2693 2694 2695 2696 2697 2698 2699 2700 2701 2702 2703 2704 2705 2706 2707 2708 2709 2710 2711 2712 2713 2714 2715 2716 2717 2718 2719 2720 2721 2722 2723 2724 2725 2726 2727 2728 2729 2730 2731 2732 2733 2734 2735 2736 2737 2738 2739 2740 2741 2742 2743 2744 2745 2746 2747 2748 2749 2750 2751 2752 2753 2754 2755 2756 2757 2758 2759 2760 2761 2762 2763 2764 2765 2766 2767 2768 2769 2770 2771 2772 2773 2774 2775 2776 2777 2778 2779 2780 2781 2782 2783 2784 2785 2786 2787 2788 2789 2790 2791 2792 2793 2794 2795 2796 2797 2798 2799 2800 2801 2802 2803 2804 2805 2806 2807 2808 2809 2810 2811 2812 2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 2888 2889 2890 2891 2892 2893 2894 2895 2896 2897 2898 2899 2900 2901 2902 2903 2904 2905 2906 2907 2908 2909 2910 2911 2912 2913 2914 2915 2916 2917 2918 2919 2920 2921 2922 2923 2924 2925 2926 2927 2928 2929 2930 2931 2932 2933 2934 2935 2936 2937 2938 2939 2940 2941 2942 2943 2944 2945 2946 2947 2948 2949 2950 2951 2952 2953 2954 2955 2956 2957 2958 2959 2960 2961 2962 2963 2964 2965 2966 2967 2968 2969 2970 2971 2972 2973 2974 2975 2976 2977 2978 2979 2980 2981 2982 2983 2984 2985 2986 2987 2988 2989 2990 2991 2992 2993 2994 2995 2996 2997 2998 2999 3000 3001 3002 3003 3004 3005 3006 3007 3008 3009 3010 3011 3012 3013 3014 3015 3016 3017 3018 3019 3020 3021 3022 3023 3024 3025 3026 3027 3028 3029 3030 3031 3032 3033 3034 3035 3036 3037 3038 3039 3040 3041 3042 3043 3044 3045 3046 3047 3048 3049 3050 3051 3052 3053 3054 3055 3056 3057 3058 3059 3060 3061 3062 3063 3064 3065 3066 3067 3068 3069 3070 3071 3072 3073 3074 3075 3076 3077 3078 3079 3080 3081 3082 3083 3084 3085 3086 3087 3088 3089 3090 3091 3092 3093 3094 3095 3096 3097 3098 3099 3100 3101 3102 3103 3104 3105 3106 3107 3108 3109 3110 3111 3112 3113 3114 3115 3116 3117 3118 3119 3120 3121 3122 3123 3124 3125 3126 3127 3128 3129 3130 3131 3132 3133 3134 3135 3136 3137 3138 3139 3140 3141 3142 3143 3144 3145 3146 3147 3148 3149 3150 3151 3152 3153 3154 3155 3156 3157 3158 3159 3160 3161 3162 3163 3164 3165 3166 3167 3168 3169 3170 3171 3172 3173 3174 3175 3176 3177 3178 3179 3180 3181 3182 3183 3184 3185 3186 3187 3188 3189 3190 3191 3192 3193 3194 3195 3196 3197 3198 3199 3200 3201 3202 3203 3204 3205 3206 3207 3208 3209 3210 3211 3212 3213 3214 3215 3216 3217 3218 3219 3220 3221 3222 3223 3224 3225 3226 3227 3228 3229 3230 3231 3232 3233 3234 3235 3236 3237 3238 3239 3240 3241 3242 3243 3244 3245 3246 3247 3248 3249 3250 3251 3252 3253 3254 3255 3256 3257 3258 3259 3260 3261 3262 3263 3264 3265 3266 3267 3268 3269 3270 3271 3272 3273 3274 3275 3276 3277 3278 3279 3280 3281 3282 3283 3284 3285 3286 3287 3288 3289 3290 3291 3292 3293 3294 3295 3296 3297 3298 3299 3300 3301 3302 3303 3304 3305 3306 3307 3308 3309 3310 3311 3312 3313 3314 3315 3316 3317 3318 3319 3320 3321 3322 3323 3324 3325 3326 3327 3328 3329 3330 3331 3332 3333 3334 3335 3336 3337 3338 3339 3340 3341 3342 3343 3344 3345 3346 3347 3348 3349 3350 3351 3352 3353 3354 3355 3356 3357 3358 3359 3360 3361 3362 3363 3364 3365 3366 3367 3368 3369 3370 3371 3372 3373 3374 3375 3376 3377 3378 3379 3380 3381 3382 3383 3384 3385 3386 3387 3388 3389 3390 3391 3392 3393 3394 3395 3396 3397 3398 3399 3400 3401 3402 3403 3404 3405 3406 3407 3408 3409 3410 3411 3412 3413 3414 3415 3416 3417 3418 3419 3420 3421 3422 3423 3424 3425 3426 3427 3428 3429 3430 3431 3432 3433 3434 3435 3436 3437 3438 3439 3440 3441 3442 3443 3444 3445 3446 3447 3448 3449 3450 3451 3452 3453 3454 3455 3456 3457 3458 3459 3460 3461 3462 3463 3464 3465 3466 3467 3468 3469 3470 3471 3472 3473 3474 3475 3476 3477 3478 3479 3480 3481 3482 3483 3484 3485 3486 3487 3488 3489 3490 3491 3492 3493 3494 3495 3496 3497 3498 3499 3500 3501 3502 3503 3504 3505 3506 3507 3508 3509 3510 3511 3512 3513 3514 3515 3516 3517 3518 3519 3520 3521 3522 3523 3524 3525 3526 3527 3528 3529 3530 3531 3532 3533 3534 3535 3536 3537 3538 3539 3540 3541 3542 3543 3544 3545 3546 3547 3548 3549 3550 3551 3552 3553 3554 3555 3556 3557 3558 3559 3560 3561 3562 3563 3564 3565 3566 3567 3568 3569 3570 3571 3572 3573 3574 3575 3576 3577 3578 3579 3580 3581 3582 3583 3584 3585 3586 3587 3588 3589 3590 3591 3592 3593 3594 3595 3596 3597 3598 3599 3600 3601 3602 3603 3604 3605 3606 3607 3608 3609 3610 3611 3612 3613 3614 3615 3616 3617 3618 3619 3620 3621 3622 3623 3624 3625 3626 3627 3628 3629 3630 3631 3632 3633 3634 3635 3636 3637 3638 3639 3640 3641 3642 3643 3644 3645 3646 3647 3648 3649 3650 3651 3652 3653 3654 3655 3656 3657 3658 3659 3660 3661 3662 3663 3664 3665 3666 3667 3668 3669 3670 3671 3672 3673 3674 3675 3676 3677 3678 3679 3680 3681 3682 3683 3684 3685 3686 3687 3688 3689 3690 3691 3692 3693 3694 3695 3696 3697 3698 3699 3700 3701 3702 3703 3704 3705 3706 3707 3708 3709 3710 3711 3712 3713 3714 3715 3716 3717 3718 3719 3720 3721 3722 3723 3724 3725 3726 3727 3728 3729 3730 3731 3732 3733 3734 3735 3736 3737 3738 3739 3740 3741 3742 3743 3744 3745 3746 3747 3748 3749 3750 3751 3752 3753 3754 3755 3756 3757 3758 3759 3760 3761 3762 3763 3764 3765 3766 3767 3768 3769 3770 3771 3772 3773 3774 3775 3776 3777 3778 3779 3780 3781 3782 3783 3784 3785 3786 3787 3788 3789 3790 3791 3792 3793 3794 3795 3796 3797 3798 3799 3800 3801 3802 3803 3804 3805 3806 3807 3808 3809 3810 3811 3812 3813 3814 3815 3816 3817 3818 3819 3820 3821 3822 3823 3824 3825 3826 3827 3828 3829 3830 3831 3832 3833 3834 3835 3836 3837 3838 3839 3840 3841 3842 3843 3844 3845 3846 3847 3848 3849 3850 3851 3852 3853 3854 3855 3856 3857 3858 3859 3860 3861 3862 3863 3864 3865 3866 3867 3868 3869 3870 3871 3872 3873 3874 3875 3876 3877 3878 3879 3880 3881 3882 3883 3884 3885 3886 3887 3888 3889 3890 3891 3892 3893 3894 3895 3896 3897 3898 3899 3900 3901 3902 3903 3904 3905 3906 3907 3908 3909 3910 3911 3912 3913 3914 3915 3916 3917 3918 3919 3920 3921 3922 3923 3924 3925 3926 3927 3928 3929 3930 3931 3932 3933 3934 3935 3936 3937 3938 3939 3940 3941 3942 3943 3944 3945 3946 3947 3948 3949 3950 3951 3952 3953 3954 3955 3956 3957 3958 3959 3960 3961 3962 3963 3964 3965 3966 3967 3968 3969 3970 3971 3972 3973 3974 3975 3976 3977 3978 3979 3980 3981 3982 3983 3984 3985 3986 3987 3988 3989 3990 3991 3992 3993 3994 3995 3996 3997 3998 3999 4000 4001 4002 4003 4004 4005 4006 4007 4008 4009 4010 4011 4012 4013 4014 4015 4016 4017 4018 4019 4020 4021 4022 4023 4024 4025 4026 4027 4028 4029 4030 4031 4032 4033 4034 4035 4036 4037 4038 4039 4040 4041 4042 4043 4044 4045 4046 4047 4048 4049 4050 4051 4052 4053 4054 4055 4056 4057 4058 4059 4060 4061 4062 4063 4064 4065 4066 4067 4068 4069 4070 4071 4072 4073 4074 4075 4076 4077 4078 4079 4080 4081 4082 4083 4084 4085 4086 4087 4088 4089 4090 4091 4092 4093 4094 4095 4096 4097 4098 4099 4100 4101 4102 4103 4104 4105 4106 4107 4108 4109 4110 4111 4112 4113 4114 4115 4116 4117 4118 4119 4120 4121 4122 4123 4124 4125 4126 4127 4128 4129 4130 4131 4132 4133 4134 4135 4136 4137 4138 4139 4140 4141 4142 4143 4144 4145 4146 4147 4148 4149 4150 4151 4152 4153 4154 4155 4156 4157 4158 4159 4160 4161 4162 4163 4164 4165 4166 4167 4168 4169 4170 4171 4172 4173 4174 4175 4176 4177 4178 4179 4180 4181 4182 4183 4184 4185 4186 4187 4188 4189 4190 4191 4192 4193 4194 4195 4196 4197 4198 4199 4200 4201 4202 4203 4204 4205 4206 4207 4208 4209 4210 4211 4212 4213 4214 4215 4216 4217 4218 4219 4220 4221 4222 4223 4224 4225 4226 4227 4228 4229 4230 4231 4232 4233 4234 4235 4236 4237 4238 4239 4240 4241 4242 4243 4244 4245 4246 4247 4248 4249 4250 4251 4252 4253 4254 4255 4256 4257 4258 4259 4260 4261 4262 4263 4264 4265 4266 4267 4268 4269 4270 4271 4272 4273 4274 4275 4276 4277 4278 4279 4280 4281 4282 4283 4284 4285 4286 4287 4288 4289 4290 4291 4292 4293 4294 4295 4296 4297 4298 4299 4300 4301 4302 4303 4304 4305 4306 4307 4308 4309 4310 4311 4312 4313 4314 4315 4316 4317 4318 4319 4320 4321 4322 4323 4324 4325 4326 4327 4328 4329 4330 4331 4332 4333 4334 4335 4336 4337 4338 4339 4340 4341 4342 4343 4344 4345 4346 4347 4348 4349 4350 4351 4352 4353 4354 4355 4356 4357 4358 4359 4360 4361 4362 4363 4364 4365 4366 4367 4368 4369 4370 4371 4372 4373 4374 4375 4376 4377 4378 4379 4380 4381 4382 4383 4384 4385 4386 4387 4388 4389 4390 4391 4392 4393 4394 4395 4396 4397 4398 4399 4400 4401 4402 4403 4404 4405 4406 4407 4408 4409 4410 4411 4412 4413 4414 4415 4416 4417 4418 4419 4420 4421 4422 4423 4424 4425 4426 4427 4428 4429 4430 4431 4432 4433 4434 4435 4436 4437 4438 4439 4440 4441 4442 4443 4444 4445 4446 4447 4448 4449 4450 4451 4452 4453 4454 4455 4456 4457 4458 4459 4460 4461 4462 4463 4464 4465 4466 4467 4468 4469 4470 4471 4472 4473 4474 4475 4476 4477 4478 4479 4480 4481 4482 4483 4484 4485 4486 4487 4488 4489 4490 4491 4492 4493 4494 4495 4496 4497 4498 4499 4500 4501 4502 4503 4504 4505 4506 4507 4508 4509 4510 4511 4512 4513 4514 4515 4516 4517 4518 4519 4520 4521 4522 4523 4524 4525 4526 4527 4528 4529 4530 4531 4532 4533 4534 4535 4536 4537 4538 4539 4540 4541 4542 4543 4544 4545 4546 4547 4548 4549 4550 4551 4552 4553 4554 4555 4556 4557 4558 4559 4560 4561 4562 4563 4564 4565 4566 4567 4568 4569 4570 4571 4572 4573 4574 4575 4576 4577 4578 4579 4580 4581 4582 4583 4584 4585 4586 4587 4588 4589 4590 4591 4592 4593 4594 4595 4596 4597 4598 4599 4600 4601 4602 4603 4604 4605 4606 4607 4608 4609 4610 4611 4612 4613 4614 4615 4616 4617 4618 4619 4620 4621 4622 4623 4624 4625 4626 4627 4628 4629 4630 4631 4632 4633 4634 4635 4636 4637 4638 4639 4640 4641 4642 4643 4644 4645 4646 4647 4648 4649 4650 4651 4652 4653 4654 4655 4656 4657 4658 4659 4660 4661 4662 4663 4664 4665 4666 4667 4668 4669 4670 4671 4672 4673 4674 4675 4676 4677 4678 4679 4680 4681 4682 4683 4684 4685 4686 4687 4688 4689 4690 4691 4692 4693 4694 4695 4696 4697 4698 4699 4700 4701 4702 4703 4704 4705 4706 4707 4708 4709 4710 4711 4712 4713 4714 4715 4716 4717 4718 4719 4720 4721 4722 4723 4724 4725 4726 4727 4728 4729 4730 4731 4732 4733 4734 4735 4736 4737 4738 4739 4740 4741 4742 4743 4744 4745 4746 4747 4748 4749 4750 4751 4752 4753 4754 4755 4756 4757 4758 4759 4760 4761 4762 4763 4764 4765 4766 4767 4768 4769 4770 4771 4772 4773 4774 4775 4776 4777 4778 4779 4780 4781 4782 4783 4784 4785 4786 4787 4788 4789 4790 4791 4792 4793 4794 4795 4796 4797 4798 4799 4800 4801 4802 4803 4804 4805 4806 4807 4808 4809 4810 4811 4812 4813 4814 4815 4816 4817 4818 4819 4820 4821 4822 4823 4824 4825 4826 4827 4828 4829 4830 4831 4832 4833 4834 4835 4836 4837 4838 4839 4840 4841 4842 4843 4844 4845 4846 4847 4848 4849 4850 4851 4852 4853 4854 4855 4856 4857 4858 4859 4860 4861 4862 4863 4864 4865 4866 4867 4868 4869 4870 4871 4872 4873 4874 4875 4876 4877 4878 4879 4880 4881 4882 4883 4884 4885 4886 4887 4888 4889 4890 4891 4892 4893 4894 4895 4896 4897 4898 4899 4900 4901 4902 4903 4904 4905 4906 4907 4908 4909 4910 4911 4912 4913 4914 4915 4916 4917 4918 4919 4920 4921 4922 4923 4924 4925 4926 4927 4928 4929 4930 4931 4932 4933 4934 4935 4936 4937 4938 4939 4940 4941 4942 4943 4944 4945 4946 4947 4948 4949 4950 4951 4952 4953 4954 4955 4956 4957 4958 4959 4960 4961 4962 4963 4964 4965 4966 4967 4968 4969 4970 4971 4972 4973 4974 4975 4976 4977 4978 4979 4980 4981 4982 4983 4984 4985 4986 4987 4988 4989 4990 4991 4992 4993 4994 4995 4996 4997 4998 4999 5000 5001 5002 5003 5004 5005 5006 5007 5008 5009 5010 5011 5012 5013 5014 5015 5016 5017 5018 5019 5020 5021 5022 5023 5024 5025 5026 5027 5028 5029 5030 5031 5032 5033 5034 5035 5036 5037 5038 5039 5040 5041 5042 5043 5044 5045 5046 5047 5048 5049 5050 5051 5052 5053 5054 5055 5056 5057 5058 5059 5060 5061 5062 5063 5064 5065 5066 5067 5068 5069 5070 5071 5072 5073 5074 5075 5076 5077 5078 5079 5080 5081 5082 5083 5084 5085 5086 5087 5088 5089 5090 5091 5092 5093 5094 5095 5096 5097 5098 5099 5100 5101 5102 5103 5104 5105 5106 5107 5108 5109 5110 5111 5112 5113 5114 5115 5116 5117 5118 5119 5120 5121 5122 5123 5124 5125 5126 5127 5128 5129 5130 5131 5132 5133 5134 5135 5136 5137 5138 5139 5140 5141 5142 5143 5144 5145 5146 5147 5148 5149 5150 5151 5152 5153 5154 5155 5156 5157 5158 5159 5160 5161 5162 5163 5164 5165 5166 5167 5168 5169 5170 5171 5172 5173 5174 5175 5176 5177 5178 5179 5180 5181 5182 5183 5184 5185 5186 5187 5188 5189 5190 5191 5192 5193 5194 5195 5196 5197 5198 5199 5200 5201 5202 5203 5204 5205 5206 5207 5208 5209 5210 5211 5212 5213 5214 5215 5216 5217 5218 5219 5220 5221 5222 5223 5224 5225 5226 5227 5228 5229 5230 5231 5232 5233 5234 5235 5236 5237 5238 5239 5240 5241 5242 5243 5244 5245 5246 5247 5248 5249 5250 5251 5252 5253 5254 5255 5256 5257 5258 5259 5260 5261 5262 5263 5264 5265 5266 5267 5268 5269 5270 5271 5272 5273 5274 5275 5276 5277 5278 5279 5280 5281 5282 5283 5284 5285 5286 5287 5288 5289 5290 5291 5292 5293 5294 5295 5296 5297 5298 5299 5300 5301 5302 5303 5304 5305 5306 5307 5308 5309 5310 5311 5312 5313 5314 5315 5316 5317 5318 5319 5320 5321 5322 5323 5324 5325 5326 5327 5328 5329 5330 5331 5332 5333 5334 5335 5336 5337 5338 5339 5340 5341 5342 5343 5344 5345 5346 5347 5348 5349 5350 5351 5352 5353 5354 5355 5356 5357 5358 5359 5360 5361 5362 5363 5364 5365 5366 5367 5368 5369 5370 5371 5372 5373 5374 5375 5376 5377 5378 5379 5380 5381 5382 5383 5384 5385 5386 5387 5388 5389 5390 5391 5392 5393 5394 5395 5396 5397 5398 5399 5400 5401 5402 5403 5404 5405 5406 5407 5408 5409 5410 5411 5412 5413 5414 5415 5416 5417 5418 5419 5420 5421 5422 5423 5424 5425 5426 5427 5428 5429 5430 5431 5432 5433 5434 5435 5436 5437 5438 5439 5440 5441 5442 5443 5444 5445 5446 5447 5448 5449 5450 5451 5452 5453 5454 5455 5456 5457 5458 5459 5460 5461 5462 5463 5464 5465 5466 5467 5468 5469 5470 5471 5472 5473 5474 5475 5476 5477 5478 5479 5480 5481 5482 5483 5484 5485 5486 5487 5488 5489 5490 5491 5492 5493 5494 5495 5496 5497 5498 5499 5500 5501 5502 5503 5504 5505 5506 5507 5508 5509 5510 5511 5512 5513 5514 5515 5516 5517 5518 5519 5520 5521 5522 5523 5524 5525 5526 5527 5528 5529 5530 5531 5532 5533 5534 5535 5536 5537 5538 5539 5540 5541 5542 5543 5544 5545 5546 5547 5548 5549 5550 5551 5552 5553 5554 5555 5556 5557 5558 5559 5560 5561 5562 5563 5564 5565 5566 5567 5568 5569 5570 5571 5572 5573 5574 5575 5576 5577 5578 5579 5580 5581 5582 5583 5584 5585 5586 5587 5588 5589 5590 5591 5592 5593 5594 5595 5596 5597 5598 5599 5600 5601 5602 5603 5604 5605 5606 5607 5608 5609 5610 5611 5612 5613 5614 5615 5616 5617 5618 5619 5620 5621 5622 5623 5624 5625 5626 5627 5628 5629 5630 5631 5632 5633 5634 5635 5636 5637 5638 5639 5640 5641 5642 5643 5644 5645 5646 5647 5648 5649 5650 5651 5652 5653 5654 5655 5656 5657 5658 5659 5660 5661 5662 5663 5664 5665 5666 5667 5668 5669 5670 5671 5672 5673 5674 5675 5676 5677 5678 5679 5680 5681 5682 5683 5684 5685 5686 5687 5688 5689 5690 5691 5692 5693 5694 5695 5696 5697 5698 5699 5700 5701 5702 5703 5704 5705 5706 5707 5708 5709 5710 5711 5712 5713 5714 5715 5716 5717 5718 5719 5720 5721 5722 5723 5724 5725 5726 5727 5728 5729 5730 5731 5732 5733 5734 5735 5736 5737 5738 5739 5740 5741 5742 5743 5744 5745 5746 5747 5748 5749 5750 5751 5752 5753 5754 5755 5756 5757 5758 5759 5760 5761 5762 5763 5764 5765 5766 5767 5768 5769 5770 5771 5772 5773 5774 5775 5776 5777 5778 5779 5780 5781 5782 5783 5784 5785 5786 5787 5788 5789 5790 5791 5792 5793 5794 5795 5796 5797 5798 5799 5800 5801 5802 5803 5804 5805 5806 5807 5808 5809 5810 5811 5812 5813 5814 5815 5816 5817 5818 5819 5820 5821 5822 5823 5824 5825 5826 5827 5828 5829 5830 5831 5832 5833 5834 5835 5836 5837 5838 5839 5840 5841 5842 5843 5844 5845 5846 5847 5848 5849 5850 5851 5852 5853 5854 5855 5856 5857 5858 5859 5860 5861 5862 5863 5864 5865 5866 5867 5868 5869 5870 5871 5872 5873 5874 5875 5876 5877 5878 5879 5880 5881 5882 5883 5884 5885 5886 5887 5888 5889 5890 5891 5892 5893 5894 5895 5896 5897 5898 5899 5900 5901 5902 5903 5904 5905 5906 5907 5908 5909 5910 5911 5912 5913 5914 5915 5916 5917 5918 5919 5920 5921 5922 5923 5924 5925 5926 5927 5928 5929 5930 5931 5932 5933 5934 5935 5936 5937 5938 5939 5940 5941 5942 5943 5944 5945 5946 5947 5948 5949 5950 5951 5952 5953 5954 5955 5956 5957 5958 5959 5960 5961 5962 5963 5964 5965 5966 5967 5968 5969 5970 5971 5972 5973 5974 5975 5976 5977 5978 5979 5980 5981 5982 5983 5984 5985 5986 5987 5988 5989 5990 5991 5992 5993 5994 5995 5996 5997 5998 5999 6000 6001 6002 6003 6004 6005 6006 6007 6008 6009 6010 6011 6012 6013 6014 6015 6016 6017 6018 6019 6020 6021 6022 6023 6024 6025 6026 6027 6028 6029 6030 6031 6032 6033 6034 6035 6036 6037 6038 6039 6040 6041 6042 6043 6044 6045 6046 6047 6048 6049 6050 6051 6052 6053 6054 6055 6056 6057 6058 6059 6060 6061 6062 6063 6064 6065 6066 6067 6068 6069 6070 6071 6072 6073 6074 6075 6076 6077 6078 6079 6080 6081 6082 6083 6084 6085 6086 6087 6088 6089 6090 6091 6092 6093 6094 6095 6096 6097 6098 6099 6100 6101 6102 6103 6104 6105 6106 6107 6108 6109 6110 6111 6112 6113 6114 6115 6116 6117 6118 6119 6120 6121 6122 6123 6124 6125 6126 6127 6128 6129 6130 6131 6132 6133 6134 6135 6136 6137 6138 6139 6140 6141 6142 6143 6144 6145 6146 6147 6148 6149 6150 6151 6152 6153 6154 6155 6156 6157 6158 6159 6160 6161 6162 6163 6164 6165 6166 6167 6168 6169 6170 6171 6172 6173 6174 6175 6176 6177 6178 6179 6180 6181 6182 6183 6184 6185 6186 6187 6188 6189 6190 6191 6192 6193 6194 6195 6196 6197 6198 6199 6200 6201 6202 6203 6204 6205 6206 6207 6208 6209 6210 6211 6212 6213 6214 6215 6216 6217 6218 6219 6220 6221 6222 6223 6224 6225 6226 6227 6228 6229 6230 6231 6232 6233 6234 6235 6236 6237 6238 6239 6240 6241 6242 6243 6244 6245 6246 6247 6248 6249 6250 6251 6252 6253 6254 6255 6256 6257 6258 6259 6260 6261 6262 6263 6264 6265 6266 6267 6268 6269 6270 6271 6272 6273 6274 6275 6276 6277 6278 6279 6280 6281 6282 6283 6284 6285 6286 6287 6288 6289 6290 6291 6292 6293 6294 6295 6296 6297 6298 6299 6300 6301 6302 6303 6304 6305 6306 6307 6308 6309 6310 6311 6312 6313 6314 6315 6316 6317 6318 6319 6320 6321 6322 6323 6324 6325 6326 6327 6328 6329 6330 6331 6332 6333 6334 6335 6336 6337 6338 6339 6340 6341 6342 6343 6344 6345 6346 6347 6348 6349 6350 6351 6352 6353 6354 6355 6356 6357 6358 6359 6360 6361 6362 6363 6364 6365 6366 6367 6368 6369 6370 6371 6372 6373 6374 6375
|
# Licensed to Elasticsearch B.V. under one or more contributor
# license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright
# ownership. Elasticsearch B.V. licenses this file to you under
# the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
import logging
import typing as t
from elastic_transport import (
AsyncTransport,
BaseNode,
BinaryApiResponse,
HeadApiResponse,
NodeConfig,
NodePool,
NodeSelector,
ObjectApiResponse,
Serializer,
)
from elastic_transport.client_utils import DEFAULT, DefaultType
from ...exceptions import ApiError, TransportError
from ...serializer import DEFAULT_SERIALIZERS
from ._base import (
BaseClient,
create_sniff_callback,
default_sniff_callback,
resolve_auth_headers,
)
from .async_search import AsyncSearchClient
from .autoscaling import AutoscalingClient
from .cat import CatClient
from .ccr import CcrClient
from .cluster import ClusterClient
from .connector import ConnectorClient
from .dangling_indices import DanglingIndicesClient
from .enrich import EnrichClient
from .eql import EqlClient
from .esql import EsqlClient
from .features import FeaturesClient
from .fleet import FleetClient
from .graph import GraphClient
from .ilm import IlmClient
from .indices import IndicesClient
from .inference import InferenceClient
from .ingest import IngestClient
from .license import LicenseClient
from .logstash import LogstashClient
from .migration import MigrationClient
from .ml import MlClient
from .monitoring import MonitoringClient
from .nodes import NodesClient
from .query_rules import QueryRulesClient
from .rollup import RollupClient
from .search_application import SearchApplicationClient
from .searchable_snapshots import SearchableSnapshotsClient
from .security import SecurityClient
from .shutdown import ShutdownClient
from .simulate import SimulateClient
from .slm import SlmClient
from .snapshot import SnapshotClient
from .sql import SqlClient
from .ssl import SslClient
from .synonyms import SynonymsClient
from .tasks import TasksClient
from .text_structure import TextStructureClient
from .transform import TransformClient
from .utils import (
_TYPE_HOSTS,
CLIENT_META_SERVICE,
SKIP_IN_PATH,
Stability,
_quote,
_rewrite_parameters,
_stability_warning,
client_node_configs,
is_requests_http_auth,
is_requests_node_class,
)
from .watcher import WatcherClient
from .xpack import XPackClient
logger = logging.getLogger("elasticsearch")
SelfType = t.TypeVar("SelfType", bound="AsyncElasticsearch")
class AsyncElasticsearch(BaseClient):
"""
Elasticsearch low-level client. Provides a straightforward mapping from
Python to Elasticsearch REST APIs.
The client instance has additional attributes to update APIs in different
namespaces such as ``async_search``, ``indices``, ``security``, and more:
.. code-block:: python
client = Elasticsearch("http://localhost:9200")
# Get Document API
client.get(index="*", id="1")
# Get Index API
client.indices.get(index="*")
Transport options can be set on the client constructor or using
the :meth:`~elasticsearch.Elasticsearch.options` method:
.. code-block:: python
# Set 'api_key' on the constructor
client = Elasticsearch(
"http://localhost:9200",
api_key="api_key",
)
client.search(...)
# Set 'api_key' per request
client.options(api_key="api_key").search(...)
"""
def __init__(
self,
hosts: t.Optional[_TYPE_HOSTS] = None,
*,
# API
cloud_id: t.Optional[str] = None,
api_key: t.Optional[t.Union[str, t.Tuple[str, str]]] = None,
basic_auth: t.Optional[t.Union[str, t.Tuple[str, str]]] = None,
bearer_auth: t.Optional[str] = None,
opaque_id: t.Optional[str] = None,
# Node
headers: t.Union[DefaultType, t.Mapping[str, str]] = DEFAULT,
connections_per_node: t.Union[DefaultType, int] = DEFAULT,
http_compress: t.Union[DefaultType, bool] = DEFAULT,
verify_certs: t.Union[DefaultType, bool] = DEFAULT,
ca_certs: t.Union[DefaultType, str] = DEFAULT,
client_cert: t.Union[DefaultType, str] = DEFAULT,
client_key: t.Union[DefaultType, str] = DEFAULT,
ssl_assert_hostname: t.Union[DefaultType, str] = DEFAULT,
ssl_assert_fingerprint: t.Union[DefaultType, str] = DEFAULT,
ssl_version: t.Union[DefaultType, int] = DEFAULT,
ssl_context: t.Union[DefaultType, t.Any] = DEFAULT,
ssl_show_warn: t.Union[DefaultType, bool] = DEFAULT,
# Transport
transport_class: t.Type[AsyncTransport] = AsyncTransport,
request_timeout: t.Union[DefaultType, None, float] = DEFAULT,
node_class: t.Union[DefaultType, t.Type[BaseNode]] = DEFAULT,
node_pool_class: t.Union[DefaultType, t.Type[NodePool]] = DEFAULT,
randomize_nodes_in_pool: t.Union[DefaultType, bool] = DEFAULT,
node_selector_class: t.Union[DefaultType, t.Type[NodeSelector]] = DEFAULT,
dead_node_backoff_factor: t.Union[DefaultType, float] = DEFAULT,
max_dead_node_backoff: t.Union[DefaultType, float] = DEFAULT,
serializer: t.Optional[Serializer] = None,
serializers: t.Union[DefaultType, t.Mapping[str, Serializer]] = DEFAULT,
default_mimetype: str = "application/json",
max_retries: t.Union[DefaultType, int] = DEFAULT,
retry_on_status: t.Union[DefaultType, int, t.Collection[int]] = DEFAULT,
retry_on_timeout: t.Union[DefaultType, bool] = DEFAULT,
sniff_on_start: t.Union[DefaultType, bool] = DEFAULT,
sniff_before_requests: t.Union[DefaultType, bool] = DEFAULT,
sniff_on_node_failure: t.Union[DefaultType, bool] = DEFAULT,
sniff_timeout: t.Union[DefaultType, None, float] = DEFAULT,
min_delay_between_sniffing: t.Union[DefaultType, None, float] = DEFAULT,
sniffed_node_callback: t.Optional[
t.Callable[[t.Dict[str, t.Any], NodeConfig], t.Optional[NodeConfig]]
] = None,
meta_header: t.Union[DefaultType, bool] = DEFAULT,
http_auth: t.Union[DefaultType, t.Any] = DEFAULT,
# Internal use only
_transport: t.Optional[AsyncTransport] = None,
) -> None:
if hosts is None and cloud_id is None and _transport is None:
raise ValueError("Either 'hosts' or 'cloud_id' must be specified")
if serializer is not None:
if serializers is not DEFAULT:
raise ValueError(
"Can't specify both 'serializer' and 'serializers' parameters "
"together. Instead only specify one of the other."
)
serializers = {default_mimetype: serializer}
# Setting min_delay_between_sniffing=True implies sniff_before_requests=True
if min_delay_between_sniffing is not DEFAULT:
sniff_before_requests = True
sniffing_options = (
sniff_timeout,
sniff_on_start,
sniff_before_requests,
sniff_on_node_failure,
sniffed_node_callback,
min_delay_between_sniffing,
sniffed_node_callback,
)
if cloud_id is not None and any(
x is not DEFAULT and x is not None for x in sniffing_options
):
raise ValueError(
"Sniffing should not be enabled when connecting to Elastic Cloud"
)
sniff_callback = None
if sniffed_node_callback is not None:
sniff_callback = create_sniff_callback(
sniffed_node_callback=sniffed_node_callback
)
elif (
sniff_on_start is True
or sniff_before_requests is True
or sniff_on_node_failure is True
):
sniff_callback = default_sniff_callback
if _transport is None:
requests_session_auth = None
if http_auth is not None and http_auth is not DEFAULT:
if is_requests_http_auth(http_auth):
# If we're using custom requests authentication
# then we need to alert the user that they also
# need to use 'node_class=requests'.
if not is_requests_node_class(node_class):
raise ValueError(
"Using a custom 'requests.auth.AuthBase' class for "
"'http_auth' must be used with node_class='requests'"
)
# Reset 'http_auth' to DEFAULT so it's not consumed below.
requests_session_auth = http_auth
http_auth = DEFAULT
node_configs = client_node_configs(
hosts,
cloud_id=cloud_id,
requests_session_auth=requests_session_auth,
connections_per_node=connections_per_node,
http_compress=http_compress,
verify_certs=verify_certs,
ca_certs=ca_certs,
client_cert=client_cert,
client_key=client_key,
ssl_assert_hostname=ssl_assert_hostname,
ssl_assert_fingerprint=ssl_assert_fingerprint,
ssl_version=ssl_version,
ssl_context=ssl_context,
ssl_show_warn=ssl_show_warn,
)
transport_kwargs: t.Dict[str, t.Any] = {}
if node_class is not DEFAULT:
transport_kwargs["node_class"] = node_class
if node_pool_class is not DEFAULT:
transport_kwargs["node_pool_class"] = node_pool_class
if randomize_nodes_in_pool is not DEFAULT:
transport_kwargs["randomize_nodes_in_pool"] = randomize_nodes_in_pool
if node_selector_class is not DEFAULT:
transport_kwargs["node_selector_class"] = node_selector_class
if dead_node_backoff_factor is not DEFAULT:
transport_kwargs["dead_node_backoff_factor"] = dead_node_backoff_factor
if max_dead_node_backoff is not DEFAULT:
transport_kwargs["max_dead_node_backoff"] = max_dead_node_backoff
if meta_header is not DEFAULT:
transport_kwargs["meta_header"] = meta_header
transport_serializers = DEFAULT_SERIALIZERS.copy()
if serializers is not DEFAULT:
transport_serializers.update(serializers)
# Override compatibility serializers from their non-compat mimetypes too.
# So we use the same serializer for requests and responses.
for mime_subtype in ("json", "x-ndjson"):
if f"application/{mime_subtype}" in serializers:
compat_mimetype = (
f"application/vnd.elasticsearch+{mime_subtype}"
)
if compat_mimetype not in serializers:
transport_serializers[compat_mimetype] = serializers[
f"application/{mime_subtype}"
]
transport_kwargs["serializers"] = transport_serializers
transport_kwargs["default_mimetype"] = default_mimetype
if sniff_on_start is not DEFAULT:
transport_kwargs["sniff_on_start"] = sniff_on_start
if sniff_before_requests is not DEFAULT:
transport_kwargs["sniff_before_requests"] = sniff_before_requests
if sniff_on_node_failure is not DEFAULT:
transport_kwargs["sniff_on_node_failure"] = sniff_on_node_failure
if sniff_timeout is not DEFAULT:
transport_kwargs["sniff_timeout"] = sniff_timeout
if min_delay_between_sniffing is not DEFAULT:
transport_kwargs["min_delay_between_sniffing"] = (
min_delay_between_sniffing
)
_transport = transport_class(
node_configs,
client_meta_service=CLIENT_META_SERVICE,
sniff_callback=sniff_callback,
**transport_kwargs,
)
super().__init__(_transport)
# These are set per-request so are stored separately.
self._request_timeout = request_timeout
self._max_retries = max_retries
self._retry_on_timeout = retry_on_timeout
if isinstance(retry_on_status, int):
retry_on_status = (retry_on_status,)
self._retry_on_status = retry_on_status
else:
super().__init__(_transport)
if headers is not DEFAULT and headers is not None:
self._headers.update(headers)
if opaque_id is not DEFAULT and opaque_id is not None: # type: ignore[comparison-overlap]
self._headers["x-opaque-id"] = opaque_id
self._headers = resolve_auth_headers(
self._headers,
http_auth=http_auth,
api_key=api_key,
basic_auth=basic_auth,
bearer_auth=bearer_auth,
)
# namespaced clients for compatibility with API names
self.async_search = AsyncSearchClient(self)
self.autoscaling = AutoscalingClient(self)
self.cat = CatClient(self)
self.cluster = ClusterClient(self)
self.connector = ConnectorClient(self)
self.fleet = FleetClient(self)
self.features = FeaturesClient(self)
self.indices = IndicesClient(self)
self.inference = InferenceClient(self)
self.ingest = IngestClient(self)
self.nodes = NodesClient(self)
self.snapshot = SnapshotClient(self)
self.tasks = TasksClient(self)
self.xpack = XPackClient(self)
self.ccr = CcrClient(self)
self.dangling_indices = DanglingIndicesClient(self)
self.enrich = EnrichClient(self)
self.eql = EqlClient(self)
self.esql = EsqlClient(self)
self.graph = GraphClient(self)
self.ilm = IlmClient(self)
self.license = LicenseClient(self)
self.logstash = LogstashClient(self)
self.migration = MigrationClient(self)
self.ml = MlClient(self)
self.monitoring = MonitoringClient(self)
self.query_rules = QueryRulesClient(self)
self.rollup = RollupClient(self)
self.search_application = SearchApplicationClient(self)
self.searchable_snapshots = SearchableSnapshotsClient(self)
self.security = SecurityClient(self)
self.slm = SlmClient(self)
self.simulate = SimulateClient(self)
self.shutdown = ShutdownClient(self)
self.sql = SqlClient(self)
self.ssl = SslClient(self)
self.synonyms = SynonymsClient(self)
self.text_structure = TextStructureClient(self)
self.transform = TransformClient(self)
self.watcher = WatcherClient(self)
def __repr__(self) -> str:
try:
# get a list of all connections
nodes = [node.base_url for node in self.transport.node_pool.all()]
# truncate to 5 if there are too many
if len(nodes) > 5:
nodes = nodes[:5] + ["..."]
return f"<{self.__class__.__name__}({nodes})>"
except Exception:
# probably operating on custom transport and connection_pool, ignore
return super().__repr__()
async def __aenter__(self) -> "AsyncElasticsearch":
try:
# All this to avoid a Mypy error when using unasync.
await getattr(self.transport, "_async_call")()
except AttributeError:
pass
return self
async def __aexit__(self, *_: t.Any) -> None:
await self.close()
def options(
self: SelfType,
*,
opaque_id: t.Union[DefaultType, str] = DEFAULT,
api_key: t.Union[DefaultType, str, t.Tuple[str, str]] = DEFAULT,
basic_auth: t.Union[DefaultType, str, t.Tuple[str, str]] = DEFAULT,
bearer_auth: t.Union[DefaultType, str] = DEFAULT,
headers: t.Union[DefaultType, t.Mapping[str, str]] = DEFAULT,
request_timeout: t.Union[DefaultType, t.Optional[float]] = DEFAULT,
ignore_status: t.Union[DefaultType, int, t.Collection[int]] = DEFAULT,
max_retries: t.Union[DefaultType, int] = DEFAULT,
retry_on_status: t.Union[DefaultType, int, t.Collection[int]] = DEFAULT,
retry_on_timeout: t.Union[DefaultType, bool] = DEFAULT,
) -> SelfType:
client = type(self)(_transport=self.transport)
resolved_headers = headers if headers is not DEFAULT else None
resolved_headers = resolve_auth_headers(
headers=resolved_headers,
api_key=api_key,
basic_auth=basic_auth,
bearer_auth=bearer_auth,
)
resolved_opaque_id = opaque_id if opaque_id is not DEFAULT else None
if resolved_opaque_id:
resolved_headers["x-opaque-id"] = resolved_opaque_id
if resolved_headers:
new_headers = self._headers.copy()
new_headers.update(resolved_headers)
client._headers = new_headers
else:
client._headers = self._headers.copy()
if request_timeout is not DEFAULT:
client._request_timeout = request_timeout
else:
client._request_timeout = self._request_timeout
if ignore_status is not DEFAULT:
if isinstance(ignore_status, int):
ignore_status = (ignore_status,)
client._ignore_status = ignore_status
else:
client._ignore_status = self._ignore_status
if max_retries is not DEFAULT:
if not isinstance(max_retries, int):
raise TypeError("'max_retries' must be of type 'int'")
client._max_retries = max_retries
else:
client._max_retries = self._max_retries
if retry_on_status is not DEFAULT:
if isinstance(retry_on_status, int):
retry_on_status = (retry_on_status,)
client._retry_on_status = retry_on_status
else:
client._retry_on_status = self._retry_on_status
if retry_on_timeout is not DEFAULT:
if not isinstance(retry_on_timeout, bool):
raise TypeError("'retry_on_timeout' must be of type 'bool'")
client._retry_on_timeout = retry_on_timeout
else:
client._retry_on_timeout = self._retry_on_timeout
return client
async def close(self) -> None:
"""Closes the Transport and all internal connections"""
await self.transport.close()
@_rewrite_parameters()
async def ping(
self,
*,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[t.List[str], str]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
) -> bool:
"""
Returns True if a successful response returns from the info() API,
otherwise returns False. This API call can fail either at the transport
layer (due to connection errors or timeouts) or from a non-2XX HTTP response
(due to authentication or authorization issues).
If you want to discover why the request failed you should use the ``info()`` API.
`<https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html>`_
"""
__path = "/"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
__headers = {"accept": "application/json"}
try:
await self.perform_request(
"HEAD", __path, params=__query, headers=__headers
)
return True
except (ApiError, TransportError):
return False
# AUTO-GENERATED-API-DEFINITIONS #
@_rewrite_parameters(
body_name="operations",
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def bulk(
self,
*,
operations: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
body: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
index: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
include_source_on_error: t.Optional[bool] = None,
list_executed_pipelines: t.Optional[bool] = None,
pipeline: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[
t.Union[bool, str, t.Literal["false", "true", "wait_for"]]
] = None,
require_alias: t.Optional[bool] = None,
require_data_stream: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Bulk index or delete documents.
Perform multiple <code>index</code>, <code>create</code>, <code>delete</code>, and <code>update</code> actions in a single request.
This reduces overhead and can greatly increase indexing speed.</p>
<p>If the Elasticsearch security features are enabled, you must have the following index privileges for the target data stream, index, or index alias:</p>
<ul>
<li>To use the <code>create</code> action, you must have the <code>create_doc</code>, <code>create</code>, <code>index</code>, or <code>write</code> index privilege. Data streams support only the <code>create</code> action.</li>
<li>To use the <code>index</code> action, you must have the <code>create</code>, <code>index</code>, or <code>write</code> index privilege.</li>
<li>To use the <code>delete</code> action, you must have the <code>delete</code> or <code>write</code> index privilege.</li>
<li>To use the <code>update</code> action, you must have the <code>index</code> or <code>write</code> index privilege.</li>
<li>To automatically create a data stream or index with a bulk API request, you must have the <code>auto_configure</code>, <code>create_index</code>, or <code>manage</code> index privilege.</li>
<li>To make the result of a bulk operation visible to search using the <code>refresh</code> parameter, you must have the <code>maintenance</code> or <code>manage</code> index privilege.</li>
</ul>
<p>Automatic data stream creation requires a matching index template with data stream enabled.</p>
<p>The actions are specified in the request body using a newline delimited JSON (NDJSON) structure:</p>
<pre><code>action_and_meta_data\\n
optional_source\\n
action_and_meta_data\\n
optional_source\\n
....
action_and_meta_data\\n
optional_source\\n
</code></pre>
<p>The <code>index</code> and <code>create</code> actions expect a source on the next line and have the same semantics as the <code>op_type</code> parameter in the standard index API.
A <code>create</code> action fails if a document with the same ID already exists in the target
An <code>index</code> action adds or replaces a document as necessary.</p>
<p>NOTE: Data streams support only the <code>create</code> action.
To update or delete a document in a data stream, you must target the backing index containing the document.</p>
<p>An <code>update</code> action expects that the partial doc, upsert, and script and its options are specified on the next line.</p>
<p>A <code>delete</code> action does not expect a source on the next line and has the same semantics as the standard delete API.</p>
<p>NOTE: The final line of data must end with a newline character (<code>\\n</code>).
Each newline character may be preceded by a carriage return (<code>\\r</code>).
When sending NDJSON data to the <code>_bulk</code> endpoint, use a <code>Content-Type</code> header of <code>application/json</code> or <code>application/x-ndjson</code>.
Because this format uses literal newline characters (<code>\\n</code>) as delimiters, make sure that the JSON actions and sources are not pretty printed.</p>
<p>If you provide a target in the request path, it is used for any actions that don't explicitly specify an <code>_index</code> argument.</p>
<p>A note on the format: the idea here is to make processing as fast as possible.
As some of the actions are redirected to other shards on other nodes, only <code>action_meta_data</code> is parsed on the receiving node side.</p>
<p>Client libraries using this protocol should try and strive to do something similar on the client side, and reduce buffering as much as possible.</p>
<p>There is no "correct" number of actions to perform in a single bulk request.
Experiment with different settings to find the optimal size for your particular workload.
Note that Elasticsearch limits the maximum size of a HTTP request to 100mb by default so clients must ensure that no request exceeds this size.
It is not possible to index a single document that exceeds the size limit, so you must pre-process any such documents into smaller pieces before sending them to Elasticsearch.
For instance, split documents into pages or chapters before indexing them, or store raw binary data in a system outside Elasticsearch and replace the raw data with a link to the external system in the documents that you send to Elasticsearch.</p>
<p><strong>Client suppport for bulk requests</strong></p>
<p>Some of the officially supported clients provide helpers to assist with bulk requests and reindexing:</p>
<ul>
<li>Go: Check out <code>esutil.BulkIndexer</code></li>
<li>Perl: Check out <code>Search::Elasticsearch::Client::5_0::Bulk</code> and <code>Search::Elasticsearch::Client::5_0::Scroll</code></li>
<li>Python: Check out <code>elasticsearch.helpers.*</code></li>
<li>JavaScript: Check out <code>client.helpers.*</code></li>
<li>.NET: Check out <code>BulkAllObservable</code></li>
<li>PHP: Check out bulk indexing.</li>
</ul>
<p><strong>Submitting bulk requests with cURL</strong></p>
<p>If you're providing text file input to <code>curl</code>, you must use the <code>--data-binary</code> flag instead of plain <code>-d</code>.
The latter doesn't preserve newlines. For example:</p>
<pre><code>$ cat requests
{ "index" : { "_index" : "test", "_id" : "1" } }
{ "field1" : "value1" }
$ curl -s -H "Content-Type: application/x-ndjson" -XPOST localhost:9200/_bulk --data-binary "@requests"; echo
{"took":7, "errors": false, "items":[{"index":{"_index":"test","_id":"1","_version":1,"result":"created","forced_refresh":false}}]}
</code></pre>
<p><strong>Optimistic concurrency control</strong></p>
<p>Each <code>index</code> and <code>delete</code> action within a bulk API call may include the <code>if_seq_no</code> and <code>if_primary_term</code> parameters in their respective action and meta data lines.
The <code>if_seq_no</code> and <code>if_primary_term</code> parameters control how operations are run, based on the last modification to existing documents. See Optimistic concurrency control for more details.</p>
<p><strong>Versioning</strong></p>
<p>Each bulk item can include the version value using the <code>version</code> field.
It automatically follows the behavior of the index or delete operation based on the <code>_version</code> mapping.
It also support the <code>version_type</code>.</p>
<p><strong>Routing</strong></p>
<p>Each bulk item can include the routing value using the <code>routing</code> field.
It automatically follows the behavior of the index or delete operation based on the <code>_routing</code> mapping.</p>
<p>NOTE: Data streams do not support custom routing unless they were created with the <code>allow_custom_routing</code> setting enabled in the template.</p>
<p><strong>Wait for active shards</strong></p>
<p>When making bulk calls, you can set the <code>wait_for_active_shards</code> parameter to require a minimum number of shard copies to be active before starting to process the bulk request.</p>
<p><strong>Refresh</strong></p>
<p>Control when the changes made by this request are visible to search.</p>
<p>NOTE: Only the shards that receive the bulk request will be affected by refresh.
Imagine a <code>_bulk?refresh=wait_for</code> request with three documents in it that happen to be routed to different shards in an index with five shards.
The request will only wait for those three shards to refresh.
The other two shards that make up the index do not participate in the <code>_bulk</code> request at all.</p>
<p>You might want to disable the refresh interval temporarily to improve indexing throughput for large bulk requests.
Refer to the linked documentation for step-by-step instructions using the index settings API.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-bulk>`_
:param operations:
:param index: The name of the data stream, index, or index alias to perform bulk
actions on.
:param include_source_on_error: True or false if to include the document source
in the error message in case of parsing errors.
:param list_executed_pipelines: If `true`, the response will include the ingest
pipelines that were run for each index or create.
:param pipeline: The pipeline identifier to use to preprocess incoming documents.
If the index has a default ingest pipeline specified, setting the value to
`_none` turns off the default ingest pipeline for this request. If a final
pipeline is configured, it will always run regardless of the value of this
parameter.
:param refresh: If `true`, Elasticsearch refreshes the affected shards to make
this operation visible to search. If `wait_for`, wait for a refresh to make
this operation visible to search. If `false`, do nothing with refreshes.
Valid values: `true`, `false`, `wait_for`.
:param require_alias: If `true`, the request's actions must target an index alias.
:param require_data_stream: If `true`, the request's actions must target a data
stream (existing or to be created).
:param routing: A custom value that is used to route operations to a specific
shard.
:param source: Indicates whether to return the `_source` field (`true` or `false`)
or contains a list of fields to return.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter. If the `_source`
parameter is `false`, this parameter is ignored.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param timeout: The period each action waits for the following operations: automatic
index creation, dynamic mapping updates, and waiting for active shards. The
default is `1m` (one minute), which guarantees Elasticsearch waits for at
least the timeout before failing. The actual wait time could be longer, particularly
when multiple waits occur.
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. Set to `all` or any positive integer
up to the total number of shards in the index (`number_of_replicas+1`). The
default is `1`, which waits for each primary shard to be active.
"""
if operations is None and body is None:
raise ValueError(
"Empty value passed for parameters 'operations' and 'body', one of them should be set."
)
elif operations is not None and body is not None:
raise ValueError("Cannot set both 'operations' and 'body'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_bulk'
else:
__path_parts = {}
__path = "/_bulk"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if include_source_on_error is not None:
__query["include_source_on_error"] = include_source_on_error
if list_executed_pipelines is not None:
__query["list_executed_pipelines"] = list_executed_pipelines
if pipeline is not None:
__query["pipeline"] = pipeline
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if require_alias is not None:
__query["require_alias"] = require_alias
if require_data_stream is not None:
__query["require_data_stream"] = require_data_stream
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if timeout is not None:
__query["timeout"] = timeout
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
__body = operations if operations is not None else body
__headers = {
"accept": "application/json",
"content-type": "application/x-ndjson",
}
return await self.perform_request( # type: ignore[return-value]
"PUT",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="bulk",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("scroll_id",),
)
async def clear_scroll(
self,
*,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
scroll_id: t.Optional[t.Union[str, t.Sequence[str]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Clear a scrolling search.
Clear the search context and results for a scrolling search.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-clear-scroll>`_
:param scroll_id: The scroll IDs to clear. To clear all scroll IDs, use `_all`.
"""
__path_parts: t.Dict[str, str] = {}
__path = "/_search/scroll"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if scroll_id is not None:
__body["scroll_id"] = scroll_id
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"DELETE",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="clear_scroll",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("id",),
)
async def close_point_in_time(
self,
*,
id: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Close a point in time.
A point in time must be opened explicitly before being used in search requests.
The <code>keep_alive</code> parameter tells Elasticsearch how long it should persist.
A point in time is automatically closed when the <code>keep_alive</code> period has elapsed.
However, keeping points in time has a cost; close them as soon as they are no longer required for search requests.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-open-point-in-time>`_
:param id: The ID of the point-in-time.
"""
if id is None and body is None:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {}
__path = "/_pit"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if id is not None:
__body["id"] = id
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"DELETE",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="close_point_in_time",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("query",),
)
async def count(
self,
*,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
analyze_wildcard: t.Optional[bool] = None,
analyzer: t.Optional[str] = None,
default_operator: t.Optional[t.Union[str, t.Literal["and", "or"]]] = None,
df: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ignore_throttled: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
lenient: t.Optional[bool] = None,
min_score: t.Optional[float] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
q: t.Optional[str] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
routing: t.Optional[str] = None,
terminate_after: t.Optional[int] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Count search results.
Get the number of documents matching a query.</p>
<p>The query can be provided either by using a simple query string as a parameter, or by defining Query DSL within the request body.
The query is optional. When no query is provided, the API uses <code>match_all</code> to count all the documents.</p>
<p>The count API supports multi-target syntax. You can run a single count API search across multiple data streams and indices.</p>
<p>The operation is broadcast across all shards.
For each shard ID group, a replica is chosen and the search is run against it.
This means that replicas increase the scalability of the count.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-count>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams and indices,
omit this parameter or use `*` or `_all`.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param analyze_wildcard: If `true`, wildcard and prefix queries are analyzed.
This parameter can be used only when the `q` query string parameter is specified.
:param analyzer: The analyzer to use for the query string. This parameter can
be used only when the `q` query string parameter is specified.
:param default_operator: The default operator for query string query: `AND` or
`OR`. This parameter can be used only when the `q` query string parameter
is specified.
:param df: The field to use as a default when no field prefix is given in the
query string. This parameter can be used only when the `q` query string parameter
is specified.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. It supports comma-separated
values, such as `open,hidden`.
:param ignore_throttled: If `true`, concrete, expanded, or aliased indices are
ignored when frozen.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param lenient: If `true`, format-based query failures (such as providing text
to a numeric field) in the query string will be ignored. This parameter can
be used only when the `q` query string parameter is specified.
:param min_score: The minimum `_score` value that documents must have to be included
in the result.
:param preference: The node or shard the operation should be performed on. By
default, it is random.
:param q: The query in Lucene query string syntax. This parameter cannot be used
with a request body.
:param query: Defines the search query using Query DSL. A request body query
cannot be used with the `q` query string parameter.
:param routing: A custom value used to route operations to a specific shard.
:param terminate_after: The maximum number of documents to collect for each shard.
If a query reaches this limit, Elasticsearch terminates the query early.
Elasticsearch collects documents before sorting. IMPORTANT: Use with caution.
Elasticsearch applies this parameter to each shard handling the request.
When possible, let Elasticsearch perform early termination automatically.
Avoid specifying this parameter for requests that target data streams with
backing indices across multiple data tiers.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_count'
else:
__path_parts = {}
__path = "/_count"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if analyze_wildcard is not None:
__query["analyze_wildcard"] = analyze_wildcard
if analyzer is not None:
__query["analyzer"] = analyzer
if default_operator is not None:
__query["default_operator"] = default_operator
if df is not None:
__query["df"] = df
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_throttled is not None:
__query["ignore_throttled"] = ignore_throttled
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if lenient is not None:
__query["lenient"] = lenient
if min_score is not None:
__query["min_score"] = min_score
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if q is not None:
__query["q"] = q
if routing is not None:
__query["routing"] = routing
if terminate_after is not None:
__query["terminate_after"] = terminate_after
if not __body:
if query is not None:
__body["query"] = query
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="count",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_name="document",
)
async def create(
self,
*,
index: str,
id: str,
document: t.Optional[t.Mapping[str, t.Any]] = None,
body: t.Optional[t.Mapping[str, t.Any]] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
include_source_on_error: t.Optional[bool] = None,
pipeline: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[
t.Union[bool, str, t.Literal["false", "true", "wait_for"]]
] = None,
require_alias: t.Optional[bool] = None,
require_data_stream: t.Optional[bool] = None,
routing: t.Optional[str] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Create a new document in the index.</p>
<p>You can index a new JSON document with the <code>/<target>/_doc/</code> or <code>/<target>/_create/<_id></code> APIs
Using <code>_create</code> guarantees that the document is indexed only if it does not already exist.
It returns a 409 response when a document with a same ID already exists in the index.
To update an existing document, you must use the <code>/<target>/_doc/</code> API.</p>
<p>If the Elasticsearch security features are enabled, you must have the following index privileges for the target data stream, index, or index alias:</p>
<ul>
<li>To add a document using the <code>PUT /<target>/_create/<_id></code> or <code>POST /<target>/_create/<_id></code> request formats, you must have the <code>create_doc</code>, <code>create</code>, <code>index</code>, or <code>write</code> index privilege.</li>
<li>To automatically create a data stream or index with this API request, you must have the <code>auto_configure</code>, <code>create_index</code>, or <code>manage</code> index privilege.</li>
</ul>
<p>Automatic data stream creation requires a matching index template with data stream enabled.</p>
<p><strong>Automatically create data streams and indices</strong></p>
<p>If the request's target doesn't exist and matches an index template with a <code>data_stream</code> definition, the index operation automatically creates the data stream.</p>
<p>If the target doesn't exist and doesn't match a data stream template, the operation automatically creates the index and applies any matching index templates.</p>
<p>NOTE: Elasticsearch includes several built-in index templates. To avoid naming collisions with these templates, refer to index pattern documentation.</p>
<p>If no mapping exists, the index operation creates a dynamic mapping.
By default, new fields and objects are automatically added to the mapping if needed.</p>
<p>Automatic index creation is controlled by the <code>action.auto_create_index</code> setting.
If it is <code>true</code>, any index can be created automatically.
You can modify this setting to explicitly allow or block automatic creation of indices that match specified patterns or set it to <code>false</code> to turn off automatic index creation entirely.
Specify a comma-separated list of patterns you want to allow or prefix each pattern with <code>+</code> or <code>-</code> to indicate whether it should be allowed or blocked.
When a list is specified, the default behaviour is to disallow.</p>
<p>NOTE: The <code>action.auto_create_index</code> setting affects the automatic creation of indices only.
It does not affect the creation of data streams.</p>
<p><strong>Routing</strong></p>
<p>By default, shard placement — or routing — is controlled by using a hash of the document's ID value.
For more explicit control, the value fed into the hash function used by the router can be directly specified on a per-operation basis using the <code>routing</code> parameter.</p>
<p>When setting up explicit mapping, you can also use the <code>_routing</code> field to direct the index operation to extract the routing value from the document itself.
This does come at the (very minimal) cost of an additional document parsing pass.
If the <code>_routing</code> mapping is defined and set to be required, the index operation will fail if no routing value is provided or extracted.</p>
<p>NOTE: Data streams do not support custom routing unless they were created with the <code>allow_custom_routing</code> setting enabled in the template.</p>
<p><strong>Distributed</strong></p>
<p>The index operation is directed to the primary shard based on its route and performed on the actual node containing this shard.
After the primary shard completes the operation, if needed, the update is distributed to applicable replicas.</p>
<p><strong>Active shards</strong></p>
<p>To improve the resiliency of writes to the system, indexing operations can be configured to wait for a certain number of active shard copies before proceeding with the operation.
If the requisite number of active shard copies are not available, then the write operation must wait and retry, until either the requisite shard copies have started or a timeout occurs.
By default, write operations only wait for the primary shards to be active before proceeding (that is to say <code>wait_for_active_shards</code> is <code>1</code>).
This default can be overridden in the index settings dynamically by setting <code>index.write.wait_for_active_shards</code>.
To alter this behavior per operation, use the <code>wait_for_active_shards request</code> parameter.</p>
<p>Valid values are all or any positive integer up to the total number of configured copies per shard in the index (which is <code>number_of_replicas</code>+1).
Specifying a negative value or a number greater than the number of shard copies will throw an error.</p>
<p>For example, suppose you have a cluster of three nodes, A, B, and C and you create an index index with the number of replicas set to 3 (resulting in 4 shard copies, one more copy than there are nodes).
If you attempt an indexing operation, by default the operation will only ensure the primary copy of each shard is available before proceeding.
This means that even if B and C went down and A hosted the primary shard copies, the indexing operation would still proceed with only one copy of the data.
If <code>wait_for_active_shards</code> is set on the request to <code>3</code> (and all three nodes are up), the indexing operation will require 3 active shard copies before proceeding.
This requirement should be met because there are 3 active nodes in the cluster, each one holding a copy of the shard.
However, if you set <code>wait_for_active_shards</code> to <code>all</code> (or to <code>4</code>, which is the same in this situation), the indexing operation will not proceed as you do not have all 4 copies of each shard active in the index.
The operation will timeout unless a new node is brought up in the cluster to host the fourth copy of the shard.</p>
<p>It is important to note that this setting greatly reduces the chances of the write operation not writing to the requisite number of shard copies, but it does not completely eliminate the possibility, because this check occurs before the write operation starts.
After the write operation is underway, it is still possible for replication to fail on any number of shard copies but still succeed on the primary.
The <code>_shards</code> section of the API response reveals the number of shard copies on which replication succeeded and failed.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-create>`_
:param index: The name of the data stream or index to target. If the target doesn't
exist and matches the name or wildcard (`*`) pattern of an index template
with a `data_stream` definition, this request creates the data stream. If
the target doesn't exist and doesn’t match a data stream template, this request
creates the index.
:param id: A unique identifier for the document. To automatically generate a
document ID, use the `POST /<target>/_doc/` request format.
:param document:
:param include_source_on_error: True or false if to include the document source
in the error message in case of parsing errors.
:param pipeline: The ID of the pipeline to use to preprocess incoming documents.
If the index has a default ingest pipeline specified, setting the value to
`_none` turns off the default ingest pipeline for this request. If a final
pipeline is configured, it will always run regardless of the value of this
parameter.
:param refresh: If `true`, Elasticsearch refreshes the affected shards to make
this operation visible to search. If `wait_for`, it waits for a refresh to
make this operation visible to search. If `false`, it does nothing with refreshes.
:param require_alias: If `true`, the destination must be an index alias.
:param require_data_stream: If `true`, the request's actions must target a data
stream (existing or to be created).
:param routing: A custom value that is used to route operations to a specific
shard.
:param timeout: The period the request waits for the following operations: automatic
index creation, dynamic mapping updates, waiting for active shards. Elasticsearch
waits for at least the specified timeout period before failing. The actual
wait time could be longer, particularly when multiple waits occur. This parameter
is useful for situations where the primary shard assigned to perform the
operation might not be available when the operation runs. Some reasons for
this might be that the primary shard is currently recovering from a gateway
or undergoing relocation. By default, the operation will wait on the primary
shard to become available for at least 1 minute before failing and responding
with an error. The actual wait time could be longer, particularly when multiple
waits occur.
:param version: The explicit version number for concurrency control. It must
be a non-negative long number.
:param version_type: The version type.
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. You can set it to `all` or any positive
integer up to the total number of shards in the index (`number_of_replicas+1`).
The default value of `1` means it waits for each primary shard to be active.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
if document is None and body is None:
raise ValueError(
"Empty value passed for parameters 'document' and 'body', one of them should be set."
)
elif document is not None and body is not None:
raise ValueError("Cannot set both 'document' and 'body'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_create/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if include_source_on_error is not None:
__query["include_source_on_error"] = include_source_on_error
if pipeline is not None:
__query["pipeline"] = pipeline
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if require_alias is not None:
__query["require_alias"] = require_alias
if require_data_stream is not None:
__query["require_data_stream"] = require_data_stream
if routing is not None:
__query["routing"] = routing
if timeout is not None:
__query["timeout"] = timeout
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
__body = document if document is not None else body
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"PUT",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="create",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def delete(
self,
*,
index: str,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
if_primary_term: t.Optional[int] = None,
if_seq_no: t.Optional[int] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[
t.Union[bool, str, t.Literal["false", "true", "wait_for"]]
] = None,
routing: t.Optional[str] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Delete a document.</p>
<p>Remove a JSON document from the specified index.</p>
<p>NOTE: You cannot send deletion requests directly to a data stream.
To delete a document in a data stream, you must target the backing index containing the document.</p>
<p><strong>Optimistic concurrency control</strong></p>
<p>Delete operations can be made conditional and only be performed if the last modification to the document was assigned the sequence number and primary term specified by the <code>if_seq_no</code> and <code>if_primary_term</code> parameters.
If a mismatch is detected, the operation will result in a <code>VersionConflictException</code> and a status code of <code>409</code>.</p>
<p><strong>Versioning</strong></p>
<p>Each document indexed is versioned.
When deleting a document, the version can be specified to make sure the relevant document you are trying to delete is actually being deleted and it has not changed in the meantime.
Every write operation run on a document, deletes included, causes its version to be incremented.
The version number of a deleted document remains available for a short time after deletion to allow for control of concurrent operations.
The length of time for which a deleted document's version remains available is determined by the <code>index.gc_deletes</code> index setting.</p>
<p><strong>Routing</strong></p>
<p>If routing is used during indexing, the routing value also needs to be specified to delete a document.</p>
<p>If the <code>_routing</code> mapping is set to <code>required</code> and no routing value is specified, the delete API throws a <code>RoutingMissingException</code> and rejects the request.</p>
<p>For example:</p>
<pre><code>DELETE /my-index-000001/_doc/1?routing=shard-1
</code></pre>
<p>This request deletes the document with ID 1, but it is routed based on the user.
The document is not deleted if the correct routing is not specified.</p>
<p><strong>Distributed</strong></p>
<p>The delete operation gets hashed into a specific shard ID.
It then gets redirected into the primary shard within that ID group and replicated (if needed) to shard replicas within that ID group.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-delete>`_
:param index: The name of the target index.
:param id: A unique identifier for the document.
:param if_primary_term: Only perform the operation if the document has this primary
term.
:param if_seq_no: Only perform the operation if the document has this sequence
number.
:param refresh: If `true`, Elasticsearch refreshes the affected shards to make
this operation visible to search. If `wait_for`, it waits for a refresh to
make this operation visible to search. If `false`, it does nothing with refreshes.
:param routing: A custom value used to route operations to a specific shard.
:param timeout: The period to wait for active shards. This parameter is useful
for situations where the primary shard assigned to perform the delete operation
might not be available when the delete operation runs. Some reasons for this
might be that the primary shard is currently recovering from a store or undergoing
relocation. By default, the delete operation will wait on the primary shard
to become available for up to 1 minute before failing and responding with
an error.
:param version: An explicit version number for concurrency control. It must match
the current version of the document for the request to succeed.
:param version_type: The version type.
:param wait_for_active_shards: The minimum number of shard copies that must be
active before proceeding with the operation. You can set it to `all` or any
positive integer up to the total number of shards in the index (`number_of_replicas+1`).
The default value of `1` means it waits for each primary shard to be active.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_doc/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if if_primary_term is not None:
__query["if_primary_term"] = if_primary_term
if if_seq_no is not None:
__query["if_seq_no"] = if_seq_no
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if timeout is not None:
__query["timeout"] = timeout
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"DELETE",
__path,
params=__query,
headers=__headers,
endpoint_id="delete",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("max_docs", "query", "slice"),
parameter_aliases={"from": "from_"},
)
async def delete_by_query(
self,
*,
index: t.Union[str, t.Sequence[str]],
allow_no_indices: t.Optional[bool] = None,
analyze_wildcard: t.Optional[bool] = None,
analyzer: t.Optional[str] = None,
conflicts: t.Optional[t.Union[str, t.Literal["abort", "proceed"]]] = None,
default_operator: t.Optional[t.Union[str, t.Literal["and", "or"]]] = None,
df: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
from_: t.Optional[int] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
lenient: t.Optional[bool] = None,
max_docs: t.Optional[int] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
q: t.Optional[str] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
refresh: t.Optional[bool] = None,
request_cache: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
routing: t.Optional[str] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
scroll_size: t.Optional[int] = None,
search_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
slice: t.Optional[t.Mapping[str, t.Any]] = None,
slices: t.Optional[t.Union[int, t.Union[str, t.Literal["auto"]]]] = None,
sort: t.Optional[t.Sequence[str]] = None,
stats: t.Optional[t.Sequence[str]] = None,
terminate_after: t.Optional[int] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
version: t.Optional[bool] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
wait_for_completion: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Delete documents.</p>
<p>Deletes documents that match the specified query.</p>
<p>If the Elasticsearch security features are enabled, you must have the following index privileges for the target data stream, index, or alias:</p>
<ul>
<li><code>read</code></li>
<li><code>delete</code> or <code>write</code></li>
</ul>
<p>You can specify the query criteria in the request URI or the request body using the same syntax as the search API.
When you submit a delete by query request, Elasticsearch gets a snapshot of the data stream or index when it begins processing the request and deletes matching documents using internal versioning.
If a document changes between the time that the snapshot is taken and the delete operation is processed, it results in a version conflict and the delete operation fails.</p>
<p>NOTE: Documents with a version equal to 0 cannot be deleted using delete by query because internal versioning does not support 0 as a valid version number.</p>
<p>While processing a delete by query request, Elasticsearch performs multiple search requests sequentially to find all of the matching documents to delete.
A bulk delete request is performed for each batch of matching documents.
If a search or bulk request is rejected, the requests are retried up to 10 times, with exponential back off.
If the maximum retry limit is reached, processing halts and all failed requests are returned in the response.
Any delete requests that completed successfully still stick, they are not rolled back.</p>
<p>You can opt to count version conflicts instead of halting and returning by setting <code>conflicts</code> to <code>proceed</code>.
Note that if you opt to count version conflicts the operation could attempt to delete more documents from the source than <code>max_docs</code> until it has successfully deleted <code>max_docs documents</code>, or it has gone through every document in the source query.</p>
<p><strong>Throttling delete requests</strong></p>
<p>To control the rate at which delete by query issues batches of delete operations, you can set <code>requests_per_second</code> to any positive decimal number.
This pads each batch with a wait time to throttle the rate.
Set <code>requests_per_second</code> to <code>-1</code> to disable throttling.</p>
<p>Throttling uses a wait time between batches so that the internal scroll requests can be given a timeout that takes the request padding into account.
The padding time is the difference between the batch size divided by the <code>requests_per_second</code> and the time spent writing.
By default the batch size is <code>1000</code>, so if <code>requests_per_second</code> is set to <code>500</code>:</p>
<pre><code>target_time = 1000 / 500 per second = 2 seconds
wait_time = target_time - write_time = 2 seconds - .5 seconds = 1.5 seconds
</code></pre>
<p>Since the batch is issued as a single <code>_bulk</code> request, large batch sizes cause Elasticsearch to create many requests and wait before starting the next set.
This is "bursty" instead of "smooth".</p>
<p><strong>Slicing</strong></p>
<p>Delete by query supports sliced scroll to parallelize the delete process.
This can improve efficiency and provide a convenient way to break the request down into smaller parts.</p>
<p>Setting <code>slices</code> to <code>auto</code> lets Elasticsearch choose the number of slices to use.
This setting will use one slice per shard, up to a certain limit.
If there are multiple source data streams or indices, it will choose the number of slices based on the index or backing index with the smallest number of shards.
Adding slices to the delete by query operation creates sub-requests which means it has some quirks:</p>
<ul>
<li>You can see these requests in the tasks APIs. These sub-requests are "child" tasks of the task for the request with slices.</li>
<li>Fetching the status of the task for the request with slices only contains the status of completed slices.</li>
<li>These sub-requests are individually addressable for things like cancellation and rethrottling.</li>
<li>Rethrottling the request with <code>slices</code> will rethrottle the unfinished sub-request proportionally.</li>
<li>Canceling the request with <code>slices</code> will cancel each sub-request.</li>
<li>Due to the nature of <code>slices</code> each sub-request won't get a perfectly even portion of the documents. All documents will be addressed, but some slices may be larger than others. Expect larger slices to have a more even distribution.</li>
<li>Parameters like <code>requests_per_second</code> and <code>max_docs</code> on a request with <code>slices</code> are distributed proportionally to each sub-request. Combine that with the earlier point about distribution being uneven and you should conclude that using <code>max_docs</code> with <code>slices</code> might not result in exactly <code>max_docs</code> documents being deleted.</li>
<li>Each sub-request gets a slightly different snapshot of the source data stream or index though these are all taken at approximately the same time.</li>
</ul>
<p>If you're slicing manually or otherwise tuning automatic slicing, keep in mind that:</p>
<ul>
<li>Query performance is most efficient when the number of slices is equal to the number of shards in the index or backing index. If that number is large (for example, 500), choose a lower number as too many <code>slices</code> hurts performance. Setting <code>slices</code> higher than the number of shards generally does not improve efficiency and adds overhead.</li>
<li>Delete performance scales linearly across available resources with the number of slices.</li>
</ul>
<p>Whether query or delete performance dominates the runtime depends on the documents being reindexed and cluster resources.</p>
<p><strong>Cancel a delete by query operation</strong></p>
<p>Any delete by query can be canceled using the task cancel API. For example:</p>
<pre><code>POST _tasks/r1A2WoRbTwKZ516z6NEs5A:36619/_cancel
</code></pre>
<p>The task ID can be found by using the get tasks API.</p>
<p>Cancellation should happen quickly but might take a few seconds.
The get task status API will continue to list the delete by query task until this task checks that it has been cancelled and terminates itself.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-delete-by-query>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams or indices,
omit this parameter or use `*` or `_all`.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param analyze_wildcard: If `true`, wildcard and prefix queries are analyzed.
This parameter can be used only when the `q` query string parameter is specified.
:param analyzer: Analyzer to use for the query string. This parameter can be
used only when the `q` query string parameter is specified.
:param conflicts: What to do if delete by query hits version conflicts: `abort`
or `proceed`.
:param default_operator: The default operator for query string query: `AND` or
`OR`. This parameter can be used only when the `q` query string parameter
is specified.
:param df: The field to use as default where no field prefix is given in the
query string. This parameter can be used only when the `q` query string parameter
is specified.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. It supports comma-separated
values, such as `open,hidden`.
:param from_: Skips the specified number of documents.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param lenient: If `true`, format-based query failures (such as providing text
to a numeric field) in the query string will be ignored. This parameter can
be used only when the `q` query string parameter is specified.
:param max_docs: The maximum number of documents to delete.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param q: A query in the Lucene query string syntax.
:param query: The documents to delete specified with Query DSL.
:param refresh: If `true`, Elasticsearch refreshes all shards involved in the
delete by query after the request completes. This is different than the delete
API's `refresh` parameter, which causes just the shard that received the
delete request to be refreshed. Unlike the delete API, it does not support
`wait_for`.
:param request_cache: If `true`, the request cache is used for this request.
Defaults to the index-level setting.
:param requests_per_second: The throttle for this request in sub-requests per
second.
:param routing: A custom value used to route operations to a specific shard.
:param scroll: The period to retain the search context for scrolling.
:param scroll_size: The size of the scroll request that powers the operation.
:param search_timeout: The explicit timeout for each search request. It defaults
to no timeout.
:param search_type: The type of the search operation. Available options include
`query_then_fetch` and `dfs_query_then_fetch`.
:param slice: Slice the request manually using the provided slice ID and total
number of slices.
:param slices: The number of slices this task should be divided into.
:param sort: A comma-separated list of `<field>:<direction>` pairs.
:param stats: The specific `tag` of the request for logging and statistical purposes.
:param terminate_after: The maximum number of documents to collect for each shard.
If a query reaches this limit, Elasticsearch terminates the query early.
Elasticsearch collects documents before sorting. Use with caution. Elasticsearch
applies this parameter to each shard handling the request. When possible,
let Elasticsearch perform early termination automatically. Avoid specifying
this parameter for requests that target data streams with backing indices
across multiple data tiers.
:param timeout: The period each deletion request waits for active shards.
:param version: If `true`, returns the document version as part of a hit.
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. Set to `all` or any positive integer
up to the total number of shards in the index (`number_of_replicas+1`). The
`timeout` value controls how long each write request waits for unavailable
shards to become available.
:param wait_for_completion: If `true`, the request blocks until the operation
is complete. If `false`, Elasticsearch performs some preflight checks, launches
the request, and returns a task you can use to cancel or get the status of
the task. Elasticsearch creates a record of this task as a document at `.tasks/task/${taskId}`.
When you are done with a task, you should delete the task document so Elasticsearch
can reclaim the space.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
__path_parts: t.Dict[str, str] = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_delete_by_query'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
# The 'sort' parameter with a colon can't be encoded to the body.
if sort is not None and (
(isinstance(sort, str) and ":" in sort)
or (
isinstance(sort, (list, tuple))
and all(isinstance(_x, str) for _x in sort)
and any(":" in _x for _x in sort)
)
):
__query["sort"] = sort
sort = None
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if analyze_wildcard is not None:
__query["analyze_wildcard"] = analyze_wildcard
if analyzer is not None:
__query["analyzer"] = analyzer
if conflicts is not None:
__query["conflicts"] = conflicts
if default_operator is not None:
__query["default_operator"] = default_operator
if df is not None:
__query["df"] = df
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if from_ is not None:
__query["from"] = from_
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if lenient is not None:
__query["lenient"] = lenient
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if q is not None:
__query["q"] = q
if refresh is not None:
__query["refresh"] = refresh
if request_cache is not None:
__query["request_cache"] = request_cache
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
if routing is not None:
__query["routing"] = routing
if scroll is not None:
__query["scroll"] = scroll
if scroll_size is not None:
__query["scroll_size"] = scroll_size
if search_timeout is not None:
__query["search_timeout"] = search_timeout
if search_type is not None:
__query["search_type"] = search_type
if slices is not None:
__query["slices"] = slices
if sort is not None:
__query["sort"] = sort
if stats is not None:
__query["stats"] = stats
if terminate_after is not None:
__query["terminate_after"] = terminate_after
if timeout is not None:
__query["timeout"] = timeout
if version is not None:
__query["version"] = version
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
if wait_for_completion is not None:
__query["wait_for_completion"] = wait_for_completion
if not __body:
if max_docs is not None:
__body["max_docs"] = max_docs
if query is not None:
__body["query"] = query
if slice is not None:
__body["slice"] = slice
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="delete_by_query",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def delete_by_query_rethrottle(
self,
*,
task_id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Throttle a delete by query operation.</p>
<p>Change the number of requests per second for a particular delete by query operation.
Rethrottling that speeds up the query takes effect immediately but rethrotting that slows down the query takes effect after completing the current batch to prevent scroll timeouts.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-delete-by-query-rethrottle>`_
:param task_id: The ID for the task.
:param requests_per_second: The throttle for this request in sub-requests per
second. To disable throttling, set it to `-1`.
"""
if task_id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'task_id'")
__path_parts: t.Dict[str, str] = {"task_id": _quote(task_id)}
__path = f'/_delete_by_query/{__path_parts["task_id"]}/_rethrottle'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
endpoint_id="delete_by_query_rethrottle",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def delete_script(
self,
*,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
master_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
pretty: t.Optional[bool] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Delete a script or search template.
Deletes a stored script or search template.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-delete-script>`_
:param id: The identifier for the stored script or search template.
:param master_timeout: The period to wait for a connection to the master node.
If no response is received before the timeout expires, the request fails
and returns an error. It can also be set to `-1` to indicate that the request
should never timeout.
:param timeout: The period to wait for a response. If no response is received
before the timeout expires, the request fails and returns an error. It can
also be set to `-1` to indicate that the request should never timeout.
"""
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"id": _quote(id)}
__path = f'/_scripts/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if master_timeout is not None:
__query["master_timeout"] = master_timeout
if pretty is not None:
__query["pretty"] = pretty
if timeout is not None:
__query["timeout"] = timeout
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"DELETE",
__path,
params=__query,
headers=__headers,
endpoint_id="delete_script",
path_parts=__path_parts,
)
@_rewrite_parameters(
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def exists(
self,
*,
index: str,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
stored_fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
) -> HeadApiResponse:
"""
.. raw:: html
<p>Check a document.</p>
<p>Verify that a document exists.
For example, check to see if a document with the <code>_id</code> 0 exists:</p>
<pre><code>HEAD my-index-000001/_doc/0
</code></pre>
<p>If the document exists, the API returns a status code of <code>200 - OK</code>.
If the document doesn’t exist, the API returns <code>404 - Not Found</code>.</p>
<p><strong>Versioning support</strong></p>
<p>You can use the <code>version</code> parameter to check the document only if its current version is equal to the specified one.</p>
<p>Internally, Elasticsearch has marked the old document as deleted and added an entirely new document.
The old version of the document doesn't disappear immediately, although you won't be able to access it.
Elasticsearch cleans up deleted documents in the background as you continue to index more data.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get>`_
:param index: A comma-separated list of data streams, indices, and aliases. It
supports wildcards (`*`).
:param id: A unique document identifier.
:param preference: The node or shard the operation should be performed on. By
default, the operation is randomized between the shard replicas. If it is
set to `_local`, the operation will prefer to be run on a local allocated
shard when possible. If it is set to a custom value, the value is used to
guarantee that the same shards will be used for the same custom value. This
can help with "jumping values" when hitting different shards in different
refresh states. A sample value can be something like the web session ID or
the user name.
:param realtime: If `true`, the request is real-time as opposed to near-real-time.
:param refresh: If `true`, the request refreshes the relevant shards before retrieving
the document. Setting it to `true` should be done after careful thought and
verification that this does not cause a heavy load on the system (and slow
down indexing).
:param routing: A custom value used to route operations to a specific shard.
:param source: Indicates whether to return the `_source` field (`true` or `false`)
or lists the fields to return.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter. If the `_source`
parameter is `false`, this parameter is ignored.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param stored_fields: A comma-separated list of stored fields to return as part
of a hit. If no fields are specified, no stored fields are included in the
response. If this field is specified, the `_source` parameter defaults to
`false`.
:param version: Explicit version number for concurrency control. The specified
version must match the current version of the document for the request to
succeed.
:param version_type: The version type.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_doc/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if stored_fields is not None:
__query["stored_fields"] = stored_fields
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"HEAD",
__path,
params=__query,
headers=__headers,
endpoint_id="exists",
path_parts=__path_parts,
)
@_rewrite_parameters(
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def exists_source(
self,
*,
index: str,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
) -> HeadApiResponse:
"""
.. raw:: html
<p>Check for a document source.</p>
<p>Check whether a document source exists in an index.
For example:</p>
<pre><code>HEAD my-index-000001/_source/1
</code></pre>
<p>A document's source is not available if it is disabled in the mapping.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get>`_
:param index: A comma-separated list of data streams, indices, and aliases. It
supports wildcards (`*`).
:param id: A unique identifier for the document.
:param preference: The node or shard the operation should be performed on. By
default, the operation is randomized between the shard replicas.
:param realtime: If `true`, the request is real-time as opposed to near-real-time.
:param refresh: If `true`, the request refreshes the relevant shards before retrieving
the document. Setting it to `true` should be done after careful thought and
verification that this does not cause a heavy load on the system (and slow
down indexing).
:param routing: A custom value used to route operations to a specific shard.
:param source: Indicates whether to return the `_source` field (`true` or `false`)
or lists the fields to return.
:param source_excludes: A comma-separated list of source fields to exclude in
the response.
:param source_includes: A comma-separated list of source fields to include in
the response.
:param version: The version number for concurrency control. It must match the
current version of the document for the request to succeed.
:param version_type: The version type.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_source/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"HEAD",
__path,
params=__query,
headers=__headers,
endpoint_id="exists_source",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("query",),
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def explain(
self,
*,
index: str,
id: str,
analyze_wildcard: t.Optional[bool] = None,
analyzer: t.Optional[str] = None,
default_operator: t.Optional[t.Union[str, t.Literal["and", "or"]]] = None,
df: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
lenient: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
q: t.Optional[str] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
stored_fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Explain a document match result.
Get information about why a specific document matches, or doesn't match, a query.
It computes a score explanation for a query and a specific document.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-explain>`_
:param index: Index names that are used to limit the request. Only a single index
name can be provided to this parameter.
:param id: The document identifier.
:param analyze_wildcard: If `true`, wildcard and prefix queries are analyzed.
This parameter can be used only when the `q` query string parameter is specified.
:param analyzer: The analyzer to use for the query string. This parameter can
be used only when the `q` query string parameter is specified.
:param default_operator: The default operator for query string query: `AND` or
`OR`. This parameter can be used only when the `q` query string parameter
is specified.
:param df: The field to use as default where no field prefix is given in the
query string. This parameter can be used only when the `q` query string parameter
is specified.
:param lenient: If `true`, format-based query failures (such as providing text
to a numeric field) in the query string will be ignored. This parameter can
be used only when the `q` query string parameter is specified.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param q: The query in the Lucene query string syntax.
:param query: Defines the search definition using the Query DSL.
:param routing: A custom value used to route operations to a specific shard.
:param source: `True` or `false` to return the `_source` field or not or a list
of fields to return.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter. If the `_source`
parameter is `false`, this parameter is ignored.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param stored_fields: A comma-separated list of stored fields to return in the
response.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_explain/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if analyze_wildcard is not None:
__query["analyze_wildcard"] = analyze_wildcard
if analyzer is not None:
__query["analyzer"] = analyzer
if default_operator is not None:
__query["default_operator"] = default_operator
if df is not None:
__query["df"] = df
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if lenient is not None:
__query["lenient"] = lenient
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if q is not None:
__query["q"] = q
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if stored_fields is not None:
__query["stored_fields"] = stored_fields
if not __body:
if query is not None:
__body["query"] = query
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="explain",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("fields", "index_filter", "runtime_mappings"),
)
async def field_caps(
self,
*,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
filters: t.Optional[str] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
include_empty_fields: t.Optional[bool] = None,
include_unmapped: t.Optional[bool] = None,
index_filter: t.Optional[t.Mapping[str, t.Any]] = None,
pretty: t.Optional[bool] = None,
runtime_mappings: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
types: t.Optional[t.Sequence[str]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get the field capabilities.</p>
<p>Get information about the capabilities of fields among multiple indices.</p>
<p>For data streams, the API returns field capabilities among the stream’s backing indices.
It returns runtime fields like any other field.
For example, a runtime field with a type of keyword is returned the same as any other field that belongs to the <code>keyword</code> family.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-field-caps>`_
:param index: A comma-separated list of data streams, indices, and aliases used
to limit the request. Supports wildcards (*). To target all data streams
and indices, omit this parameter or use * or _all.
:param allow_no_indices: If false, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with foo but no index starts with bar.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. Supports comma-separated
values, such as `open,hidden`.
:param fields: A list of fields to retrieve capabilities for. Wildcard (`*`)
expressions are supported.
:param filters: A comma-separated list of filters to apply to the response.
:param ignore_unavailable: If `true`, missing or closed indices are not included
in the response.
:param include_empty_fields: If false, empty fields are not included in the response.
:param include_unmapped: If true, unmapped fields are included in the response.
:param index_filter: Filter indices if the provided query rewrites to `match_none`
on every shard. IMPORTANT: The filtering is done on a best-effort basis,
it uses index statistics and mappings to rewrite queries to `match_none`
instead of fully running the request. For instance a range query over a date
field can rewrite to `match_none` if all documents within a shard (including
deleted documents) are outside of the provided range. However, not all queries
can rewrite to `match_none` so this API may return an index even if the provided
filter matches no document.
:param runtime_mappings: Define ad-hoc runtime fields in the request similar
to the way it is done in search requests. These fields exist only as part
of the query and take precedence over fields defined with the same name in
the index mappings.
:param types: A comma-separated list of field types to include. Any fields that
do not match one of these types will be excluded from the results. It defaults
to empty, meaning that all field types are returned.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_field_caps'
else:
__path_parts = {}
__path = "/_field_caps"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if filters is not None:
__query["filters"] = filters
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if include_empty_fields is not None:
__query["include_empty_fields"] = include_empty_fields
if include_unmapped is not None:
__query["include_unmapped"] = include_unmapped
if pretty is not None:
__query["pretty"] = pretty
if types is not None:
__query["types"] = types
if not __body:
if fields is not None:
__body["fields"] = fields
if index_filter is not None:
__body["index_filter"] = index_filter
if runtime_mappings is not None:
__body["runtime_mappings"] = runtime_mappings
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="field_caps",
path_parts=__path_parts,
)
@_rewrite_parameters(
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def get(
self,
*,
index: str,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
force_synthetic_source: t.Optional[bool] = None,
human: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
stored_fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get a document by its ID.</p>
<p>Get a document and its source or stored fields from an index.</p>
<p>By default, this API is realtime and is not affected by the refresh rate of the index (when data will become visible for search).
In the case where stored fields are requested with the <code>stored_fields</code> parameter and the document has been updated but is not yet refreshed, the API will have to parse and analyze the source to extract the stored fields.
To turn off realtime behavior, set the <code>realtime</code> parameter to false.</p>
<p><strong>Source filtering</strong></p>
<p>By default, the API returns the contents of the <code>_source</code> field unless you have used the <code>stored_fields</code> parameter or the <code>_source</code> field is turned off.
You can turn off <code>_source</code> retrieval by using the <code>_source</code> parameter:</p>
<pre><code>GET my-index-000001/_doc/0?_source=false
</code></pre>
<p>If you only need one or two fields from the <code>_source</code>, use the <code>_source_includes</code> or <code>_source_excludes</code> parameters to include or filter out particular fields.
This can be helpful with large documents where partial retrieval can save on network overhead
Both parameters take a comma separated list of fields or wildcard expressions.
For example:</p>
<pre><code>GET my-index-000001/_doc/0?_source_includes=*.id&_source_excludes=entities
</code></pre>
<p>If you only want to specify includes, you can use a shorter notation:</p>
<pre><code>GET my-index-000001/_doc/0?_source=*.id
</code></pre>
<p><strong>Routing</strong></p>
<p>If routing is used during indexing, the routing value also needs to be specified to retrieve a document.
For example:</p>
<pre><code>GET my-index-000001/_doc/2?routing=user1
</code></pre>
<p>This request gets the document with ID 2, but it is routed based on the user.
The document is not fetched if the correct routing is not specified.</p>
<p><strong>Distributed</strong></p>
<p>The GET operation is hashed into a specific shard ID.
It is then redirected to one of the replicas within that shard ID and returns the result.
The replicas are the primary shard and its replicas within that shard ID group.
This means that the more replicas you have, the better your GET scaling will be.</p>
<p><strong>Versioning support</strong></p>
<p>You can use the <code>version</code> parameter to retrieve the document only if its current version is equal to the specified one.</p>
<p>Internally, Elasticsearch has marked the old document as deleted and added an entirely new document.
The old version of the document doesn't disappear immediately, although you won't be able to access it.
Elasticsearch cleans up deleted documents in the background as you continue to index more data.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get>`_
:param index: The name of the index that contains the document.
:param id: A unique document identifier.
:param force_synthetic_source: Indicates whether the request forces synthetic
`_source`. Use this parameter to test if the mapping supports synthetic `_source`
and to get a sense of the worst case performance. Fetches with this parameter
enabled will be slower than enabling synthetic source natively in the index.
:param preference: The node or shard the operation should be performed on. By
default, the operation is randomized between the shard replicas. If it is
set to `_local`, the operation will prefer to be run on a local allocated
shard when possible. If it is set to a custom value, the value is used to
guarantee that the same shards will be used for the same custom value. This
can help with "jumping values" when hitting different shards in different
refresh states. A sample value can be something like the web session ID or
the user name.
:param realtime: If `true`, the request is real-time as opposed to near-real-time.
:param refresh: If `true`, the request refreshes the relevant shards before retrieving
the document. Setting it to `true` should be done after careful thought and
verification that this does not cause a heavy load on the system (and slow
down indexing).
:param routing: A custom value used to route operations to a specific shard.
:param source: Indicates whether to return the `_source` field (`true` or `false`)
or lists the fields to return.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter. If the `_source`
parameter is `false`, this parameter is ignored.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param stored_fields: A comma-separated list of stored fields to return as part
of a hit. If no fields are specified, no stored fields are included in the
response. If this field is specified, the `_source` parameter defaults to
`false`. Only leaf fields can be retrieved with the `stored_fields` option.
Object fields can't be returned; if specified, the request fails.
:param version: The version number for concurrency control. It must match the
current version of the document for the request to succeed.
:param version_type: The version type.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_doc/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if force_synthetic_source is not None:
__query["force_synthetic_source"] = force_synthetic_source
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if stored_fields is not None:
__query["stored_fields"] = stored_fields
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="get",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def get_script(
self,
*,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
master_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
pretty: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get a script or search template.
Retrieves a stored script or search template.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get-script>`_
:param id: The identifier for the stored script or search template.
:param master_timeout: The period to wait for the master node. If the master
node is not available before the timeout expires, the request fails and returns
an error. It can also be set to `-1` to indicate that the request should
never timeout.
"""
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"id": _quote(id)}
__path = f'/_scripts/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if master_timeout is not None:
__query["master_timeout"] = master_timeout
if pretty is not None:
__query["pretty"] = pretty
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="get_script",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def get_script_context(
self,
*,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get script contexts.</p>
<p>Get a list of supported script contexts and their methods.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get-script-context>`_
"""
__path_parts: t.Dict[str, str] = {}
__path = "/_script_context"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="get_script_context",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def get_script_languages(
self,
*,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get script languages.</p>
<p>Get a list of available script types, languages, and contexts.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get-script-languages>`_
"""
__path_parts: t.Dict[str, str] = {}
__path = "/_script_language"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="get_script_languages",
path_parts=__path_parts,
)
@_rewrite_parameters(
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def get_source(
self,
*,
index: str,
id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get a document's source.</p>
<p>Get the source of a document.
For example:</p>
<pre><code>GET my-index-000001/_source/1
</code></pre>
<p>You can use the source filtering parameters to control which parts of the <code>_source</code> are returned:</p>
<pre><code>GET my-index-000001/_source/1/?_source_includes=*.id&_source_excludes=entities
</code></pre>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-get>`_
:param index: The name of the index that contains the document.
:param id: A unique document identifier.
:param preference: The node or shard the operation should be performed on. By
default, the operation is randomized between the shard replicas.
:param realtime: If `true`, the request is real-time as opposed to near-real-time.
:param refresh: If `true`, the request refreshes the relevant shards before retrieving
the document. Setting it to `true` should be done after careful thought and
verification that this does not cause a heavy load on the system (and slow
down indexing).
:param routing: A custom value used to route operations to a specific shard.
:param source: Indicates whether to return the `_source` field (`true` or `false`)
or lists the fields to return.
:param source_excludes: A comma-separated list of source fields to exclude in
the response.
:param source_includes: A comma-separated list of source fields to include in
the response.
:param version: The version number for concurrency control. It must match the
current version of the document for the request to succeed.
:param version_type: The version type.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_source/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="get_source",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def health_report(
self,
*,
feature: t.Optional[t.Union[str, t.Sequence[str]]] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
size: t.Optional[int] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
verbose: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get the cluster health.
Get a report with the health status of an Elasticsearch cluster.
The report contains a list of indicators that compose Elasticsearch functionality.</p>
<p>Each indicator has a health status of: green, unknown, yellow or red.
The indicator will provide an explanation and metadata describing the reason for its current health status.</p>
<p>The cluster’s status is controlled by the worst indicator status.</p>
<p>In the event that an indicator’s status is non-green, a list of impacts may be present in the indicator result which detail the functionalities that are negatively affected by the health issue.
Each impact carries with it a severity level, an area of the system that is affected, and a simple description of the impact on the system.</p>
<p>Some health indicators can determine the root cause of a health problem and prescribe a set of steps that can be performed in order to improve the health of the system.
The root cause and remediation steps are encapsulated in a diagnosis.
A diagnosis contains a cause detailing a root cause analysis, an action containing a brief description of the steps to take to fix the problem, the list of affected resources (if applicable), and a detailed step-by-step troubleshooting guide to fix the diagnosed problem.</p>
<p>NOTE: The health indicators perform root cause analysis of non-green health statuses. This can be computationally expensive when called frequently.
When setting up automated polling of the API for health status, set verbose to false to disable the more expensive analysis logic.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-health-report>`_
:param feature: A feature of the cluster, as returned by the top-level health
report API.
:param size: Limit the number of affected resources the health report API returns.
:param timeout: Explicit operation timeout.
:param verbose: Opt-in for more information about the health of the system.
"""
__path_parts: t.Dict[str, str]
if feature not in SKIP_IN_PATH:
__path_parts = {"feature": _quote(feature)}
__path = f'/_health_report/{__path_parts["feature"]}'
else:
__path_parts = {}
__path = "/_health_report"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if size is not None:
__query["size"] = size
if timeout is not None:
__query["timeout"] = timeout
if verbose is not None:
__query["verbose"] = verbose
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="health_report",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_name="document",
)
async def index(
self,
*,
index: str,
document: t.Optional[t.Mapping[str, t.Any]] = None,
body: t.Optional[t.Mapping[str, t.Any]] = None,
id: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
if_primary_term: t.Optional[int] = None,
if_seq_no: t.Optional[int] = None,
include_source_on_error: t.Optional[bool] = None,
op_type: t.Optional[t.Union[str, t.Literal["create", "index"]]] = None,
pipeline: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[
t.Union[bool, str, t.Literal["false", "true", "wait_for"]]
] = None,
require_alias: t.Optional[bool] = None,
require_data_stream: t.Optional[bool] = None,
routing: t.Optional[str] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Create or update a document in an index.</p>
<p>Add a JSON document to the specified data stream or index and make it searchable.
If the target is an index and the document already exists, the request updates the document and increments its version.</p>
<p>NOTE: You cannot use this API to send update requests for existing documents in a data stream.</p>
<p>If the Elasticsearch security features are enabled, you must have the following index privileges for the target data stream, index, or index alias:</p>
<ul>
<li>To add or overwrite a document using the <code>PUT /<target>/_doc/<_id></code> request format, you must have the <code>create</code>, <code>index</code>, or <code>write</code> index privilege.</li>
<li>To add a document using the <code>POST /<target>/_doc/</code> request format, you must have the <code>create_doc</code>, <code>create</code>, <code>index</code>, or <code>write</code> index privilege.</li>
<li>To automatically create a data stream or index with this API request, you must have the <code>auto_configure</code>, <code>create_index</code>, or <code>manage</code> index privilege.</li>
</ul>
<p>Automatic data stream creation requires a matching index template with data stream enabled.</p>
<p>NOTE: Replica shards might not all be started when an indexing operation returns successfully.
By default, only the primary is required. Set <code>wait_for_active_shards</code> to change this default behavior.</p>
<p><strong>Automatically create data streams and indices</strong></p>
<p>If the request's target doesn't exist and matches an index template with a <code>data_stream</code> definition, the index operation automatically creates the data stream.</p>
<p>If the target doesn't exist and doesn't match a data stream template, the operation automatically creates the index and applies any matching index templates.</p>
<p>NOTE: Elasticsearch includes several built-in index templates. To avoid naming collisions with these templates, refer to index pattern documentation.</p>
<p>If no mapping exists, the index operation creates a dynamic mapping.
By default, new fields and objects are automatically added to the mapping if needed.</p>
<p>Automatic index creation is controlled by the <code>action.auto_create_index</code> setting.
If it is <code>true</code>, any index can be created automatically.
You can modify this setting to explicitly allow or block automatic creation of indices that match specified patterns or set it to <code>false</code> to turn off automatic index creation entirely.
Specify a comma-separated list of patterns you want to allow or prefix each pattern with <code>+</code> or <code>-</code> to indicate whether it should be allowed or blocked.
When a list is specified, the default behaviour is to disallow.</p>
<p>NOTE: The <code>action.auto_create_index</code> setting affects the automatic creation of indices only.
It does not affect the creation of data streams.</p>
<p><strong>Optimistic concurrency control</strong></p>
<p>Index operations can be made conditional and only be performed if the last modification to the document was assigned the sequence number and primary term specified by the <code>if_seq_no</code> and <code>if_primary_term</code> parameters.
If a mismatch is detected, the operation will result in a <code>VersionConflictException</code> and a status code of <code>409</code>.</p>
<p><strong>Routing</strong></p>
<p>By default, shard placement — or routing — is controlled by using a hash of the document's ID value.
For more explicit control, the value fed into the hash function used by the router can be directly specified on a per-operation basis using the <code>routing</code> parameter.</p>
<p>When setting up explicit mapping, you can also use the <code>_routing</code> field to direct the index operation to extract the routing value from the document itself.
This does come at the (very minimal) cost of an additional document parsing pass.
If the <code>_routing</code> mapping is defined and set to be required, the index operation will fail if no routing value is provided or extracted.</p>
<p>NOTE: Data streams do not support custom routing unless they were created with the <code>allow_custom_routing</code> setting enabled in the template.</p>
<p><strong>Distributed</strong></p>
<p>The index operation is directed to the primary shard based on its route and performed on the actual node containing this shard.
After the primary shard completes the operation, if needed, the update is distributed to applicable replicas.</p>
<p><strong>Active shards</strong></p>
<p>To improve the resiliency of writes to the system, indexing operations can be configured to wait for a certain number of active shard copies before proceeding with the operation.
If the requisite number of active shard copies are not available, then the write operation must wait and retry, until either the requisite shard copies have started or a timeout occurs.
By default, write operations only wait for the primary shards to be active before proceeding (that is to say <code>wait_for_active_shards</code> is <code>1</code>).
This default can be overridden in the index settings dynamically by setting <code>index.write.wait_for_active_shards</code>.
To alter this behavior per operation, use the <code>wait_for_active_shards request</code> parameter.</p>
<p>Valid values are all or any positive integer up to the total number of configured copies per shard in the index (which is <code>number_of_replicas</code>+1).
Specifying a negative value or a number greater than the number of shard copies will throw an error.</p>
<p>For example, suppose you have a cluster of three nodes, A, B, and C and you create an index index with the number of replicas set to 3 (resulting in 4 shard copies, one more copy than there are nodes).
If you attempt an indexing operation, by default the operation will only ensure the primary copy of each shard is available before proceeding.
This means that even if B and C went down and A hosted the primary shard copies, the indexing operation would still proceed with only one copy of the data.
If <code>wait_for_active_shards</code> is set on the request to <code>3</code> (and all three nodes are up), the indexing operation will require 3 active shard copies before proceeding.
This requirement should be met because there are 3 active nodes in the cluster, each one holding a copy of the shard.
However, if you set <code>wait_for_active_shards</code> to <code>all</code> (or to <code>4</code>, which is the same in this situation), the indexing operation will not proceed as you do not have all 4 copies of each shard active in the index.
The operation will timeout unless a new node is brought up in the cluster to host the fourth copy of the shard.</p>
<p>It is important to note that this setting greatly reduces the chances of the write operation not writing to the requisite number of shard copies, but it does not completely eliminate the possibility, because this check occurs before the write operation starts.
After the write operation is underway, it is still possible for replication to fail on any number of shard copies but still succeed on the primary.
The <code>_shards</code> section of the API response reveals the number of shard copies on which replication succeeded and failed.</p>
<p><strong>No operation (noop) updates</strong></p>
<p>When updating a document by using this API, a new version of the document is always created even if the document hasn't changed.
If this isn't acceptable use the <code>_update</code> API with <code>detect_noop</code> set to <code>true</code>.
The <code>detect_noop</code> option isn't available on this API because it doesn’t fetch the old source and isn't able to compare it against the new source.</p>
<p>There isn't a definitive rule for when noop updates aren't acceptable.
It's a combination of lots of factors like how frequently your data source sends updates that are actually noops and how many queries per second Elasticsearch runs on the shard receiving the updates.</p>
<p><strong>Versioning</strong></p>
<p>Each indexed document is given a version number.
By default, internal versioning is used that starts at 1 and increments with each update, deletes included.
Optionally, the version number can be set to an external value (for example, if maintained in a database).
To enable this functionality, <code>version_type</code> should be set to <code>external</code>.
The value provided must be a numeric, long value greater than or equal to 0, and less than around <code>9.2e+18</code>.</p>
<p>NOTE: Versioning is completely real time, and is not affected by the near real time aspects of search operations.
If no version is provided, the operation runs without any version checks.</p>
<p>When using the external version type, the system checks to see if the version number passed to the index request is greater than the version of the currently stored document.
If true, the document will be indexed and the new version number used.
If the value provided is less than or equal to the stored document's version number, a version conflict will occur and the index operation will fail. For example:</p>
<pre><code>PUT my-index-000001/_doc/1?version=2&version_type=external
{
"user": {
"id": "elkbee"
}
}
In this example, the operation will succeed since the supplied version of 2 is higher than the current document version of 1.
If the document was already updated and its version was set to 2 or higher, the indexing command will fail and result in a conflict (409 HTTP status code).
A nice side effect is that there is no need to maintain strict ordering of async indexing operations run as a result of changes to a source database, as long as version numbers from the source database are used.
Even the simple case of updating the Elasticsearch index using data from a database is simplified if external versioning is used, as only the latest version will be used if the index operations arrive out of order.
</code></pre>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-create>`_
:param index: The name of the data stream or index to target. If the target doesn't
exist and matches the name or wildcard (`*`) pattern of an index template
with a `data_stream` definition, this request creates the data stream. If
the target doesn't exist and doesn't match a data stream template, this request
creates the index. You can check for existing targets with the resolve index
API.
:param document:
:param id: A unique identifier for the document. To automatically generate a
document ID, use the `POST /<target>/_doc/` request format and omit this
parameter.
:param if_primary_term: Only perform the operation if the document has this primary
term.
:param if_seq_no: Only perform the operation if the document has this sequence
number.
:param include_source_on_error: True or false if to include the document source
in the error message in case of parsing errors.
:param op_type: Set to `create` to only index the document if it does not already
exist (put if absent). If a document with the specified `_id` already exists,
the indexing operation will fail. The behavior is the same as using the `<index>/_create`
endpoint. If a document ID is specified, this paramater defaults to `index`.
Otherwise, it defaults to `create`. If the request targets a data stream,
an `op_type` of `create` is required.
:param pipeline: The ID of the pipeline to use to preprocess incoming documents.
If the index has a default ingest pipeline specified, then setting the value
to `_none` disables the default ingest pipeline for this request. If a final
pipeline is configured it will always run, regardless of the value of this
parameter.
:param refresh: If `true`, Elasticsearch refreshes the affected shards to make
this operation visible to search. If `wait_for`, it waits for a refresh to
make this operation visible to search. If `false`, it does nothing with refreshes.
:param require_alias: If `true`, the destination must be an index alias.
:param require_data_stream: If `true`, the request's actions must target a data
stream (existing or to be created).
:param routing: A custom value that is used to route operations to a specific
shard.
:param timeout: The period the request waits for the following operations: automatic
index creation, dynamic mapping updates, waiting for active shards. This
parameter is useful for situations where the primary shard assigned to perform
the operation might not be available when the operation runs. Some reasons
for this might be that the primary shard is currently recovering from a gateway
or undergoing relocation. By default, the operation will wait on the primary
shard to become available for at least 1 minute before failing and responding
with an error. The actual wait time could be longer, particularly when multiple
waits occur.
:param version: An explicit version number for concurrency control. It must be
a non-negative long number.
:param version_type: The version type.
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. You can set it to `all` or any positive
integer up to the total number of shards in the index (`number_of_replicas+1`).
The default value of `1` means it waits for each primary shard to be active.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if document is None and body is None:
raise ValueError(
"Empty value passed for parameters 'document' and 'body', one of them should be set."
)
elif document is not None and body is not None:
raise ValueError("Cannot set both 'document' and 'body'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH and id not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_doc/{__path_parts["id"]}'
__method = "PUT"
elif index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_doc'
__method = "POST"
else:
raise ValueError("Couldn't find a path for the given parameters")
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if if_primary_term is not None:
__query["if_primary_term"] = if_primary_term
if if_seq_no is not None:
__query["if_seq_no"] = if_seq_no
if include_source_on_error is not None:
__query["include_source_on_error"] = include_source_on_error
if op_type is not None:
__query["op_type"] = op_type
if pipeline is not None:
__query["pipeline"] = pipeline
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if require_alias is not None:
__query["require_alias"] = require_alias
if require_data_stream is not None:
__query["require_data_stream"] = require_data_stream
if routing is not None:
__query["routing"] = routing
if timeout is not None:
__query["timeout"] = timeout
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
__body = document if document is not None else body
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
__method,
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="index",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def info(
self,
*,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get cluster info.
Get basic build, version, and cluster information.
::: In Serverless, this API is retained for backward compatibility only. Some response fields, such as the version number, should be ignored.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/group/endpoint-info>`_
"""
__path_parts: t.Dict[str, str] = {}
__path = "/"
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"GET",
__path,
params=__query,
headers=__headers,
endpoint_id="info",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("docs", "ids"),
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def mget(
self,
*,
index: t.Optional[str] = None,
docs: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
force_synthetic_source: t.Optional[bool] = None,
human: t.Optional[bool] = None,
ids: t.Optional[t.Union[str, t.Sequence[str]]] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
routing: t.Optional[str] = None,
source: t.Optional[t.Union[bool, t.Union[str, t.Sequence[str]]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
stored_fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get multiple documents.</p>
<p>Get multiple JSON documents by ID from one or more indices.
If you specify an index in the request URI, you only need to specify the document IDs in the request body.
To ensure fast responses, this multi get (mget) API responds with partial results if one or more shards fail.</p>
<p><strong>Filter source fields</strong></p>
<p>By default, the <code>_source</code> field is returned for every document (if stored).
Use the <code>_source</code> and <code>_source_include</code> or <code>source_exclude</code> attributes to filter what fields are returned for a particular document.
You can include the <code>_source</code>, <code>_source_includes</code>, and <code>_source_excludes</code> query parameters in the request URI to specify the defaults to use when there are no per-document instructions.</p>
<p><strong>Get stored fields</strong></p>
<p>Use the <code>stored_fields</code> attribute to specify the set of stored fields you want to retrieve.
Any requested fields that are not stored are ignored.
You can include the <code>stored_fields</code> query parameter in the request URI to specify the defaults to use when there are no per-document instructions.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-mget>`_
:param index: Name of the index to retrieve documents from when `ids` are specified,
or when a document in the `docs` array does not specify an index.
:param docs: The documents you want to retrieve. Required if no index is specified
in the request URI.
:param force_synthetic_source: Should this request force synthetic _source? Use
this to test if the mapping supports synthetic _source and to get a sense
of the worst case performance. Fetches with this enabled will be slower the
enabling synthetic source natively in the index.
:param ids: The IDs of the documents you want to retrieve. Allowed when the index
is specified in the request URI.
:param preference: Specifies the node or shard the operation should be performed
on. Random by default.
:param realtime: If `true`, the request is real-time as opposed to near-real-time.
:param refresh: If `true`, the request refreshes relevant shards before retrieving
documents.
:param routing: Custom value used to route operations to a specific shard.
:param source: True or false to return the `_source` field or not, or a list
of fields to return.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param stored_fields: If `true`, retrieves the document fields stored in the
index rather than the document `_source`.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_mget'
else:
__path_parts = {}
__path = "/_mget"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if force_synthetic_source is not None:
__query["force_synthetic_source"] = force_synthetic_source
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if refresh is not None:
__query["refresh"] = refresh
if routing is not None:
__query["routing"] = routing
if source is not None:
__query["_source"] = source
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if stored_fields is not None:
__query["stored_fields"] = stored_fields
if not __body:
if docs is not None:
__body["docs"] = docs
if ids is not None:
__body["ids"] = ids
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="mget",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_name="searches",
)
async def msearch(
self,
*,
searches: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
body: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
ccs_minimize_roundtrips: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ignore_throttled: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
include_named_queries_score: t.Optional[bool] = None,
max_concurrent_searches: t.Optional[int] = None,
max_concurrent_shard_requests: t.Optional[int] = None,
pre_filter_shard_size: t.Optional[int] = None,
pretty: t.Optional[bool] = None,
rest_total_hits_as_int: t.Optional[bool] = None,
routing: t.Optional[str] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
typed_keys: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run multiple searches.</p>
<p>The format of the request is similar to the bulk API format and makes use of the newline delimited JSON (NDJSON) format.
The structure is as follows:</p>
<pre><code>header\\n
body\\n
header\\n
body\\n
</code></pre>
<p>This structure is specifically optimized to reduce parsing if a specific search ends up redirected to another node.</p>
<p>IMPORTANT: The final line of data must end with a newline character <code>\\n</code>.
Each newline character may be preceded by a carriage return <code>\\r</code>.
When sending requests to this endpoint the <code>Content-Type</code> header should be set to <code>application/x-ndjson</code>.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-msearch>`_
:param searches:
:param index: Comma-separated list of data streams, indices, and index aliases
to search.
:param allow_no_indices: If false, the request returns an error if any wildcard
expression, index alias, or _all value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting foo*,bar* returns an error if an index starts
with foo but no index starts with bar.
:param ccs_minimize_roundtrips: If true, network roundtrips between the coordinating
node and remote clusters are minimized for cross-cluster search requests.
:param expand_wildcards: Type of index that wildcard expressions can match. If
the request can target data streams, this argument determines whether wildcard
expressions match hidden data streams.
:param ignore_throttled: If true, concrete, expanded or aliased indices are ignored
when frozen.
:param ignore_unavailable: If true, missing or closed indices are not included
in the response.
:param include_named_queries_score: Indicates whether hit.matched_queries should
be rendered as a map that includes the name of the matched query associated
with its score (true) or as an array containing the name of the matched queries
(false) This functionality reruns each named query on every hit in a search
response. Typically, this adds a small overhead to a request. However, using
computationally expensive named queries on a large number of hits may add
significant overhead.
:param max_concurrent_searches: Maximum number of concurrent searches the multi
search API can execute. Defaults to `max(1, (# of data nodes * min(search
thread pool size, 10)))`.
:param max_concurrent_shard_requests: Maximum number of concurrent shard requests
that each sub-search request executes per node.
:param pre_filter_shard_size: Defines a threshold that enforces a pre-filter
roundtrip to prefilter search shards based on query rewriting if the number
of shards the search request expands to exceeds the threshold. This filter
roundtrip can limit the number of shards significantly if for instance a
shard can not match any documents based on its rewrite method i.e., if date
filters are mandatory to match but the shard bounds and the query are disjoint.
:param rest_total_hits_as_int: If true, hits.total are returned as an integer
in the response. Defaults to false, which returns an object.
:param routing: Custom routing value used to route search operations to a specific
shard.
:param search_type: Indicates whether global term and document frequencies should
be used when scoring returned documents.
:param typed_keys: Specifies whether aggregation and suggester names should be
prefixed by their respective types in the response.
"""
if searches is None and body is None:
raise ValueError(
"Empty value passed for parameters 'searches' and 'body', one of them should be set."
)
elif searches is not None and body is not None:
raise ValueError("Cannot set both 'searches' and 'body'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_msearch'
else:
__path_parts = {}
__path = "/_msearch"
__query: t.Dict[str, t.Any] = {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if ccs_minimize_roundtrips is not None:
__query["ccs_minimize_roundtrips"] = ccs_minimize_roundtrips
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_throttled is not None:
__query["ignore_throttled"] = ignore_throttled
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if include_named_queries_score is not None:
__query["include_named_queries_score"] = include_named_queries_score
if max_concurrent_searches is not None:
__query["max_concurrent_searches"] = max_concurrent_searches
if max_concurrent_shard_requests is not None:
__query["max_concurrent_shard_requests"] = max_concurrent_shard_requests
if pre_filter_shard_size is not None:
__query["pre_filter_shard_size"] = pre_filter_shard_size
if pretty is not None:
__query["pretty"] = pretty
if rest_total_hits_as_int is not None:
__query["rest_total_hits_as_int"] = rest_total_hits_as_int
if routing is not None:
__query["routing"] = routing
if search_type is not None:
__query["search_type"] = search_type
if typed_keys is not None:
__query["typed_keys"] = typed_keys
__body = searches if searches is not None else body
__headers = {
"accept": "application/json",
"content-type": "application/x-ndjson",
}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="msearch",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_name="search_templates",
)
async def msearch_template(
self,
*,
search_templates: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
body: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
ccs_minimize_roundtrips: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
max_concurrent_searches: t.Optional[int] = None,
pretty: t.Optional[bool] = None,
rest_total_hits_as_int: t.Optional[bool] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
typed_keys: t.Optional[bool] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run multiple templated searches.</p>
<p>Run multiple templated searches with a single request.
If you are providing a text file or text input to <code>curl</code>, use the <code>--data-binary</code> flag instead of <code>-d</code> to preserve newlines.
For example:</p>
<pre><code>$ cat requests
{ "index": "my-index" }
{ "id": "my-search-template", "params": { "query_string": "hello world", "from": 0, "size": 10 }}
{ "index": "my-other-index" }
{ "id": "my-other-search-template", "params": { "query_type": "match_all" }}
$ curl -H "Content-Type: application/x-ndjson" -XGET localhost:9200/_msearch/template --data-binary "@requests"; echo
</code></pre>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-msearch-template>`_
:param search_templates:
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams and indices,
omit this parameter or use `*`.
:param ccs_minimize_roundtrips: If `true`, network round-trips are minimized
for cross-cluster search requests.
:param max_concurrent_searches: The maximum number of concurrent searches the
API can run.
:param rest_total_hits_as_int: If `true`, the response returns `hits.total` as
an integer. If `false`, it returns `hits.total` as an object.
:param search_type: The type of the search operation.
:param typed_keys: If `true`, the response prefixes aggregation and suggester
names with their respective types.
"""
if search_templates is None and body is None:
raise ValueError(
"Empty value passed for parameters 'search_templates' and 'body', one of them should be set."
)
elif search_templates is not None and body is not None:
raise ValueError("Cannot set both 'search_templates' and 'body'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_msearch/template'
else:
__path_parts = {}
__path = "/_msearch/template"
__query: t.Dict[str, t.Any] = {}
if ccs_minimize_roundtrips is not None:
__query["ccs_minimize_roundtrips"] = ccs_minimize_roundtrips
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if max_concurrent_searches is not None:
__query["max_concurrent_searches"] = max_concurrent_searches
if pretty is not None:
__query["pretty"] = pretty
if rest_total_hits_as_int is not None:
__query["rest_total_hits_as_int"] = rest_total_hits_as_int
if search_type is not None:
__query["search_type"] = search_type
if typed_keys is not None:
__query["typed_keys"] = typed_keys
__body = search_templates if search_templates is not None else body
__headers = {
"accept": "application/json",
"content-type": "application/x-ndjson",
}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="msearch_template",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("docs", "ids"),
)
async def mtermvectors(
self,
*,
index: t.Optional[str] = None,
docs: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
error_trace: t.Optional[bool] = None,
field_statistics: t.Optional[bool] = None,
fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ids: t.Optional[t.Sequence[str]] = None,
offsets: t.Optional[bool] = None,
payloads: t.Optional[bool] = None,
positions: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
routing: t.Optional[str] = None,
term_statistics: t.Optional[bool] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get multiple term vectors.</p>
<p>Get multiple term vectors with a single request.
You can specify existing documents by index and ID or provide artificial documents in the body of the request.
You can specify the index in the request body or request URI.
The response contains a <code>docs</code> array with all the fetched termvectors.
Each element has the structure provided by the termvectors API.</p>
<p><strong>Artificial documents</strong></p>
<p>You can also use <code>mtermvectors</code> to generate term vectors for artificial documents provided in the body of the request.
The mapping used is determined by the specified <code>_index</code>.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-mtermvectors>`_
:param index: The name of the index that contains the documents.
:param docs: An array of existing or artificial documents.
:param field_statistics: If `true`, the response includes the document count,
sum of document frequencies, and sum of total term frequencies.
:param fields: A comma-separated list or wildcard expressions of fields to include
in the statistics. It is used as the default list unless a specific field
list is provided in the `completion_fields` or `fielddata_fields` parameters.
:param ids: A simplified syntax to specify documents by their ID if they're in
the same index.
:param offsets: If `true`, the response includes term offsets.
:param payloads: If `true`, the response includes term payloads.
:param positions: If `true`, the response includes term positions.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param realtime: If true, the request is real-time as opposed to near-real-time.
:param routing: A custom value used to route operations to a specific shard.
:param term_statistics: If true, the response includes term frequency and document
frequency.
:param version: If `true`, returns the document version as part of a hit.
:param version_type: The version type.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_mtermvectors'
else:
__path_parts = {}
__path = "/_mtermvectors"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if field_statistics is not None:
__query["field_statistics"] = field_statistics
if fields is not None:
__query["fields"] = fields
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if offsets is not None:
__query["offsets"] = offsets
if payloads is not None:
__query["payloads"] = payloads
if positions is not None:
__query["positions"] = positions
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if routing is not None:
__query["routing"] = routing
if term_statistics is not None:
__query["term_statistics"] = term_statistics
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
if not __body:
if docs is not None:
__body["docs"] = docs
if ids is not None:
__body["ids"] = ids
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="mtermvectors",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("index_filter",),
)
async def open_point_in_time(
self,
*,
index: t.Union[str, t.Sequence[str]],
keep_alive: t.Union[str, t.Literal[-1], t.Literal[0]],
allow_partial_search_results: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
index_filter: t.Optional[t.Mapping[str, t.Any]] = None,
max_concurrent_shard_requests: t.Optional[int] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
routing: t.Optional[str] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Open a point in time.</p>
<p>A search request by default runs against the most recent visible data of the target indices,
which is called point in time. Elasticsearch pit (point in time) is a lightweight view into the
state of the data as it existed when initiated. In some cases, it’s preferred to perform multiple
search requests using the same point in time. For example, if refreshes happen between
<code>search_after</code> requests, then the results of those requests might not be consistent as changes happening
between searches are only visible to the more recent point in time.</p>
<p>A point in time must be opened explicitly before being used in search requests.</p>
<p>A subsequent search request with the <code>pit</code> parameter must not specify <code>index</code>, <code>routing</code>, or <code>preference</code> values as these parameters are copied from the point in time.</p>
<p>Just like regular searches, you can use <code>from</code> and <code>size</code> to page through point in time search results, up to the first 10,000 hits.
If you want to retrieve more hits, use PIT with <code>search_after</code>.</p>
<p>IMPORTANT: The open point in time request and each subsequent search request can return different identifiers; always use the most recently received ID for the next search request.</p>
<p>When a PIT that contains shard failures is used in a search request, the missing are always reported in the search response as a <code>NoShardAvailableActionException</code> exception.
To get rid of these exceptions, a new PIT needs to be created so that shards missing from the previous PIT can be handled, assuming they become available in the meantime.</p>
<p><strong>Keeping point in time alive</strong></p>
<p>The <code>keep_alive</code> parameter, which is passed to a open point in time request and search request, extends the time to live of the corresponding point in time.
The value does not need to be long enough to process all data — it just needs to be long enough for the next request.</p>
<p>Normally, the background merge process optimizes the index by merging together smaller segments to create new, bigger segments.
Once the smaller segments are no longer needed they are deleted.
However, open point-in-times prevent the old segments from being deleted since they are still in use.</p>
<p>TIP: Keeping older segments alive means that more disk space and file handles are needed.
Ensure that you have configured your nodes to have ample free file handles.</p>
<p>Additionally, if a segment contains deleted or updated documents then the point in time must keep track of whether each document in the segment was live at the time of the initial search request.
Ensure that your nodes have sufficient heap space if you have many open point-in-times on an index that is subject to ongoing deletes or updates.
Note that a point-in-time doesn't prevent its associated indices from being deleted.
You can check how many point-in-times (that is, search contexts) are open with the nodes stats API.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-open-point-in-time>`_
:param index: A comma-separated list of index names to open point in time; use
`_all` or empty string to perform the operation on all indices
:param keep_alive: Extend the length of time that the point in time persists.
:param allow_partial_search_results: Indicates whether the point in time tolerates
unavailable shards or shard failures when initially creating the PIT. If
`false`, creating a point in time request when a shard is missing or unavailable
will throw an exception. If `true`, the point in time will contain all the
shards that are available at the time of the request.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. It supports comma-separated
values, such as `open,hidden`.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param index_filter: Filter indices if the provided query rewrites to `match_none`
on every shard.
:param max_concurrent_shard_requests: Maximum number of concurrent shard requests
that each sub-search request executes per node.
:param preference: The node or shard the operation should be performed on. By
default, it is random.
:param routing: A custom value that is used to route operations to a specific
shard.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if keep_alive is None and body is None:
raise ValueError("Empty value passed for parameter 'keep_alive'")
__path_parts: t.Dict[str, str] = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_pit'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if keep_alive is not None:
__query["keep_alive"] = keep_alive
if allow_partial_search_results is not None:
__query["allow_partial_search_results"] = allow_partial_search_results
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if max_concurrent_shard_requests is not None:
__query["max_concurrent_shard_requests"] = max_concurrent_shard_requests
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if routing is not None:
__query["routing"] = routing
if not __body:
if index_filter is not None:
__body["index_filter"] = index_filter
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="open_point_in_time",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("script",),
)
async def put_script(
self,
*,
id: str,
script: t.Optional[t.Mapping[str, t.Any]] = None,
context: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
master_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
pretty: t.Optional[bool] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Create or update a script or search template.
Creates or updates a stored script or search template.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-put-script>`_
:param id: The identifier for the stored script or search template. It must be
unique within the cluster.
:param script: The script or search template, its parameters, and its language.
:param context: The context in which the script or search template should run.
To prevent errors, the API immediately compiles the script or template in
this context.
:param master_timeout: The period to wait for a connection to the master node.
If no response is received before the timeout expires, the request fails
and returns an error. It can also be set to `-1` to indicate that the request
should never timeout.
:param timeout: The period to wait for a response. If no response is received
before the timeout expires, the request fails and returns an error. It can
also be set to `-1` to indicate that the request should never timeout.
"""
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
if script is None and body is None:
raise ValueError("Empty value passed for parameter 'script'")
__path_parts: t.Dict[str, str]
if id not in SKIP_IN_PATH and context not in SKIP_IN_PATH:
__path_parts = {"id": _quote(id), "context": _quote(context)}
__path = f'/_scripts/{__path_parts["id"]}/{__path_parts["context"]}'
elif id not in SKIP_IN_PATH:
__path_parts = {"id": _quote(id)}
__path = f'/_scripts/{__path_parts["id"]}'
else:
raise ValueError("Couldn't find a path for the given parameters")
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if master_timeout is not None:
__query["master_timeout"] = master_timeout
if pretty is not None:
__query["pretty"] = pretty
if timeout is not None:
__query["timeout"] = timeout
if not __body:
if script is not None:
__body["script"] = script
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"PUT",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="put_script",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("requests", "metric"),
)
async def rank_eval(
self,
*,
requests: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
metric: t.Optional[t.Mapping[str, t.Any]] = None,
pretty: t.Optional[bool] = None,
search_type: t.Optional[str] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Evaluate ranked search results.</p>
<p>Evaluate the quality of ranked search results over a set of typical search queries.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-rank-eval>`_
:param requests: A set of typical search requests, together with their provided
ratings.
:param index: A comma-separated list of data streams, indices, and index aliases
used to limit the request. Wildcard (`*`) expressions are supported. To target
all data streams and indices in a cluster, omit this parameter or use `_all`
or `*`.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param expand_wildcards: Whether to expand wildcard expression to concrete indices
that are open, closed or both.
:param ignore_unavailable: If `true`, missing or closed indices are not included
in the response.
:param metric: Definition of the evaluation metric to calculate.
:param search_type: Search operation type
"""
if requests is None and body is None:
raise ValueError("Empty value passed for parameter 'requests'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_rank_eval'
else:
__path_parts = {}
__path = "/_rank_eval"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if pretty is not None:
__query["pretty"] = pretty
if search_type is not None:
__query["search_type"] = search_type
if not __body:
if requests is not None:
__body["requests"] = requests
if metric is not None:
__body["metric"] = metric
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="rank_eval",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("dest", "source", "conflicts", "max_docs", "script", "size"),
)
async def reindex(
self,
*,
dest: t.Optional[t.Mapping[str, t.Any]] = None,
source: t.Optional[t.Mapping[str, t.Any]] = None,
conflicts: t.Optional[t.Union[str, t.Literal["abort", "proceed"]]] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
max_docs: t.Optional[int] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
require_alias: t.Optional[bool] = None,
script: t.Optional[t.Mapping[str, t.Any]] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
size: t.Optional[int] = None,
slices: t.Optional[t.Union[int, t.Union[str, t.Literal["auto"]]]] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
wait_for_completion: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Reindex documents.</p>
<p>Copy documents from a source to a destination.
You can copy all documents to the destination index or reindex a subset of the documents.
The source can be any existing index, alias, or data stream.
The destination must differ from the source.
For example, you cannot reindex a data stream into itself.</p>
<p>IMPORTANT: Reindex requires <code>_source</code> to be enabled for all documents in the source.
The destination should be configured as wanted before calling the reindex API.
Reindex does not copy the settings from the source or its associated template.
Mappings, shard counts, and replicas, for example, must be configured ahead of time.</p>
<p>If the Elasticsearch security features are enabled, you must have the following security privileges:</p>
<ul>
<li>The <code>read</code> index privilege for the source data stream, index, or alias.</li>
<li>The <code>write</code> index privilege for the destination data stream, index, or index alias.</li>
<li>To automatically create a data stream or index with a reindex API request, you must have the <code>auto_configure</code>, <code>create_index</code>, or <code>manage</code> index privilege for the destination data stream, index, or alias.</li>
<li>If reindexing from a remote cluster, the <code>source.remote.user</code> must have the <code>monitor</code> cluster privilege and the <code>read</code> index privilege for the source data stream, index, or alias.</li>
</ul>
<p>If reindexing from a remote cluster, you must explicitly allow the remote host in the <code>reindex.remote.whitelist</code> setting.
Automatic data stream creation requires a matching index template with data stream enabled.</p>
<p>The <code>dest</code> element can be configured like the index API to control optimistic concurrency control.
Omitting <code>version_type</code> or setting it to <code>internal</code> causes Elasticsearch to blindly dump documents into the destination, overwriting any that happen to have the same ID.</p>
<p>Setting <code>version_type</code> to <code>external</code> causes Elasticsearch to preserve the <code>version</code> from the source, create any documents that are missing, and update any documents that have an older version in the destination than they do in the source.</p>
<p>Setting <code>op_type</code> to <code>create</code> causes the reindex API to create only missing documents in the destination.
All existing documents will cause a version conflict.</p>
<p>IMPORTANT: Because data streams are append-only, any reindex request to a destination data stream must have an <code>op_type</code> of <code>create</code>.
A reindex can only add new documents to a destination data stream.
It cannot update existing documents in a destination data stream.</p>
<p>By default, version conflicts abort the reindex process.
To continue reindexing if there are conflicts, set the <code>conflicts</code> request body property to <code>proceed</code>.
In this case, the response includes a count of the version conflicts that were encountered.
Note that the handling of other error types is unaffected by the <code>conflicts</code> property.
Additionally, if you opt to count version conflicts, the operation could attempt to reindex more documents from the source than <code>max_docs</code> until it has successfully indexed <code>max_docs</code> documents into the target or it has gone through every document in the source query.</p>
<p>Refer to the linked documentation for examples of how to reindex documents.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-reindex>`_
:param dest: The destination you are copying to.
:param source: The source you are copying from.
:param conflicts: Indicates whether to continue reindexing even when there are
conflicts.
:param max_docs: The maximum number of documents to reindex. By default, all
documents are reindexed. If it is a value less then or equal to `scroll_size`,
a scroll will not be used to retrieve the results for the operation. If `conflicts`
is set to `proceed`, the reindex operation could attempt to reindex more
documents from the source than `max_docs` until it has successfully indexed
`max_docs` documents into the target or it has gone through every document
in the source query.
:param refresh: If `true`, the request refreshes affected shards to make this
operation visible to search.
:param requests_per_second: The throttle for this request in sub-requests per
second. By default, there is no throttle.
:param require_alias: If `true`, the destination must be an index alias.
:param script: The script to run to update the document source or metadata when
reindexing.
:param scroll: The period of time that a consistent view of the index should
be maintained for scrolled search.
:param size:
:param slices: The number of slices this task should be divided into. It defaults
to one slice, which means the task isn't sliced into subtasks. Reindex supports
sliced scroll to parallelize the reindexing process. This parallelization
can improve efficiency and provide a convenient way to break the request
down into smaller parts. NOTE: Reindexing from remote clusters does not support
manual or automatic slicing. If set to `auto`, Elasticsearch chooses the
number of slices to use. This setting will use one slice per shard, up to
a certain limit. If there are multiple sources, it will choose the number
of slices based on the index or backing index with the smallest number of
shards.
:param timeout: The period each indexing waits for automatic index creation,
dynamic mapping updates, and waiting for active shards. By default, Elasticsearch
waits for at least one minute before failing. The actual wait time could
be longer, particularly when multiple waits occur.
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. Set it to `all` or any positive integer
up to the total number of shards in the index (`number_of_replicas+1`). The
default value is one, which means it waits for each primary shard to be active.
:param wait_for_completion: If `true`, the request blocks until the operation
is complete.
"""
if dest is None and body is None:
raise ValueError("Empty value passed for parameter 'dest'")
if source is None and body is None:
raise ValueError("Empty value passed for parameter 'source'")
__path_parts: t.Dict[str, str] = {}
__path = "/_reindex"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
if require_alias is not None:
__query["require_alias"] = require_alias
if scroll is not None:
__query["scroll"] = scroll
if slices is not None:
__query["slices"] = slices
if timeout is not None:
__query["timeout"] = timeout
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
if wait_for_completion is not None:
__query["wait_for_completion"] = wait_for_completion
if not __body:
if dest is not None:
__body["dest"] = dest
if source is not None:
__body["source"] = source
if conflicts is not None:
__body["conflicts"] = conflicts
if max_docs is not None:
__body["max_docs"] = max_docs
if script is not None:
__body["script"] = script
if size is not None:
__body["size"] = size
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="reindex",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def reindex_rethrottle(
self,
*,
task_id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Throttle a reindex operation.</p>
<p>Change the number of requests per second for a particular reindex operation.
For example:</p>
<pre><code>POST _reindex/r1A2WoRbTwKZ516z6NEs5A:36619/_rethrottle?requests_per_second=-1
</code></pre>
<p>Rethrottling that speeds up the query takes effect immediately.
Rethrottling that slows down the query will take effect after completing the current batch.
This behavior prevents scroll timeouts.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-reindex>`_
:param task_id: The task identifier, which can be found by using the tasks API.
:param requests_per_second: The throttle for this request in sub-requests per
second. It can be either `-1` to turn off throttling or any decimal number
like `1.7` or `12` to throttle to that level.
"""
if task_id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'task_id'")
__path_parts: t.Dict[str, str] = {"task_id": _quote(task_id)}
__path = f'/_reindex/{__path_parts["task_id"]}/_rethrottle'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
endpoint_id="reindex_rethrottle",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("file", "params", "source"),
ignore_deprecated_options={"params"},
)
async def render_search_template(
self,
*,
id: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
file: t.Optional[str] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
params: t.Optional[t.Mapping[str, t.Any]] = None,
pretty: t.Optional[bool] = None,
source: t.Optional[t.Union[str, t.Mapping[str, t.Any]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Render a search template.</p>
<p>Render a search template as a search request body.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-render-search-template>`_
:param id: The ID of the search template to render. If no `source` is specified,
this or the `id` request body parameter is required.
:param file:
:param params: Key-value pairs used to replace Mustache variables in the template.
The key is the variable name. The value is the variable value.
:param source: An inline search template. It supports the same parameters as
the search API's request body. These parameters also support Mustache variables.
If no `id` or `<templated-id>` is specified, this parameter is required.
"""
__path_parts: t.Dict[str, str]
if id not in SKIP_IN_PATH:
__path_parts = {"id": _quote(id)}
__path = f'/_render/template/{__path_parts["id"]}'
else:
__path_parts = {}
__path = "/_render/template"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if file is not None:
__body["file"] = file
if params is not None:
__body["params"] = params
if source is not None:
__body["source"] = source
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="render_search_template",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("context", "context_setup", "script"),
)
@_stability_warning(Stability.EXPERIMENTAL)
async def scripts_painless_execute(
self,
*,
context: t.Optional[
t.Union[
str,
t.Literal[
"boolean_field",
"composite_field",
"date_field",
"double_field",
"filter",
"geo_point_field",
"ip_field",
"keyword_field",
"long_field",
"painless_test",
"score",
],
]
] = None,
context_setup: t.Optional[t.Mapping[str, t.Any]] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
script: t.Optional[t.Mapping[str, t.Any]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run a script.</p>
<p>Runs a script and returns a result.
Use this API to build and test scripts, such as when defining a script for a runtime field.
This API requires very few dependencies and is especially useful if you don't have permissions to write documents on a cluster.</p>
<p>The API uses several <em>contexts</em>, which control how scripts are run, what variables are available at runtime, and what the return type is.</p>
<p>Each context requires a script, but additional parameters depend on the context you're using for that script.</p>
`<https://www.elastic.co/docs/reference/scripting-languages/painless/painless-api-examples>`_
:param context: The context that the script should run in. NOTE: Result ordering
in the field contexts is not guaranteed.
:param context_setup: Additional parameters for the `context`. NOTE: This parameter
is required for all contexts except `painless_test`, which is the default
if no value is provided for `context`.
:param script: The Painless script to run.
"""
__path_parts: t.Dict[str, str] = {}
__path = "/_scripts/painless/_execute"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if context is not None:
__body["context"] = context
if context_setup is not None:
__body["context_setup"] = context_setup
if script is not None:
__body["script"] = script
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="scripts_painless_execute",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("scroll_id", "scroll"),
)
async def scroll(
self,
*,
scroll_id: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
rest_total_hits_as_int: t.Optional[bool] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run a scrolling search.</p>
<p>IMPORTANT: The scroll API is no longer recommend for deep pagination. If you need to preserve the index state while paging through more than 10,000 hits, use the <code>search_after</code> parameter with a point in time (PIT).</p>
<p>The scroll API gets large sets of results from a single scrolling search request.
To get the necessary scroll ID, submit a search API request that includes an argument for the <code>scroll</code> query parameter.
The <code>scroll</code> parameter indicates how long Elasticsearch should retain the search context for the request.
The search response returns a scroll ID in the <code>_scroll_id</code> response body parameter.
You can then use the scroll ID with the scroll API to retrieve the next batch of results for the request.
If the Elasticsearch security features are enabled, the access to the results of a specific scroll ID is restricted to the user or API key that submitted the search.</p>
<p>You can also use the scroll API to specify a new scroll parameter that extends or shortens the retention period for the search context.</p>
<p>IMPORTANT: Results from a scrolling search reflect the state of the index at the time of the initial search request. Subsequent indexing or document changes only affect later search and scroll requests.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-scroll>`_
:param scroll_id: The scroll ID of the search.
:param rest_total_hits_as_int: If true, the API response’s hit.total property
is returned as an integer. If false, the API response’s hit.total property
is returned as an object.
:param scroll: The period to retain the search context for scrolling.
"""
if scroll_id is None and body is None:
raise ValueError("Empty value passed for parameter 'scroll_id'")
__path_parts: t.Dict[str, str] = {}
__path = "/_search/scroll"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if rest_total_hits_as_int is not None:
__query["rest_total_hits_as_int"] = rest_total_hits_as_int
if not __body:
if scroll_id is not None:
__body["scroll_id"] = scroll_id
if scroll is not None:
__body["scroll"] = scroll
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="scroll",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=(
"aggregations",
"aggs",
"collapse",
"docvalue_fields",
"explain",
"ext",
"fields",
"from_",
"highlight",
"indices_boost",
"knn",
"min_score",
"pit",
"post_filter",
"profile",
"query",
"rank",
"rescore",
"retriever",
"runtime_mappings",
"script_fields",
"search_after",
"seq_no_primary_term",
"size",
"slice",
"sort",
"source",
"stats",
"stored_fields",
"suggest",
"terminate_after",
"timeout",
"track_scores",
"track_total_hits",
"version",
),
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
"from": "from_",
},
)
async def search(
self,
*,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
aggregations: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
aggs: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
allow_no_indices: t.Optional[bool] = None,
allow_partial_search_results: t.Optional[bool] = None,
analyze_wildcard: t.Optional[bool] = None,
analyzer: t.Optional[str] = None,
batched_reduce_size: t.Optional[int] = None,
ccs_minimize_roundtrips: t.Optional[bool] = None,
collapse: t.Optional[t.Mapping[str, t.Any]] = None,
default_operator: t.Optional[t.Union[str, t.Literal["and", "or"]]] = None,
df: t.Optional[str] = None,
docvalue_fields: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
explain: t.Optional[bool] = None,
ext: t.Optional[t.Mapping[str, t.Any]] = None,
fields: t.Optional[t.Sequence[t.Mapping[str, t.Any]]] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
force_synthetic_source: t.Optional[bool] = None,
from_: t.Optional[int] = None,
highlight: t.Optional[t.Mapping[str, t.Any]] = None,
human: t.Optional[bool] = None,
ignore_throttled: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
include_named_queries_score: t.Optional[bool] = None,
indices_boost: t.Optional[t.Sequence[t.Mapping[str, float]]] = None,
knn: t.Optional[
t.Union[t.Mapping[str, t.Any], t.Sequence[t.Mapping[str, t.Any]]]
] = None,
lenient: t.Optional[bool] = None,
max_concurrent_shard_requests: t.Optional[int] = None,
min_score: t.Optional[float] = None,
pit: t.Optional[t.Mapping[str, t.Any]] = None,
post_filter: t.Optional[t.Mapping[str, t.Any]] = None,
pre_filter_shard_size: t.Optional[int] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
profile: t.Optional[bool] = None,
q: t.Optional[str] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
rank: t.Optional[t.Mapping[str, t.Any]] = None,
request_cache: t.Optional[bool] = None,
rescore: t.Optional[
t.Union[t.Mapping[str, t.Any], t.Sequence[t.Mapping[str, t.Any]]]
] = None,
rest_total_hits_as_int: t.Optional[bool] = None,
retriever: t.Optional[t.Mapping[str, t.Any]] = None,
routing: t.Optional[str] = None,
runtime_mappings: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
script_fields: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
search_after: t.Optional[
t.Sequence[t.Union[None, bool, float, int, str]]
] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
seq_no_primary_term: t.Optional[bool] = None,
size: t.Optional[int] = None,
slice: t.Optional[t.Mapping[str, t.Any]] = None,
sort: t.Optional[
t.Union[
t.Sequence[t.Union[str, t.Mapping[str, t.Any]]],
t.Union[str, t.Mapping[str, t.Any]],
]
] = None,
source: t.Optional[t.Union[bool, t.Mapping[str, t.Any]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
stats: t.Optional[t.Sequence[str]] = None,
stored_fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
suggest: t.Optional[t.Mapping[str, t.Any]] = None,
suggest_field: t.Optional[str] = None,
suggest_mode: t.Optional[
t.Union[str, t.Literal["always", "missing", "popular"]]
] = None,
suggest_size: t.Optional[int] = None,
suggest_text: t.Optional[str] = None,
terminate_after: t.Optional[int] = None,
timeout: t.Optional[str] = None,
track_scores: t.Optional[bool] = None,
track_total_hits: t.Optional[t.Union[bool, int]] = None,
typed_keys: t.Optional[bool] = None,
version: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run a search.</p>
<p>Get search hits that match the query defined in the request.
You can provide search queries using the <code>q</code> query string parameter or the request body.
If both are specified, only the query parameter is used.</p>
<p>If the Elasticsearch security features are enabled, you must have the read index privilege for the target data stream, index, or alias. For cross-cluster search, refer to the documentation about configuring CCS privileges.
To search a point in time (PIT) for an alias, you must have the <code>read</code> index privilege for the alias's data streams or indices.</p>
<p><strong>Search slicing</strong></p>
<p>When paging through a large number of documents, it can be helpful to split the search into multiple slices to consume them independently with the <code>slice</code> and <code>pit</code> properties.
By default the splitting is done first on the shards, then locally on each shard.
The local splitting partitions the shard into contiguous ranges based on Lucene document IDs.</p>
<p>For instance if the number of shards is equal to 2 and you request 4 slices, the slices 0 and 2 are assigned to the first shard and the slices 1 and 3 are assigned to the second shard.</p>
<p>IMPORTANT: The same point-in-time ID should be used for all slices.
If different PIT IDs are used, slices can overlap and miss documents.
This situation can occur because the splitting criterion is based on Lucene document IDs, which are not stable across changes to the index.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-search>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams and indices,
omit this parameter or use `*` or `_all`.
:param aggregations: Defines the aggregations that are run as part of the search
request.
:param aggs: Defines the aggregations that are run as part of the search request.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param allow_partial_search_results: If `true` and there are shard request timeouts
or shard failures, the request returns partial results. If `false`, it returns
an error with no partial results. To override the default behavior, you can
set the `search.default_allow_partial_results` cluster setting to `false`.
:param analyze_wildcard: If `true`, wildcard and prefix queries are analyzed.
This parameter can be used only when the `q` query string parameter is specified.
:param analyzer: The analyzer to use for the query string. This parameter can
be used only when the `q` query string parameter is specified.
:param batched_reduce_size: The number of shard results that should be reduced
at once on the coordinating node. If the potential number of shards in the
request can be large, this value should be used as a protection mechanism
to reduce the memory overhead per search request.
:param ccs_minimize_roundtrips: If `true`, network round-trips between the coordinating
node and the remote clusters are minimized when running cross-cluster search
(CCS) requests.
:param collapse: Collapses search results the values of the specified field.
:param default_operator: The default operator for the query string query: `AND`
or `OR`. This parameter can be used only when the `q` query string parameter
is specified.
:param df: The field to use as a default when no field prefix is given in the
query string. This parameter can be used only when the `q` query string parameter
is specified.
:param docvalue_fields: An array of wildcard (`*`) field patterns. The request
returns doc values for field names matching these patterns in the `hits.fields`
property of the response.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. It supports comma-separated
values such as `open,hidden`.
:param explain: If `true`, the request returns detailed information about score
computation as part of a hit.
:param ext: Configuration of search extensions defined by Elasticsearch plugins.
:param fields: An array of wildcard (`*`) field patterns. The request returns
values for field names matching these patterns in the `hits.fields` property
of the response.
:param force_synthetic_source: Should this request force synthetic _source? Use
this to test if the mapping supports synthetic _source and to get a sense
of the worst case performance. Fetches with this enabled will be slower the
enabling synthetic source natively in the index.
:param from_: The starting document offset, which must be non-negative. By default,
you cannot page through more than 10,000 hits using the `from` and `size`
parameters. To page through more hits, use the `search_after` parameter.
:param highlight: Specifies the highlighter to use for retrieving highlighted
snippets from one or more fields in your search results.
:param ignore_throttled: If `true`, concrete, expanded or aliased indices will
be ignored when frozen.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param include_named_queries_score: If `true`, the response includes the score
contribution from any named queries. This functionality reruns each named
query on every hit in a search response. Typically, this adds a small overhead
to a request. However, using computationally expensive named queries on a
large number of hits may add significant overhead.
:param indices_boost: Boost the `_score` of documents from specified indices.
The boost value is the factor by which scores are multiplied. A boost value
greater than `1.0` increases the score. A boost value between `0` and `1.0`
decreases the score.
:param knn: The approximate kNN search to run.
:param lenient: If `true`, format-based query failures (such as providing text
to a numeric field) in the query string will be ignored. This parameter can
be used only when the `q` query string parameter is specified.
:param max_concurrent_shard_requests: The number of concurrent shard requests
per node that the search runs concurrently. This value should be used to
limit the impact of the search on the cluster in order to limit the number
of concurrent shard requests.
:param min_score: The minimum `_score` for matching documents. Documents with
a lower `_score` are not included in search results and results collected
by aggregations.
:param pit: Limit the search to a point in time (PIT). If you provide a PIT,
you cannot specify an `<index>` in the request path.
:param post_filter: Use the `post_filter` parameter to filter search results.
The search hits are filtered after the aggregations are calculated. A post
filter has no impact on the aggregation results.
:param pre_filter_shard_size: A threshold that enforces a pre-filter roundtrip
to prefilter search shards based on query rewriting if the number of shards
the search request expands to exceeds the threshold. This filter roundtrip
can limit the number of shards significantly if for instance a shard can
not match any documents based on its rewrite method (if date filters are
mandatory to match but the shard bounds and the query are disjoint). When
unspecified, the pre-filter phase is executed if any of these conditions
is met: * The request targets more than 128 shards. * The request targets
one or more read-only index. * The primary sort of the query targets an indexed
field.
:param preference: The nodes and shards used for the search. By default, Elasticsearch
selects from eligible nodes and shards using adaptive replica selection,
accounting for allocation awareness. Valid values are: * `_only_local` to
run the search only on shards on the local node. * `_local` to, if possible,
run the search on shards on the local node, or if not, select shards using
the default method. * `_only_nodes:<node-id>,<node-id>` to run the search
on only the specified nodes IDs. If suitable shards exist on more than one
selected node, use shards on those nodes using the default method. If none
of the specified nodes are available, select shards from any available node
using the default method. * `_prefer_nodes:<node-id>,<node-id>` to if possible,
run the search on the specified nodes IDs. If not, select shards using the
default method. * `_shards:<shard>,<shard>` to run the search only on the
specified shards. You can combine this value with other `preference` values.
However, the `_shards` value must come first. For example: `_shards:2,3|_local`.
* `<custom-string>` (any string that does not start with `_`) to route searches
with the same `<custom-string>` to the same shards in the same order.
:param profile: Set to `true` to return detailed timing information about the
execution of individual components in a search request. NOTE: This is a debugging
tool and adds significant overhead to search execution.
:param q: A query in the Lucene query string syntax. Query parameter searches
do not support the full Elasticsearch Query DSL but are handy for testing.
IMPORTANT: This parameter overrides the query parameter in the request body.
If both parameters are specified, documents matching the query request body
parameter are not returned.
:param query: The search definition using the Query DSL.
:param rank: The Reciprocal Rank Fusion (RRF) to use.
:param request_cache: If `true`, the caching of search results is enabled for
requests where `size` is `0`. It defaults to index level settings.
:param rescore: Can be used to improve precision by reordering just the top (for
example 100 - 500) documents returned by the `query` and `post_filter` phases.
:param rest_total_hits_as_int: Indicates whether `hits.total` should be rendered
as an integer or an object in the rest search response.
:param retriever: A retriever is a specification to describe top documents returned
from a search. A retriever replaces other elements of the search API that
also return top documents such as `query` and `knn`.
:param routing: A custom value that is used to route operations to a specific
shard.
:param runtime_mappings: One or more runtime fields in the search request. These
fields take precedence over mapped fields with the same name.
:param script_fields: Retrieve a script evaluation (based on different fields)
for each hit.
:param scroll: The period to retain the search context for scrolling. By default,
this value cannot exceed `1d` (24 hours). You can change this limit by using
the `search.max_keep_alive` cluster-level setting.
:param search_after: Used to retrieve the next page of hits using a set of sort
values from the previous page.
:param search_type: Indicates how distributed term frequencies are calculated
for relevance scoring.
:param seq_no_primary_term: If `true`, the request returns sequence number and
primary term of the last modification of each hit.
:param size: The number of hits to return, which must not be negative. By default,
you cannot page through more than 10,000 hits using the `from` and `size`
parameters. To page through more hits, use the `search_after` property.
:param slice: Split a scrolled search into multiple slices that can be consumed
independently.
:param sort: A comma-separated list of <field>:<direction> pairs.
:param source: The source fields that are returned for matching documents. These
fields are returned in the `hits._source` property of the search response.
If the `stored_fields` property is specified, the `_source` property defaults
to `false`. Otherwise, it defaults to `true`.
:param source_excludes: A comma-separated list of source fields to exclude from
the response. You can also use this parameter to exclude fields from the
subset specified in `_source_includes` query parameter. If the `_source`
parameter is `false`, this parameter is ignored.
:param source_includes: A comma-separated list of source fields to include in
the response. If this parameter is specified, only these source fields are
returned. You can exclude fields from this subset using the `_source_excludes`
query parameter. If the `_source` parameter is `false`, this parameter is
ignored.
:param stats: The stats groups to associate with the search. Each group maintains
a statistics aggregation for its associated searches. You can retrieve these
stats using the indices stats API.
:param stored_fields: A comma-separated list of stored fields to return as part
of a hit. If no fields are specified, no stored fields are included in the
response. If this field is specified, the `_source` property defaults to
`false`. You can pass `_source: true` to return both source fields and stored
fields in the search response.
:param suggest: Defines a suggester that provides similar looking terms based
on a provided text.
:param suggest_field: The field to use for suggestions.
:param suggest_mode: The suggest mode. This parameter can be used only when the
`suggest_field` and `suggest_text` query string parameters are specified.
:param suggest_size: The number of suggestions to return. This parameter can
be used only when the `suggest_field` and `suggest_text` query string parameters
are specified.
:param suggest_text: The source text for which the suggestions should be returned.
This parameter can be used only when the `suggest_field` and `suggest_text`
query string parameters are specified.
:param terminate_after: The maximum number of documents to collect for each shard.
If a query reaches this limit, Elasticsearch terminates the query early.
Elasticsearch collects documents before sorting. IMPORTANT: Use with caution.
Elasticsearch applies this property to each shard handling the request. When
possible, let Elasticsearch perform early termination automatically. Avoid
specifying this property for requests that target data streams with backing
indices across multiple data tiers. If set to `0` (default), the query does
not terminate early.
:param timeout: The period of time to wait for a response from each shard. If
no response is received before the timeout expires, the request fails and
returns an error. Defaults to no timeout.
:param track_scores: If `true`, calculate and return document scores, even if
the scores are not used for sorting.
:param track_total_hits: Number of hits matching the query to count accurately.
If `true`, the exact number of hits is returned at the cost of some performance.
If `false`, the response does not include the total number of hits matching
the query.
:param typed_keys: If `true`, aggregation and suggester names are be prefixed
by their respective types in the response.
:param version: If `true`, the request returns the document version as part of
a hit.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_search'
else:
__path_parts = {}
__path = "/_search"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
# The 'sort' parameter with a colon can't be encoded to the body.
if sort is not None and (
(isinstance(sort, str) and ":" in sort)
or (
isinstance(sort, (list, tuple))
and all(isinstance(_x, str) for _x in sort)
and any(":" in _x for _x in sort)
)
):
__query["sort"] = sort
sort = None
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if allow_partial_search_results is not None:
__query["allow_partial_search_results"] = allow_partial_search_results
if analyze_wildcard is not None:
__query["analyze_wildcard"] = analyze_wildcard
if analyzer is not None:
__query["analyzer"] = analyzer
if batched_reduce_size is not None:
__query["batched_reduce_size"] = batched_reduce_size
if ccs_minimize_roundtrips is not None:
__query["ccs_minimize_roundtrips"] = ccs_minimize_roundtrips
if default_operator is not None:
__query["default_operator"] = default_operator
if df is not None:
__query["df"] = df
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if force_synthetic_source is not None:
__query["force_synthetic_source"] = force_synthetic_source
if human is not None:
__query["human"] = human
if ignore_throttled is not None:
__query["ignore_throttled"] = ignore_throttled
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if include_named_queries_score is not None:
__query["include_named_queries_score"] = include_named_queries_score
if lenient is not None:
__query["lenient"] = lenient
if max_concurrent_shard_requests is not None:
__query["max_concurrent_shard_requests"] = max_concurrent_shard_requests
if pre_filter_shard_size is not None:
__query["pre_filter_shard_size"] = pre_filter_shard_size
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if q is not None:
__query["q"] = q
if request_cache is not None:
__query["request_cache"] = request_cache
if rest_total_hits_as_int is not None:
__query["rest_total_hits_as_int"] = rest_total_hits_as_int
if routing is not None:
__query["routing"] = routing
if scroll is not None:
__query["scroll"] = scroll
if search_type is not None:
__query["search_type"] = search_type
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if suggest_field is not None:
__query["suggest_field"] = suggest_field
if suggest_mode is not None:
__query["suggest_mode"] = suggest_mode
if suggest_size is not None:
__query["suggest_size"] = suggest_size
if suggest_text is not None:
__query["suggest_text"] = suggest_text
if typed_keys is not None:
__query["typed_keys"] = typed_keys
if not __body:
if aggregations is not None:
__body["aggregations"] = aggregations
if aggs is not None:
__body["aggs"] = aggs
if collapse is not None:
__body["collapse"] = collapse
if docvalue_fields is not None:
__body["docvalue_fields"] = docvalue_fields
if explain is not None:
__body["explain"] = explain
if ext is not None:
__body["ext"] = ext
if fields is not None:
__body["fields"] = fields
if from_ is not None:
__body["from"] = from_
if highlight is not None:
__body["highlight"] = highlight
if indices_boost is not None:
__body["indices_boost"] = indices_boost
if knn is not None:
__body["knn"] = knn
if min_score is not None:
__body["min_score"] = min_score
if pit is not None:
__body["pit"] = pit
if post_filter is not None:
__body["post_filter"] = post_filter
if profile is not None:
__body["profile"] = profile
if query is not None:
__body["query"] = query
if rank is not None:
__body["rank"] = rank
if rescore is not None:
__body["rescore"] = rescore
if retriever is not None:
__body["retriever"] = retriever
if runtime_mappings is not None:
__body["runtime_mappings"] = runtime_mappings
if script_fields is not None:
__body["script_fields"] = script_fields
if search_after is not None:
__body["search_after"] = search_after
if seq_no_primary_term is not None:
__body["seq_no_primary_term"] = seq_no_primary_term
if size is not None:
__body["size"] = size
if slice is not None:
__body["slice"] = slice
if sort is not None:
__body["sort"] = sort
if source is not None:
__body["_source"] = source
if stats is not None:
__body["stats"] = stats
if stored_fields is not None:
__body["stored_fields"] = stored_fields
if suggest is not None:
__body["suggest"] = suggest
if terminate_after is not None:
__body["terminate_after"] = terminate_after
if timeout is not None:
__body["timeout"] = timeout
if track_scores is not None:
__body["track_scores"] = track_scores
if track_total_hits is not None:
__body["track_total_hits"] = track_total_hits
if version is not None:
__body["version"] = version
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="search",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=(
"aggs",
"buffer",
"exact_bounds",
"extent",
"fields",
"grid_agg",
"grid_precision",
"grid_type",
"query",
"runtime_mappings",
"size",
"sort",
"track_total_hits",
"with_labels",
),
)
async def search_mvt(
self,
*,
index: t.Union[str, t.Sequence[str]],
field: str,
zoom: int,
x: int,
y: int,
aggs: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
buffer: t.Optional[int] = None,
error_trace: t.Optional[bool] = None,
exact_bounds: t.Optional[bool] = None,
extent: t.Optional[int] = None,
fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
grid_agg: t.Optional[t.Union[str, t.Literal["geohex", "geotile"]]] = None,
grid_precision: t.Optional[int] = None,
grid_type: t.Optional[
t.Union[str, t.Literal["centroid", "grid", "point"]]
] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
runtime_mappings: t.Optional[t.Mapping[str, t.Mapping[str, t.Any]]] = None,
size: t.Optional[int] = None,
sort: t.Optional[
t.Union[
t.Sequence[t.Union[str, t.Mapping[str, t.Any]]],
t.Union[str, t.Mapping[str, t.Any]],
]
] = None,
track_total_hits: t.Optional[t.Union[bool, int]] = None,
with_labels: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> BinaryApiResponse:
"""
.. raw:: html
<p>Search a vector tile.</p>
<p>Search a vector tile for geospatial values.
Before using this API, you should be familiar with the Mapbox vector tile specification.
The API returns results as a binary mapbox vector tile.</p>
<p>Internally, Elasticsearch translates a vector tile search API request into a search containing:</p>
<ul>
<li>A <code>geo_bounding_box</code> query on the <code><field></code>. The query uses the <code><zoom>/<x>/<y></code> tile as a bounding box.</li>
<li>A <code>geotile_grid</code> or <code>geohex_grid</code> aggregation on the <code><field></code>. The <code>grid_agg</code> parameter determines the aggregation type. The aggregation uses the <code><zoom>/<x>/<y></code> tile as a bounding box.</li>
<li>Optionally, a <code>geo_bounds</code> aggregation on the <code><field></code>. The search only includes this aggregation if the <code>exact_bounds</code> parameter is <code>true</code>.</li>
<li>If the optional parameter <code>with_labels</code> is <code>true</code>, the internal search will include a dynamic runtime field that calls the <code>getLabelPosition</code> function of the geometry doc value. This enables the generation of new point features containing suggested geometry labels, so that, for example, multi-polygons will have only one label.</li>
</ul>
<p>The API returns results as a binary Mapbox vector tile.
Mapbox vector tiles are encoded as Google Protobufs (PBF). By default, the tile contains three layers:</p>
<ul>
<li>A <code>hits</code> layer containing a feature for each <code><field></code> value matching the <code>geo_bounding_box</code> query.</li>
<li>An <code>aggs</code> layer containing a feature for each cell of the <code>geotile_grid</code> or <code>geohex_grid</code>. The layer only contains features for cells with matching data.</li>
<li>A meta layer containing:
<ul>
<li>A feature containing a bounding box. By default, this is the bounding box of the tile.</li>
<li>Value ranges for any sub-aggregations on the <code>geotile_grid</code> or <code>geohex_grid</code>.</li>
<li>Metadata for the search.</li>
</ul>
</li>
</ul>
<p>The API only returns features that can display at its zoom level.
For example, if a polygon feature has no area at its zoom level, the API omits it.
The API returns errors as UTF-8 encoded JSON.</p>
<p>IMPORTANT: You can specify several options for this API as either a query parameter or request body parameter.
If you specify both parameters, the query parameter takes precedence.</p>
<p><strong>Grid precision for geotile</strong></p>
<p>For a <code>grid_agg</code> of <code>geotile</code>, you can use cells in the <code>aggs</code> layer as tiles for lower zoom levels.
<code>grid_precision</code> represents the additional zoom levels available through these cells. The final precision is computed by as follows: <code><zoom> + grid_precision</code>.
For example, if <code><zoom></code> is 7 and <code>grid_precision</code> is 8, then the <code>geotile_grid</code> aggregation will use a precision of 15.
The maximum final precision is 29.
The <code>grid_precision</code> also determines the number of cells for the grid as follows: <code>(2^grid_precision) x (2^grid_precision)</code>.
For example, a value of 8 divides the tile into a grid of 256 x 256 cells.
The <code>aggs</code> layer only contains features for cells with matching data.</p>
<p><strong>Grid precision for geohex</strong></p>
<p>For a <code>grid_agg</code> of <code>geohex</code>, Elasticsearch uses <code><zoom></code> and <code>grid_precision</code> to calculate a final precision as follows: <code><zoom> + grid_precision</code>.</p>
<p>This precision determines the H3 resolution of the hexagonal cells produced by the <code>geohex</code> aggregation.
The following table maps the H3 resolution for each precision.
For example, if <code><zoom></code> is 3 and <code>grid_precision</code> is 3, the precision is 6.
At a precision of 6, hexagonal cells have an H3 resolution of 2.
If <code><zoom></code> is 3 and <code>grid_precision</code> is 4, the precision is 7.
At a precision of 7, hexagonal cells have an H3 resolution of 3.</p>
<table>
<thead>
<tr>
<th>Precision</th>
<th>Unique tile bins</th>
<th>H3 resolution</th>
<th>Unique hex bins</th>
<th>Ratio</th>
</tr>
</thead>
<tbody>
<tr>
<td>1</td>
<td>4</td>
<td>0</td>
<td>122</td>
<td>30.5</td>
</tr>
<tr>
<td>2</td>
<td>16</td>
<td>0</td>
<td>122</td>
<td>7.625</td>
</tr>
<tr>
<td>3</td>
<td>64</td>
<td>1</td>
<td>842</td>
<td>13.15625</td>
</tr>
<tr>
<td>4</td>
<td>256</td>
<td>1</td>
<td>842</td>
<td>3.2890625</td>
</tr>
<tr>
<td>5</td>
<td>1024</td>
<td>2</td>
<td>5882</td>
<td>5.744140625</td>
</tr>
<tr>
<td>6</td>
<td>4096</td>
<td>2</td>
<td>5882</td>
<td>1.436035156</td>
</tr>
<tr>
<td>7</td>
<td>16384</td>
<td>3</td>
<td>41162</td>
<td>2.512329102</td>
</tr>
<tr>
<td>8</td>
<td>65536</td>
<td>3</td>
<td>41162</td>
<td>0.6280822754</td>
</tr>
<tr>
<td>9</td>
<td>262144</td>
<td>4</td>
<td>288122</td>
<td>1.099098206</td>
</tr>
<tr>
<td>10</td>
<td>1048576</td>
<td>4</td>
<td>288122</td>
<td>0.2747745514</td>
</tr>
<tr>
<td>11</td>
<td>4194304</td>
<td>5</td>
<td>2016842</td>
<td>0.4808526039</td>
</tr>
<tr>
<td>12</td>
<td>16777216</td>
<td>6</td>
<td>14117882</td>
<td>0.8414913416</td>
</tr>
<tr>
<td>13</td>
<td>67108864</td>
<td>6</td>
<td>14117882</td>
<td>0.2103728354</td>
</tr>
<tr>
<td>14</td>
<td>268435456</td>
<td>7</td>
<td>98825162</td>
<td>0.3681524172</td>
</tr>
<tr>
<td>15</td>
<td>1073741824</td>
<td>8</td>
<td>691776122</td>
<td>0.644266719</td>
</tr>
<tr>
<td>16</td>
<td>4294967296</td>
<td>8</td>
<td>691776122</td>
<td>0.1610666797</td>
</tr>
<tr>
<td>17</td>
<td>17179869184</td>
<td>9</td>
<td>4842432842</td>
<td>0.2818666889</td>
</tr>
<tr>
<td>18</td>
<td>68719476736</td>
<td>10</td>
<td>33897029882</td>
<td>0.4932667053</td>
</tr>
<tr>
<td>19</td>
<td>274877906944</td>
<td>11</td>
<td>237279209162</td>
<td>0.8632167343</td>
</tr>
<tr>
<td>20</td>
<td>1099511627776</td>
<td>11</td>
<td>237279209162</td>
<td>0.2158041836</td>
</tr>
<tr>
<td>21</td>
<td>4398046511104</td>
<td>12</td>
<td>1660954464122</td>
<td>0.3776573213</td>
</tr>
<tr>
<td>22</td>
<td>17592186044416</td>
<td>13</td>
<td>11626681248842</td>
<td>0.6609003122</td>
</tr>
<tr>
<td>23</td>
<td>70368744177664</td>
<td>13</td>
<td>11626681248842</td>
<td>0.165225078</td>
</tr>
<tr>
<td>24</td>
<td>281474976710656</td>
<td>14</td>
<td>81386768741882</td>
<td>0.2891438866</td>
</tr>
<tr>
<td>25</td>
<td>1125899906842620</td>
<td>15</td>
<td>569707381193162</td>
<td>0.5060018015</td>
</tr>
<tr>
<td>26</td>
<td>4503599627370500</td>
<td>15</td>
<td>569707381193162</td>
<td>0.1265004504</td>
</tr>
<tr>
<td>27</td>
<td>18014398509482000</td>
<td>15</td>
<td>569707381193162</td>
<td>0.03162511259</td>
</tr>
<tr>
<td>28</td>
<td>72057594037927900</td>
<td>15</td>
<td>569707381193162</td>
<td>0.007906278149</td>
</tr>
<tr>
<td>29</td>
<td>288230376151712000</td>
<td>15</td>
<td>569707381193162</td>
<td>0.001976569537</td>
</tr>
</tbody>
</table>
<p>Hexagonal cells don't align perfectly on a vector tile.
Some cells may intersect more than one vector tile.
To compute the H3 resolution for each precision, Elasticsearch compares the average density of hexagonal bins at each resolution with the average density of tile bins at each zoom level.
Elasticsearch uses the H3 resolution that is closest to the corresponding geotile density.</p>
<p>Learn how to use the vector tile search API with practical examples in the <a href="https://www.elastic.co/docs/reference/elasticsearch/rest-apis/vector-tile-search">Vector tile search examples</a> guide.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-search-mvt>`_
:param index: Comma-separated list of data streams, indices, or aliases to search
:param field: Field containing geospatial data to return
:param zoom: Zoom level for the vector tile to search
:param x: X coordinate for the vector tile to search
:param y: Y coordinate for the vector tile to search
:param aggs: Sub-aggregations for the geotile_grid. It supports the following
aggregation types: - `avg` - `boxplot` - `cardinality` - `extended stats`
- `max` - `median absolute deviation` - `min` - `percentile` - `percentile-rank`
- `stats` - `sum` - `value count` The aggregation names can't start with
`_mvt_`. The `_mvt_` prefix is reserved for internal aggregations.
:param buffer: The size, in pixels, of a clipping buffer outside the tile. This
allows renderers to avoid outline artifacts from geometries that extend past
the extent of the tile.
:param exact_bounds: If `false`, the meta layer's feature is the bounding box
of the tile. If `true`, the meta layer's feature is a bounding box resulting
from a `geo_bounds` aggregation. The aggregation runs on <field> values that
intersect the `<zoom>/<x>/<y>` tile with `wrap_longitude` set to `false`.
The resulting bounding box may be larger than the vector tile.
:param extent: The size, in pixels, of a side of the tile. Vector tiles are square
with equal sides.
:param fields: The fields to return in the `hits` layer. It supports wildcards
(`*`). This parameter does not support fields with array values. Fields with
array values may return inconsistent results.
:param grid_agg: The aggregation used to create a grid for the `field`.
:param grid_precision: Additional zoom levels available through the aggs layer.
For example, if `<zoom>` is `7` and `grid_precision` is `8`, you can zoom
in up to level 15. Accepts 0-8. If 0, results don't include the aggs layer.
:param grid_type: Determines the geometry type for features in the aggs layer.
In the aggs layer, each feature represents a `geotile_grid` cell. If `grid,
each feature is a polygon of the cells bounding box. If `point`, each feature
is a Point that is the centroid of the cell.
:param query: The query DSL used to filter documents for the search.
:param runtime_mappings: Defines one or more runtime fields in the search request.
These fields take precedence over mapped fields with the same name.
:param size: The maximum number of features to return in the hits layer. Accepts
0-10000. If 0, results don't include the hits layer.
:param sort: Sort the features in the hits layer. By default, the API calculates
a bounding box for each feature. It sorts features based on this box's diagonal
length, from longest to shortest.
:param track_total_hits: The number of hits matching the query to count accurately.
If `true`, the exact number of hits is returned at the cost of some performance.
If `false`, the response does not include the total number of hits matching
the query.
:param with_labels: If `true`, the hits and aggs layers will contain additional
point features representing suggested label positions for the original features.
* `Point` and `MultiPoint` features will have one of the points selected.
* `Polygon` and `MultiPolygon` features will have a single point generated,
either the centroid, if it is within the polygon, or another point within
the polygon selected from the sorted triangle-tree. * `LineString` features
will likewise provide a roughly central point selected from the triangle-tree.
* The aggregation results will provide one central point for each aggregation
bucket. All attributes from the original features will also be copied to
the new label features. In addition, the new features will be distinguishable
using the tag `_mvt_label_position`.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if field in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'field'")
if zoom in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'zoom'")
if x in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'x'")
if y in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'y'")
__path_parts: t.Dict[str, str] = {
"index": _quote(index),
"field": _quote(field),
"zoom": _quote(zoom),
"x": _quote(x),
"y": _quote(y),
}
__path = f'/{__path_parts["index"]}/_mvt/{__path_parts["field"]}/{__path_parts["zoom"]}/{__path_parts["x"]}/{__path_parts["y"]}'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
# The 'sort' parameter with a colon can't be encoded to the body.
if sort is not None and (
(isinstance(sort, str) and ":" in sort)
or (
isinstance(sort, (list, tuple))
and all(isinstance(_x, str) for _x in sort)
and any(":" in _x for _x in sort)
)
):
__query["sort"] = sort
sort = None
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if aggs is not None:
__body["aggs"] = aggs
if buffer is not None:
__body["buffer"] = buffer
if exact_bounds is not None:
__body["exact_bounds"] = exact_bounds
if extent is not None:
__body["extent"] = extent
if fields is not None:
__body["fields"] = fields
if grid_agg is not None:
__body["grid_agg"] = grid_agg
if grid_precision is not None:
__body["grid_precision"] = grid_precision
if grid_type is not None:
__body["grid_type"] = grid_type
if query is not None:
__body["query"] = query
if runtime_mappings is not None:
__body["runtime_mappings"] = runtime_mappings
if size is not None:
__body["size"] = size
if sort is not None:
__body["sort"] = sort
if track_total_hits is not None:
__body["track_total_hits"] = track_total_hits
if with_labels is not None:
__body["with_labels"] = with_labels
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/vnd.mapbox-vector-tile"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="search_mvt",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def search_shards(
self,
*,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
local: t.Optional[bool] = None,
master_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
routing: t.Optional[str] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get the search shards.</p>
<p>Get the indices and shards that a search request would be run against.
This information can be useful for working out issues or planning optimizations with routing and shard preferences.
When filtered aliases are used, the filter is returned as part of the <code>indices</code> section.</p>
<p>If the Elasticsearch security features are enabled, you must have the <code>view_index_metadata</code> or <code>manage</code> index privilege for the target data stream, index, or alias.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-search-shards>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams and indices,
omit this parameter or use `*` or `_all`.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param expand_wildcards: Type of index that wildcard patterns can match. If the
request can target data streams, this argument determines whether wildcard
expressions match hidden data streams. Supports comma-separated values, such
as `open,hidden`.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param local: If `true`, the request retrieves information from the local node
only.
:param master_timeout: The period to wait for a connection to the master node.
If the master node is not available before the timeout expires, the request
fails and returns an error. IT can also be set to `-1` to indicate that the
request should never timeout.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param routing: A custom value used to route operations to a specific shard.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_search_shards'
else:
__path_parts = {}
__path = "/_search_shards"
__query: t.Dict[str, t.Any] = {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if local is not None:
__query["local"] = local
if master_timeout is not None:
__query["master_timeout"] = master_timeout
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if routing is not None:
__query["routing"] = routing
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
endpoint_id="search_shards",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("explain", "id", "params", "profile", "source"),
ignore_deprecated_options={"params"},
)
async def search_template(
self,
*,
index: t.Optional[t.Union[str, t.Sequence[str]]] = None,
allow_no_indices: t.Optional[bool] = None,
ccs_minimize_roundtrips: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
explain: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
id: t.Optional[str] = None,
ignore_throttled: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
params: t.Optional[t.Mapping[str, t.Any]] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
profile: t.Optional[bool] = None,
rest_total_hits_as_int: t.Optional[bool] = None,
routing: t.Optional[str] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
source: t.Optional[t.Union[str, t.Mapping[str, t.Any]]] = None,
typed_keys: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Run a search with a search template.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-search-template>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`).
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param ccs_minimize_roundtrips: If `true`, network round-trips are minimized
for cross-cluster search requests.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. Supports comma-separated
values, such as `open,hidden`.
:param explain: If `true`, returns detailed information about score calculation
as part of each hit. If you specify both this and the `explain` query parameter,
the API uses only the query parameter.
:param id: The ID of the search template to use. If no `source` is specified,
this parameter is required.
:param ignore_throttled: If `true`, specified concrete, expanded, or aliased
indices are not included in the response when throttled.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param params: Key-value pairs used to replace Mustache variables in the template.
The key is the variable name. The value is the variable value.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param profile: If `true`, the query execution is profiled.
:param rest_total_hits_as_int: If `true`, `hits.total` is rendered as an integer
in the response. If `false`, it is rendered as an object.
:param routing: A custom value used to route operations to a specific shard.
:param scroll: Specifies how long a consistent view of the index should be maintained
for scrolled search.
:param search_type: The type of the search operation.
:param source: An inline search template. Supports the same parameters as the
search API's request body. It also supports Mustache variables. If no `id`
is specified, this parameter is required.
:param typed_keys: If `true`, the response prefixes aggregation and suggester
names with their respective types.
"""
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_search/template'
else:
__path_parts = {}
__path = "/_search/template"
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if ccs_minimize_roundtrips is not None:
__query["ccs_minimize_roundtrips"] = ccs_minimize_roundtrips
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if ignore_throttled is not None:
__query["ignore_throttled"] = ignore_throttled
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if rest_total_hits_as_int is not None:
__query["rest_total_hits_as_int"] = rest_total_hits_as_int
if routing is not None:
__query["routing"] = routing
if scroll is not None:
__query["scroll"] = scroll
if search_type is not None:
__query["search_type"] = search_type
if typed_keys is not None:
__query["typed_keys"] = typed_keys
if not __body:
if explain is not None:
__body["explain"] = explain
if id is not None:
__body["id"] = id
if params is not None:
__body["params"] = params
if profile is not None:
__body["profile"] = profile
if source is not None:
__body["source"] = source
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="search_template",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=(
"field",
"case_insensitive",
"index_filter",
"search_after",
"size",
"string",
"timeout",
),
)
async def terms_enum(
self,
*,
index: str,
field: t.Optional[str] = None,
case_insensitive: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
index_filter: t.Optional[t.Mapping[str, t.Any]] = None,
pretty: t.Optional[bool] = None,
search_after: t.Optional[str] = None,
size: t.Optional[int] = None,
string: t.Optional[str] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get terms in an index.</p>
<p>Discover terms that match a partial string in an index.
This API is designed for low-latency look-ups used in auto-complete scenarios.</p>
<blockquote>
<p>info
The terms enum API may return terms from deleted documents. Deleted documents are initially only marked as deleted. It is not until their segments are merged that documents are actually deleted. Until that happens, the terms enum API will return terms from these documents.</p>
</blockquote>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-terms-enum>`_
:param index: A comma-separated list of data streams, indices, and index aliases
to search. Wildcard (`*`) expressions are supported. To search all data streams
or indices, omit this parameter or use `*` or `_all`.
:param field: The string to match at the start of indexed terms. If not provided,
all terms in the field are considered.
:param case_insensitive: When `true`, the provided search string is matched against
index terms without case sensitivity.
:param index_filter: Filter an index shard if the provided query rewrites to
`match_none`.
:param search_after: The string after which terms in the index should be returned.
It allows for a form of pagination if the last result from one request is
passed as the `search_after` parameter for a subsequent request.
:param size: The number of matching terms to return.
:param string: The string to match at the start of indexed terms. If it is not
provided, all terms in the field are considered. > info > The prefix string
cannot be larger than the largest possible keyword value, which is Lucene's
term byte-length limit of 32766.
:param timeout: The maximum length of time to spend collecting results. If the
timeout is exceeded the `complete` flag set to `false` in the response and
the results may be partial or empty.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if field is None and body is None:
raise ValueError("Empty value passed for parameter 'field'")
__path_parts: t.Dict[str, str] = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_terms_enum'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if not __body:
if field is not None:
__body["field"] = field
if case_insensitive is not None:
__body["case_insensitive"] = case_insensitive
if index_filter is not None:
__body["index_filter"] = index_filter
if search_after is not None:
__body["search_after"] = search_after
if size is not None:
__body["size"] = size
if string is not None:
__body["string"] = string
if timeout is not None:
__body["timeout"] = timeout
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="terms_enum",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=(
"doc",
"field_statistics",
"fields",
"filter",
"offsets",
"payloads",
"per_field_analyzer",
"positions",
"routing",
"term_statistics",
"version",
"version_type",
),
)
async def termvectors(
self,
*,
index: str,
id: t.Optional[str] = None,
doc: t.Optional[t.Mapping[str, t.Any]] = None,
error_trace: t.Optional[bool] = None,
field_statistics: t.Optional[bool] = None,
fields: t.Optional[t.Union[str, t.Sequence[str]]] = None,
filter: t.Optional[t.Mapping[str, t.Any]] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
offsets: t.Optional[bool] = None,
payloads: t.Optional[bool] = None,
per_field_analyzer: t.Optional[t.Mapping[str, str]] = None,
positions: t.Optional[bool] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
realtime: t.Optional[bool] = None,
routing: t.Optional[str] = None,
term_statistics: t.Optional[bool] = None,
version: t.Optional[int] = None,
version_type: t.Optional[
t.Union[str, t.Literal["external", "external_gte", "force", "internal"]]
] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Get term vector information.</p>
<p>Get information and statistics about terms in the fields of a particular document.</p>
<p>You can retrieve term vectors for documents stored in the index or for artificial documents passed in the body of the request.
You can specify the fields you are interested in through the <code>fields</code> parameter or by adding the fields to the request body.
For example:</p>
<pre><code>GET /my-index-000001/_termvectors/1?fields=message
</code></pre>
<p>Fields can be specified using wildcards, similar to the multi match query.</p>
<p>Term vectors are real-time by default, not near real-time.
This can be changed by setting <code>realtime</code> parameter to <code>false</code>.</p>
<p>You can request three types of values: <em>term information</em>, <em>term statistics</em>, and <em>field statistics</em>.
By default, all term information and field statistics are returned for all fields but term statistics are excluded.</p>
<p><strong>Term information</strong></p>
<ul>
<li>term frequency in the field (always returned)</li>
<li>term positions (<code>positions: true</code>)</li>
<li>start and end offsets (<code>offsets: true</code>)</li>
<li>term payloads (<code>payloads: true</code>), as base64 encoded bytes</li>
</ul>
<p>If the requested information wasn't stored in the index, it will be computed on the fly if possible.
Additionally, term vectors could be computed for documents not even existing in the index, but instead provided by the user.</p>
<blockquote>
<p>warn
Start and end offsets assume UTF-16 encoding is being used. If you want to use these offsets in order to get the original text that produced this token, you should make sure that the string you are taking a sub-string of is also encoded using UTF-16.</p>
</blockquote>
<p><strong>Behaviour</strong></p>
<p>The term and field statistics are not accurate.
Deleted documents are not taken into account.
The information is only retrieved for the shard the requested document resides in.
The term and field statistics are therefore only useful as relative measures whereas the absolute numbers have no meaning in this context.
By default, when requesting term vectors of artificial documents, a shard to get the statistics from is randomly selected.
Use <code>routing</code> only to hit a particular shard.
Refer to the linked documentation for detailed examples of how to use this API.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-termvectors>`_
:param index: The name of the index that contains the document.
:param id: A unique identifier for the document.
:param doc: An artificial document (a document not present in the index) for
which you want to retrieve term vectors.
:param field_statistics: If `true`, the response includes: * The document count
(how many documents contain this field). * The sum of document frequencies
(the sum of document frequencies for all terms in this field). * The sum
of total term frequencies (the sum of total term frequencies of each term
in this field).
:param fields: A list of fields to include in the statistics. It is used as the
default list unless a specific field list is provided in the `completion_fields`
or `fielddata_fields` parameters.
:param filter: Filter terms based on their tf-idf scores. This could be useful
in order find out a good characteristic vector of a document. This feature
works in a similar manner to the second phase of the More Like This Query.
:param offsets: If `true`, the response includes term offsets.
:param payloads: If `true`, the response includes term payloads.
:param per_field_analyzer: Override the default per-field analyzer. This is useful
in order to generate term vectors in any fashion, especially when using artificial
documents. When providing an analyzer for a field that already stores term
vectors, the term vectors will be regenerated.
:param positions: If `true`, the response includes term positions.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param realtime: If true, the request is real-time as opposed to near-real-time.
:param routing: A custom value that is used to route operations to a specific
shard.
:param term_statistics: If `true`, the response includes: * The total term frequency
(how often a term occurs in all documents). * The document frequency (the
number of documents containing the current term). By default these values
are not returned since term statistics can have a serious performance impact.
:param version: If `true`, returns the document version as part of a hit.
:param version_type: The version type.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
__path_parts: t.Dict[str, str]
if index not in SKIP_IN_PATH and id not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_termvectors/{__path_parts["id"]}'
elif index not in SKIP_IN_PATH:
__path_parts = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_termvectors'
else:
raise ValueError("Couldn't find a path for the given parameters")
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if realtime is not None:
__query["realtime"] = realtime
if not __body:
if doc is not None:
__body["doc"] = doc
if field_statistics is not None:
__body["field_statistics"] = field_statistics
if fields is not None:
__body["fields"] = fields
if filter is not None:
__body["filter"] = filter
if offsets is not None:
__body["offsets"] = offsets
if payloads is not None:
__body["payloads"] = payloads
if per_field_analyzer is not None:
__body["per_field_analyzer"] = per_field_analyzer
if positions is not None:
__body["positions"] = positions
if routing is not None:
__body["routing"] = routing
if term_statistics is not None:
__body["term_statistics"] = term_statistics
if version is not None:
__body["version"] = version
if version_type is not None:
__body["version_type"] = version_type
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="termvectors",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=(
"detect_noop",
"doc",
"doc_as_upsert",
"script",
"scripted_upsert",
"source",
"upsert",
),
parameter_aliases={
"_source": "source",
"_source_excludes": "source_excludes",
"_source_includes": "source_includes",
},
)
async def update(
self,
*,
index: str,
id: str,
detect_noop: t.Optional[bool] = None,
doc: t.Optional[t.Mapping[str, t.Any]] = None,
doc_as_upsert: t.Optional[bool] = None,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
if_primary_term: t.Optional[int] = None,
if_seq_no: t.Optional[int] = None,
include_source_on_error: t.Optional[bool] = None,
lang: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
refresh: t.Optional[
t.Union[bool, str, t.Literal["false", "true", "wait_for"]]
] = None,
require_alias: t.Optional[bool] = None,
retry_on_conflict: t.Optional[int] = None,
routing: t.Optional[str] = None,
script: t.Optional[t.Mapping[str, t.Any]] = None,
scripted_upsert: t.Optional[bool] = None,
source: t.Optional[t.Union[bool, t.Mapping[str, t.Any]]] = None,
source_excludes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
source_includes: t.Optional[t.Union[str, t.Sequence[str]]] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
upsert: t.Optional[t.Mapping[str, t.Any]] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Update a document.</p>
<p>Update a document by running a script or passing a partial document.</p>
<p>If the Elasticsearch security features are enabled, you must have the <code>index</code> or <code>write</code> index privilege for the target index or index alias.</p>
<p>The script can update, delete, or skip modifying the document.
The API also supports passing a partial document, which is merged into the existing document.
To fully replace an existing document, use the index API.
This operation:</p>
<ul>
<li>Gets the document (collocated with the shard) from the index.</li>
<li>Runs the specified script.</li>
<li>Indexes the result.</li>
</ul>
<p>The document must still be reindexed, but using this API removes some network roundtrips and reduces chances of version conflicts between the GET and the index operation.</p>
<p>The <code>_source</code> field must be enabled to use this API.
In addition to <code>_source</code>, you can access the following variables through the <code>ctx</code> map: <code>_index</code>, <code>_type</code>, <code>_id</code>, <code>_version</code>, <code>_routing</code>, and <code>_now</code> (the current timestamp).
For usage examples such as partial updates, upserts, and scripted updates, see the External documentation.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-update>`_
:param index: The name of the target index. By default, the index is created
automatically if it doesn't exist.
:param id: A unique identifier for the document to be updated.
:param detect_noop: If `true`, the `result` in the response is set to `noop`
(no operation) when there are no changes to the document.
:param doc: A partial update to an existing document. If both `doc` and `script`
are specified, `doc` is ignored.
:param doc_as_upsert: If `true`, use the contents of 'doc' as the value of 'upsert'.
NOTE: Using ingest pipelines with `doc_as_upsert` is not supported.
:param if_primary_term: Only perform the operation if the document has this primary
term.
:param if_seq_no: Only perform the operation if the document has this sequence
number.
:param include_source_on_error: True or false if to include the document source
in the error message in case of parsing errors.
:param lang: The script language.
:param refresh: If 'true', Elasticsearch refreshes the affected shards to make
this operation visible to search. If 'wait_for', it waits for a refresh to
make this operation visible to search. If 'false', it does nothing with refreshes.
:param require_alias: If `true`, the destination must be an index alias.
:param retry_on_conflict: The number of times the operation should be retried
when a conflict occurs.
:param routing: A custom value used to route operations to a specific shard.
:param script: The script to run to update the document.
:param scripted_upsert: If `true`, run the script whether or not the document
exists.
:param source: If `false`, turn off source retrieval. You can also specify a
comma-separated list of the fields you want to retrieve.
:param source_excludes: The source fields you want to exclude.
:param source_includes: The source fields you want to retrieve.
:param timeout: The period to wait for the following operations: dynamic mapping
updates and waiting for active shards. Elasticsearch waits for at least the
timeout period before failing. The actual wait time could be longer, particularly
when multiple waits occur.
:param upsert: If the document does not already exist, the contents of 'upsert'
are inserted as a new document. If the document exists, the 'script' is run.
:param wait_for_active_shards: The number of copies of each shard that must be
active before proceeding with the operation. Set to 'all' or any positive
integer up to the total number of shards in the index (`number_of_replicas`+1).
The default value of `1` means it waits for each primary shard to be active.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
if id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'id'")
__path_parts: t.Dict[str, str] = {"index": _quote(index), "id": _quote(id)}
__path = f'/{__path_parts["index"]}/_update/{__path_parts["id"]}'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if if_primary_term is not None:
__query["if_primary_term"] = if_primary_term
if if_seq_no is not None:
__query["if_seq_no"] = if_seq_no
if include_source_on_error is not None:
__query["include_source_on_error"] = include_source_on_error
if lang is not None:
__query["lang"] = lang
if pretty is not None:
__query["pretty"] = pretty
if refresh is not None:
__query["refresh"] = refresh
if require_alias is not None:
__query["require_alias"] = require_alias
if retry_on_conflict is not None:
__query["retry_on_conflict"] = retry_on_conflict
if routing is not None:
__query["routing"] = routing
if source_excludes is not None:
__query["_source_excludes"] = source_excludes
if source_includes is not None:
__query["_source_includes"] = source_includes
if timeout is not None:
__query["timeout"] = timeout
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
if not __body:
if detect_noop is not None:
__body["detect_noop"] = detect_noop
if doc is not None:
__body["doc"] = doc
if doc_as_upsert is not None:
__body["doc_as_upsert"] = doc_as_upsert
if script is not None:
__body["script"] = script
if scripted_upsert is not None:
__body["scripted_upsert"] = scripted_upsert
if source is not None:
__body["_source"] = source
if upsert is not None:
__body["upsert"] = upsert
__headers = {"accept": "application/json", "content-type": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="update",
path_parts=__path_parts,
)
@_rewrite_parameters(
body_fields=("conflicts", "max_docs", "query", "script", "slice"),
parameter_aliases={"from": "from_"},
)
async def update_by_query(
self,
*,
index: t.Union[str, t.Sequence[str]],
allow_no_indices: t.Optional[bool] = None,
analyze_wildcard: t.Optional[bool] = None,
analyzer: t.Optional[str] = None,
conflicts: t.Optional[t.Union[str, t.Literal["abort", "proceed"]]] = None,
default_operator: t.Optional[t.Union[str, t.Literal["and", "or"]]] = None,
df: t.Optional[str] = None,
error_trace: t.Optional[bool] = None,
expand_wildcards: t.Optional[
t.Union[
t.Sequence[
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]]
],
t.Union[str, t.Literal["all", "closed", "hidden", "none", "open"]],
]
] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
from_: t.Optional[int] = None,
human: t.Optional[bool] = None,
ignore_unavailable: t.Optional[bool] = None,
lenient: t.Optional[bool] = None,
max_docs: t.Optional[int] = None,
pipeline: t.Optional[str] = None,
preference: t.Optional[str] = None,
pretty: t.Optional[bool] = None,
q: t.Optional[str] = None,
query: t.Optional[t.Mapping[str, t.Any]] = None,
refresh: t.Optional[bool] = None,
request_cache: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
routing: t.Optional[str] = None,
script: t.Optional[t.Mapping[str, t.Any]] = None,
scroll: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
scroll_size: t.Optional[int] = None,
search_timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
search_type: t.Optional[
t.Union[str, t.Literal["dfs_query_then_fetch", "query_then_fetch"]]
] = None,
slice: t.Optional[t.Mapping[str, t.Any]] = None,
slices: t.Optional[t.Union[int, t.Union[str, t.Literal["auto"]]]] = None,
sort: t.Optional[t.Sequence[str]] = None,
stats: t.Optional[t.Sequence[str]] = None,
terminate_after: t.Optional[int] = None,
timeout: t.Optional[t.Union[str, t.Literal[-1], t.Literal[0]]] = None,
version: t.Optional[bool] = None,
version_type: t.Optional[bool] = None,
wait_for_active_shards: t.Optional[
t.Union[int, t.Union[str, t.Literal["all", "index-setting"]]]
] = None,
wait_for_completion: t.Optional[bool] = None,
body: t.Optional[t.Dict[str, t.Any]] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Update documents.
Updates documents that match the specified query.
If no query is specified, performs an update on every document in the data stream or index without modifying the source, which is useful for picking up mapping changes.</p>
<p>If the Elasticsearch security features are enabled, you must have the following index privileges for the target data stream, index, or alias:</p>
<ul>
<li><code>read</code></li>
<li><code>index</code> or <code>write</code></li>
</ul>
<p>You can specify the query criteria in the request URI or the request body using the same syntax as the search API.</p>
<p>When you submit an update by query request, Elasticsearch gets a snapshot of the data stream or index when it begins processing the request and updates matching documents using internal versioning.
When the versions match, the document is updated and the version number is incremented.
If a document changes between the time that the snapshot is taken and the update operation is processed, it results in a version conflict and the operation fails.
You can opt to count version conflicts instead of halting and returning by setting <code>conflicts</code> to <code>proceed</code>.
Note that if you opt to count version conflicts, the operation could attempt to update more documents from the source than <code>max_docs</code> until it has successfully updated <code>max_docs</code> documents or it has gone through every document in the source query.</p>
<p>NOTE: Documents with a version equal to 0 cannot be updated using update by query because internal versioning does not support 0 as a valid version number.</p>
<p>While processing an update by query request, Elasticsearch performs multiple search requests sequentially to find all of the matching documents.
A bulk update request is performed for each batch of matching documents.
Any query or update failures cause the update by query request to fail and the failures are shown in the response.
Any update requests that completed successfully still stick, they are not rolled back.</p>
<p><strong>Refreshing shards</strong></p>
<p>Specifying the <code>refresh</code> parameter refreshes all shards once the request completes.
This is different to the update API's <code>refresh</code> parameter, which causes only the shard
that received the request to be refreshed. Unlike the update API, it does not support
<code>wait_for</code>.</p>
<p><strong>Running update by query asynchronously</strong></p>
<p>If the request contains <code>wait_for_completion=false</code>, Elasticsearch
performs some preflight checks, launches the request, and returns a
<a href="https://www.elastic.co/docs/api/doc/elasticsearch/group/endpoint-tasks">task</a> you can use to cancel or get the status of the task.
Elasticsearch creates a record of this task as a document at <code>.tasks/task/${taskId}</code>.</p>
<p><strong>Waiting for active shards</strong></p>
<p><code>wait_for_active_shards</code> controls how many copies of a shard must be active
before proceeding with the request. See <a href="https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-create#operation-create-wait_for_active_shards"><code>wait_for_active_shards</code></a>
for details. <code>timeout</code> controls how long each write request waits for unavailable
shards to become available. Both work exactly the way they work in the
<a href="https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-bulk">Bulk API</a>. Update by query uses scrolled searches, so you can also
specify the <code>scroll</code> parameter to control how long it keeps the search context
alive, for example <code>?scroll=10m</code>. The default is 5 minutes.</p>
<p><strong>Throttling update requests</strong></p>
<p>To control the rate at which update by query issues batches of update operations, you can set <code>requests_per_second</code> to any positive decimal number.
This pads each batch with a wait time to throttle the rate.
Set <code>requests_per_second</code> to <code>-1</code> to turn off throttling.</p>
<p>Throttling uses a wait time between batches so that the internal scroll requests can be given a timeout that takes the request padding into account.
The padding time is the difference between the batch size divided by the <code>requests_per_second</code> and the time spent writing.
By default the batch size is 1000, so if <code>requests_per_second</code> is set to <code>500</code>:</p>
<pre><code>target_time = 1000 / 500 per second = 2 seconds
wait_time = target_time - write_time = 2 seconds - .5 seconds = 1.5 seconds
</code></pre>
<p>Since the batch is issued as a single _bulk request, large batch sizes cause Elasticsearch to create many requests and wait before starting the next set.
This is "bursty" instead of "smooth".</p>
<p><strong>Slicing</strong></p>
<p>Update by query supports sliced scroll to parallelize the update process.
This can improve efficiency and provide a convenient way to break the request down into smaller parts.</p>
<p>Setting <code>slices</code> to <code>auto</code> chooses a reasonable number for most data streams and indices.
This setting will use one slice per shard, up to a certain limit.
If there are multiple source data streams or indices, it will choose the number of slices based on the index or backing index with the smallest number of shards.</p>
<p>Adding <code>slices</code> to <code>_update_by_query</code> just automates the manual process of creating sub-requests, which means it has some quirks:</p>
<ul>
<li>You can see these requests in the tasks APIs. These sub-requests are "child" tasks of the task for the request with slices.</li>
<li>Fetching the status of the task for the request with <code>slices</code> only contains the status of completed slices.</li>
<li>These sub-requests are individually addressable for things like cancellation and rethrottling.</li>
<li>Rethrottling the request with <code>slices</code> will rethrottle the unfinished sub-request proportionally.</li>
<li>Canceling the request with slices will cancel each sub-request.</li>
<li>Due to the nature of slices each sub-request won't get a perfectly even portion of the documents. All documents will be addressed, but some slices may be larger than others. Expect larger slices to have a more even distribution.</li>
<li>Parameters like <code>requests_per_second</code> and <code>max_docs</code> on a request with slices are distributed proportionally to each sub-request. Combine that with the point above about distribution being uneven and you should conclude that using <code>max_docs</code> with <code>slices</code> might not result in exactly <code>max_docs</code> documents being updated.</li>
<li>Each sub-request gets a slightly different snapshot of the source data stream or index though these are all taken at approximately the same time.</li>
</ul>
<p>If you're slicing manually or otherwise tuning automatic slicing, keep in mind that:</p>
<ul>
<li>Query performance is most efficient when the number of slices is equal to the number of shards in the index or backing index. If that number is large (for example, 500), choose a lower number as too many slices hurts performance. Setting slices higher than the number of shards generally does not improve efficiency and adds overhead.</li>
<li>Update performance scales linearly across available resources with the number of slices.</li>
</ul>
<p>Whether query or update performance dominates the runtime depends on the documents being reindexed and cluster resources.
Refer to the linked documentation for examples of how to update documents using the <code>_update_by_query</code> API:</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-update-by-query>`_
:param index: A comma-separated list of data streams, indices, and aliases to
search. It supports wildcards (`*`). To search all data streams or indices,
omit this parameter or use `*` or `_all`.
:param allow_no_indices: If `false`, the request returns an error if any wildcard
expression, index alias, or `_all` value targets only missing or closed indices.
This behavior applies even if the request targets other open indices. For
example, a request targeting `foo*,bar*` returns an error if an index starts
with `foo` but no index starts with `bar`.
:param analyze_wildcard: If `true`, wildcard and prefix queries are analyzed.
This parameter can be used only when the `q` query string parameter is specified.
:param analyzer: The analyzer to use for the query string. This parameter can
be used only when the `q` query string parameter is specified.
:param conflicts: The preferred behavior when update by query hits version conflicts:
`abort` or `proceed`.
:param default_operator: The default operator for query string query: `AND` or
`OR`. This parameter can be used only when the `q` query string parameter
is specified.
:param df: The field to use as default where no field prefix is given in the
query string. This parameter can be used only when the `q` query string parameter
is specified.
:param expand_wildcards: The type of index that wildcard patterns can match.
If the request can target data streams, this argument determines whether
wildcard expressions match hidden data streams. It supports comma-separated
values, such as `open,hidden`.
:param from_: Skips the specified number of documents.
:param ignore_unavailable: If `false`, the request returns an error if it targets
a missing or closed index.
:param lenient: If `true`, format-based query failures (such as providing text
to a numeric field) in the query string will be ignored. This parameter can
be used only when the `q` query string parameter is specified.
:param max_docs: The maximum number of documents to update.
:param pipeline: The ID of the pipeline to use to preprocess incoming documents.
If the index has a default ingest pipeline specified, then setting the value
to `_none` disables the default ingest pipeline for this request. If a final
pipeline is configured it will always run, regardless of the value of this
parameter.
:param preference: The node or shard the operation should be performed on. It
is random by default.
:param q: A query in the Lucene query string syntax.
:param query: The documents to update using the Query DSL.
:param refresh: If `true`, Elasticsearch refreshes affected shards to make the
operation visible to search after the request completes. This is different
than the update API's `refresh` parameter, which causes just the shard that
received the request to be refreshed.
:param request_cache: If `true`, the request cache is used for this request.
It defaults to the index-level setting.
:param requests_per_second: The throttle for this request in sub-requests per
second.
:param routing: A custom value used to route operations to a specific shard.
:param script: The script to run to update the document source or metadata when
updating.
:param scroll: The period to retain the search context for scrolling.
:param scroll_size: The size of the scroll request that powers the operation.
:param search_timeout: An explicit timeout for each search request. By default,
there is no timeout.
:param search_type: The type of the search operation. Available options include
`query_then_fetch` and `dfs_query_then_fetch`.
:param slice: Slice the request manually using the provided slice ID and total
number of slices.
:param slices: The number of slices this task should be divided into.
:param sort: A comma-separated list of <field>:<direction> pairs.
:param stats: The specific `tag` of the request for logging and statistical purposes.
:param terminate_after: The maximum number of documents to collect for each shard.
If a query reaches this limit, Elasticsearch terminates the query early.
Elasticsearch collects documents before sorting. IMPORTANT: Use with caution.
Elasticsearch applies this parameter to each shard handling the request.
When possible, let Elasticsearch perform early termination automatically.
Avoid specifying this parameter for requests that target data streams with
backing indices across multiple data tiers.
:param timeout: The period each update request waits for the following operations:
dynamic mapping updates, waiting for active shards. By default, it is one
minute. This guarantees Elasticsearch waits for at least the timeout before
failing. The actual wait time could be longer, particularly when multiple
waits occur.
:param version: If `true`, returns the document version as part of a hit.
:param version_type: Should the document increment the version number (internal)
on hit or not (reindex)
:param wait_for_active_shards: The number of shard copies that must be active
before proceeding with the operation. Set to `all` or any positive integer
up to the total number of shards in the index (`number_of_replicas+1`). The
`timeout` parameter controls how long each write request waits for unavailable
shards to become available. Both work exactly the way they work in the bulk
API.
:param wait_for_completion: If `true`, the request blocks until the operation
is complete. If `false`, Elasticsearch performs some preflight checks, launches
the request, and returns a task ID that you can use to cancel or get the
status of the task. Elasticsearch creates a record of this task as a document
at `.tasks/task/${taskId}`.
"""
if index in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'index'")
__path_parts: t.Dict[str, str] = {"index": _quote(index)}
__path = f'/{__path_parts["index"]}/_update_by_query'
__query: t.Dict[str, t.Any] = {}
__body: t.Dict[str, t.Any] = body if body is not None else {}
# The 'sort' parameter with a colon can't be encoded to the body.
if sort is not None and (
(isinstance(sort, str) and ":" in sort)
or (
isinstance(sort, (list, tuple))
and all(isinstance(_x, str) for _x in sort)
and any(":" in _x for _x in sort)
)
):
__query["sort"] = sort
sort = None
if allow_no_indices is not None:
__query["allow_no_indices"] = allow_no_indices
if analyze_wildcard is not None:
__query["analyze_wildcard"] = analyze_wildcard
if analyzer is not None:
__query["analyzer"] = analyzer
if default_operator is not None:
__query["default_operator"] = default_operator
if df is not None:
__query["df"] = df
if error_trace is not None:
__query["error_trace"] = error_trace
if expand_wildcards is not None:
__query["expand_wildcards"] = expand_wildcards
if filter_path is not None:
__query["filter_path"] = filter_path
if from_ is not None:
__query["from"] = from_
if human is not None:
__query["human"] = human
if ignore_unavailable is not None:
__query["ignore_unavailable"] = ignore_unavailable
if lenient is not None:
__query["lenient"] = lenient
if pipeline is not None:
__query["pipeline"] = pipeline
if preference is not None:
__query["preference"] = preference
if pretty is not None:
__query["pretty"] = pretty
if q is not None:
__query["q"] = q
if refresh is not None:
__query["refresh"] = refresh
if request_cache is not None:
__query["request_cache"] = request_cache
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
if routing is not None:
__query["routing"] = routing
if scroll is not None:
__query["scroll"] = scroll
if scroll_size is not None:
__query["scroll_size"] = scroll_size
if search_timeout is not None:
__query["search_timeout"] = search_timeout
if search_type is not None:
__query["search_type"] = search_type
if slices is not None:
__query["slices"] = slices
if sort is not None:
__query["sort"] = sort
if stats is not None:
__query["stats"] = stats
if terminate_after is not None:
__query["terminate_after"] = terminate_after
if timeout is not None:
__query["timeout"] = timeout
if version is not None:
__query["version"] = version
if version_type is not None:
__query["version_type"] = version_type
if wait_for_active_shards is not None:
__query["wait_for_active_shards"] = wait_for_active_shards
if wait_for_completion is not None:
__query["wait_for_completion"] = wait_for_completion
if not __body:
if conflicts is not None:
__body["conflicts"] = conflicts
if max_docs is not None:
__body["max_docs"] = max_docs
if query is not None:
__body["query"] = query
if script is not None:
__body["script"] = script
if slice is not None:
__body["slice"] = slice
if not __body:
__body = None # type: ignore[assignment]
__headers = {"accept": "application/json"}
if __body is not None:
__headers["content-type"] = "application/json"
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
body=__body,
endpoint_id="update_by_query",
path_parts=__path_parts,
)
@_rewrite_parameters()
async def update_by_query_rethrottle(
self,
*,
task_id: str,
error_trace: t.Optional[bool] = None,
filter_path: t.Optional[t.Union[str, t.Sequence[str]]] = None,
human: t.Optional[bool] = None,
pretty: t.Optional[bool] = None,
requests_per_second: t.Optional[float] = None,
) -> ObjectApiResponse[t.Any]:
"""
.. raw:: html
<p>Throttle an update by query operation.</p>
<p>Change the number of requests per second for a particular update by query operation.
Rethrottling that speeds up the query takes effect immediately but rethrotting that slows down the query takes effect after completing the current batch to prevent scroll timeouts.</p>
`<https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-update-by-query-rethrottle>`_
:param task_id: The ID for the task.
:param requests_per_second: The throttle for this request in sub-requests per
second. To turn off throttling, set it to `-1`.
"""
if task_id in SKIP_IN_PATH:
raise ValueError("Empty value passed for parameter 'task_id'")
__path_parts: t.Dict[str, str] = {"task_id": _quote(task_id)}
__path = f'/_update_by_query/{__path_parts["task_id"]}/_rethrottle'
__query: t.Dict[str, t.Any] = {}
if error_trace is not None:
__query["error_trace"] = error_trace
if filter_path is not None:
__query["filter_path"] = filter_path
if human is not None:
__query["human"] = human
if pretty is not None:
__query["pretty"] = pretty
if requests_per_second is not None:
__query["requests_per_second"] = requests_per_second
__headers = {"accept": "application/json"}
return await self.perform_request( # type: ignore[return-value]
"POST",
__path,
params=__query,
headers=__headers,
endpoint_id="update_by_query_rethrottle",
path_parts=__path_parts,
)
|