1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 1845 1846 1847 1848 1849 1850 1851 1852 1853 1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1878 1879 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 2026 2027 2028 2029 2030 2031 2032 2033 2034 2035 2036 2037 2038 2039 2040 2041 2042 2043 2044 2045 2046 2047 2048 2049 2050 2051 2052
|
/*
PsychToolbox3/Source/Linux/Screen/PsychWindowGlueWayland.c
PLATFORMS:
This is the Linux/Wayland version only.
AUTHORS:
Mario Kleiner mk mario.kleiner.de@gmail.com
HISTORY:
04-Jan-2015 mk Created - Derived from Linux/Waffle version.
DESCRIPTION:
Functions in this file comprise an abstraction layer for probing and controlling window state, except for window content.
This is the Wayland specific backend.
NOTES:
Preformatted via: indent -linux -l240 -i4 PsychWindowGlueWayland.c
TO DO:
*/
/* Only enable the native Wayland backend at compile time if explicitely requested: */
#ifdef PTB_USE_WAYLAND
/* At the moment we still depend on Waffle even for "native" Wayland support.
* Waffle is mostly used for initial Wayland connection setup, window creation,
* and interacting with EGL to get the rendering api's setup and attached,
* OpenGL contexts created and managed, GL extensions bound etc.
*
* Plan is to mix Wayland specific code with "minimal" Waffle here, and then incrementally
* replace Waffle bits with Wayland bits as far as this is neccessary or useful.
*/
#ifndef PTB_USE_WAFFLE
#error PTB_USE_WAFFLE not defined for PTB_USE_WAYLAND build! We depend on Waffle at the moment, so this is a no-go!
#endif
#include "Screen.h"
#include <waffle-1/waffle_wayland.h>
// Number of currently open onscreen windows:
static int open_windowcount = 0;
// Delay to add to targetTime when manual swap scheduling is used:
static double delayFromFrameStart = 0;
// Tracking of currently bound OpenGL rendering context for master-thread:
static struct waffle_context *currentContext = NULL;
// Forward define prototype for glewContextInit(), which is normally not a public function:
GLenum glewContextInit(void);
#include <wayland-client.h>
// Header file for wp_presentation extension, auto-generated by wayland-scanner, included in our
// source tree, as permitted by license, just like presentation_timing-protocol.c:
#include "presentation_timing-client-protocol.h"
// XDG shell protocol:
#include "xdg_shell-client-protocol.h"
#define ARRAY_LENGTH(a) (sizeof (a) / sizeof (a)[0])
// These are defined in PsychScreenGlueWayland.c:
extern struct waffle_display *waffle_display;
extern struct wl_display* wl_display;
extern struct wl_compositor* wl_compositor;
extern EGLDisplay egl_display;
extern uint32_t wayland_presentation_clock_id;
// wl_output* for all screens, from PsychScreenGlueWayland.c:
extern struct wl_output* displayWaylandOutputs[kPsychMaxPossibleDisplays];
// Read-only access this gem from PsychScreenGlue.c:
extern psych_bool displayOriginalCGSettingsValid[kPsychMaxPossibleDisplays];
// From PsychScreenGlueWayland.c:
struct wp_presentation *get_wayland_presentation_extension(PsychWindowRecordType* windowRecord);
// Container with feedback about a completed swap - the equivalent of
// our good old INTEL_swap_event on X11/GLX, here for Wayland:
struct wayland_feedback {
PsychWindowRecordType *windowRecord;
unsigned int present_status; // 0 == Pending, 1 = Completed, 2 = Skipped.
psych_uint64 sbc;
psych_uint64 msc;
psych_uint64 ust;
uint32_t present_flags;
struct wp_presentation_feedback *feedback;
struct timespec commit;
struct timespec target;
struct wl_list link;
struct timespec present;
};
static void
destroy_wayland_feedback(struct wayland_feedback *wayland_feedback)
{
if (wayland_feedback->feedback)
wp_presentation_feedback_destroy(wayland_feedback->feedback);
wl_list_remove(&wayland_feedback->link);
free(wayland_feedback);
}
static uint32_t
timespec_to_ms(const struct timespec *ts)
{
return (uint32_t)ts->tv_sec * 1000 + ts->tv_nsec / 1000000;
}
static void
timespec_from_proto(struct timespec *tm, uint32_t tv_sec_hi,
uint32_t tv_sec_lo, uint32_t tv_nsec)
{
tm->tv_sec = ((uint64_t)tv_sec_hi << 32) + tv_sec_lo;
tm->tv_nsec = tv_nsec;
}
static uint64_t
timespec_to_us(const struct timespec *ts)
{
return (uint64_t) ts->tv_sec * 1000000 + ts->tv_nsec / 1000;
}
static int
timespec_diff_to_usec(const struct timespec *a, const struct timespec *b)
{
time_t secs = a->tv_sec - b->tv_sec;
long nsec = a->tv_nsec - b->tv_nsec;
return secs * 1000000 + nsec / 1000;
}
static char *
wayland_pflags_to_str(uint32_t flags, char *str, unsigned len)
{
static const struct {
uint32_t flag;
char sym;
} desc[] = {
{ WP_PRESENTATION_FEEDBACK_KIND_VSYNC, 's' },
{ WP_PRESENTATION_FEEDBACK_KIND_HW_CLOCK, 'c' },
{ WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION, 'e' },
{ WP_PRESENTATION_FEEDBACK_KIND_ZERO_COPY, 'z' },
};
unsigned i;
*str = '\0';
if (len < ARRAY_LENGTH(desc) + 1)
return str;
for (i = 0; i < ARRAY_LENGTH(desc); i++)
str[i] = flags & desc[i].flag ? desc[i].sym : '_';
str[ARRAY_LENGTH(desc)] = '\0';
return str;
}
static void
wayland_feedback_presented(void *data,
struct wp_presentation_feedback *presentation_feedback,
uint32_t tv_sec_hi,
uint32_t tv_sec_lo,
uint32_t tv_nsec,
uint32_t refresh_nsec,
uint32_t seq_hi,
uint32_t seq_lo,
uint32_t flags)
{
struct wayland_feedback *wayland_feedback = data;
PsychWindowRecordType *windowRecord = wayland_feedback->windowRecord;
uint64_t msc = ((uint64_t) seq_hi << 32) + seq_lo;
uint32_t commit, present;
uint32_t f2c, c2p, f2p;
int p2p, t2p;
char flagstr[10];
// Translate protocol presentation timestamp to a timespec:
timespec_from_proto(&wayland_feedback->present, tv_sec_hi, tv_sec_lo, tv_nsec);
commit = timespec_to_ms(&wayland_feedback->commit);
present = timespec_to_ms(&wayland_feedback->present);
// Time delta in msecs between swap scheduled and completed:
c2p = present - commit;
// Compute delta in usecs between successive swaps:
if (wayland_feedback->sbc > 1) {
p2p = timespec_to_us(&wayland_feedback->present) - windowRecord->reference_ust;
// Compute delta in usecs between target time and true time of swap:
t2p = timespec_diff_to_usec(&wayland_feedback->present, &wayland_feedback->target);
}
else {
p2p = 0;
t2p = 0;
}
if (PsychPrefStateGet_Verbosity() > 4) {
printf("PTB-DEBUG: SBC = %6lu: c2p %4u ms, p2p %5d us (refresh %6u us), t2p %6d us, [%s] MSC %" PRIu64 "\n",
wayland_feedback->sbc, c2p, p2p, refresh_nsec / 1000, t2p, wayland_pflags_to_str(flags, flagstr, sizeof(flagstr)), msc);
}
// Record sbc, msc, ust, present flags of this completed swap:
// Once for the feedback events used by our Screen('GetFlipInfo') logging functions:
wayland_feedback->present_status = 1; // "Presented".
wayland_feedback->present_flags = flags;
wayland_feedback->msc = msc;
wayland_feedback->ust = timespec_to_us(&wayland_feedback->present);
// Once for the windowRecord for internal use by PsychOSGetSwapCompletionTimestamp() internal
// timestamping and swap reliability asessment:
windowRecord->reference_sbc = wayland_feedback->sbc;
windowRecord->reference_msc = msc;
windowRecord->reference_ust = wayland_feedback->ust;
windowRecord->swapcompletiontype = flags;
// Delete our own completion wayland_feedback container if swap completion logging
// isn't enabled:
if (windowRecord->swapevents_enabled == 0) destroy_wayland_feedback(wayland_feedback);
return;
}
static void
wayland_feedback_discarded(void *data, struct wp_presentation_feedback *presentation_feedback)
{
struct wayland_feedback *wayland_feedback = data;
PsychWindowRecordType *windowRecord = wayland_feedback->windowRecord;
if (PsychPrefStateGet_Verbosity() > 1) printf("PTB-WARNING: Wayland presentation request discarded for SBC = %lu !\n", wayland_feedback->sbc);
// Once for the feedback events used by our Screen('GetFlipInfo') logging functions:
wayland_feedback->present_status = 2; // "Discarded/Skipped".
wayland_feedback->present_flags = 0;
wayland_feedback->msc = 0;
wayland_feedback->ust = 0;
// Once for the windowRecord for internal use by PsychOSGetSwapCompletionTimestamp() internal
// timestamping and swap reliability asessment:
windowRecord->reference_sbc = wayland_feedback->sbc;
windowRecord->reference_msc = 0;
windowRecord->reference_ust = 0;
windowRecord->swapcompletiontype = -1; // "Presentation discarded/Skipped"
// Delete our own completion wayland_feedback container if swap completion logging
// isn't enabled:
if (windowRecord->swapevents_enabled == 0) destroy_wayland_feedback(wayland_feedback);
}
static void
wayland_feedback_sync_output(void *data, struct wp_presentation_feedback *presentation_feedback, struct wl_output *output)
{
struct wayland_feedback *wayland_feedback = data;
PsychWindowRecordType *windowRecord = wayland_feedback->windowRecord;
if (PsychPrefStateGet_Verbosity() > 10) {
printf("PTB-INFO: Window %i uses Wayland output %p.\n", windowRecord->windowIndex, output);
}
}
static const struct wp_presentation_feedback_listener wayland_feedback_listener = {
.sync_output = wayland_feedback_sync_output,
.presented = wayland_feedback_presented,
.discarded = wayland_feedback_discarded
};
static void
wayland_window_create_feedback(PsychWindowRecordType* windowRecord)
{
struct wp_presentation *wayland_pres = get_wayland_presentation_extension(windowRecord);
struct wayland_feedback *wayland_feedback;
struct wl_surface *wl_surface;
struct waffle_wayland_window *wayland_window;
struct waffle_window* window = windowRecord->targetSpecific.windowHandle;
// Retrieve underlying native Wayland window:
union waffle_native_window *wafflewin = waffle_window_get_native(window);
wayland_window = wafflewin->wayland;
wl_surface = wayland_window->wl_surface;
free(wafflewin);
wafflewin = NULL;
// Noop if wp_presentation_feedback extension unavailable:
if (!wayland_pres) return;
// Create our own wayland_feedback container for swap completion events:
wayland_feedback = calloc(1, sizeof(*wayland_feedback));
if (!wayland_feedback) return;
wayland_feedback->windowRecord = windowRecord;
wayland_feedback->sbc = ++(windowRecord->submitted_sbc);
// Create wayland present_feedback object, attach listener callbacks to it:
wayland_feedback->feedback = wp_presentation_feedback(wayland_pres, wl_surface);
wp_presentation_feedback_add_listener(wayland_feedback->feedback, &wayland_feedback_listener, wayland_feedback);
// Record approximate time of swap submission according to the compositor clock:
clock_gettime(wayland_presentation_clock_id, &wayland_feedback->commit);
wayland_feedback->target = wayland_feedback->commit;
// Add to our queue of pending swap completion events:
wl_list_insert(&windowRecord->targetSpecific.presentation_feedback_list, &wayland_feedback->link);
}
// Perform OS specific processing of Window events:
void PsychOSProcessEvents(PsychWindowRecordType *windowRecord, int flags)
{
int w, h, x, y;
// Trigger event queue dispatch processing for GUI windows:
if (windowRecord == NULL) {
// No op, so far...
return;
}
// No-Op if we don't have a valid Wayland window:
if (!windowRecord->targetSpecific.xwindowHandle) return;
// TODO: Probably call Wayland display sync and use info from surface configure
// event. No-Op for now:
return;
// GUI windows need to behave GUIyee:
if ((windowRecord->specialflags & kPsychGUIWindow) && PsychIsOnscreenWindow(windowRecord) && !(windowRecord->specialflags & kPsychFbOverrideSizeActive)) {
// Update windows rect and globalrect, based on current size and location:
PsychLockDisplay();
x = y = w = h = 0;
PsychUnlockDisplay();
PsychMakeRect(windowRecord->globalrect, x, y, x + (int) w, y + (int) h);
PsychNormalizeRect(windowRecord->globalrect, windowRecord->rect);
PsychSetupClientRect(windowRecord);
PsychSetupView(windowRecord, FALSE);
}
}
/*
PsychOSOpenOnscreenWindow()
Creates the pixel format and the context objects and then instantiates the context onto the screen.
-The pixel format and the context are stored in the target specific field of the window recored. Close
should clean up by destroying both the pixel format and the context.
-We mantain the context because it must be be made the current context by drawing functions to draw into
the specified window.
-We maintain the pixel format object because there seems to be now way to retrieve that from the context.
-To tell the caller to clean up PsychOSOpenOnscreenWindow returns FALSE if we fail to open the window. It
would be better to just issue an PsychErrorExit() and have that clean up everything allocated outside of
PsychOpenOnscreenWindow().
*/
psych_bool PsychOSOpenOnscreenWindow(PsychScreenSettingsType * screenSettings, PsychWindowRecordType * windowRecord, int numBuffers, int stereomode, int conserveVRAM)
{
char windowTitle[32];
PsychRectType screenrect;
CGDirectDisplayID dpy;
int scrnum;
unsigned long mask;
int i, x, y, width, height, nrconfigs, buffdepth;
GLenum glerr;
int32_t attrib[41];
int attribcount = 0;
int stereoenableattrib = 0;
int depth, bpc;
int windowLevel;
int32_t opengl_api;
char backendname[16];
char backendname2[16];
struct waffle_config *config;
struct waffle_window *window;
union waffle_native_window *wafflewin;
struct waffle_wayland_window *wayland_window;
struct waffle_context *ctx;
// Always init the list for wayland present events:
wl_list_init(&windowRecord->targetSpecific.presentation_feedback_list);
// Define default rendering backend:
#ifdef PTB_USE_GLES1
opengl_api = WAFFLE_CONTEXT_OPENGL_ES1;
#else
opengl_api = WAFFLE_CONTEXT_OPENGL;
#endif
// Map the logical screen number to the corresponding X11 display connection handle
// for the corresponding X-Server connection.
PsychGetCGDisplayIDFromScreenNumber(&dpy, screenSettings->screenNumber);
// TODO FIXME: We currently don't have any way of selecting the target X-Screen 'scrnum' for
// our window, as Waffle does not yet support selection of X-Screen. It always opens
// windows on the display's default screen. Therefore this is mostly a dead placeholder for now:
scrnum = PsychGetXScreenIdForScreen(screenSettings->screenNumber);
// Include onscreen window index in title:
sprintf(windowTitle, "PTB Onscreen Window [%i]:", windowRecord->windowIndex);
// Set windowing system backend type for this window to Wayland:
windowRecord->winsysType = (int) WAFFLE_PLATFORM_WAYLAND;
// Translate spec to human readable name and spec string:
sprintf(backendname, "Wayland/EGL");
sprintf(backendname2, "wayland");
// Announce actual choice of backend to runtime environment. This is a marker
// to, e.g., moglcore, so it can adapt its context/gl setup:
setenv("PSYCH_USE_DISPLAY_BACKEND", backendname2, 1);
if (PsychPrefStateGet_Verbosity() > 3) {
printf("PTB-INFO: Wayland display backend '%s' initialized [%s].\n", backendname, backendname2);
}
// Allow usercode to override our default backend choice via environment variable:
if (getenv("PSYCH_USE_GFX_BACKEND")) {
if (!strcmp(getenv("PSYCH_USE_GFX_BACKEND"), "gl")) opengl_api = WAFFLE_CONTEXT_OPENGL;
if (!strcmp(getenv("PSYCH_USE_GFX_BACKEND"), "gles1")) opengl_api = WAFFLE_CONTEXT_OPENGL_ES1;
if (!strcmp(getenv("PSYCH_USE_GFX_BACKEND"), "gles2")) opengl_api = WAFFLE_CONTEXT_OPENGL_ES2;
if (!strcmp(getenv("PSYCH_USE_GFX_BACKEND"), "gles3")) opengl_api = WAFFLE_CONTEXT_OPENGL_ES3;
}
switch (opengl_api) {
case WAFFLE_CONTEXT_OPENGL:
sprintf(backendname, "OpenGL");
break;
case WAFFLE_CONTEXT_OPENGL_ES1:
sprintf(backendname, "OpenGL-ES 1");
break;
case WAFFLE_CONTEXT_OPENGL_ES2:
sprintf(backendname, "OpenGL-ES 2");
break;
case WAFFLE_CONTEXT_OPENGL_ES3:
sprintf(backendname, "OpenGL-ES 3");
break;
default:
sprintf(backendname, "UNKNOWN");
}
// Try the requested backend, try alternate backends on failure:
if (!waffle_display_supports_context_api(waffle_display, opengl_api)) {
if (PsychPrefStateGet_Verbosity() > 1) printf("PTB-WARNING: Selected Waffle display backend does not support requested OpenGL rendering API '%s': %s. Trying fallbacks...\n",
backendname, waffle_error_to_string(waffle_error_get_code()));
// Try fallbacks: OpenGL > OpenGL-ES1 > OpenGL-ES2 > OpenGL-ES3
if (waffle_display_supports_context_api(waffle_display, WAFFLE_CONTEXT_OPENGL)) {
opengl_api = WAFFLE_CONTEXT_OPENGL;
}
else if (waffle_display_supports_context_api(waffle_display, WAFFLE_CONTEXT_OPENGL_ES1)) {
opengl_api = WAFFLE_CONTEXT_OPENGL_ES1;
}
else if (waffle_display_supports_context_api(waffle_display, WAFFLE_CONTEXT_OPENGL_ES2)) {
opengl_api = WAFFLE_CONTEXT_OPENGL_ES2;
}
else if (waffle_display_supports_context_api(waffle_display, WAFFLE_CONTEXT_OPENGL_ES3)) {
opengl_api = WAFFLE_CONTEXT_OPENGL_ES3;
}
else {
// Game over:
if (PsychPrefStateGet_Verbosity() > 0) printf("PTB-ERROR: Waffle display backend does not support any OpenGL rendering API: %s. Game over!\n",
waffle_error_to_string(waffle_error_get_code()));
return(FALSE);
}
}
// Assign human readable name to selected OpenGL rendering api. Also assign
// type flag for higher-level code:
switch (opengl_api) {
case WAFFLE_CONTEXT_OPENGL:
sprintf(backendname, "OpenGL");
sprintf(backendname2, "gl");
windowRecord->glApiType = 0;
break;
case WAFFLE_CONTEXT_OPENGL_ES1:
sprintf(backendname, "OpenGL-ES 1");
sprintf(backendname2, "gles1");
windowRecord->glApiType = 10;
break;
case WAFFLE_CONTEXT_OPENGL_ES2:
sprintf(backendname, "OpenGL-ES 2");
sprintf(backendname2, "gles2");
windowRecord->glApiType = 20;
break;
case WAFFLE_CONTEXT_OPENGL_ES3:
sprintf(backendname, "OpenGL-ES 3");
sprintf(backendname2, "gles3");
windowRecord->glApiType = 30;
break;
default:
sprintf(backendname, "UNKNOWN");
sprintf(backendname2, "X");
windowRecord->glApiType = 0;
}
// Tell environment about our final rendering backend choice:
setenv("PSYCH_USE_GFX_BACKEND", backendname2, 1);
// OpenGL embedded subset api in use?
if (windowRecord->glApiType > 0) {
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Waffle display backend connected to OpenGL rendering API '%s' [%s].\n", backendname, backendname2);
// Yes: Try to disable all OpenGL error checking for now during initial OpenGL-ES support bringup.
// We know there will be many errors due to incompatibilities but just try to keep going and rely
// on external trace and debug tools to find and fix errors at this point:
PsychPrefStateSet_ConserveVRAM(PsychPrefStateGet_ConserveVRAM() | kPsychAvoidCPUGPUSync);
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Will try to disable/suppress all internal OpenGL error reporting/handling for OpenGL-ES operation.\n");
}
// Mark window as EGL controlled:
windowRecord->specialflags |= kPsychIsEGLWindow;
// Retrieve windowLevel, an indicator of where non-fullscreen windows should
// be located wrt. to other windows. 0 = Behind everything else, occluded by
// everything else. 1 - 999 = At layer windowLevel -> Occludes stuff on layers "below" it.
// 1000 - 1999 = At highest level, but partially translucent / alpha channel allows to make
// regions transparent. 2000 or higher: Above everything, fully opaque, occludes everything.
// 2000 is the default.
windowLevel = PsychPrefStateGet_WindowShieldingLevel();
// Init userspace GL context to safe default:
windowRecord->targetSpecific.glusercontextObject = NULL;
windowRecord->targetSpecific.glswapcontextObject = NULL;
// Default to use of one shared x-display connection "dpy" for all onscreen windows
// on a given x-display and x-screen:
// windowRecord->targetSpecific.privDpy = dpy;
// HACK TODO:
windowRecord->targetSpecific.privDpy = NULL;
// Check if this should be a fullscreen window:
PsychGetScreenRect(screenSettings->screenNumber, screenrect);
if (PsychMatchRect(screenrect, windowRecord->rect)) windowRecord->specialflags |= kPsychIsFullscreenWindow;
PsychGetGlobalScreenRect(screenSettings->screenNumber, screenrect);
if (PsychMatchRect(screenrect, windowRecord->rect)) windowRecord->specialflags |= kPsychIsFullscreenWindow;
if (windowRecord->specialflags & kPsychIsFullscreenWindow) {
// This is supposed to be a fullscreen window with the dimensions of
// the current display/desktop:
x = 0;
y = 0;
width = PsychGetWidthFromRect(screenrect);
height = PsychGetHeightFromRect(screenrect);
// Mark this window as fullscreen window:
windowRecord->specialflags |= kPsychIsFullscreenWindow;
// Copy absolute screen location and area of window to 'globalrect',
// so functions like Screen('GlobalRect') can still query the real
// bounding box of a window onscreen:
PsychGetGlobalScreenRect(screenSettings->screenNumber, windowRecord->globalrect);
} else {
// Window size different from current screen size:
// A regular desktop window with borders and control icons is requested, e.g., for debugging:
// Extract settings:
x = windowRecord->rect[kPsychLeft];
y = windowRecord->rect[kPsychTop];
width = PsychGetWidthFromRect(windowRecord->rect);
height = PsychGetHeightFromRect(windowRecord->rect);
// Copy absolute screen location and area of window to 'globalrect',
// so functions like Screen('GlobalRect') can still query the real
// bounding gox of a window onscreen:
PsychCopyRect(windowRecord->globalrect, windowRecord->rect);
}
// Select OpenGL context API for use with this window:
attrib[attribcount++] = WAFFLE_CONTEXT_API;
attrib[attribcount++] = opengl_api;
// Which display depth is supported?
depth = PsychGetValueFromDepthStruct(0, &(screenSettings->depth));
// Select requested depth per color component 'bpc' for each channel:
bpc = 8; // We default to 8 bpc == RGBA8
if (windowRecord->depth == 30) {
bpc = 10;
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Trying to enable at least 10 bpc fixed point framebuffer.\n");
}
if (windowRecord->depth == 33) {
bpc = 11;
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Trying to enable at least 11 bpc fixed point framebuffer.\n");
}
if (windowRecord->depth == 48) {
bpc = 16;
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Trying to enable at least 16 bpc fixed point framebuffer.\n");
}
if (windowRecord->depth == 64) {
bpc = 16;
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Trying to enable 16 bpc fixed point framebuffer.\n");
}
if (windowRecord->depth == 128) {
bpc = 32;
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: Trying to enable 32 bpc fixed point framebuffer.\n");
}
attrib[attribcount++] = WAFFLE_RED_SIZE; // Setup requested minimum depth of each color channel:
attrib[attribcount++] = (depth > 16) ? bpc : 1;
attrib[attribcount++] = WAFFLE_GREEN_SIZE;
attrib[attribcount++] = (depth > 16) ? bpc : 1;
attrib[attribcount++] = WAFFLE_BLUE_SIZE;
attrib[attribcount++] = (depth > 16) ? bpc : 1;
attrib[attribcount++] = WAFFLE_ALPHA_SIZE;
// Alpha channel needs special treatment:
if ((bpc != 10) && (bpc != 11)) {
// Non 10/11 bpc drawable: Request a 'bpc' alpha channel if the underlying framebuffer
// is in true-color mode ( >= 24 bpp format). If framebuffer is in 16 bpp mode, we
// don't have/request an alpha channel at all:
attrib[attribcount++] = (depth > 16) ? bpc : 0; // In 16 bit mode, we don't request an alpha-channel.
} else if (bpc == 10) {
// 10 bpc drawable: We have a 32 bpp pixel format with R10G10B10 10 bpc per color channel.
// There are at most 2 bits left for the alpha channel, so we request an alpha channel with
// minimum size 1 bit --> Will likely translate into a 2 bit alpha channel:
attrib[attribcount++] = 1;
}
else {
// 11 bpc drawable - or more likely a 32 bpp drawable with R11G11B10, ie., all 32 bpp
// used up by RGB color info and no space for alpha bits. Therefore do not request an
// alpha channel:
attrib[attribcount++] = 0;
}
// Stereo display support: If stereo display output is requested with OpenGL native stereo,
// we request a stereo-enabled rendering context. Or at least we would, if Waffle would support this.
if (stereomode == kPsychOpenGLStereo) {
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: OpenGL native quad-buffered stereomode requested, but this is not supported by the Wayland backend.\n");
}
// Multisampling support:
if (windowRecord->multiSample > 0) {
// Request a multisample buffer:
attrib[attribcount++] = WAFFLE_SAMPLE_BUFFERS;
attrib[attribcount++] = 1;
// Request at least multiSample samples per pixel:
attrib[attribcount++] = WAFFLE_SAMPLES;
attrib[attribcount++] = windowRecord->multiSample;
}
// Support for OpenGL 3D rendering requested?
if (PsychPrefStateGet_3DGfx()) {
// Yes. Allocate and attach a 24 bit depth buffer and 8 bit stencil buffer:
attrib[attribcount++] = WAFFLE_DEPTH_SIZE;
attrib[attribcount++] = 24;
attrib[attribcount++] = WAFFLE_STENCIL_SIZE;
attrib[attribcount++] = 8;
// Alloc an accumulation buffer as well?
if (PsychPrefStateGet_3DGfx() & 2) {
// Yes: Allocate an accumulation buffer if possible:
attrib[attribcount++] = WAFFLE_ACCUM_BUFFER;
attrib[attribcount++] = 1;
}
}
// Double buffering requested?
attrib[attribcount++] = WAFFLE_DOUBLE_BUFFERED;
attrib[attribcount++] = (numBuffers >= 2) ? 1 : 0;
// Finalize attrib array:
attrib[attribcount++] = 0;
PsychLockDisplay();
// Choose waffle configuration for attrib's - the equivalent of
// a pixelformat or framebuffer config in GLX speak:
config = waffle_config_choose(waffle_display, attrib);
if (!config) {
// Failed to find matching visual: Could it be related to request for unsupported native 10/11/16 bpc framebuffer?
if (((windowRecord->depth == 30) && (bpc == 10)) || ((windowRecord->depth == 33) && (bpc == 11)) || ((windowRecord->depth == 48) && (bpc == 16))) {
// 10/11/16 bpc framebuffer requested: Let's see if we can get a visual by lowering our demand to 8 bpc:
for (i = 0; i < attribcount && attrib[i] != WAFFLE_RED_SIZE; i++);
attrib[i + 1] = 8;
for (i = 0; i < attribcount && attrib[i] != WAFFLE_GREEN_SIZE; i++);
attrib[i + 1] = 8;
for (i = 0; i < attribcount && attrib[i] != WAFFLE_BLUE_SIZE; i++);
attrib[i + 1] = 8;
for (i = 0; i < attribcount && attrib[i] != WAFFLE_ALPHA_SIZE; i++);
attrib[i + 1] = 1;
// Retry:
config = waffle_config_choose(waffle_display, attrib);
}
}
if (!config) {
// Failed to find matching visual: Could it be related to multisampling?
if (windowRecord->multiSample > 0) {
// Multisampling requested: Let's see if we can get a visual by
// lowering our demand:
for (i = 0; i < attribcount && attrib[i] != WAFFLE_SAMPLES; i++);
while (!config && windowRecord->multiSample > 0) {
attrib[i + 1]--;
windowRecord->multiSample--;
config = waffle_config_choose(waffle_display, attrib);
}
// Either we have a valid visual at this point or we still fail despite
// requesting zero samples.
if (!config) {
// We still fail. Disable multisampling by requesting zero multisample buffers:
for (i = 0; i < attribcount && attrib[i] != WAFFLE_SAMPLE_BUFFERS; i++);
windowRecord->multiSample = 0;
attrib[i + 1] = 0;
config = waffle_config_choose(waffle_display, attrib);
}
}
// Worked? If not, see if we can lower our 3D settings if in 3D mode:
if (!config && PsychPrefStateGet_3DGfx()) {
// Ok, retry with a 16 bit depth buffer...
for (i = 0; i < attribcount && attrib[i] != WAFFLE_DEPTH_SIZE; i++);
if (attrib[i] == WAFFLE_DEPTH_SIZE && i < attribcount) attrib[i + 1] = 16;
if (PsychPrefStateGet_Verbosity() > 1) printf("PTB-WARNING: Have to use 16 bit depth buffer instead of 24 bit buffer due to limitations of your gfx-hardware or driver. Accuracy of 3D-Gfx may be limited...\n");
config = waffle_config_choose(waffle_display, attrib);
if (!config) {
// Failed again. Retry with disabled stencil buffer:
if (PsychPrefStateGet_Verbosity() > 1) printf("PTB-WARNING: Have to disable stencil buffer due to limitations of your gfx-hardware or driver. Some 3D Gfx algorithms may fail...\n");
for (i = 0; i < attribcount && attrib[i] != WAFFLE_STENCIL_SIZE; i++);
if (attrib[i] == WAFFLE_STENCIL_SIZE && i < attribcount) attrib[i + 1] = 0;
config = waffle_config_choose(waffle_display, attrib);
}
}
}
if (!config) {
// Ok, nothing worked. Require the absolute minimum configuration:
if (PsychPrefStateGet_Verbosity() > 1) printf("PTB-WARNING: Could not get any display configuration matching your minimum requirements. Trying to get the bare minimum config of a RGB framebuffer of arbitrarily low resolution now.\n");
attribcount = 0;
attrib[attribcount++] = WAFFLE_CONTEXT_API;
attrib[attribcount++] = opengl_api;
attrib[attribcount++] = WAFFLE_RED_SIZE;
attrib[attribcount++] = 1;
attrib[attribcount++] = WAFFLE_GREEN_SIZE;
attrib[attribcount++] = 1;
attrib[attribcount++] = WAFFLE_BLUE_SIZE;
attrib[attribcount++] = 1;
attrib[attribcount++] = WAFFLE_ALPHA_SIZE;
attrib[attribcount++] = WAFFLE_DONT_CARE;
config = waffle_config_choose(waffle_display, attrib);
}
// Finally?
if (!config) {
// Game over:
if (PsychPrefStateGet_Verbosity() > 0) printf("\nPTB-ERROR[waffle_config_choose() failed]: Couldn't get any suitable visual from display backend.\n\n");
PsychUnlockDisplay();
return (FALSE);
}
// Create our onscreen window:
window = NULL;
if (FALSE) {
// Old style: Use Waffle for this -- Too restricted for our purpose as it does not
// allow definition of the wayland output (aka PTB screen aka monitor) to display
// the window on in fullscreen mode. We use our own code below via xdg_toplevel_set_fullscreen()...
// Code left here for now for testing Waffle itself...
// Fullscreen opaque?
if ((windowRecord->specialflags & kPsychIsFullscreenWindow) && (windowLevel < 1000 || windowLevel >= 2000)) {
// This works for compositors which support xdg shell:
// NOTE: Does not work for selection of video output! Compositor decides!
intptr_t window_attrib_list[3];
attribcount = 0;
window_attrib_list[attribcount++] = WAFFLE_WINDOW_FULLSCREEN;
window_attrib_list[attribcount++] = true;
window_attrib_list[attribcount++] = 0;
window = waffle_window_create2(config, window_attrib_list);
if (!window && (PsychPrefStateGet_Verbosity() > 1))
printf("\nPTB-WARNING: Could not create Wayland fullscreen window: %s\n", waffle_error_to_string(waffle_error_get_code()));
}
}
// Create onscreen window, in windowed non-fullscreen configuration first:
if (!window) {
window = waffle_window_create(config, width, height);
}
if (!window) {
if (PsychPrefStateGet_Verbosity() > 0)
printf("\nPTB-ERROR: Could not create Wayland window [waffle_window_create() failed]: %s\n", waffle_error_to_string(waffle_error_get_code()));
PsychUnlockDisplay();
return (FALSE);
}
wafflewin = waffle_window_get_native(window);
wayland_window = wafflewin->wayland;
// Set hints for window sizing and positioning:
// TODO FIXME Wayland...
{
XSizeHints sizehints;
sizehints.x = x;
sizehints.y = y;
sizehints.width = width;
sizehints.height = height;
// Let window manager control window position if kPsychGUIWindowWMPositioned is set:
sizehints.flags = USSize | (windowRecord->specialflags & kPsychGUIWindowWMPositioned) ? 0 : USPosition;
}
// Create associated OpenGL rendering context: We use ressource
// sharing of textures, display lists, FBO's and shaders if 'slaveWindow'
// is assigned for that purpose as master-window.
ctx = waffle_context_create(config, ((windowRecord->slaveWindow) ? windowRecord->slaveWindow->targetSpecific.contextObject : NULL));
if (!ctx) {
if (PsychPrefStateGet_Verbosity() > 0) printf("\nPTB-ERROR:[waffle_context_create() failed] OpenGL context creation failed: %s\n\n", waffle_error_to_string(waffle_error_get_code()));
PsychUnlockDisplay();
return (FALSE);
}
// Store the handles:
// windowHandle is a waffle_window*:
windowRecord->targetSpecific.windowHandle = window;
// xwindowHandle stores the underlying Wayland "window":
windowRecord->targetSpecific.xwindowHandle = wayland_window->wl_surface;
// Provide a pointer back to windowRecord in the wl_surface:
wl_surface_set_user_data(wayland_window->wl_surface, (void *) windowRecord);
// waffle_display*
windowRecord->targetSpecific.deviceContext = waffle_display;
// waffle_context*
windowRecord->targetSpecific.contextObject = ctx;
// Create rendering context for async flips with identical config as main context, share all heavyweight ressources with it:
windowRecord->targetSpecific.glswapcontextObject = waffle_context_create(config, windowRecord->targetSpecific.contextObject);
if (windowRecord->targetSpecific.glswapcontextObject == NULL) {
if (PsychPrefStateGet_Verbosity() > 0) printf("\nPTB-ERROR[SwapContextCreation failed]: Creating a private OpenGL context for async flips failed for unknown reasons.\n\n");
PsychUnlockDisplay();
return (FALSE);
}
// External 3D graphics support enabled?
if (PsychPrefStateGet_3DGfx()) {
// Yes. We need to create an extra OpenGL rendering context for the external
// OpenGL code to provide optimal state-isolation. The context shares all
// heavyweight ressources likes textures, FBOs, VBOs, PBOs, display lists and
// starts off as an identical copy of PTB's context as of here.
// Create rendering context with identical config as main context, share all heavyweight ressources with it:
windowRecord->targetSpecific.glusercontextObject = waffle_context_create(config, windowRecord->targetSpecific.contextObject);
if (windowRecord->targetSpecific.glusercontextObject == NULL) {
if (PsychPrefStateGet_Verbosity() > 0) printf("\nPTB-ERROR[UserContextCreation failed]: Creating a private OpenGL context for MOGL failed for unknown reasons.\n\n");
PsychUnlockDisplay();
return (FALSE);
}
}
// Release config info:
waffle_config_destroy(config);
// Setup window transparency:
if ((windowLevel >= 1000) && (windowLevel < 2000)) {
// For windowLevels between 1000 and 1999, make the window background transparent, so standard GUI
// would be visible, wherever nothing is drawn, i.e., where alpha channel is zero:
// Levels 1000 - 1499 and 1500 to 1999 map to a master opacity level of 0.0 - 1.0:
unsigned int opacity = (unsigned int)(0xffffffff * (((float)(windowLevel % 500)) / 499.0));
// TODO FIXME Wayland...
}
// If this window is a GUI window then enable all window decorations and
// manipulations, except for the window close button, which would wreak havoc:
if (windowRecord->specialflags & kPsychGUIWindow) {
// TODO Wayland
}
// For windowLevels of at least 500, tell window manager to try to keep
// our window above most other windows, by setting the state to WM_STATE_ABOVE:
if (windowLevel >= 500) {
// TODO Wayland
}
// Sync with server:
wl_display_roundtrip(wl_display);
// Show our new window:
if (windowLevel != -1) {
struct wl_region *region = wl_compositor_create_region(wl_compositor);
// Is this window supposed to be transparent to user input (mouse, keyboard etc.)?
if ((windowLevel >= 1000) && (windowLevel < 1500)) {
// Yes. Assign our currently empty 'region' as input region, so
// the surface doesn't care about input but input is sent to
// surfaces below our onscreen windows surface:
wl_surface_set_input_region(wayland_window->wl_surface, region);
// Note: The default input region is infinite, covering the whole
// surface, ie., the whole surface accepts user input. Therefore
// nothing to do in the regular case.
}
// Is this window supposed to be opaque / non-transparent?
if (windowLevel < 1000 || windowLevel >= 2000) {
// Yes. Define an opaque region the full size of the windows area:
wl_region_add(region, 0, 0, width, height);
wl_surface_set_opaque_region(wayland_window->wl_surface, region);
}
// Done with defining input and display regions, so destroy our region:
wl_region_destroy(region);
if (PsychPrefStateGet_Verbosity() > 3)
printf("PTB-INFO: Onscreen window uses: wl_shell_surface %p, xdg_toplevel %p\n", wayland_window->wl_shell_surface, wayland_window->xdg_toplevel);
// Is this supposed to be a fullscreen window?
if ((windowRecord->specialflags & kPsychIsFullscreenWindow) && (windowLevel < 1000 || windowLevel >= 2000)) {
int milliHz = 0;
// Opaque fullscreen onscreen window setup:
if (PsychPrefStateGet_Verbosity() > 3) {
printf("PTB-INFO: Opening fullscreen onscreen window on screen %i - wl_output %p\n",
screenSettings->screenNumber, displayWaylandOutputs[screenSettings->screenNumber]);
}
// Video refresh rate switch requested?
if (displayOriginalCGSettingsValid[screenSettings->screenNumber]) {
// Video refresh rate switch requested:
milliHz = (int) (PsychGetNominalFramerate(screenSettings->screenNumber) * 1000.0 + 0.5);
if (PsychPrefStateGet_Verbosity() > 3) {
printf("PTB-INFO: Requesting video mode switch for fullscreen windw to a target of %i x %i pixels at %i milliHz.\n", width, height, milliHz);
}
}
if (wayland_window->wl_shell_surface) {
// WL_SHELL_SURFACE_FULLSCREEN_METHOD_DRIVER - Switch video output to optimal resolution to accomodate the
// size of the surface, ie., the mode with the smallest resolution that can contain the surface. Add black
// borders for padding if a perfect fit isn't possible.
wl_shell_surface_set_fullscreen(wayland_window->wl_shell_surface, WL_SHELL_SURFACE_FULLSCREEN_METHOD_DRIVER, milliHz, displayWaylandOutputs[screenSettings->screenNumber]);
} else {
// XDG shell: Not much options. We can set it fullscreen, requesting a specific target wayland output,
// that's it. Everything else is at the compositors discretion:
xdg_toplevel_set_fullscreen(wayland_window->xdg_toplevel, displayWaylandOutputs[screenSettings->screenNumber]);
waffle_window_show(window);
}
}
else {
// A windowed window aka non-fullscreen, or a transparent fullscreen window.
if (windowRecord->specialflags & kPsychGUIWindow) {
// A GUI window. Nothing to do yet.
}
// Show it as toplevel window:
if (wayland_window->wl_shell_surface)
wl_shell_surface_set_toplevel(wayland_window->wl_shell_surface);
else
waffle_window_show(window);
}
// Give the window a title:
if (wayland_window->wl_shell_surface)
wl_shell_surface_set_title(wayland_window->wl_shell_surface, windowTitle);
else
xdg_toplevel_set_title(wayland_window->xdg_toplevel, windowTitle);
// Make it so!
wl_display_roundtrip(wl_display);
}
// If windowLevel is zero, lower it to the bottom of the stack of windows:
if (windowLevel == 0) {
// TODO Wayland
}
if (!(windowRecord->specialflags & kPsychGUIWindowWMPositioned)) {
// TODO Wayland
// XMoveWindow(dpy, win, x, y);
}
// Ok, the onscreen window is ready on the screen. Time for OpenGL setup...
// Activate the associated rendering context:
waffle_make_current(waffle_display, window, ctx);
// Ok, the OpenGL rendering context is up and running. Auto-detect and bind all
// available OpenGL extensions via GLEW:
glerr = glewInit();
if (GLEW_OK != glerr) {
/* Problem: glewContextInit failed, something is seriously wrong. */
if (PsychPrefStateGet_Verbosity() > 0) printf("\nPTB-ERROR[GLEW init failed: %s]: Please report this to the forum. Will try to continue, but may crash soon!\n\n", glewGetErrorString(glerr));
} else {
if (PsychPrefStateGet_Verbosity() > 3) printf("PTB-INFO: Using GLEW version %s for automatic detection of OpenGL extensions...\n", glewGetString(GLEW_VERSION));
}
fflush(NULL);
// Increase our own open window counter:
open_windowcount++;
// Disable screensavers:
if (open_windowcount == 1) {
// TODO Wayland
}
if (!egl_display && (PsychPrefStateGet_Verbosity() > 1)) {
printf("PTB-WARNING: The Wayland display backend does not allow to control synchronization of bufferswap to vertical retrace.\n");
}
PsychUnlockDisplay();
// Ok, we should be ready for OS independent setup...
fflush(NULL);
// First opened onscreen window? If so, we try to map GPU MMIO registers
// to enable beamposition based timestamping and other special goodies:
if (open_windowcount == 1) PsychScreenMapRadeonCntlMemory();
PsychLockDisplay();
// Retrieve modeline of current video mode on primary crtc for the screen to which
// this onscreen window is assigned. Could also query useful info about crtc, but let's not
// overdo it in the first iteration...
XRRCrtcInfo *crtc_info = NULL;
XRRModeInfo *mode = PsychOSGetModeLine(screenSettings->screenNumber, 0, &crtc_info);
if (mode) {
// Assign modes display height aka vactive or vdisplay as startline of vblank interval:
windowRecord->VBL_Startline = mode->height;
// Assign vbl endline as vtotal - 1:
// TODO: Don't know how to get this on Wayland, but not critical, as it would
// only be needed for the beamposition timestamping fallback, which itself
// should usually not be needed due to present_feedback extension:
// windowRecord->VBL_Endline = mode->vTotal - 1;
// Check for output display rotation enabled. Will likely impair timing/timestamping
// because it uses copy-swaps via an intermediate shadow framebuffer to do rotation
// during copy-swap blit, instead of via rotated crtc scanout, as most crtc's don't
// support this in hardware:
// TODO: Wayland is more clever here, but need to investigate how this maps to
// our standard method of solving such issues via imaging pipeline. Leave warning
// of for the moment.
//if ((crtc_info->rotation != RR_Rotate_0) && (PsychPrefStateGet_Verbosity() > 1)) {
// printf("PTB-WARNING: Your primary output display has hardware rotation enabled. It is not displaying in upright orientation.\n");
// printf("PTB-WARNING: On many graphics cards, this will cause unreliable stimulus presentation timing and timestamping.\n");
// printf("PTB-WARNING: If you want non-upright stimulus presentation, look at 'help PsychImaging' on how to achieve this in\n");
// printf("PTB-WARNING: a way that doesn't impair timing. The subfunctions 'FlipHorizontal' and 'FlipVertical' are what you probably need.\n");
//}
XRRFreeCrtcInfo(crtc_info);
}
PsychUnlockDisplay();
// Display unlocked from here on...
// OpenGL-ES bindings needed?
if (PsychIsGLES(windowRecord)) {
// Yes: Allow userspace to force rebinding:
psych_bool forceRebind = (getenv("PSYCH_FORCE_REBINDGLES")) ? TRUE : FALSE;
// Which version of OpenGL-ES? Set proper selector:
int32_t apidl = 0;
if (windowRecord->glApiType < 20) {
apidl = WAFFLE_DL_OPENGL_ES1;
}
else if (windowRecord->glApiType < 30) {
apidl = WAFFLE_DL_OPENGL_ES2;
}
else if (windowRecord->glApiType < 40) {
apidl = WAFFLE_DL_OPENGL_ES3;
}
else printf("PTB-WARNING: Unsupported OpenGL-ES API version >= 4.0! Update the code, this may end badly!!\n");
// Some diagnostics for forceRebind mode:
if (forceRebind) printf("PTB-DEBUG: Forced rebinding of OpenGL-ES extensions requested.\n");
if (PsychPrefStateGet_Verbosity() > 4) printf("PTB-DEBUG: Pre-GLES-Rebind: glBindFramebufferEXT = %p , glBindFramebuffer = %p \n",
(void*) glBindFramebufferEXT, (void*) waffle_dl_sym(WAFFLE_DL_OPENGL_ES2, "glBindFramebuffer"));
// Try to rebind OpenGL-ES specific entry points to standard desktop OpenGL entry
// points of compatible syntax and semantics, so we don't need to rewrite lots of
// desktop GL support code just to account for syntactic sugar.
// Needed in imaging pipeline: ES implementations don't expose the ARB suffixed version anymore,
// as glActiveTexture() is part of core-spec:
if (NULL == glActiveTextureARB || forceRebind) glActiveTextureARB = waffle_dl_sym(apidl, "glActiveTexture");
glOrthof = waffle_dl_sym(WAFFLE_DL_OPENGL_ES1, "glOrthof");
if (NULL == glOrthof) glOrthof = waffle_dl_sym(WAFFLE_DL_OPENGL_ES1, "glOrthofOES");
if (NULL == glOrthof) {
printf("PTB-ERROR: NO glOrthofOES() or glOrthof() available under OpenGL-ES api! This will not work with OpenGL-ES! Aborting.\n");
return(FALSE);
}
// Bind glBlitFrameBuffer() if provided by extension or by core OpenGL-ES3:
if (strstr(glGetString(GL_EXTENSIONS), "GL_NV_framebuffer_blit") || (windowRecord->glApiType >= 30)) {
glBlitFramebufferEXT = waffle_dl_sym(apidl, "glBlitFramebufferNV");
if (NULL == glBlitFramebufferEXT) glBlitFramebufferEXT = waffle_dl_sym(WAFFLE_DL_OPENGL_ES3, "glBlitFramebuffer");
if (NULL == glBlitFramebufferEXT) printf("PTB-ERROR: Could not bind glBlitFramebuffer() function as expected! This may end in a crash!\n");
}
// Framebuffer objects supported? As extension on ES-1, core on ES-2+
if (strstr(glGetString(GL_EXTENSIONS), "framebuffer_object") || (windowRecord->glApiType >= 20)) {
// FBO extension or core code binding:
// Some of this is a mess, as apparently each ES implementation vendor does its own non-standard thing. In theory it should be
// enough to query for the "OES" suffixed entry points on the api as defined by apidl. In practice, three different
// implementations (MESA, NVidia binary desktop GL drivers, NVidia binary Tegra drivers) required three different types
// of hacks to get it working. We try the following strategy:
// First try to bind ES-1 standard compliant: OES suffix and apidl as selected. Then retry without OES suffix with higher
// apidl versions:
if (apidl == WAFFLE_DL_OPENGL_ES1) {
// OpenGL-ES 1: Framebuffer objects are only available as extension, so entry points should be OES-suffixed. Try with OES suffix:
if (NULL == glBindFramebufferEXT || forceRebind) glBindFramebufferEXT = waffle_dl_sym(apidl, "glBindFramebufferOES");
if (NULL == glDeleteFramebuffersEXT || forceRebind) glDeleteFramebuffersEXT = waffle_dl_sym(apidl, "glDeleteFramebuffersOES");
if (NULL == glGenFramebuffersEXT || forceRebind) glGenFramebuffersEXT = waffle_dl_sym(apidl, "glGenFramebuffersOES");
if (NULL == glIsFramebufferEXT || forceRebind) glIsFramebufferEXT = waffle_dl_sym(apidl, "glIsFramebufferOES");
if (NULL == glCheckFramebufferStatusEXT || forceRebind) glCheckFramebufferStatusEXT = waffle_dl_sym(apidl, "glCheckFramebufferStatusOES");
if (NULL == glFramebufferTexture2DEXT || forceRebind) glFramebufferTexture2DEXT = waffle_dl_sym(apidl, "glFramebufferTexture2DOES");
if (NULL == glFramebufferRenderbufferEXT || forceRebind) glFramebufferRenderbufferEXT = waffle_dl_sym(apidl, "glFramebufferRenderbufferOES");
if (NULL == glGetFramebufferAttachmentParameterivEXT || forceRebind) glGetFramebufferAttachmentParameterivEXT = waffle_dl_sym(apidl, "glGetFramebufferAttachmentParameterivOES");
if (NULL == glGenerateMipmapEXT || forceRebind) glGenerateMipmapEXT = waffle_dl_sym(apidl, "glGenerateMipmapOES");
if (NULL == glIsRenderbufferEXT || forceRebind) glIsRenderbufferEXT = waffle_dl_sym(apidl, "glIsRenderbufferOES");
if (NULL == glBindRenderbufferEXT || forceRebind) glBindRenderbufferEXT = waffle_dl_sym(apidl, "glBindRenderbufferOES");
if (NULL == glDeleteRenderbuffersEXT || forceRebind) glDeleteRenderbuffersEXT = waffle_dl_sym(apidl, "glDeleteRenderbuffersOES");
if (NULL == glGenRenderbuffersEXT || forceRebind) glGenRenderbuffersEXT = waffle_dl_sym(apidl, "glGenRenderbuffersOES");
if (NULL == glRenderbufferStorageEXT || forceRebind) glRenderbufferStorageEXT = waffle_dl_sym(apidl, "glRenderbufferStorageOES");
if (NULL == glGetRenderbufferParameterivEXT || forceRebind) glGetRenderbufferParameterivEXT = waffle_dl_sym(apidl, "glGetRenderbufferParameterivOES");
}
// Try binding without OES suffix: We do this for OpenGL-ES2 and later, as FBO's are part of the core,
// and on OpenGL-ES1 if the "OES" binding failed, e.g., on the non standard compliant NVidia Tegra binary drivers:
if ((apidl != WAFFLE_DL_OPENGL_ES1) || (NULL == glBindFramebufferEXT)) {
// NVidia weirdness?
if (apidl == WAFFLE_DL_OPENGL_ES1) {
// Yes. Their Tegra OpenGL-ES1 library internally loads their OpenGL-ES2 library behind our back
// and then uses their ES-2 functionality to emulate ES-1 behaviour, ie., their ES-1 lib is a wrapper
// around ES-2 libs, using self-defined shaders etc. to replicate fixed-pipeline behaviour. Unfortunately
// their emulation is not perfectly transparent, as their ES-1 libs claim FBO support, but get FBO entry
// points from ES-2 libs, thereby their entry points don't have the ES-1 compliant OES suffixes and our
// binding procedure for ES-1 above fails miserably. What to do? We query their ES-2 implementation/libs
// directly and bind ES2 entry points and hope this works and doesn't die a miserable death:
apidl = WAFFLE_DL_OPENGL_ES2;
// Of course they may pull the same trick with ES-2 vs. ES-3 some time, so if their ES-2 libs don't
// expose the most basic FBO entry point, we try with ES3:
if (NULL == waffle_dl_sym(apidl, "glBindFramebuffer")) apidl = WAFFLE_DL_OPENGL_ES3;
}
if (NULL == glBindFramebufferEXT || forceRebind) glBindFramebufferEXT = waffle_dl_sym(apidl, "glBindFramebuffer");
if (NULL == glDeleteFramebuffersEXT || forceRebind) glDeleteFramebuffersEXT = waffle_dl_sym(apidl, "glDeleteFramebuffers");
if (NULL == glGenFramebuffersEXT || forceRebind) glGenFramebuffersEXT = waffle_dl_sym(apidl, "glGenFramebuffers");
if (NULL == glIsFramebufferEXT || forceRebind) glIsFramebufferEXT = waffle_dl_sym(apidl, "glIsFramebuffer");
if (NULL == glCheckFramebufferStatusEXT || forceRebind) glCheckFramebufferStatusEXT = waffle_dl_sym(apidl, "glCheckFramebufferStatus");
if (NULL == glFramebufferTexture2DEXT || forceRebind) glFramebufferTexture2DEXT = waffle_dl_sym(apidl, "glFramebufferTexture2D");
if (NULL == glFramebufferRenderbufferEXT || forceRebind) glFramebufferRenderbufferEXT = waffle_dl_sym(apidl, "glFramebufferRenderbuffer");
if (NULL == glGetFramebufferAttachmentParameterivEXT || forceRebind) glGetFramebufferAttachmentParameterivEXT = waffle_dl_sym(apidl, "glGetFramebufferAttachmentParameteriv");
if (NULL == glGenerateMipmapEXT || forceRebind) glGenerateMipmapEXT = waffle_dl_sym(apidl, "glGenerateMipmap");
if (NULL == glIsRenderbufferEXT || forceRebind) glIsRenderbufferEXT = waffle_dl_sym(apidl, "glIsRenderbuffer");
if (NULL == glBindRenderbufferEXT || forceRebind) glBindRenderbufferEXT = waffle_dl_sym(apidl, "glBindRenderbuffer");
if (NULL == glDeleteRenderbuffersEXT || forceRebind) glDeleteRenderbuffersEXT = waffle_dl_sym(apidl, "glDeleteRenderbuffers");
if (NULL == glGenRenderbuffersEXT || forceRebind) glGenRenderbuffersEXT = waffle_dl_sym(apidl, "glGenRenderbuffers");
if (NULL == glRenderbufferStorageEXT || forceRebind) glRenderbufferStorageEXT = waffle_dl_sym(apidl, "glRenderbufferStorage");
if (NULL == glGetRenderbufferParameterivEXT || forceRebind) glGetRenderbufferParameterivEXT = waffle_dl_sym(apidl, "glGetRenderbufferParameteriv");
}
} // End of FBO binding.
} // End of OpenGL-ES binding.
// Release the waffle_native_window:
free(wafflewin);
wafflewin = NULL;
return(TRUE);
}
void PsychOSCloseWindow(PsychWindowRecordType * windowRecord)
{
Display *dpy = windowRecord->targetSpecific.privDpy;
PsychLockDisplay();
// Detach OpenGL rendering context again - just to be safe!
waffle_make_current(windowRecord->targetSpecific.deviceContext, NULL, NULL);
currentContext = NULL;
// Delete rendering context:
waffle_context_destroy(windowRecord->targetSpecific.contextObject);
windowRecord->targetSpecific.contextObject = NULL;
// Delete swap context:
waffle_context_destroy(windowRecord->targetSpecific.glswapcontextObject);
windowRecord->targetSpecific.glswapcontextObject = NULL;
// Delete userspace context, if any:
if (windowRecord->targetSpecific.glusercontextObject) {
waffle_context_destroy(windowRecord->targetSpecific.glusercontextObject);
windowRecord->targetSpecific.glusercontextObject = NULL;
}
// Close & Destroy the window:
waffle_window_destroy(windowRecord->targetSpecific.windowHandle);
windowRecord->targetSpecific.windowHandle = 0;
windowRecord->targetSpecific.xwindowHandle = NULL;
PsychUnlockDisplay();
// Make it so!
wl_display_roundtrip(wl_display);
while (!wl_list_empty(&windowRecord->targetSpecific.presentation_feedback_list)) {
struct wayland_feedback *f;
f = wl_container_of(windowRecord->targetSpecific.presentation_feedback_list.next, f, link);
if (PsychPrefStateGet_Verbosity() > 3) printf("PTB-DEBUG: Cleaning up Wayland feedback event %llu.\n", f->sbc);
destroy_wayland_feedback(f);
}
// Decrement global count of open onscreen windows:
open_windowcount--;
// Was this the last window?
if (open_windowcount <= 0) {
open_windowcount = 0;
PsychLockDisplay();
// (Re-)enable X-Windows screensavers if they were enabled before opening windows:
// Set screensaver to previous settings, potentially enabling it:
// TODO Wayland: XSetScreenSaver(dpy, -1, 0, DefaultBlanking, DefaultExposures);
PsychUnlockDisplay();
// Unmap/release possibly mapped device memory: Defined in PsychScreenGlue.c
PsychScreenUnmapDeviceMemory();
}
windowRecord->targetSpecific.deviceContext = NULL;
// Done.
return;
}
/*
PsychOSGetVBLTimeAndCount()
Returns absolute system time of last VBL and current total count of VBL interrupts since
startup of gfx-system for the given screen. Returns a time of -1 and a count of 0 if this
feature is unavailable on the given OS/Hardware configuration.
*/
double PsychOSGetVBLTimeAndCount(PsychWindowRecordType *windowRecord, psych_uint64* vblCount)
{
// Unsupported:
*vblCount = 0;
return(-1);
}
/* PsychOSGetSwapCompletionTimestamp()
*
* Retrieve a very precise timestamp of doublebuffer swap completion by means
* of OS specific facilities. This function is optional. If the underlying
* OS/driver/GPU combo doesn't support a high-precision, high-reliability method
* to query such timestamps, the function should return -1 as a signal that it
* is unsupported or (temporarily) unavailable. Higher level timestamping code
* should use/prefer timestamps returned by this function over other timestamps
* provided by other mechanisms if possible. Calling code must be prepared to
* use alternate timestamping methods if this method fails or returns a -1
* unsupported error. Calling code must expect this function to block until
* swap completion.
*
* Input argument targetSBC: Swapbuffers count for which to wait for. A value
* of zero means to block until all pending bufferswaps for windowRecord have
* completed, then return the timestamp of the most recently completed swap.
*
* A value of zero is recommended.
*
* Returns: Precise and reliable swap completion timestamp in seconds of
* system time in variable referenced by 'tSwap', and msc value of completed swap,
* or a negative value on error (-1 == unsupported, -2/-3 == Query failed).
*
*/
psych_int64 PsychOSGetSwapCompletionTimestamp(PsychWindowRecordType *windowRecord, psych_int64 targetSBC, double* tSwap)
{
psych_int64 ust = 0, sbc = 0, msc = -1;
// Extension unsupported or known to be defective? Return -1 "unsupported" in that case:
if (windowRecord->specialflags & kPsychOpenMLDefective) return(-1);
// Translate targetSBC 0 aka sbc of last submitted swap into proper value:
if (targetSBC == 0) {
targetSBC = windowRecord->target_sbc;
if (PsychPrefStateGet_Verbosity() > 11) printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: Supported. Calling with overriden targetSBC = %lld.\n", targetSBC);
}
else if (PsychPrefStateGet_Verbosity() > 11) printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: Supported. Calling with targetSBC = %lld.\n", targetSBC);
if (!wl_display) return(-1);
// Perform Wayland event dispatch cycles until targetSBC is reached:
while (windowRecord->reference_sbc < targetSBC) {
wl_display_dispatch(wl_display);
}
sbc = windowRecord->reference_sbc;
// Was this a discarded swap?
if (windowRecord->swapcompletiontype == -1) {
// Yes! Can't do anything meaningful with this one atm. We can output a warning if this happened
// on a vsynced window, and make up some values and fallback to standard code and hope for the
// best:
if ((windowRecord->vSynced) && (PsychPrefStateGet_Verbosity() > 1)) {
// This should probably not happen
printf("PTB-WARNING:PsychOSGetSwapCompletionTimestamp: Swaprequest with sbc = %lld was discarded by compositor for vsynced flip!\n", sbc);
}
else if (PsychPrefStateGet_Verbosity() > 4) {
// How peculiar. This may happen, so just output some note at debug verbosity:
printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: Swaprequest with sbc = %lld was discarded by compositor for non-vsynced flip.\n", sbc);
}
return(-1);
}
msc = windowRecord->reference_msc;
ust = windowRecord->reference_ust;
// Check for valid return values:
if ((windowRecord->vSynced) && (ust == 0)) {
if (PsychPrefStateGet_Verbosity() > 1) {
printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: Invalid return values ust = %lld, msc = %lld from call with success return code (sbc = %lld)! Failing with rc = -2.\n", ust, msc, sbc);
printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: This likely means a driver bug or malfunction, or that timestamping support has been disabled by the user in the driver!\n");
}
// Return with "failure" rc, so calling code can provide more error handling:
return(-2);
}
// If no actual timestamp / msc was requested, then we return here. This was needed by the
// workaround code for multi-threaded XLib access. It passes NULL to just (ab)use this
// function to wait for swap completion, before it touches the framebuffer for real.
// See function PsychLockedTouchFramebufferIfNeeded() in PsychWindowSupport.c
if (tSwap == NULL) return(msc);
// Success at least for timestamping. Translate ust into system time in seconds:
*tSwap = PsychOSMonotonicToRefTime(((double) ust) / PsychGetKernelTimebaseFrequencyHz());
if (PsychPrefStateGet_Verbosity() > 11) printf("PTB-DEBUG:PsychOSGetSwapCompletionTimestamp: Success! refust = %lld, refmsc = %lld, refsbc = %lld.\n", ust, msc, sbc);
// This would drive internal swap completion logging if it would be enabled for internal use.
// Atm. we don't enable swap completion logging for internal use, as there isn't any need due
// to the different completion handling of Wayland as compared to X11/GLX. We leave this code
// as reference for potential future use:
if (PsychOSSwapCompletionLogging(windowRecord, 4, (int) sbc)) {
// Internal logging worked and processed an event. Nothing to do atm.
}
// Perform validation of the quality, trustworthiness and precision of stimulus onset if
// sync tests are not completely disabled and vsynced stimulus onset with precise timing
// is requested, iow. if the usercode signals it cares about visual and timing correctness:
if ((PsychPrefStateGet_SkipSyncTests() < 2) && (windowRecord->vSynced)) {
// HACK TODO FIXME REMOVE IN PRODUCTION: Windowed opaque windows can end in a hardware overlay on Wayland/Weston,
// but the current implementation as of at least Weston 1.8 can't provide proper sync, ergo always reports lack
// of vsync. To allow us to test Weston, we suppress our regular warning/error handling for such windows by
// enforcing the vsync flag. This hack must be removed as soon as Weston gains proper atomic planes support.
if (!(windowRecord->specialflags & kPsychIsFullscreenWindow) && (PsychPrefStateGet_WindowShieldingLevel() >= 2000)) {
windowRecord->swapcompletiontype |= WP_PRESENTATION_FEEDBACK_KIND_VSYNC;
}
// If usercode wants vsynced tear-free swap, we better got one, otherwise we consider this a warning condition:
if (!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_VSYNC) && (PsychPrefStateGet_Verbosity() > 0)) {
printf("PTB-ERROR: Flip for window %i was not vblank synchronized/tear-free as requested. Stimulus is likely visually corrupted and visual presentation timing is likely wrong!\n",
windowRecord->windowIndex);
}
// If we don't get trustworthy presentation completion events from kernel/hardware, then our timestamps, and ergo also
// our presentation timing based on those timestamps as a baseline, will be untrustworthy and meaningless guesses - unuseable
// for research grade timed visual stimulation:
if (!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION) && (PsychPrefStateGet_Verbosity() > 0)) {
printf("PTB-ERROR: Flip for window %i didn't use reliable stimulus onset timestamping. Visual presentation timing and timestamps are likely wrong!\n",
windowRecord->windowIndex);
}
// If we got a vsynced presentation with hw completion, iow. reliable and robust, was then a high
// precision/accuracy kernel/display driver/hardware clock used for stimulus onset timestamping?
if (!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_HW_CLOCK) &&
(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION) &&
(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_VSYNC)) {
// No. Timestamps will be noisy. What to do about this? On most backends we can't do anything but
// inform the user about the lower quality of timestamps. On some backends we can fallback to our
// own homemade high precision beamposition timestamping, given that should work whenever at least vsync and
// hardware completion events work. On such backends we can just trigger the fallback here, now that we are
// certain the present completed:
if (windowRecord->VBL_Endline > 0) {
// Have beamposition timestamping fallback for this setup. Use it:
if (PsychPrefStateGet_Verbosity() > 5)
printf("PTB-INFO: Display backend doesn't support precise stimulus onset timestamps. Falling back to our own high precision beamposition timestamping.\n");
// Trigger silent fallback in calling code by returning the -1 = "unsupported" status code:
return(-1);
}
else {
// No higher precision fallback available than what we already got from Wayland. The returned timestamps
// are not actually wrong or untrustworthy, they are just less accurate than what we would wish for demanding
// neuroscience research paradigms, so this is not really a error or warning condition, but just something
// the user should be made aware of, in case high precision is needed. Let's output a one-time notice at
// normal levels of verbosity, and then ongoing notice at high debug levels for diagnostic purpose:
if (!(windowRecord->specialflags & kPsychClockPrecisionOneTimeWarningDone) &&
(PsychPrefStateGet_Verbosity() > 1)) {
windowRecord->specialflags |= kPsychClockPrecisionOneTimeWarningDone;
printf("PTB-WARNING: This display backend doesn't support precise visual stimulus onset timestamps. Timestamps will be correct, but somewhat noisy and inaccurate!\n");
}
else if (PsychPrefStateGet_Verbosity() > 5) {
printf("PTB-DEBUG: The display backend doesn't support precise stimulus onset timestamps and no fallback available. Timestamps will be correct, but noisy.\n");
}
}
}
// Give additional warning and setup tips if our minimum requirement of vsync and hw completion isn't
// fullfilled. Everything else is not catastrophic failure.
if (!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_VSYNC) ||
!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION)) {
if (PsychPrefStateGet_Verbosity() > 2) {
printf("PTB-WARNING: Something is misconfigured or suboptimal on your system, otherwise Wayland would have provided tear-free and precise\n");
printf("PTB-WARNING: visual stimulus onset timing and timestamping! Read 'help WaylandSetup' for troubleshooting tips for this problem.\n");
}
}
}
// If this is supposed to be a decorationless, unoccluded, fully opaque, topmost fullscreen window, then it should
// be presented zero-copy without any interference by compositing. Important for stimuli which need pixel-perfect
// display wrt. location, intensity and color for evey single pixel, and for driving special high precision neuroscience
// display hardware. Make sure we get zero copy in this case, as everything else almost certainly means trouble.
// Having zero-copy doesn't mean no trouble though, as we could end up in a hardware overlay with other hardware
// overlay or primary plane visual content partially occluding us or at least partially occupying the display. Or
// we could end up in a hardware overlay to the same effect with the primary plane or other overlays partially showing
// or occluding us. TODO: Find a way to control for those things.
if ((windowRecord->specialflags & kPsychIsFullscreenWindow) && (PsychPrefStateGet_WindowShieldingLevel() >= 2000) &&
!(windowRecord->swapcompletiontype & WP_PRESENTATION_FEEDBACK_KIND_ZERO_COPY) && (PsychPrefStateGet_Verbosity() > 1)) {
// Do some rate limiting for the moment - Only one warning every 600 flips:
static unsigned int ratelimitcounter = 0;
if ((ratelimitcounter++ % 600) == 0)
printf("PTB-WARNING: Flip for window %i didn't use zero copy pageflips %i times. Stimulus may not display pixel-perfect as specified.\n",
windowRecord->windowIndex, ratelimitcounter);
}
// Return swap completion msc:
return(msc);
}
/* PsychOSInitializeOpenML() - Linux specific function.
*
* Performs basic initialization of the OpenML OML_sync_control extension.
* Performs basic and extended correctness tests and disables extension if it
* is unreliable, or enables workarounds for partially broken extensions.
*
* Called from PsychDetectAndAssignGfxCapabilities() as part of the PsychOpenOnscreenWindow()
* procedure for a window with OpenML support.
*
*/
void PsychOSInitializeOpenML(PsychWindowRecordType *windowRecord)
{
// Initialize fudge factor needed by PsychOSAdjustForCompositorDelay().
// Default to 0.2 msecs, allow user override for testing and benchmarking via
// environment variable:
delayFromFrameStart = 0.0002;
if (getenv("PSYCH_WAYLAND_SWAPDELAY")) delayFromFrameStart = atof(getenv("PSYCH_WAYLAND_SWAPDELAY"));
// Disable clever swap scheduling for now:
windowRecord->gfxcaps &= ~kPsychGfxCapSupportsOpenML;
// Timestamping in PsychOSGetSwapCompletionTimestamp() and PsychOSGetVBLTimeAndCount() disabled:
windowRecord->specialflags |= kPsychOpenMLDefective;
// Try to get a handle to the Wayland presentation_interface: non-NULL == Success.
if (!get_wayland_presentation_extension(windowRecord)) {
if (PsychPrefStateGet_Verbosity() > 2) printf("PTB-INFO: No Wayland wp_presentation_feedback extension. Using naive standard implementation.\n");
// Timestamping in PsychOSGetSwapCompletionTimestamp() and PsychOSGetVBLTimeAndCount() disabled:
windowRecord->specialflags |= kPsychOpenMLDefective;
return;
}
// Enable use of Wayland presentation_feedback extension for swap completion timestamping:
windowRecord->specialflags &= ~kPsychOpenMLDefective;
// Ready to rock on Wayland:
if (PsychPrefStateGet_Verbosity() > 3) printf("PTB-INFO: Enabling Wayland wp_presentation_feedback extension for swap completion timestamping.\n");
return;
}
/*
PsychOSScheduleFlipWindowBuffers()
Schedules a double buffer swap operation for given window at a given
specific target time or target refresh count in a specified way.
This uses OS specific API's and algorithms to schedule the asynchronous
swap. This function is optional, target platforms are free to not implement
it but simply return a "not supported" status code.
Arguments:
windowRecord - The window to be swapped.
tWhen - Requested target system time for swap. Swap shall happen at first
VSync >= tWhen.
targetMSC - If non-zero, specifies target msc count for swap. Overrides tWhen.
divisor, remainder - If set to non-zero, msc at swap must satisfy (msc % divisor) == remainder.
specialFlags - Additional options, a bit field consisting of single bits that can be or'ed together:
1 = Constrain swaps to even msc values, 2 = Constrain swaps to odd msc values. (Used for frame-seq. stereo field selection)
Return value:
Value greater than or equal to zero on success: The target msc for which swap is scheduled.
Negative value: Error. Function failed. -1 == Function unsupported on current system configuration.
-2 ... -x == Error condition.
*/
psych_int64 PsychOSScheduleFlipWindowBuffers(PsychWindowRecordType *windowRecord, double tWhen, psych_int64 targetMSC, psych_int64 divisor, psych_int64 remainder, unsigned int specialFlags)
{
// Unsupported:
return(-1);
}
/*
PsychOSFlipWindowBuffers()
Performs OS specific double buffer swap call.
*/
void PsychOSFlipWindowBuffers(PsychWindowRecordType *windowRecord)
{
// If wayland present_feedback is supposed to be used for swap completion timestamping, then we
// need to setup a proper present_feedback event for the upcoming swap:
if (!(windowRecord->specialflags & kPsychOpenMLDefective)) {
wayland_window_create_feedback(windowRecord);
}
// Execute OS neutral bufferswap code first:
PsychExecuteBufferSwapPrefix(windowRecord);
// Trigger the "Front <-> Back buffer swap (flip) (on next vertical retrace)":
// This must be lock-protected for use with X11/XLib.
PsychLockDisplay();
waffle_window_swap_buffers(windowRecord->targetSpecific.windowHandle);
windowRecord->target_sbc = windowRecord->submitted_sbc;
PsychUnlockDisplay();
return;
}
/* Enable/disable syncing of buffer-swaps to vertical retrace. */
void PsychOSSetVBLSyncLevel(PsychWindowRecordType *windowRecord, int swapInterval)
{
// Enable rendering context of window (no-ops internally when not called from master-thread):
// TODO: Check if needed on EGL?
PsychSetGLContext(windowRecord);
// Store new setting also in internal helper variable, e.g., to allow workarounds to work:
windowRecord->vSynced = (swapInterval > 0) ? TRUE : FALSE;
// EGL-based backend in use:
if (egl_display) {
#ifdef PTB_USE_EGL
PsychLockDisplay();
if (!eglSwapInterval(egl_display, (EGLint) swapInterval)) {
if (PsychPrefStateGet_Verbosity() > 1) printf("\nPTB-WARNING: FAILED to %s synchronization to vertical retrace!\n\n", (swapInterval > 0) ? "enable" : "disable");
}
PsychUnlockDisplay();
#endif
}
return;
}
/*
PsychOSSetGLContext()
Set the window to which GL drawing commands are sent.
*/
void PsychOSSetGLContext(PsychWindowRecordType * windowRecord)
{
// Only change context if not already proper context bound:
// This is very important not only for performance, but also to avoid harmful
// glBindFrameBufferEXT(0) calls without switching away from context -- something
// that would completely mess up imaging pipeline state!
if (currentContext != windowRecord->targetSpecific.contextObject) {
if (currentContext) {
// We need to glFlush the context before switching, otherwise race-conditions may occur:
glFlush();
// Need to unbind any FBO's in old context before switch, otherwise bad things can happen...
if (glBindFramebufferEXT) glBindFramebufferEXT(GL_FRAMEBUFFER_EXT, 0);
}
PsychLockDisplay();
// Switch to new context: Skip surface bind if forbidden by higher-level code, e.g., for multi-threaded EGL use.
if (!waffle_make_current(windowRecord->targetSpecific.deviceContext,
(PsychGetParentWindow(windowRecord)->specialflags & kPsychSurfacelessContexts) ? EGL_NO_SURFACE : windowRecord->targetSpecific.windowHandle,
windowRecord->targetSpecific.contextObject) && (PsychPrefStateGet_Verbosity() > 0)) {
printf("PTB-ERROR: PsychOSSetGLContext(): Failed to bind master context of window %i: [%s] - Expect trouble!\n", windowRecord->windowIndex, waffle_error_to_string(waffle_error_get_code()));
}
else {
// Update context tracking:
currentContext = windowRecord->targetSpecific.contextObject;
}
PsychUnlockDisplay();
}
return;
}
/*
PsychOSUnsetGLContext()
Clear the drawing context.
*/
void PsychOSUnsetGLContext(PsychWindowRecordType * windowRecord)
{
if (PsychIsMasterThread()) {
if (currentContext) {
// We need to glFlush the context before switching, otherwise race-conditions may occur:
glFlush();
// Need to unbind any FBO's in old context before switch, otherwise bad things can happen...
if (glBindFramebufferEXT) glBindFramebufferEXT(GL_FRAMEBUFFER_EXT, 0);
}
// Reset tracking state:
currentContext = NULL;
}
PsychLockDisplay();
waffle_make_current(windowRecord->targetSpecific.deviceContext, NULL, NULL);
PsychUnlockDisplay();
return;
}
/* Same as PsychOSSetGLContext() but for selecting userspace rendering context,
* optionally copying state from PTBs context.
*/
void PsychOSSetUserGLContext(PsychWindowRecordType * windowRecord, psych_bool copyfromPTBContext)
{
// Child protection:
if (windowRecord->targetSpecific.glusercontextObject == NULL)
PsychErrorExitMsg(PsychError_user, "GL Userspace context unavailable! Call InitializeMatlabOpenGL *before* Screen('OpenWindow')!");
// Only change context if not already proper context bound:
// This is very important not only for performance, but also to avoid harmful
// glBindFrameBufferEXT(0) calls without switching away from context -- something
// that would completely mess up imaging pipeline state!
if (currentContext != windowRecord->targetSpecific.glusercontextObject) {
PsychLockDisplay();
// Copy from context unsupported on Waffle backends:
if (copyfromPTBContext && (PsychPrefStateGet_Verbosity() > 1)) {
printf("PTB-WARNING: Tried to set the 'sharecontext' flag to 2 in Screen('BeginOpenGL'), but this is not supported with Waffle display backends. Ignored!\n");
}
// Bind it: Skip surface bind if forbidden by higher-level code, e.g., for multi-threaded EGL use.
if (!waffle_make_current(windowRecord->targetSpecific.deviceContext,
(PsychGetParentWindow(windowRecord)->specialflags & kPsychSurfacelessContexts) ? EGL_NO_SURFACE : windowRecord->targetSpecific.windowHandle,
windowRecord->targetSpecific.glusercontextObject) && (PsychPrefStateGet_Verbosity() > 0)) {
printf("PTB-ERROR: PsychOSSetUserGLContext(): Failed to bind userspace gl-context of window %i: [%s] - Expect trouble!\n", windowRecord->windowIndex, waffle_error_to_string(waffle_error_get_code()));
}
else {
// Update context tracking:
currentContext = windowRecord->targetSpecific.glusercontextObject;
}
PsychUnlockDisplay();
}
return;
}
/* PsychOSSetupFrameLock - Check if framelock / swaplock support is available on
* the given graphics system implementation and try to enable it for the given
* pair of onscreen windows.
*
* If possible, will try to add slaveWindow to the swap group and/or swap barrier
* of which masterWindow is already a member, putting slaveWindow into a swap-lock
* with the masterWindow. If masterWindow isn't yet part of a swap group, create a
* new swap group and attach masterWindow to it, before joining slaveWindow into the
* new group. If masterWindow is part of a swap group and slaveWindow is NULL, then
* remove masterWindow from the swap group.
*
* The swap lock mechanism used is operating system and GPU dependent. Many systems
* will not support framelock/swaplock at all.
*
* Returns TRUE on success, FALSE on failure.
*/
psych_bool PsychOSSetupFrameLock(PsychWindowRecordType *masterWindow, PsychWindowRecordType *slaveWindow)
{
if (PsychPrefStateGet_Verbosity() > 5) printf("PTB-DEBUG: NV_swap_group and GLX_SGIX_swap_group unsupported.\n");
return(FALSE);
}
psych_bool PsychOSSwapCompletionLogging(PsychWindowRecordType *windowRecord, int cmd, int aux1)
{
const char *FieldNames[] = { "OnsetTime", "OnsetVBLCount", "SwapbuffersCount", "SwapType", "BackendFeedbackString" };
const int fieldCount = 5;
PsychGenericScriptType *s;
char flagstr[10];
int event_type;
// Currently only have meaningful handling for Wayland with wp_presentation_feedback extension:
if (!(windowRecord->specialflags & kPsychOpenMLDefective)) {
if (cmd == 0 || cmd == 1 || cmd == 2) {
// Check if wp_presentation_feedback extension is supported. Enable/Disable swap completion event delivery for our window, if so:
PsychLockDisplay();
// Logical enable state: Usercode has precedence. If it enables it goes to it. If it disabled,
// it gets directed to us:
// UPDATE: Actually no. Disable by usercode means disable for now, until we have an actual
// use case for automatic redirection to our code on Wayland. Otherwise we'd just incur extra
// overhead for nothing.
// Old style with redirect: if (cmd == 0 || cmd == 1) windowRecord->swapevents_enabled = (cmd == 1) ? 1 : 2;
// New style: Enable if usercode wants it, disable if usercode doesn't want it:
if (cmd == 0 || cmd == 1) windowRecord->swapevents_enabled = cmd;
// If we want the data and usercode doesn't have exclusive access to it already, then redirect to us:
if (cmd == 2 && (windowRecord->swapevents_enabled != 1)) windowRecord->swapevents_enabled = 2;
PsychUnlockDisplay();
return(TRUE);
}
if (cmd == 3 || cmd == 4) {
// Extension enabled? Process events if so:
if (wl_display) {
// Perform one dispatch cycle so event list is up to date:
wl_display_dispatch_pending(wl_display);
// Delivery to user-code?
if (cmd == 3 && windowRecord->swapevents_enabled == 1) {
double *dummy;
// Try to fetch oldest pending one for this window:
PsychLockDisplay();
struct wayland_feedback *sce, *tmp;
wl_list_for_each_reverse_safe(sce, tmp, &windowRecord->targetSpecific.presentation_feedback_list, link) {
// Completed or Discarded swap? That would be our one oldest completed candidate for procesing:
if (sce->present_status > 0) {
// Convert presentation status flags to something human readable:
wayland_pflags_to_str(sce->present_flags, flagstr, sizeof(flagstr));
if (PsychPrefStateGet_Verbosity() > 5) {
if (sce->present_status == 1) {
printf("SWAPEVENT[%i]: ust = %lld, msc = %lld, sbc = %lld, flags [%s].\n", windowRecord->windowIndex,
sce->ust, sce->msc, sce->sbc, flagstr);
}
else {
printf("SWAPEVENT[%i]: sbc = %lld Skipped/Discarded.\n", windowRecord->windowIndex, sce->sbc);
}
}
PsychAllocOutStructArray(aux1, FALSE, -1, fieldCount, FieldNames, &s);
// Discarded / Skipped present?
if (sce->present_status == 2) {
// Yes. Not much todo - Assign dummy values and Discarded status:
PsychSetStructArrayDoubleElement("OnsetTime", 0, 0, s);
PsychSetStructArrayDoubleElement("OnsetVBLCount", 0, 0, s);
PsychSetStructArrayDoubleElement("SwapbuffersCount", 0, (double) sce->sbc, s);
PsychSetStructArrayStringElement("BackendFeedbackString", 0, "", s);
PsychSetStructArrayStringElement("SwapType", 0, "Discarded", s);
// Delete event:
destroy_wayland_feedback(sce);
PsychUnlockDisplay();
return(TRUE);
}
// Successfully presented onscreen, go ahead...
PsychSetStructArrayDoubleElement("OnsetTime", 0, PsychOSMonotonicToRefTime(((double) sce->ust) / PsychGetKernelTimebaseFrequencyHz()), s);
PsychSetStructArrayDoubleElement("OnsetVBLCount", 0, (double) sce->msc, s);
PsychSetStructArrayDoubleElement("SwapbuffersCount", 0, (double) sce->sbc, s);
PsychSetStructArrayStringElement("BackendFeedbackString", 0, flagstr, s);
if (sce->present_flags == (WP_PRESENTATION_FEEDBACK_KIND_VSYNC | WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION |
WP_PRESENTATION_FEEDBACK_KIND_HW_CLOCK | WP_PRESENTATION_FEEDBACK_KIND_ZERO_COPY)) {
// ~ GLX_FLIP_COMPLETE_INTEL: A zero-copy pageflip of our buffer directly
// to the scanout, thereby pixel-perfect identity display, as required by
// special high precision neuro-science display hardware, precisely controlled
// "pixel-perfect" stimuli etc. Stimulus onset is perfectly tear-free and
// timestamped with robust and precise onset timestamps. For a non-fullscreen
// window, this could also have happened by atomic flipping into a hardware
// overlay instead of the primary scanout plane. This doesn't exclude the
// possible display of other content on the screen - via other active hardware
// overlays, or on the primary plane if our content went into a hw overlay, so
// this is not a guarantee that our stimulus was the only thing showing on the
// display:
PsychSetStructArrayStringElement("SwapType", 0, "IdentityPageflip", s);
}
else if (sce->present_flags == (WP_PRESENTATION_FEEDBACK_KIND_VSYNC | WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION |
WP_PRESENTATION_FEEDBACK_KIND_HW_CLOCK)) {
// ~ GLX_FLIP_COMPLETE_INTEL, likely implemented via pageflip, with precise
// and robust onset timestamps - same timing guarantees as a pageflip, but
// our image buffer was composited into a shared framebuffer before presentation.
// This is like a Copyswap on X11, but with reliable timing and timestamping.
// While executed with precise timing, pixel color and position mapping could
// be a non-identity due to compositor interference, so this might be
// problematic for high-precision stims and special neuro-science display
// equipment.
PsychSetStructArrayStringElement("SwapType", 0, "CompositedPageflip", s);
}
else if (sce->present_flags & (WP_PRESENTATION_FEEDBACK_KIND_VSYNC | WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION) ==
(WP_PRESENTATION_FEEDBACK_KIND_VSYNC | WP_PRESENTATION_FEEDBACK_KIND_HW_COMPLETION)) {
// A tear-free presentation due to reliable vsync (pageflipped or vblank synced copy) and hardware
// completion event, but no hw clock timestamp. This has well defined stimulus onset,
// and also defined stimulus onset timestamping, but the timestamps can be rather noisy:
if (sce->present_flags & WP_PRESENTATION_FEEDBACK_KIND_ZERO_COPY) {
// Map it to a "ImprecisePageflip" - not neccessary true, but the behaviour should come
// close. This is the equivalent of what we get on proprietary X11/GLX drivers like the
// NVidia binary blob or AMD Catalyst, or on Apple-OSX or MS-Windows in the best case
// scenario - essentially a pageflip with noisy timestamps.
PsychSetStructArrayStringElement("SwapType", 0, "ImprecisePageflip", s);
}
else {
// This is a bit better than a CopySwap on X11, OSX or Windows (with/without compositing),
// in that at least presentation completion gets reliably signalled, although with noisy
// timestamps.
PsychSetStructArrayStringElement("SwapType", 0, "ImpreciseCopy", s);
}
}
else if (sce->present_flags > 0) {
// Could be a pageflip or a copy, or any combination, but has undefined onset timing
// or undefined/tearing/non-vsynced onset, so this is close to unuseable for most of
// our purposes. It is what we'd get from X11, OSX, or Windows for any CopySwap or
// composited presentation, so just treat it as a regular shoddy CopySwap for now:
PsychSetStructArrayStringElement("SwapType", 0, "Copy", s);
} else {
// No info available from compositor at all:
PsychSetStructArrayStringElement("SwapType", 0, "Unknown", s);
}
// Delete event:
destroy_wayland_feedback(sce);
PsychUnlockDisplay();
return(TRUE);
}
}
PsychUnlockDisplay();
// Return empty [] argument, so client code can detect "no new result":
PsychAllocOutDoubleMatArg(aux1, FALSE, 0, 0, 0, &dummy);
return(FALSE);
}
// Delivery to internal code "us"?
// Note: This isn't used at the moment, just left here in case we need it in the future.
// As opposed to the old X11/GLX backend which used the INTEL_swap_event extension, the
// present flags are directly evaluated by the PsychOSGetSwapCompletionTimestamp()
// function for asessment if the swap happened in a reliable/trustworthy way, and to
// trigger warnings and error-handling if something bad happened. Therefore no need for
// internal logging here. We may use this function in the future for other logging
// purposes though, so leave the implementation, but don't enable its use by default:
if (cmd == 4 && windowRecord->swapevents_enabled == 2) {
// Get the most recent event in the queue, old ones are not interesting to us atm.:
event_type = 0; // Init to "undefined"
// Fetch until exhausted:
PsychLockDisplay();
struct wayland_feedback *sce, *tmp;
wl_list_for_each_reverse_safe(sce, tmp, &windowRecord->targetSpecific.presentation_feedback_list, link) {
// Completed swap? That would be a candidate for procesing:
if (sce->present_status > 0) {
if (PsychPrefStateGet_Verbosity() > 10) {
// Convert presentation status flags to something human readable:
wayland_pflags_to_str(sce->present_flags, flagstr, sizeof(flagstr));
if (sce->present_status == 1) {
printf("SWAPEVENT[%i]: ust = %lld, msc = %lld, sbc = %lld, flags [%s].\n", windowRecord->windowIndex,
sce->ust, sce->msc, sce->sbc, flagstr);
}
else {
printf("SWAPEVENT[%i]: sbc = %lld Skipped/Discarded.\n", windowRecord->windowIndex, sce->sbc);
}
}
// Assign the one that matches our last 'sbc' for swap completion on our windowRecord:
if ((int) sce->sbc == aux1) {
// Target event: Assign its flags, delete it, end our fetch:
event_type = (sce->present_status == 1) ? (int) sce->present_flags : -1;
// Delete event:
destroy_wayland_feedback(sce);
break;
}
// Delete non-target event:
destroy_wayland_feedback(sce);
}
}
PsychUnlockDisplay();
// TODO Doesn't make much sense atm., as this is done anyway by the
// present_feedback handler...
windowRecord->swapcompletiontype = event_type;
return(TRUE);
}
}
}
} else {
// Failed to enable swap events, because they're unsupported without
// Wayland present_feedback extension support enabled:
windowRecord->swapevents_enabled = 0;
}
// Invalid cmd or failed cmd:
return(FALSE);
}
/* PsychOSAdjustForCompositorDelay()
*
* Compute OS and desktop compositor specific delay that needs to be subtracted from the
* target time for a OpenGL doublebuffer swap when conventional swap scheduling is used.
* Subtract the delay, if any, from the given targetTime and return the corrected targetTime.
*
*/
double PsychOSAdjustForCompositorDelay(PsychWindowRecordType *windowRecord, double targetTime, psych_bool onlyForCalibration)
{
double nominalIFI = PsychGetNominalFramerate(windowRecord->screenNumber);
if (nominalIFI > 0) nominalIFI = 1.0 / nominalIFI;
if (!(windowRecord->specialflags & kPsychOpenMLDefective)) {
// This was needed to compensate for Westons 1 frame composition lag, but is
// no longer needed as of Weston 1.8+ due to Pekka's lag reduction patch.
if (FALSE && onlyForCalibration) {
targetTime -= nominalIFI;
if (PsychPrefStateGet_Verbosity() > 4) printf("PTB-DEBUG: Compensating for Wayland/Weston 1 frame composition lag of %f msecs.\n", nominalIFI * 1000.0);
}
// Robustness improvement for swap scheduling on at least Weston 1.8, likely
// won't hurt on other Wayland implementations - not for use in refresh rate
// calibration.
if (!onlyForCalibration) {
// Weston 1.8+ or other compositors, called for swap scheduling, not for
// sync tests/calibration.
//
// Try to target the earliest point in time inside the video refresh cycle
// directly before the target stimulus onset frame, so the compositor will
// lock onto the start vblank of the following target frame. For this we
// need to find out from given targetTime in which frame the targetTime
// is located, then find the start time of active scanout of that frame
// and return that as corrected targetTime.
//
// Background reasoning:
//
// Some (most?) Wayland compositors will define some composition deadline
// within their current frame. Presentation requests from clients arriving
// after that deadline will not be processed for the current frame, but delayed
// to the next frame, in order to leave sufficient headroom in the current
// frame for the time consuming rendering needed for desktop composition of
// new content for the upcoming frame, so they won't skip that frames vblank
// deadline and cause skipped frames. At least Weston as of 1.8 has such a
// deadline defined as 'repaint-window' msecs before end of current frame, with
// a default value of 7 msecs, ie., requests arriving < 7 msecs before end of
// a frame will be delayed by a full frame. Weston may get a dynamic deadline
// if my experimental patches get accepted, to provide a shorter cutoff if
// possible, or the strategy may change to something like "unredirect fullscreen
// windows" like on X11, or the future presentation_queue extension may deal with
// this elegantly, but atm. for Weston 1.8 this problem will exist. The strategy
// of other Wayland compositors (KDE, GNOME etc.) is not yet known.
//
// In any case, targetting the earliest possible swap submission time for given
// targetTime makes us as robust as possible against different compositors strategies.
// Need valid onset timestamp of most recent completed flip, and valid measured
// video refresh duration:
if ((windowRecord->time_at_last_vbl > 0) && (windowRecord->VideoRefreshInterval > 0)) {
// Translate targetTime into how many frames the frame containing 'targetTime' is
// ahead of the last known frame start time 'time_at_last_vbl':
targetTime = floor((targetTime - windowRecord->time_at_last_vbl) / windowRecord->VideoRefreshInterval);
// Use 'time_at_last_vbl' to calculate the start timestamp of the frame in which
// we need to swap - targetTime frames ahead - in order to hit the correct composition
// cycle for our content to get on the screen at the target frame.
// Resulting 'targetTime' will be the earliest possible point in time we can swap:
targetTime = windowRecord->time_at_last_vbl + (targetTime * windowRecord->VideoRefreshInterval);
// Add some small security margin to this to account for measurement and roundoff errors,
// as swapping a tiny bit later than a frame boundary is not hurtful, but swapping earlier is.
targetTime += delayFromFrameStart;
if (PsychPrefStateGet_Verbosity() > 4) {
printf("PTB-DEBUG: Setting swap targetTime to %f secs [fudge %f secs] %f msecs after last swap, for Wayland composition compensation.\n",
targetTime, delayFromFrameStart, 1000 * (targetTime - windowRecord->time_at_last_vbl));
}
}
else {
if (PsychPrefStateGet_Verbosity() > 4) {
printf("PTB-DEBUG: PsychOSAdjustForCompositorDelay(): No-Op due to lack of baseline data tvbl=%f, videorefresh=%f\n",
windowRecord->time_at_last_vbl, windowRecord->VideoRefreshInterval);
}
}
}
}
return(targetTime);
}
psych_bool PsychVRRActive(PsychWindowRecordType *windowRecord)
{
(void) windowRecord;
// Nope, VRR inactive or unsupported:
return(FALSE);
}
/* PsychOSConstrainPointer()
*
* Establish or release pointer confinement to a rectangle, a mouse trap if you want.
*
* Returns TRUE on success, FALSE on failure, e.g., maximum number of barriers exceeded.
*/
psych_bool PsychOSConstrainPointer(PsychWindowRecordType *windowRecord, psych_bool constrain, PsychRectType rect)
{
// Not yet supported on Wayland:
return(FALSE);
}
/* End of PTB_USE_WAYLAND */
#endif
|