1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662
|
/*
SCREENHookFunction.c
AUTHORS:
mario.kleiner.de@gmail.com mk
PLATFORMS:
All.
HISTORY:
12/05/06 mk Wrote it.
DESCRIPTION:
Manage special callback functions (processing hooks). Screen allows to "hook" specific
OpenGL GLSL shaders, C callback functions or Matlab M-File functions into its internal
processing chain at well defined points in a (hopefully) well defined manner. This allows
to extend or customize Screens behaviour. Useful applications: Automatic transparent
on-the-fly image processing on stimuli just before stimulus onset, e.g., filtering.
Customization of drawing commands. Advanced stereo stimulus output algorithms. Support for
special output devices like BrightSide HDR, Bits++, Pelli & Zhang attenuator..., interfacing
with 3rd party hardware like trigger systems...
We provide well defined hook points, each one with a unique descriptive name. Each hook is
associated with a queue or chain of callback functions which is executed from the beginning
to the end whenever that hook is processed. A callback can be a GLSL OpenGL shader program
for image processing, a Matlab M-Function for high-level processing or a C callback function
for complex low-level or realtime operations like triggering some output device or similar.
This Screen subfunction provides subfunctions to add callbacks to the chain, reset the chain,
enable or disable the chain, query properties of single hooks or dump the whole chain state
to the command window for debug purpose.
*/
#include "Screen.h"
// If you change useString then also change the corresponding synopsis string in ScreenSynopsis.c
static char useString[] = "[ret1, ret2, ...] = Screen('HookFunction', windowPtr, 'Subcommand', 'HookName', arg1, arg2, ...);";
// 1 2 3 4 5 ...
static char synopsisString[] =
"Manage Screen processing hook chains. Hook chains are a way to extend PTBs behaviour with plugins for generic processing or "
"fast image processing. They should allow to interface PTB seamlessly with 3rd party special response collection devices or "
"stimulus display devices. They also allow to perform high performance image processing, utilizing modern graphics hardwares "
"huge computational bandwidth. Read 'help PsychGLImageProcessing' for more infos."
"\n\n"
"\nSubsubcommands and their syntax: \n\n"
"Screen('HookFunction', [windowPtr], 'ListAll'); \n"
"Print out a listing of all supported 'HookName' hook points, including a short synopsis on what they do, to the Matlab console "
"in a human readable format - Useful as a reference for coding. "
"The 'windowPtr' argument is optional. If left out (replaced by empty [] brackets) it prints all implemented chains."
"\n\n"
"[slot idstring blittercfg voidptr glslid luttexid insertString] = Screen('HookFunction', windowPtr, 'Query', hookname, slotnameOrIndex);\n"
"Query information about a specific command slot in a specific hook processing chain: "
"'hookname' is the name of the chain to query, e.g., 'StereoCompositingBlit' for the stereo processing chain. Use the subcommand "
"'ListAll' for a printout of all available processing hooks and a short help on them. "
"'slotnameOrIndex', either the symbolic name of the requested slot or the index in the hook-chain: Indices start with 0. Names can "
"be assigned to slots when you add a processing slot with the 'Append' or 'Prepend' command, or they are system assigned names like "
", e.g., 'StereoCompositingShader' for builtin shaders that are needed for stereo processing."
"\n\n"
"Return arguments, all optional: 'slot' is the index of the named slot in the chain to which the queried subfunction is assigned, or "
"-1 if no such slot exists in the chain. 'glslid' numeric GLSL handle of the OpenGL GLSL shader object if the slot contains a "
"GLSL shader for image processing on the GPU, 0 otherwise. 'luttexid' OpenGL texture handle of the first assigned lookup texture, "
"0 if none assigned. 'voidptr' Memory pointer (encoded as double) to a C callback function, if one is assigned to this slot, 0 "
"otherwise. 'blittercfg' either a parameter string with a meaning dependent of slot type, or the string 'NONE' if none assigned. "
"'idstring' The symbolic name of this slot if any assigned, 'NONE' otherwise. 'insertString' the subcommand to use for reinserting "
"this slot at the place it was after a deletion."
"\n\n"
"Screen('HookFunction', windowPtr, 'AppendShader', hookname, idString, glslid [, blittercfg] [luttexid1]); \n"
"Append a new instruction slot to the end of hook processing chain 'hookname', assign the symbolic name 'idString' for later query "
"by the 'Query' command. 'glslid' must be the name of a valid GLSL program object which defines the algorithm to apply on the GPU. "
"'blittercfg' optional string with configuration commands for the shader. 'luttexid' Optional handle to an OpenGL texture which is "
"used to encode lookup tables for the shader."
"\n\n"
"Screen('HookFunction', windowPtr, 'PrependShader', hookname idString, glslid [, blittercfg] [luttexid1]); \n"
"Same as 'AppendShader' but add shader slot to beginning of the hook chain. It's recommended that you prepend slots instead of "
"appending them, because PTB itself may add special slots at the end of a chain."
"\n\n"
"Screen('HookFunction', windowPtr, 'AppendCFunction', hookname, idString, voidfunctionptr); \n"
"Screen('HookFunction', windowPtr, 'PrependCFunction', hookname, idString, voidfunctionptr); \n"
"Attach a C callable function to the chain. voidfunctionptr is a double value which encodes a memory pointer to the function in "
"memory. Encoding of the pointer and requirements to the function are non-trivial, so this is for expert developers only!"
"\n\n"
"Screen('HookFunction', windowPtr, 'AppendMFunction', hookname, idString, fevalstring); \n"
"Screen('HookFunction', windowPtr, 'PrependMFunction', hookname, idString, fevalstring); \n"
"Add a Matlab callable function to the chain. 'fevalstring' is the function call string: It will be passed to "
"and evaluated by Matlabs or Octaves feval() function, so it has to work with that function. It is not allowed to "
"return any return arguments. Some special names in the string will be replaced by PTB with internal settings, think "
"of it as a macro replacement. Caution: The called function is not allowed to call any Screen() commands or you'll "
"likely get undefined behaviour or a crash -- Screen is not reentrant!"
"\n\n"
"Screen('HookFunction', windowPtr, 'AppendBuiltin', hookname, idString, builtincmd); \n"
"Screen('HookFunction', windowPtr, 'PrependBuiltin', hookname, idString, builtincmd); \n"
"Add a call to a PTB built-in function 'builtincmd'."
"\n\n"
"You can also insert a hook function somewhere at a specific slot index via:\n"
"Screen('HookFunction', windowPtr, 'InsertAtXXXYYY', ...);\n"
"where XXX is a numeric slot id and YYY is the type specifier. Example: Insert a Builtin function\n"
"at index 4 in hook 'UserDefinedBlit':\n"
"Screen('HookFunction', windowPtr, 'InsertAt4Builtin', 'UserDefinedBlit', ...);\n"
"\n\n"
"Screen('Hookfunction', windowPtr, 'Remove', hookname, slotindex);\n"
"Remove slot at index 'slotindex' in hookchain 'hookname'. The slot after this slot will move up by one.\n"
"\n\n"
"Screen('HookFunction', windowPtr, 'Enable', hookname); \n"
"Screen('HookFunction', windowPtr, 'Disable', hookname); \n"
"Enable or disable a specific hook chain. Chains are disabled until you enable them, with the exception of a few "
"internal chains that get initialized and enabled by PTB itself, e.g., stereo algorithm chain. Disabled chains "
"are not processed."
"\n\n"
"Screen('HookFunction', windowPtr, 'Reset', hookname); \n"
"Reset a processing hook chain: All slots are deleted, resetting the chain to its startup state. Seldomly needed. "
"\n\n"
"Screen('HookFunction', windowPtr, 'Dump', hookname); \n"
"Print out the full chain for hook 'hookname' to the Matlab console in a human readable format - Useful for debugging."
"\n\n"
"Screen('HookFunction', windowPtr, 'DumpAll'); \n"
"Print out all chains for the given onscreen window 'windowPtr' to the Matlab console in a human readable format - Useful for debugging."
"\n\n"
"oldImagingMode = Screen('HookFunction', proxyPtr, 'ImagingMode' [, imagingMode]); \n"
"Change or query imagingMode flags of provided proxy window 'proxyPtr' to 'imagingMode'. Proxy windows are used to define "
"image processing operations, mostly for Screen('TransformTexture'). Returns old imaging mode."
"\n\n"
"[leftglHandle, rightglHandle, glTextureTarget, format, multiSample, width, height] = Screen('HookFunction', windowPtr, 'SetDisplayBufferTextures' [, hookname][, leftglHandle][, rightglHandle][, glTextureTarget][, format][, multiSample][, width][, height]);\n"
"Changes the external backing textures and their parameters for the final output color buffers of the imaging pipeline.\n"
"Optionally returns the previously used backing textures and their old parameters. All new parameters are optional, the "
"old values are left as they were if a parameter is not provided.\n"
"This only works if imagingMode flags kPsychNeedFinalizedFBOSinks and kPsychUseExternalSinkTextures are set, "
"otherwise external changes are rejected. It is not allowed to set a configuration which would cause the underlying "
"framebuffers to become framebuffer incomplete. Trying to do so will fail and try to revert to the old framebuffer configuration. "
"It is not allowed to switch from multisample backing textures to single-sample textures or vice versa, as that would cause various "
"processing failures in the image post-processing for a stimulus. Setting the kPsychSinkIsMSAACapable imagingMode flag signals that "
"the external sink is capable of providing multisample backing textures and desires such textures, otherwise only external single-sample "
"textures are desired. The implementation will decide if it honors the request for multisample textures, depending on general imaging "
"pipeline setup. It may decide to allow MSAA for rendering but perform the multiSample resolve step internally. In any case the presence "
"of kPsychSinkIsMSAACapable in the final imagingMode for the window signals if the caller of this function should provide multisample or "
"single sample non-power-of-two textures (GL_TEXTURE_2D_MULTISAMPLE vs. GL_TEXTURE_2D). The current implementation does not allow for a "
"change in multiSample setting, ie., the effective number of samples per pixel for a backing texture. This limitation may get relaxed "
"in future versions of the software if possible and sensible.\n"
"Parameters and their meaning:\n"
"'hookname' Currently ignored, placeholder for future extensions.\n"
"'leftglHandle' OpenGL texture object handle of the left-eye texture in stereoMode 12, or of the mono-texture in mono mode.\n"
"'rightglHandle' OpenGL texture object handle of the right-eye texture in stereoMode 12, or ignored in mono mode.\n"
"'glTextureTarget' OpenGL texture target: GL_TEXTURE_2D or GL_TEXTURE_2D_MULTISAMPLE, depending on multisample configuration.\n"
"'format' OpenGL internal texture format, e.g., GL_RGBA. Must be a framebuffer renderable format to prevent framebuffer incompleteness.\n"
"'multiSample' The number of samples per texel. Must be 0 for single-sampled GL_TEXTURE_2D textures, > 0 for GL_TEXTURE_2D_MULTISAMPLE textures.\n"
"'width' and 'height' Width and height of the output framebuffer (=texture) in pixels or texels.\n"
"\n\n"
"[leftglHandle, rightglHandle, glTextureTarget, format, multiSample, width, height, leftFboId, rightFboId] = Screen('HookFunction', windowPtr, 'GetDisplayBufferTextures');\n"
"Get the OpenGL handles of the backing textures and their parameters for the final output color buffers of the imaging pipeline.\n"
"'leftFboId' and 'rightFboId' return the ids of the associated OpenGL framebuffer objects containing the 'leftglHandle' and 'rightglHandle' output textures.\n"
"For the meaning of other return values see 'SetDisplayBufferTextures' above.\n"
"This only works if the imaging pipeline is active.\n"
"This query function works both with internally generated and maintained backing textures and externally injected/maintained ones.\n"
"For internally generated textures (without flag kPsychUseExternalSinkTextures), the handles should be considered read-only: Binding "
"the textures for sampling/reading from them is appropriate, modifying them in any way is forbidden.\n"
"\n\n"
"Screen('HookFunction', windowPtr, 'ImportDisplayBufferInteropMemory' [, hookname][, viewId=0][, interopMemObjectHandle][, allocationSize][, formatSpec][, tilingMode][, memoryOffset][, width][, height][, interopSemaphoreHandle]);\n"
"CAUTION: EXPERIMENTAL, UNSTABLE API - Subject to backwards incompatible breaking changes without notice!\n"
"Replace the current image backing memory for the final output color buffers of the imaging pipeline by externally imported memory.\n"
"This only works if imagingMode flag kPsychNeedFinalizedFBOSinks is set or stereoMode 12 is active, which implicitely sets that flag.\n"
"This uses the external memory objects OpenGL extension to import external backing memory, e.g., from a Vulkan gpu + driver, and assign "
"it as new backing memory oject to the textures which are used to implement the final output color buffers of the pipeline. Iow. it allows "
"to render into image buffers of an external agent, e.g., a Vulkan device instance.\n"
"Parameters and their meaning:\n"
"'hookname' Currently ignored, placeholder for future extensions.\n"
"'viewId' Selects the left-eye/mono framebuffer if 0, and the right-eye framebuffer if 1 in a stereoMode 12 configuration.\n"
"'interopMemObjectHandle' Operating system specific handle to the interop image backing memory.\n"
"'allocationSize' Number of bytes of backing memory for the 'interopMemObjectHandle' to import.\n"
"'formatSpec' Type of texture to create: 0 = GL_RGBA8, 1 = GL_RGB10A2, 2 = GL_RGBA16F, 3 = GL_RGBA16.\n"
"'tilingMode' Type of tiling to use/assume for rendering: 0 = Linear (non-tiled), 1 = Tiled.\n"
"'memoryOffset' Memory offset in bytes into the imported memory object to use.\n"
"'width' Width of texture in pixels.\n"
"'height' Height of texture in pixels.\n"
"'interopSemaphoreHandle' Operating system specific handle to an external interop-image-rendering-complete semaphore. "
"If this handle is provided, then Screen() will signal the associated OpenGL semaphore each time OpenGL rendering "
"into the imported interop image is finished.\n"
"\n\n"
"Screen('HookFunction', windowPtr, 'SetOneshotFlipFlags' [, hookname], flipFlags);\n"
"Assign special flags to be applied one-time during the next execution of Screen('Flip') or Screen('AsyncFlipBegin').\n"
"'hookname' is accepted, but currently ignored. Pass '' or [] for now.\n"
"These 'flipFlags' will be applied during the next window flip operation, and each applied flag will then auto-reset "
"after application, unless you also pass in the kPsychDontAutoResetOneshotFlags to prevent \"OneShot\" auto-reset.\n"
"This is mostly meant to be called from within imaging pipeline processing chains during preflip operations or the "
"active presentation sequence to modify behaviour of that sequence. The following 'flipFlags' are "
"currently implemented: kPsychSkipVsyncForFlipOnce, kPsychSkipTimestampingForFlipOnce, kPsychSkipSwapForFlipOnce, "
"kPsychSkipWaitForFlipOnce, kPsychDontAutoResetOneshotFlags.\n"
"\n\n"
"Screen('HookFunction', windowPtr, 'SetOneshotFlipResults' [, hookname], VBLTimestamp [, StimulusOnsetTime=VBLTimestamp][, Missed=0][, Beampos=-1]);\n"
"Assign override timestamp values to return from Screen('Flip') or Screen('AsyncFlipBegin').\n"
"'hookname' is accepted, but currently ignored. Pass '' or [] for now.\n"
"The provided timestamps will be applied during return from the next window flip operation and returned as the "
"corresponding Screen('Flip') return values. You must have called the 'SetOneshotFlipFlags' HookFunction beforehand "
"with at least the kPsychSkipTimestampingForFlipOnce flag to suppress internal timestamping.\n"
"This is mostly meant to be called from within imaging pipeline processing chains, notably the "
"'PreSwapbuffersOperations' hook chain, to inject stimulus onset timestamps provided by some external display client or "
"external timestamping mechanism. The following values can be injected:\n"
"'VBLTimestamp' The vbl timestamp of Flip completion, or something semantically equivalent, useful for Flip scheduling.\n"
"'StimulusOnsetTime' Optional true stimulus onset time. Will be set to VBLTimestamp if omitted. Must be StimulusOnsetTime >= VBLTimestamp.\n"
"'Missed' The presentation deadline miss estimate aka 'Missed' flag of Screen('Flip'). Defaults to 0 if omitted.\n"
"'Beampos' The beamposition at flip completion, as returned in the 'Beampos' return argument of Flip. Defaults to -1 if omitted.\n"
"\n\n"
"Screen('HookFunction', windowPtr, 'SetWindowBackendOverrides' [, hookname][, pixelSize][, refreshInterval][, proj]);\n"
"Assign override values for various window properties, as provided by the backend client instead of the windowing system.\n"
"'hookname' is accepted, but currently ignored. Pass '' or [] for now.\n"
"'pixelSize' The net color depth of the display, as returned by Screen('PixelSize', windowPtr);\n"
"'refreshInterval' The video refresh interval duration in seconds, as reported by the display backend, and after proper translation "
"returned by Screen('NominalFramerate', windowPtr), Screen('Framerate', windowPtr), and Screen('GetFlipInterval', windowPtr).\n"
"'proj' Override projection matrix/matrices for 2D drawing: proj = [] == don't change, proj = 1 == Disable overrides, proj = 4x4 matrix "
"for mono-mode drawing, proj = 4x4x2 matrices for separate matrices in stereo modes (:,:,1) left eye, (:,:,2) right eye.\n"
"\n\n"
"[maxSDRToHDRScaleFactor, normalizedToHDRScaleFactor] = Screen('HookFunction', windowPtr, 'SetHDRScalingFactors' [, hookname][, maxSDRToHDRScaleFactor][, normalizedToHDRScaleFactor]);\n"
"Get or assign scaling factors to map SDR color values or HDR color values into the linear HDR color range and units of the window.\n"
"'maxSDRToHDRScaleFactor' defines to which color value the maximum input color value of SDR content is mapped. This is used by "
"Screen('MakeTexture') for converting the color/luminance channels of SDR uint8 image matrices into the value range needed for "
"making the texture compatible with the HDR framebuffer. It is also used for mapping SDR movie video content to HDR framebuffer. "
"Example: A factor of 80 would mean to map the maximum uint8 texture value 255 in MakeTexture, or the maximum possible component value of "
"the video frame from a SDR movie to an output value of 80 units - Typical if the framebuffer operates in units of Nits, so maximum "
"SDR content intensity would map to 80 Nits, standardized as typical maximum of SDR content.\n"
"'normalizedToHDRScaleFactor' defines to which color value the maximum possible input color value of HDR content is mapped. This is used by "
"movie playback to map the normalized linear 0.0 - 1.0 intensity range of HDR movies to the linear range 0.0 - maximum HDR intensity. "
"A typical value would be 10000 to map the 1.0 normalized maximum to the maximum intensity of 10000 nits of the current HDR display "
"standards HDR10, HDR10+, DolbyVision etc., if the framebuffer uses units of Nits. A factor of 125 would be typical if the framebuffer "
"is set up to operate in units of multiples of 80 Nits, another common standard, where a value of 125 corresponds to 10000 Nits. "
"This scaling factor is also used for displaying HDR movie frames into a SDR window, in this scale to upscale some fraction of the "
"lower range of HDR values to the 0.0 - 1.0 intensity range of a SDR window, as a dumb people's tone-mapping operator. E.g., the "
"startup default is to map 0 - 500 nits input to the 0 - 1 range, to get something reasonable displayed even without application of "
"some proper tone-mapping operator."
"\n\n"
"colorGamut = Screen('HookFunction', windowPtr, 'WindowColorGamut' [, hookname][, colorGamut]);\n"
"Return the current color gamut settings for the onscreen window 'windowPtr'. Optionally assign new settings.\n"
"'hookname' is accepted, but currently ignored. Pass '' or [] for now.\n"
"'colorGamut' as return argument is a 2x4 matrix specifying the currently assigned color gamut for the window. "
"You can specify an optional 'colorGamut' matrix parameter to set a new color gamut.\n"
"By default, 'colorGamut' is an all-zeros matrix, which means that no color gamut is assigned, and Screen() "
"should use reasonable defaults (which may be context dependent) if it does some gamut dependent processing. "
"If you do set a matrix, then it must be a 2-by-4 matrix, encoding the CIE-1931 2D chromaticity coordinates of the "
"red, green, and blue color primaries in columns 1, 2, and 3, and the location of the white-point "
"in column 4. This defines the color space and gamut in which the visual content of the onscreen window is "
"supposed to live. Currently, this color gamut is only used for movie playback with pixelFormat 11, e.g., HDR playback. "
"When decoding and returning video frames from a movie, Screen() will perform a color space transformation to remap the "
"image pixels from the source color gamut of the movie to the color gamut specified for the window. If no 'WindowColorGamut' "
"call was made prior to start of movie playback, then color gamut will be selected as BT-2020 for HDR windows, and BT-709 for "
"standard dynamic range windows.\n"
"\n\n"
"General notes:\n\n"
"* Hook chains are per onscreen window, so each window can have a different configuration and enable state.\n"
"* Read all available documentation on the Psychtoolbox imaging pipeline in 'help PsychGLImageprocessing', the PsychDocumentation folder "
"and on the Wiki before you make use of this function. Its way to complex to use it by guessing ;)\n";
static char seeAlsoString[] = "";
PsychError SCREENHookFunction(void)
{
PsychWindowRecordType *windowRecord;
char numString[10];
char *cmdString, *hookString, *idString, *blitterString, *insertString;
int cmd, slotid, flag1, whereloc = 0;
int leftglHandle, rightglHandle, glTextureTarget, format, multiSample, width, height;
int leftFboHandle, rightFboHandle;
psych_int64 flag64;
double doubleptr;
double shaderid, luttexid1 = 0;
int n, m, p;
double *dblmat;
int verbosity = PsychPrefStateGet_Verbosity();
blitterString = NULL;
// All subfunctions should have these two lines.
PsychPushHelp(useString, synopsisString, seeAlsoString);
if (PsychIsGiveHelp()) { PsychGiveHelp(); return(PsychError_none); };
PsychErrorExit(PsychCapNumInputArgs(12));
PsychErrorExit(PsychRequireNumInputArgs(2));
PsychErrorExit(PsychCapNumOutputArgs(9));
// Get the subcommand string:
PsychAllocInCharArg(2, kPsychArgRequired, &cmdString);
// Subcommand dispatcher:
cmd=0;
if (strstr(cmdString, "Append")) { cmd=1; whereloc = INT_MAX; }
if (strstr(cmdString, "Prepend")) { cmd=2; whereloc = 0; }
if (strcmp(cmdString, "Reset")==0) cmd=3;
if (strcmp(cmdString, "Enable")==0) cmd=4;
if (strcmp(cmdString, "Disable")==0) cmd=5;
if (strcmp(cmdString, "Query")==0) cmd=6;
if (strcmp(cmdString, "Dump")==0) cmd=7;
if (strcmp(cmdString, "DumpAll")==0) cmd=8;
if (strcmp(cmdString, "ListAll")==0) cmd=9;
if (strcmp(cmdString, "Edit")==0) cmd=10;
if (strcmp(cmdString, "ImagingMode")==0) cmd=11;
if (strstr(cmdString, "InsertAt")) { cmd=12; whereloc = -1; sscanf(cmdString, "InsertAt%i", &whereloc); }
if (strstr(cmdString, "Remove")) cmd=13;
if (strcmp(cmdString, "GetDisplayBufferTextures")==0) cmd=14;
if (strcmp(cmdString, "SetDisplayBufferTextures")==0) cmd=15;
if (strcmp(cmdString, "SetOneshotFlipFlags")==0) cmd=16;
if (strcmp(cmdString, "SetOneshotFlipResults")==0) cmd=17;
if (strcmp(cmdString, "SetWindowBackendOverrides")==0) cmd=18;
if (strcmp(cmdString, "ImportDisplayBufferInteropMemory")==0) cmd=19;
if (strcmp(cmdString, "SetHDRScalingFactors")==0) cmd=20;
if (strcmp(cmdString, "WindowColorGamut")==0) cmd=21;
if (cmd == 0) PsychErrorExitMsg(PsychError_user, "Unknown subcommand specified to 'HookFunction'.");
if (whereloc < 0) PsychErrorExitMsg(PsychError_user, "Unknown/Invalid/Unparseable insert location specified to 'HookFunction' 'InsertAtXXX'.");
// Need hook name?
if (cmd!=9 && cmd!=8 && cmd!=11 && cmd!=14 && cmd!=15 && cmd!=16 && cmd!=17 && cmd!=18 && cmd!=19 && cmd!=20 && cmd!=21) {
// Get it:
PsychAllocInCharArg(3, kPsychArgRequired, &hookString);
}
// Get the window structure for the onscreen window.
windowRecord = NULL;
PsychAllocInWindowRecordArg(1, (cmd!=9) ? TRUE : FALSE, &windowRecord);
switch(cmd) {
case 1: // Append:
case 2: // Prepend:
case 12: // Insert at location 'whereloc':
// Add a new hook function callback to chain, either at beginning or end.
// What type of callback/handler is to be added?
if(strstr(cmdString, "Shader")) {
// GLSL shader program object:
// The id string:
PsychAllocInCharArg(4, kPsychArgRequired, &idString);
// The shader object handle:
PsychCopyInDoubleArg(5, TRUE, &shaderid);
// The blitter config string:
PsychAllocInCharArg(6, FALSE, &blitterString);
// (Optionally) a texture handle for a texture to attach to 2nd unit:
PsychCopyInDoubleArg(7, FALSE, &luttexid1);
// Add shader:
PsychPipelineAddShaderToHook(windowRecord, hookString, idString, whereloc, (unsigned int) shaderid, blitterString, (unsigned int) luttexid1);
}
else if(strstr(cmdString, "CFunction")) {
// C callback function:
// First the id string:
PsychAllocInCharArg(4, kPsychArgRequired, &idString);
// Then the void* to the function, encoded as a double value:
PsychCopyInDoubleArg(5, TRUE, &doubleptr);
// Add the function void* to the chain:
PsychPipelineAddCFunctionToHook(windowRecord, hookString, idString, whereloc, PsychDoubleToPtr(doubleptr));
}
else if(strstr(cmdString, "MFunction")) {
// Matlab/Octave/Whatever runtime environment callback function:
// First the id string:
PsychAllocInCharArg(4, kPsychArgRequired, &idString);
// Then the call string (for feval()) for the function:
PsychAllocInCharArg(5, TRUE, &blitterString);
// Add the function to the chain:
PsychPipelineAddRuntimeFunctionToHook(windowRecord, hookString, idString, whereloc, blitterString);
}
else if(strstr(cmdString, "Builtin")) {
// Built in special function:
// First the id string:
PsychAllocInCharArg(4, kPsychArgRequired, &idString);
// Then the options-string:
PsychAllocInCharArg(5, TRUE, &blitterString);
// Add the function to the chain:
PsychPipelineAddBuiltinFunctionToHook(windowRecord, hookString, idString, whereloc, blitterString);
}
else {
// Unknown?!?
PsychErrorExitMsg(PsychError_user, "Unknown callback type specified to 'HookFunction'.");
}
break;
case 3: // Reset hook-chain:
PsychPipelineResetHook(windowRecord, hookString);
break;
case 4: // Enable hook-chain:
PsychPipelineEnableHook(windowRecord, hookString);
break;
case 5: // Disable hook-chain:
PsychPipelineDisableHook(windowRecord, hookString);
break;
case 6: // Query properties of a slot in a specific hook-chain:
// Get the id string:
if (PsychGetArgType(4)!=PsychArgType_char) {
// No id string provided: Try to get numeric slot id and
// turn it into an id string:
PsychCopyInIntegerArg(4, TRUE, &slotid);
sprintf(numString, "%i", slotid);
idString = (char*) &numString[0];
slotid = -1;
}
else {
PsychAllocInCharArg(4, TRUE, &idString);
}
// Query everything that's there and copy it out:
slotid = PsychPipelineQueryHookSlot(windowRecord, hookString, &insertString, &idString, &blitterString, &doubleptr, &shaderid, &luttexid1);
// Copy out all infos:
PsychCopyOutDoubleArg(1, FALSE, slotid);
PsychCopyOutCharArg(2, FALSE, (idString) ? idString : "NONE");
PsychCopyOutCharArg(3, FALSE, (blitterString) ? blitterString : "NONE");
PsychCopyOutDoubleArg(4, FALSE, doubleptr);
PsychCopyOutDoubleArg(5, FALSE, shaderid);
PsychCopyOutDoubleArg(6, FALSE, luttexid1);
PsychCopyOutCharArg(7, FALSE, (insertString) ? insertString : "NONE");
break;
case 7: // Dump specific hook-chain:
PsychPipelineDumpHook(windowRecord, hookString);
break;
case 8: // Dump all hook-chains:
PsychPipelineDumpAllHooks(windowRecord);
break;
case 9: // List all hook-chains:
PsychPipelineListAllHooks(windowRecord);
break;
case 10: // Set properties of a slot in a specific hook-chain:
// Get the id string:
PsychAllocInCharArg(4, kPsychArgRequired, &idString);
// Query everything that's there and copy it out:
slotid = PsychPipelineQueryHookSlot(windowRecord, hookString, &insertString, &idString, &blitterString, &doubleptr, &shaderid, &luttexid1);
if (slotid < 0) PsychErrorExitMsg(PsychError_user, "In 'Edit' No such hook slot in that hook chain for that object.");
// Copy out all infos:
PsychCopyOutDoubleArg(1, FALSE, slotid);
PsychCopyOutCharArg(2, FALSE, (idString) ? idString : "NONE");
PsychCopyOutCharArg(3, FALSE, (blitterString) ? blitterString : "NONE");
PsychCopyOutDoubleArg(4, FALSE, doubleptr);
PsychCopyOutDoubleArg(5, FALSE, shaderid);
PsychCopyOutDoubleArg(6, FALSE, luttexid1);
break;
case 11: // Change imagingMode flags for a proxy window:
if (windowRecord->windowType!=kPsychProxyWindow) PsychErrorExitMsg(PsychError_user, "In 'ImagingMode' Invalid windowPtr provided. Must be a proxy window!");
PsychCopyOutDoubleArg(1, FALSE, (double) windowRecord->imagingMode);
luttexid1 = -1;
PsychCopyInDoubleArg(3, FALSE, &luttexid1);
if (luttexid1 < 0 && luttexid1!=-1) PsychErrorExitMsg(PsychError_user, "In 'ImagingMode' Invalid imagingMode flags provided. Must be positive!");
if (luttexid1!=-1) {
windowRecord->imagingMode = (unsigned int) luttexid1;
}
break;
// case 12 see at top.
case 13: // Remove slot at given index.
PsychCopyInIntegerArg(4, TRUE, &slotid);
PsychPipelineDeleteHookSlot(windowRecord, hookString, slotid);
break;
case 14: // GetDisplayBufferTextures
if (!PsychGetPipelineExportTexture(windowRecord, &leftglHandle, &rightglHandle, &glTextureTarget, &format, &multiSample, &width, &height, &leftFboHandle, &rightFboHandle) && (verbosity > 1))
printf("PTB-WARNING: Invalid HookFunction call to GetDisplayBufferTextures! Not supported with current imagingMode. Trying to carry on - Prepare for trouble!\n");
PsychCopyOutDoubleArg(1, FALSE, leftglHandle);
PsychCopyOutDoubleArg(2, FALSE, rightglHandle);
PsychCopyOutDoubleArg(3, FALSE, glTextureTarget);
PsychCopyOutDoubleArg(4, FALSE, format);
PsychCopyOutDoubleArg(5, FALSE, multiSample);
PsychCopyOutDoubleArg(6, FALSE, width);
PsychCopyOutDoubleArg(7, FALSE, height);
PsychCopyOutDoubleArg(8, FALSE, leftFboHandle);
PsychCopyOutDoubleArg(9, FALSE, rightFboHandle);
break;
case 15: // SetDisplayBufferTextures
// Get old values and return them:
if (!PsychGetPipelineExportTexture(windowRecord, &leftglHandle, &rightglHandle, &glTextureTarget, &format, &multiSample, &width, &height, &leftFboHandle, &rightFboHandle) && (verbosity > 1))
printf("PTB-WARNING: Invalid HookFunction call to SetDisplayBufferTextures! Not supported with current imagingMode. Trying to carry on - Prepare for trouble!\n");
PsychCopyOutDoubleArg(1, FALSE, leftglHandle);
PsychCopyOutDoubleArg(2, FALSE, rightglHandle);
PsychCopyOutDoubleArg(3, FALSE, glTextureTarget);
PsychCopyOutDoubleArg(4, FALSE, format);
PsychCopyOutDoubleArg(5, FALSE, multiSample);
PsychCopyOutDoubleArg(6, FALSE, width);
PsychCopyOutDoubleArg(7, FALSE, height);
// Get new optional override values and set them:
PsychCopyInIntegerArg(4, FALSE, &leftglHandle);
PsychCopyInIntegerArg(5, FALSE, &rightglHandle);
PsychCopyInIntegerArg(6, FALSE, &glTextureTarget);
PsychCopyInIntegerArg(7, FALSE, &format);
PsychCopyInIntegerArg(8, FALSE, &multiSample);
PsychCopyInIntegerArg(9, FALSE, &width);
PsychCopyInIntegerArg(10, FALSE, &height);
if (!PsychSetPipelineExportTexture(windowRecord, leftglHandle, rightglHandle, glTextureTarget, format, multiSample, width, height) && (verbosity > 1))
printf("PTB-WARNING: HookFunction call to SetDisplayBufferTextures failed. See above error message for details. Trying to carry on - Prepare for trouble!\n");
break;
case 16: // SetOneshotFlipFlags
flag64 = 0;
if (!PsychCopyInIntegerArg64(4, FALSE, &flag64) && (verbosity > 1))
printf("PTB-WARNING: HookFunction call to SetOneshotFlipFlags failed, because mandatory flipFlags parameter is missing.\n");
if (flag64 & ~(kPsychSkipVsyncForFlipOnce | kPsychSkipTimestampingForFlipOnce | kPsychSkipSwapForFlipOnce | kPsychSkipWaitForFlipOnce | kPsychDontAutoResetOneshotFlags)) {
if (verbosity > 1)
printf("PTB-WARNING: HookFunction call to SetOneshotFlipFlags failed, because invalid/unsupported flipFlags were specified.\n");
} else {
// Reset current flags:
windowRecord->specialflags &= ~(kPsychSkipVsyncForFlipOnce | kPsychSkipTimestampingForFlipOnce | kPsychSkipSwapForFlipOnce | kPsychSkipWaitForFlipOnce | kPsychDontAutoResetOneshotFlags);
// Add new ones:
windowRecord->specialflags |= flag64;
// Any flag set that would prevent proper timestamping for the onscreen window in this cycle?
if (flag64 & (kPsychSkipVsyncForFlipOnce | kPsychSkipTimestampingForFlipOnce | kPsychSkipSwapForFlipOnce)) {
// Invalidate windowRecord's bookkeeping:
windowRecord->time_at_last_vbl = 0;
windowRecord->rawtime_at_swapcompletion = 0;
windowRecord->postflip_vbltimestamp = -1;
windowRecord->osbuiltin_swaptime = 0;
}
}
break;
case 17: // SetOneshotFlipResults
// Make sure internal timestamping is really off and override with our settings is allowed:
if (!(windowRecord->specialflags & kPsychSkipTimestampingForFlipOnce)) {
if (verbosity > 1)
printf("PTB-WARNING: HookFunction call to SetOneshotFlipResults failed, because flipFlags did not include kPsychSkipTimestampingForFlipOnce for this sequence.\n");
} else {
// Override allowed: Assign usercode provided values: These will be latched into 'Flip' return values during flip completion.
// vblTimestamp of Flip, mandatory:
if (!PsychCopyInDoubleArg(4, FALSE, &windowRecord->time_at_last_vbl) && (verbosity > 1))
printf("PTB-WARNING: HookFunction call to SetOneshotFlipResults failed, because mandatory 'VBLTimestamp' is missing!\n");
// onsetTimestamp of Flip, optional, aliasese to vblTimestamp if omitted:
if (!PsychCopyInDoubleArg(5, FALSE, &windowRecord->osbuiltin_swaptime))
windowRecord->osbuiltin_swaptime = windowRecord->time_at_last_vbl;
// missEstimate of Flip, optional:
if (!PsychCopyInDoubleArg(6, FALSE, &windowRecord->postflip_vbltimestamp))
windowRecord->postflip_vbltimestamp = 0;
// beamposition of Flip, optional:
if (!PsychCopyInIntegerArg(7, FALSE, &windowRecord->beamposition_at_flip))
windowRecord->beamposition_at_flip = -1;
}
break;
case 18: // SetWindowBackendOverrides
// Retrieve override values for onscreen window properties:
if (!(windowRecord->imagingMode & kPsychNeedFinalizedFBOSinks))
PsychErrorExitMsg(PsychError_user, "In 'SetWindowBackendOverrides': No kPsychNeedFinalizedFBOSinks imaging mode selected. Overrides forbidden!");
// Screen('PixelSize'):
if (PsychCopyInIntegerArg(4, FALSE, &flag1)) {
windowRecord->depth = flag1;
// Running under Linux/X11 native?
#if (PSYCH_SYSTEM == PSYCH_LINUX) && !defined(PTB_USE_WAFFLE)
// Make sure RandR outputs are properly configured for native video output at
// at least 'bpc' (== windowRecord->depth / 3) bits per color channel:
PsychOSEnsureMinimumOutputPrecision(windowRecord->screenNumber, windowRecord->depth / 3);
#endif
}
// Video refresh interval / refresh rate / flipinterval indicators:
if (PsychCopyInDoubleArg(5, FALSE, &windowRecord->VideoRefreshInterval)) {
windowRecord->ifi_beamestimate = windowRecord->VideoRefreshInterval;
windowRecord->IFIRunningSum = windowRecord->VideoRefreshInterval;
windowRecord->nrIFISamples = 1;
}
if (PsychAllocInDoubleMatArg(6, kPsychArgOptional, &n, &m, &p, &dblmat)) {
// Release old ones, if any:
if (windowRecord->proj) {
free(windowRecord->proj);
windowRecord->proj = NULL;
}
// Validate and assign:
if (n * m * p == 1) {
// Empty assignment - No-op, as matrix is already NULL'ed above, just for clarity:
windowRecord->proj = NULL;
}
else {
// New override matrix assignment:
if (n !=4 || m != 4 || (p != 1 && p != 2))
PsychErrorExitMsg(PsychError_user, "Invalid 'proj' matrices specified. Must be a 4x4 matrix or a stack of two 4x4 matrices.");
windowRecord->proj = (double*) malloc(2 * 16 * sizeof(double));
memcpy(windowRecord->proj, dblmat, m * n * p * sizeof(double));
}
}
break;
case 19: // ImportDisplayBufferInteropMemory
// Get old values for textures. Just to check if this operation is supported at all in the current imaging pipeline configuration:
if (!PsychGetPipelineExportTexture(windowRecord, &leftglHandle, &rightglHandle, &glTextureTarget, &format, &multiSample, &width, &height, &leftFboHandle, &rightFboHandle) && (verbosity > 1))
printf("PTB-WARNING: Invalid HookFunction call to ImportDisplayBufferInteropMemory! Not supported with current imagingMode. Trying to carry on - Prepare for trouble!\n");
{
int viewId, allocationSize, formatSpec, tilingMode, memoryOffset;
void *interopMemObjectHandle = NULL;
void *interopSemaphoreHandle = NULL;
// Get new optional override values and set them:
PsychCopyInIntegerArg(4, FALSE, &viewId);
PsychCopyInPointerArg(5, FALSE, &interopMemObjectHandle);
PsychCopyInIntegerArg(6, FALSE, &allocationSize);
PsychCopyInIntegerArg(7, FALSE, &formatSpec);
PsychCopyInIntegerArg(8, FALSE, &tilingMode);
PsychCopyInIntegerArg(9, FALSE, &memoryOffset);
PsychCopyInIntegerArg(10, FALSE, &width);
PsychCopyInIntegerArg(11, FALSE, &height);
PsychCopyInPointerArg(12, FALSE, &interopSemaphoreHandle);
if (!PsychSetPipelineExportTextureInteropMemory(windowRecord, viewId, interopMemObjectHandle, allocationSize, formatSpec, tilingMode, memoryOffset, width, height, interopSemaphoreHandle) && (verbosity > 1))
printf("PTB-WARNING: HookFunction call to ImportDisplayBufferInteropMemory failed. See above error message for details. Trying to carry on - Prepare for trouble!\n");
}
break;
case 20: // SetHDRScalingFactors
// Return old settings:
PsychCopyOutDoubleArg(1, FALSE, windowRecord->maxSDRToHDRScaleFactor);
PsychCopyOutDoubleArg(2, FALSE, windowRecord->normalizedToHDRScaleFactor);
// Optionally accept new settings:
PsychCopyInDoubleArg(4, FALSE, &windowRecord->maxSDRToHDRScaleFactor);
PsychCopyInDoubleArg(5, FALSE, &windowRecord->normalizedToHDRScaleFactor);
break;
case 21: // WindowColorGamut
PsychCopyOutDoubleMatArg(1, kPsychArgOptional, 2, 4, 1, &windowRecord->colorGamut[0]);
if (PsychAllocInDoubleMatArg(4, kPsychArgOptional, &m, &n, &p, &dblmat)) {
if (m != 2 || n != 4 || p > 1)
PsychErrorExitMsg(PsychError_user, "HookFunction call to WindowColorGamut failed. Invalid 'colorGamut' matrix specified. Must be a 2x4 matrix.");
memcpy(&windowRecord->colorGamut[0], dblmat, sizeof(windowRecord->colorGamut));
}
break;
}
// Done.
return(PsychError_none);
}
|