/** @page smpl_niviewer_capture_cpp Capture.cpp file Source files: Click the following link to view the source code file: - Capture.cpp This file contains the code for capturing frames from the OpenNI generator nodes. @section capture_cpp_glb_decls Global Type Declarations for Capture.cpp The Capture.cpp file's global type declarations comprise four type definitions, which are directly connected. The relationship between these four types is presented by by the following summary, with the key components only shown. @code typedef enum { NOT_CAPTURING, ... } CapturingState; typedef enum { CAPTURE_DEPTH_NODE,..., CAPTURE_NODE_COUNT } CaptureNodeType; typedef struct NodeCapturingData { ... } NodeCapturingData; typedef struct CapturingData { NodeCapturingData nodes[CAPTURE_NODE_COUNT]; ... ... CapturingState State; ... } CapturingData; // -------------------------------- // Global Variables // -------------------------------- CapturingData g_Capture; @endcode In summary, the major data type is the CapturingData structure, for which a single run-time data instance, g_Capture, is defined, as above, and is used extensively throughout the Capture.cpp module. As shown above, g_Capture includes the nodes array, containing an entry of type NodeCapturingData for one each of the (four - CAPTURE_NODE_COUNT) types of generator nodes, @ref xn::DepthGenerator "Depth", @ref xn::ImageGenerator "Image", @ref xn::IRGenerator "IR", and @ref xn::AudioGenerator "Audio" generators. A key data field of NodeCapturingData is pGenerator, for pointing to one of the above generators. These structures are described separately and in some detail in the subsections further below. @subsection capture_cpp_glb_decls_CapturingState Type definition: CapturingState enum The CapturingState type is defined as below. It defines a field in the CapturingData structure. It is used as the state controller in the getCaptureMessage() state machine. @code typedef enum { NOT_CAPTURING, SHOULD_CAPTURE, CAPTURING, } CapturingState; @endcode @subsection capture_cpp_glb_decls_CaptureNodeType Type definition: CaptureNodeType enum This type contains enum items for specifying esch of the generator nodes. @code typedef enum { CAPTURE_DEPTH_NODE, CAPTURE_IMAGE_NODE, CAPTURE_IR_NODE, CAPTURE_AUDIO_NODE, CAPTURE_NODE_COUNT } CaptureNodeType; @endcode The CaptureNodeType type itself is not currently directly used. @subsection capture_cpp_glb_decls_NodeCapturingData Type definition: NodeCapturingData structure The NodeCapturingData type is defined as below. It defines a field in the CapturingData structure. It is used as the state controller in the getCaptureMessage() state machine. @code typedef struct NodeCapturingData { XnCodecID captureFormat; XnUInt32 nCapturedFrames; bool bRecording; xn::Generator* pGenerator; } NodeCapturingData; @endcode captureFormat: For containing the current codec enum ID of a generator node. Note that later in this file (in @ref capture_cpp_captureinit) all of the codec text names and enum IDs for each node type area stored (in g_DepthFormat.pValues[] and g_DepthFormat.pIndexToName[nIndex]). @subsection capture_cpp_glb_decls_CapturingData Type definition: CapturingData struct @code typedef struct CapturingData { NodeCapturingData nodes[CAPTURE_NODE_COUNT]; Recorder* pRecorder; char csFileName[XN_FILE_MAX_PATH]; XnUInt32 nStartOn; // time to start, in seconds bool bSkipFirstFrame; CapturingState State; XnUInt32 nCapturedFrameUniqueID; char csDisplayMessage[500]; } CapturingData; @endcode @section capture_cpp_glb_vars Global Variable Declarations for Capture.cpp The Capture.cpp file's global variable declarations includes the central g_Capture variable and a format variable of NodeCodec type for each of the four generator nodes - see the declaration block below. NodeCodec is defined in Device.h. It contains codec definitions for all the codecs of each generator node. @code // -------------------------------- // Global Variables // -------------------------------- CapturingData g_Capture; NodeCodec g_DepthFormat; NodeCodec g_ImageFormat; NodeCodec g_IRFormat; NodeCodec g_AudioFormat; @endcode @section capture_cpp_captureinit Function: captureInit() - Initializes the Primary Stream and the Resolutions This function initializes the main g_Capture variable and the NodeCodec structures, for example, g_DepthFormat. Following are examples of NodeCodec structures. Note that for each Generator node there can be a number of codes defined. For example, in the code sample below, for the DepthGenerator node there are defined the codecs XN_CODEC_16Z_EMB_TABLES and XN_CODEC_UNCOMPRESSED. @code void captureInit() { // Depth Formats int nIndex = 0; g_DepthFormat.pValues[nIndex] = XN_CODEC_16Z_EMB_TABLES; g_DepthFormat.pIndexToName[nIndex] = "PS Compression (16z ET)"; nIndex++; g_DepthFormat.pValues[nIndex] = XN_CODEC_UNCOMPRESSED; g_DepthFormat.pIndexToName[nIndex] = "Uncompressed"; nIndex++; ... ... @endcode Each entry in the g_DepthFormat.pValues[] array specifies a codec ID, e.g., @ref xn::XN_CODEC_16Z_EMB_TABLES. Each entry in the g_DepthFormat.pIndexToName[] array specifies a human readable text name for the codec, e.g., "PS Compression (16z ET)". The g_Capture data structure variable is initialized as follows. @code g_Capture.csFileName[0] = 0; g_Capture.State = NOT_CAPTURING; g_Capture.nCapturedFrameUniqueID = 0; g_Capture.csDisplayMessage[0] = '\0'; g_Capture.bSkipFirstFrame = false; g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat = XN_CODEC_16Z_EMB_TABLES; g_Capture.nodes[CAPTURE_IMAGE_NODE].captureFormat = XN_CODEC_JPEG; g_Capture.nodes[CAPTURE_IR_NODE].captureFormat = XN_CODEC_UNCOMPRESSED; g_Capture.nodes[CAPTURE_AUDIO_NODE].captureFormat = XN_CODEC_UNCOMPRESSED; @endcode Note in the above initializations: - Capture State -- in g_Capture.State -- is initialized to NOT_CAPTURING. - g_Capture.nodes[] is a list of captureFormat structures and it is initialized to contain the current codecs to be used for each Generator node. Note that earlier in this function all of the codecs for each node type have been stored in g_DepthFormat.pValues[] and g_DepthFormat.pIndexToName[nIndex]. @section capture_cpp_isCapturing Function: isCapturing() - Are the Generator nodes in Capturing State Returns whther the generator nodes are currently attempting to capture frames. @code bool isCapturing() { return (g_Capture.State != NOT_CAPTURING); } @endcode @section capture_cpp_OpenWriteDevice Function: captureOpenWriteDevice() - Open a Write Device The following code block calls @ref xn::Context::EnumerateProductionTrees "EnumerateProductionTrees" to list all available @ref xn::Recorder "Recorder" production nodes and returns a full list of the matching production nodes. The chosen pointer picks the first in the list, and to select the @ref xn::NodeInfo "NodeInfo" information of a @ref xn::Recorder "Recorder" node for recording a data generation session. @code NodeInfoList recordersList; nRetVal = g_Context.EnumerateProductionTrees(XN_NODE_TYPE_RECORDER, NULL, recordersList); NodeInfo chosen = *recordersList.Begin(); @endcode The following code block creates a @ref prod_graph "production graph" for the selected @ref xn::Recorder "Recorder" node. A pointer to the Recorder is held to the g_Capture variable. @code g_Capture.pRecorder = new Recorder; nRetVal = g_Context.CreateProductionTree(chosen, *g_Capture.pRecorder); START_CAPTURE_CHECK_RC(nRetVal, "Create recorder"); @endcode Finally, the destnation file or the recording is set, as follows. @code nRetVal = g_Capture.pRecorder->SetDestination(XN_RECORD_MEDIUM_FILE, g_Capture.csFileName); @endcode @section capture_cpp_Browse Function: captureBrowse() - Opens a Write Device This function opens the write device. // as we waited for user input, it's probably better to discard first frame (especially if an accumulating // stream is on, like audio). @section capture_cpp_Start Function: captureStart() - Starts the Capturing Process This function starts capturing process. The important features are that it sets the tiem for starting capturing by assigning the current time to g_Capture weit an added delay; and then it sets the Capture state to SHOULD_CAPTURE, indicating taht a future time has been set for starting capturing. This is shown below. @code XnUInt64 nNow; xnOSGetTimeStamp(&nNow); nNow /= 1000; g_Capture.nStartOn = (XnUInt32)nNow + nDelay; g_Capture.State = SHOULD_CAPTURE; @endcode @section capture_cpp_CloseWriteDevice Function: captureCloseWriteDevice() - Closes a Write Device This function closes a write device. Among the 'close' operations, it calls @ref xn::NodeWrapper::Release() "Release()" to Unreference a production node. This decreases its reference count by 1. If the reference count reaches zero, the node will be destroyed. @code if (g_Capture.pRecorder != NULL) { g_Capture.pRecorder->Release(); delete g_Capture.pRecorder; g_Capture.pRecorder = NULL; } @endcode @section capture_cpp_captureRestart Function: captureRestart() - Restarts the Recording Process This function restarts the recording module. It simply uses the captureCloseWriteDevice() defined just above to close the recording device. This function then reopens the recording module by using the captureOpenWriteDevice() defined further above. g_Capture.State remains at it current state. @section capture_cpp_captureStop Function: captureStop() - Stops the Recording Process This function stops the recording module, i.e., it puts it into NOT_CAPTURING state. Thus, for this purpose CAPTURING state and SHOULD_CAPTURE state are both defined as 'capturing state'. This function simply uses the captureCloseWriteDevice() defined just above to close the recording device. @section capture_cpp_captureFrame Function: captureFrame() - Main State Machine for Capturing Frames from Generator Nodes This function is the main state machine for capturing frames from generator nodes. This function processes two states: CAPTURING state and SHOULD_CAPTURE state. @subsection capture_cpp_captureframe_should_capture_st SHOULD_CAPTURE state In this state, this function add nodes to the recording. This function first checks if the capture time has been reached. (This time delay was set in the @ref capture_cpp_Start "captureStart() function".) @code if (g_Capture.State == SHOULD_CAPTURE) { XnUInt64 nNow; xnOSGetTimeStamp(&nNow); nNow /= 1000; // check if time has arrived if (nNow >= g_Capture.nStartOn) @endcode Once the capture time and started and this function starts to capture, it performs some initialization and sets the Capturing state to CAPTURING state. @code g_Capture.State = CAPTURING; @endcode The following 'if' statement adds a valid device node to the recorder. This is for recording raw input data from the device. @code if (getDevice() != NULL) { nRetVal = g_Capture.pRecorder->AddNodeToRecording(*getDevice(), XN_CODEC_UNCOMPRESSED); START_CAPTURE_CHECK_RC(nRetVal, "add device node"); } @endcode The @ref xn::Recorder::AddNodeToRecording() adds a node to the recording setup, and starts recording data that the node generates. This method must be called for each node to be recorded with this recorder. The call passes as parameters a pointer to the node and the enum ID of the codec to be used. The following sequence of 'if' statements adds nodes to the recorder. A node is added to the recorder only if: - the node is 'On' (e.g., g_bIsDepthOn=true for a DepthGenerator node), and - the node's captureFormat is defined (i.e., captureFormat!= CODEC_DONT_CAPTURE As an example, the following code block shows the code for the DepthGenerator node. @code if (isDepthOn() && (g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat != CODEC_DONT_CAPTURE)) { nRetVal = g_Capture.pRecorder->AddNodeToRecording(*getDepthGenerator(), g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat); START_CAPTURE_CHECK_RC(nRetVal, "add depth node"); g_Capture.nodes[CAPTURE_DEPTH_NODE].bRecording = TRUE; g_Capture.nodes[CAPTURE_DEPTH_NODE].pGenerator = getDepthGenerator(); } @endcode In the above, the code saves in g_Capture a pointer to the DepthGenerator node by assigning the return result of getDepthGenerator(). @subsection capture_cpp_captureframe_capturing_st CAPTURING state In this state, this function starts recording data generated from the nodes. Once all required nodes are added, the application can read data from the nodes and record it. Recording of data can be achieved either by explicitly calling the @ref xn::Recorder::Record() method, or by using one of the @ref conc_updating_data "'Update All'" functions. This function demonstrates using the Record() method. @code if (g_Capture.State == CAPTURING) { nRetVal = g_Capture.pRecorder->Record(); ... @endcode There isn't a real need to call Record() here, as the WaitXUpdateAll() call from IdleCallback() in the NiView.cpp file already makes sure that recording is performed. The following loop counts recorded frames. It uses the @ref xn::Generator::IsDataNew() method to test of a generate nodfe has actually generated new data. the IsDataNew() method returns whether the node's frame data was updated by the most recent call to any 'WaitXUpdateAll' function (e.g., @ref xn::Context::WaitAndUpdateAll()). @code for (int i = 0; i < CAPTURE_NODE_COUNT; ++i) { if (g_Capture.nodes[i].bRecording && g_Capture.nodes[i].pGenerator->IsDataNew()) g_Capture.nodes[i].nCapturedFrames++; } @endcode @section capture_cpp_setformat Function: captureSetFormat() - Selects a New Codec for Recording This function is used by a number of individual 'Set Format' functions (e.g., captureSetDepthFormat() - described further below) to select a new codec for recording. Parameters: pMember: the old format
newFormat: the new format
node: ProductionNode specifier If a state change is being requested, i.e., from 'not capture' to 'capture', or the reverse, then the node is @ref xn::Recorder::AddNodeToRecording "added to" or @ref xn::Recorder::AddNodeToRecording "removed from" the Recorder, accordingly. If a codec change is being requested, then the node removed from the Recorder and then added again, this time with the new codec. @section capture_cpp_setformat_grp Function group: 'Set Format' for each Production Node All functions in this group call the captureSetFormat() described above. For example: @code void captureSetDepthFormat(int format) { captureSetFormat(&g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat, format, *getDepthGenerator()); } ... ... @endcode @section capture_cpp_getCodecName Function: getCodecName() - Gets Text Name of Node's Current Codec This function gets the text name of the current codec being used for a specific node. This function is used by a number of individual 'GetDepthFormatName' functions (e.g., captureGetImageFormatName() - described further below) to get the text name of a specified codec from the list of all possible codecs for a specific node. Parameters: pNodeCodec: a specific generator node's list of all codec ID info (text name and ID enum), e.g., this function is called with g_DepthFormat passed as this parameter codecID: the enum ID of the codec currently being used for the specific generator node @code for (int i = 0; i < pNodeCodec->nValuesCount; i++) { if (pNodeCodec->pValues[i] == codecID) { return pNodeCodec->pIndexToName[i]; } } @endcode @section capture_cpp_getCodecName_grp Function group: 'getCodecName' for each Generator node All functions in this group call the getCodecName() described above. For example: @code const char* captureGetDepthFormatName() { return getCodecName(&g_DepthFormat, g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat); } @endcode @section capture_cpp_getCaptureMessage Function: 'getCaptureMessage()' This function builds a capture message according to the current Capture State. In this function, there is one OpenNI method of note - the @ref xn::NodeWrapper::GetName() method - see the 'case' block below. @code case CAPTURING: { int nChars = sprintf(pMessage, "* Recording! Press any key or use menu to stop *\nRecorded Frames: "); for (int i = 0; i < CAPTURE_NODE_COUNT; ++i) { if (g_Capture.nodes[i].bRecording) { nChars += sprintf(pMessage + nChars, "%s-%d ", g_Capture.nodes[i].pGenerator->GetName(), g_Capture.nodes[i].nCapturedFrames); } } } @endcode The GetName() method gets the instance name of a node. Unless the application made a specific request for a specific name, the name will be of the form: "Depth1", "Image2", etc. GetName() is a member of the @ref xn::NodeWrapper "NodeWrapper" class. The NodeWrapper class is the base class for all OpenNI node classes in C++, for example, the @ref xn::ProductionNode class and the @ref xn::Generator class. @section capture_cpp_getFileName_grp Function group: 'Get File Name' - Build a file name for each Generator node All functions in this group build a file name (from a path and ID number) for saving a captured data frame. For example: @code const char* captureGetDepthFormatName() { return getCodecName(&g_DepthFormat, g_Capture.nodes[CAPTURE_DEPTH_NODE].captureFormat); } @endcode This unique file name is later to save a captured data frame to a file for storage. All the functions in this group are called from the findUniqueFileName() function (described immediately below) @section capture_cpp_findUniqueFileName Function: findUniqueFileName() - Builds a Unique File Name for Saving a Captured Data Frame This function builds a unique file name for saving a captured data frame. The purpose of this function is straightforward and there are no OpenNI specific operations in this function. @section capture_cpp_captureSingleFrame Function: captureSingleFrame() - Captures a Single Frame This function captures a single data frame from each generator node. The function first builds for each generator node a unique file name for saving the data frame. Then the function gets a @ref glos_frame_object "frame object" for each generator node. A "frame object" is a data frame and associated configuration information saved from a generator node. For example, @code const ImageMetaData* pImageMD = getImageMetaData(); if (pImageMD != NULL) { xnOSSaveFile(csImageFileName, pImageMD->Data(), pImageMD->DataSize()); } @endcode In this sample program, the frame objects are stored as metadata objects in the readFrame() function in the Device.cpp file of this program sample. getImageMetaData() is also a function in this sample program for simply getting the frame object that was already saved. */