1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138
|
/*
* Copyright (c) 2020 The WebRTC project authors. All Rights Reserved.
*
* Use of this source code is governed by a BSD-style license
* that can be found in the LICENSE file in the root of the source
* tree. An additional intellectual property rights grant can be found
* in the file PATENTS. All contributing project authors may
* be found in the AUTHORS file in the root of the source tree.
*/
#ifndef MODULES_VIDEO_CODING_SVC_SCALABILITY_STRUCTURE_KEY_SVC_H_
#define MODULES_VIDEO_CODING_SVC_SCALABILITY_STRUCTURE_KEY_SVC_H_
#include <bitset>
#include <vector>
#include "api/transport/rtp/dependency_descriptor.h"
#include "api/video/video_bitrate_allocation.h"
#include "common_video/generic_frame_descriptor/generic_frame_info.h"
#include "modules/video_coding/svc/scalable_video_controller.h"
namespace webrtc {
class ScalabilityStructureKeySvc : public ScalableVideoController {
public:
ScalabilityStructureKeySvc(int num_spatial_layers, int num_temporal_layers);
~ScalabilityStructureKeySvc() override;
StreamLayersConfig StreamConfig() const override;
std::vector<LayerFrameConfig> NextFrameConfig(bool restart) override;
GenericFrameInfo OnEncodeDone(const LayerFrameConfig& config) override;
void OnRatesUpdated(const VideoBitrateAllocation& bitrates) override;
private:
enum FramePattern : int {
kNone,
kKey,
kDeltaT0,
kDeltaT2A,
kDeltaT1,
kDeltaT2B,
};
static constexpr int kMaxNumSpatialLayers = 3;
static constexpr int kMaxNumTemporalLayers = 3;
// Index of the buffer to store last frame for layer (`sid`, `tid`)
int BufferIndex(int sid, int tid) const {
return tid * num_spatial_layers_ + sid;
}
bool DecodeTargetIsActive(int sid, int tid) const {
return active_decode_targets_[sid * num_temporal_layers_ + tid];
}
void SetDecodeTargetIsActive(int sid, int tid, bool value) {
active_decode_targets_.set(sid * num_temporal_layers_ + tid, value);
}
bool TemporalLayerIsActive(int tid) const;
static DecodeTargetIndication Dti(int sid,
int tid,
const LayerFrameConfig& config);
std::vector<LayerFrameConfig> KeyframeConfig();
std::vector<LayerFrameConfig> T0Config();
std::vector<LayerFrameConfig> T1Config();
std::vector<LayerFrameConfig> T2Config(FramePattern pattern);
FramePattern NextPattern(FramePattern last_pattern) const;
const int num_spatial_layers_;
const int num_temporal_layers_;
FramePattern last_pattern_ = kNone;
std::bitset<kMaxNumSpatialLayers> spatial_id_is_enabled_;
std::bitset<kMaxNumSpatialLayers> can_reference_t1_frame_for_spatial_id_;
std::bitset<32> active_decode_targets_;
};
// S1 0--0--0-
// | ...
// S0 0--0--0-
class ScalabilityStructureL2T1Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL2T1Key() : ScalabilityStructureKeySvc(2, 1) {}
~ScalabilityStructureL2T1Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
// S1T1 0 0
// / / /
// S1T0 0---0---0
// | ...
// S0T1 | 0 0
// |/ / /
// S0T0 0---0---0
// Time-> 0 1 2 3 4
class ScalabilityStructureL2T2Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL2T2Key() : ScalabilityStructureKeySvc(2, 2) {}
~ScalabilityStructureL2T2Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
class ScalabilityStructureL2T3Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL2T3Key() : ScalabilityStructureKeySvc(2, 3) {}
~ScalabilityStructureL2T3Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
class ScalabilityStructureL3T1Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL3T1Key() : ScalabilityStructureKeySvc(3, 1) {}
~ScalabilityStructureL3T1Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
class ScalabilityStructureL3T2Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL3T2Key() : ScalabilityStructureKeySvc(3, 2) {}
~ScalabilityStructureL3T2Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
class ScalabilityStructureL3T3Key : public ScalabilityStructureKeySvc {
public:
ScalabilityStructureL3T3Key() : ScalabilityStructureKeySvc(3, 3) {}
~ScalabilityStructureL3T3Key() override;
FrameDependencyStructure DependencyStructure() const override;
};
} // namespace webrtc
#endif // MODULES_VIDEO_CODING_SVC_SCALABILITY_STRUCTURE_KEY_SVC_H_
|