1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239
|
/*
* Copyright (C) 2017-2022 Igalia S.L. All rights reserved.
* Copyright (C) 2022 Metrological Group B.V.
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Lesser General Public
* License as published by the Free Software Foundation; either
* version 2 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Lesser General Public License for more details.
*
* You should have received a copy of the GNU Lesser General Public
* License along with this library; if not, write to the Free Software
* Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
*/
#pragma once
#if USE(GSTREAMER_WEBRTC)
#include "GRefPtrGStreamer.h"
#include "GStreamerDataChannelHandler.h"
#include "GStreamerPeerConnectionBackend.h"
#include "GStreamerRtpSenderBackend.h"
#include "GStreamerStatsCollector.h"
#include "GStreamerWebRTCCommon.h"
#include "GUniquePtrGStreamer.h"
#include "RTCRtpReceiver.h"
#define GST_USE_UNSTABLE_API
#include <gst/webrtc/webrtc.h>
#undef GST_USE_UNSTABLE_API
#include <wtf/LoggerHelper.h>
#include <wtf/ThreadSafeRefCounted.h>
#include <wtf/glib/GUniquePtr.h>
#include <wtf/glib/WTFGType.h>
namespace WebCore {
class GStreamerIncomingTrackProcessor;
class GStreamerRtpReceiverBackend;
class GStreamerRtpTransceiverBackend;
class MediaStreamTrack;
class RTCSessionDescription;
class RealtimeOutgoingMediaSourceGStreamer;
class UniqueSSRCGenerator;
class GStreamerMediaEndpoint : public ThreadSafeRefCountedAndCanMakeThreadSafeWeakPtr<GStreamerMediaEndpoint, WTF::DestructionThread::Main>
#if !RELEASE_LOG_DISABLED
, private LoggerHelper
#endif
{
public:
static Ref<GStreamerMediaEndpoint> create(GStreamerPeerConnectionBackend& peerConnection) { return adoptRef(*new GStreamerMediaEndpoint(peerConnection)); }
~GStreamerMediaEndpoint();
bool setConfiguration(MediaEndpointConfiguration&);
void restartIce();
void doSetLocalDescription(const RTCSessionDescription*);
void doSetRemoteDescription(const RTCSessionDescription&);
void doCreateOffer(const RTCOfferOptions&);
void doCreateAnswer();
void getStats(const GRefPtr<GstPad>&, Ref<DeferredPromise>&&);
void getStats(RTCRtpReceiver&, Ref<DeferredPromise>&&);
std::unique_ptr<RTCDataChannelHandler> createDataChannel(const String&, const RTCDataChannelInit&);
void addIceCandidate(GStreamerIceCandidate&, PeerConnectionBackend::AddIceCandidateCallback&&);
void close();
void stop();
bool isStopped() const { return !m_pipeline; }
void suspend();
void resume();
void gatherDecoderImplementationName(Function<void(String&&)>&&);
bool isNegotiationNeeded(uint32_t eventId) const { return eventId == m_negotiationNeededEventId; }
std::optional<bool> canTrickleIceCandidates() const;
void configureSource(RealtimeOutgoingMediaSourceGStreamer&, GUniquePtr<GstStructure>&&);
ExceptionOr<std::unique_ptr<GStreamerRtpSenderBackend>> addTrack(MediaStreamTrack&, const FixedVector<String>&);
void removeTrack(GStreamerRtpSenderBackend&);
void recycleTransceiverForSenderTrack(GStreamerRtpTransceiverBackend*, MediaStreamTrack&, const FixedVector<String>&);
struct Backends {
std::unique_ptr<GStreamerRtpSenderBackend> senderBackend;
std::unique_ptr<GStreamerRtpReceiverBackend> receiverBackend;
std::unique_ptr<GStreamerRtpTransceiverBackend> transceiverBackend;
};
ExceptionOr<Backends> addTransceiver(const String& trackKind, const RTCRtpTransceiverInit&, PeerConnectionBackend::IgnoreNegotiationNeededFlag);
ExceptionOr<Backends> addTransceiver(MediaStreamTrack&, const RTCRtpTransceiverInit&, PeerConnectionBackend::IgnoreNegotiationNeededFlag);
std::unique_ptr<GStreamerRtpTransceiverBackend> transceiverBackendFromSender(GStreamerRtpSenderBackend&);
GStreamerRtpSenderBackend::Source createSourceForTrack(MediaStreamTrack&);
void collectTransceivers();
void createSessionDescriptionSucceeded(GUniquePtr<GstWebRTCSessionDescription>&&);
void createSessionDescriptionFailed(RTCSdpType, GUniquePtr<GError>&&);
GstElement* pipeline() const { return m_pipeline.get(); }
GstElement* webrtcBin() const { return m_webrtcBin.get(); }
bool handleMessage(GstMessage*);
GUniquePtr<GstStructure> preprocessStats(const GRefPtr<GstPad>&, const GstStructure*);
#if !RELEASE_LOG_DISABLED
void processStatsItem(const GValue*);
#endif
void connectIncomingTrack(WebRTCTrackData&);
void startRTCLogs();
void stopRTCLogs();
void onNegotiationNeeded();
protected:
#if !RELEASE_LOG_DISABLED
void onStatsDelivered(const GstStructure*);
#endif
private:
GStreamerMediaEndpoint(GStreamerPeerConnectionBackend&);
bool initializePipeline();
void teardownPipeline();
void disposeElementChain(GstElement*);
enum class DescriptionType {
Local,
Remote
};
void setDescription(const RTCSessionDescription*, DescriptionType, Function<void(const GstSDPMessage&)>&& successCallback, Function<void(const GError*)>&& failureCallback);
void initiate(bool isInitiator, GstStructure*);
void onIceConnectionChange();
void onIceGatheringChange();
void onIceCandidate(guint sdpMLineIndex, gchararray candidate);
void prepareDataChannel(GstWebRTCDataChannel*, gboolean isLocal);
void onDataChannel(GstWebRTCDataChannel*);
WARN_UNUSED_RETURN GstElement* requestAuxiliarySender(GRefPtr<GstWebRTCDTLSTransport>&&);
MediaStream& mediaStreamFromRTCStream(String mediaStreamId);
void connectPad(GstPad*);
void removeRemoteStream(GstPad*);
int pickAvailablePayloadType();
ExceptionOr<Backends> createTransceiverBackends(const String& kind, const RTCRtpTransceiverInit&, GStreamerRtpSenderBackend::Source&&, PeerConnectionBackend::IgnoreNegotiationNeededFlag);
void processSDPMessage(const GstSDPMessage*, Function<void(unsigned index, StringView mid, const GstSDPMedia*)>);
WARN_UNUSED_RETURN GRefPtr<GstPad> requestPad(const GRefPtr<GstCaps>&, const String& mediaStreamID);
std::optional<bool> isIceGatheringComplete(const String& currentLocalDescription);
void setTransceiverCodecPreferences(const GstSDPMedia&, guint transceiverIdx);
#if !RELEASE_LOG_DISABLED
void gatherStatsForLogging();
void startLoggingStats();
void stopLoggingStats();
const Logger& logger() const final { return m_logger.get(); }
uint64_t logIdentifier() const final { return m_logIdentifier; }
ASCIILiteral logClassName() const final { return "GStreamerMediaEndpoint"_s; }
WTFLogChannel& logChannel() const final;
Seconds statsLogInterval(Seconds) const;
#endif
void linkOutgoingSources(GstSDPMessage*);
String trackIdFromSDPMedia(const GstSDPMedia&);
HashMap<String, RealtimeMediaSource::Type> m_mediaForMid;
GStreamerPeerConnectionBackend& m_peerConnectionBackend;
GRefPtr<GstElement> m_webrtcBin;
GRefPtr<GstElement> m_pipeline;
HashMap<String, RefPtr<MediaStream>> m_remoteStreamsById;
Ref<GStreamerStatsCollector> m_statsCollector;
uint32_t m_negotiationNeededEventId { 0 };
#if !RELEASE_LOG_DISABLED
Timer m_statsLogTimer;
Seconds m_statsFirstDeliveredTimestamp;
Ref<const Logger> m_logger;
const uint64_t m_logIdentifier;
#endif
UniqueRef<GStreamerDataChannelHandler> findOrCreateIncomingChannelHandler(GRefPtr<GstWebRTCDataChannel>&&);
using DataChannelHandlerIdentifier = ObjectIdentifier<GstWebRTCDataChannel>;
HashMap<DataChannelHandlerIdentifier, UniqueRef<GStreamerDataChannelHandler>> m_incomingDataChannels;
RefPtr<UniqueSSRCGenerator> m_ssrcGenerator;
using SSRC = unsigned;
HashMap<SSRC, RefPtr<GStreamerIncomingTrackProcessor>> m_trackProcessors;
Vector<String> m_pendingIncomingMediaStreamIDs;
bool m_shouldIgnoreNegotiationNeededSignal { false };
Vector<RefPtr<MediaStreamTrackPrivate>> m_pendingIncomingTracks;
Vector<RefPtr<RealtimeOutgoingMediaSourceGStreamer>> m_unlinkedOutgoingSources;
bool m_isGatheringRTCLogs { false };
void maybeInsertNetSimForElement(GstBin*, GstElement*);
using NetSimOptions = HashMap<String, String>;
NetSimOptions netSimOptionsFromEnvironment(ASCIILiteral);
NetSimOptions m_srcNetSimOptions;
NetSimOptions m_sinkNetSimOptions;
};
} // namespace WebCore
#endif // USE(GSTREAMER_WEBRTC)
|