h264 support test

[notedit]

[saket424]

Hi @notedit
I am trying to get RTMPSink to work. I had to modify webrtc/source.py to use H264 instead of VP8 as follows

diff webrtc/source.py.orig webrtc/source.py
51,52c51,52
< videotestsrc ! videoconvert ! queue ! vp8enc deadline=1 ! rtpvp8pay !
< application/x-rtp,media=video,encoding-name=VP8,payload=97,clock-rate=90000 ! queue

videotestsrc ! videoconvert ! queue ! x264enc ! rtph264pay !
application/x-rtp,media=video,encoding-name=H264,payload=98,clock-rate=90000 ! queue
66c66
< # self.video_caps = Gst.caps_from_string('application/x-rtp,media=video,encoding-name=VP8,payload=97,clock-rate=90000')

---

    # self.video_caps = Gst.caps_from_string('application/x-rtp,media=video,encoding-name=H264,payload=98,clock-rate=90000')

94c94
< videotestsrc ! videoconvert ! queue ! vp8enc deadline=1 ! rtpvp8pay ! queue

    videotestsrc ! videoconvert ! queue ! x264enc ! rtph264pay ! queue

98,100c98,99
< videoenc = make_element('vp8enc')
< videoenc.set_property('deadline',1)
< videortppay = make_element('rtpvp8pay')

    videoenc = make_element('x264enc')
    videortppay = make_element('rtph264pay')

After that I get further but the RTMPSink pipeline still does not quite work even though the connection between the browser and gstreamer webrtcbin does work

python3 rtmpsink.py
negotiation-needed <gi.GstWebRTCBin object at 0x7f405a5ebf78 (GstWebRTCBin at 0x229a240)>
{"join":"aaaaa"}
send offer v=0
o=- 97955494887538072 0 IN IP4 0.0.0.0
s=-
t=0 0
a=ice-options:trickle
a=group:BUNDLE audio0 video1
m=audio 9 UDP/TLS/RTP/SAVPF 100
c=IN IP4 0.0.0.0
a=setup:actpass
a=ice-ufrag:MfILjT0UsGX+ZlVRYjtxVzfG/l3KoI/5
a=ice-pwd:YXbR/dfp8IxbmZZCLwpry51fIRSBlGMy
a=rtcp-mux
a=rtcp-rsize
a=sendrecv
a=rtpmap:100 OPUS/48000/2
a=rtcp-fb:100 nack pli
a=fmtp:100 sprop-maxcapturerate=48000;sprop-stereo=0
a=ssrc:3392047779 msid:user3089320759@host-ec964ea8 webrtctransceiver0
a=ssrc:3392047779 cname:user3089320759@host-ec964ea8
a=mid:audio0
a=fingerprint:sha-256 B9:85:33:23:87:3A:AB:10:53:5F:30:B3:9D:98:1C:D6:75:8E:93:62:31:98:0D:6A:EF:8F:FE:A1:1D:39:A6:8A
m=video 0 UDP/TLS/RTP/SAVPF 98
c=IN IP4 0.0.0.0
a=setup:actpass
a=ice-ufrag:MfILjT0UsGX+ZlVRYjtxVzfG/l3KoI/5
a=ice-pwd:YXbR/dfp8IxbmZZCLwpry51fIRSBlGMy
a=bundle-only
a=rtcp-mux
a=rtcp-rsize
a=sendrecv
a=rtpmap:98 H264/90000
a=rtcp-fb:98 nack pli
a=framerate:30
a=fmtp:98 packetization-mode=1;profile-level-id=42c015;sprop-parameter-sets=Z0LAFdkBQfsBagwCC0oAAAMAAgAAAwB5HixckA==,aMuMsg==
a=ssrc:3273378542 msid:user3089320759@host-ec964ea8 webrtctransceiver1
a=ssrc:3273378542 cname:user3089320759@host-ec964ea8
a=mid:video1
a=fingerprint:sha-256 B9:85:33:23:87:3A:AB:10:53:5F:30:B3:9D:98:1C:D6:75:8E:93:62:31:98:0D:6A:EF:8F:FE:A1:1D:39:A6:8A

{"answer":"v=0\r\no=- 627683038156950650 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE audio0 video1\r\na=msid-semantic: WMS ZSpRrdS3Ce4nQq1xMs7M0BPTYnuwGVGvZrrJ\r\nm=audio 9 UDP/TLS/RTP/SAVPF 100\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:Lofg\r\na=ice-pwd:xVKgiYp6NuYboDQLMaj00IAv\r\na=ice-options:trickle\r\na=fingerprint:sha-256 D0:75:EF:98:3D:B8:16:E0:3E:B6:16:50:AD:B4:C6:C0:C6:4F:DB:47:84:ED:04:8A:29:D8:22:5F:F3:EC:AA:5D\r\na=setup:active\r\na=mid:audio0\r\na=sendrecv\r\na=rtcp-mux\r\na=rtpmap:100 OPUS/48000/2\r\na=fmtp:100 minptime=10;useinbandfec=1\r\na=ssrc:397471572 cname:xhxVuFE6BVQNeIlV\r\na=ssrc:397471572 msid:ZSpRrdS3Ce4nQq1xMs7M0BPTYnuwGVGvZrrJ ba96d0b8-9099-4723-ad05-88b2d6264505\r\na=ssrc:397471572 mslabel:ZSpRrdS3Ce4nQq1xMs7M0BPTYnuwGVGvZrrJ\r\na=ssrc:397471572 label:ba96d0b8-9099-4723-ad05-88b2d6264505\r\nm=video 9 UDP/TLS/RTP/SAVPF 98\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:Lofg\r\na=ice-pwd:xVKgiYp6NuYboDQLMaj00IAv\r\na=ice-options:trickle\r\na=fingerprint:sha-256 D0:75:EF:98:3D:B8:16:E0:3E:B6:16:50:AD:B4:C6:C0:C6:4F:DB:47:84:ED:04:8A:29:D8:22:5F:F3:EC:AA:5D\r\na=setup:active\r\na=mid:video1\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:98 H264/90000\r\na=rtcp-fb:98 nack pli\r\na=fmtp:98 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e015\r\na=ssrc:2949926185 cname:xhxVuFE6BVQNeIlV\r\na=ssrc:2949926185 msid:ZSpRrdS3Ce4nQq1xMs7M0BPTYnuwGVGvZrrJ 208d68d6-f9e8-4618-aaa9-a9a694ac7440\r\na=ssrc:2949926185 mslabel:ZSpRrdS3Ce4nQq1xMs7M0BPTYnuwGVGvZrrJ\r\na=ssrc:2949926185 label:208d68d6-f9e8-4618-aaa9-a9a694ac7440\r\n"}
audio/x-raw, format=(string)S16LE, layout=(string)interleaved, rate=(int)48000, channels=(int)2, channel-mask=(bitmask)0x0000000000000003

[notedit]

the diff is hard to understand