Skip to content

H265Packet: pack multi-slice HEVC access units as one unit (YouTube enhanced-RTMP) #2223

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
yeheskel2016 wants to merge 1 commit into from
Closed

H265Packet: pack multi-slice HEVC access units as one unit (YouTube enhanced-RTMP) #2223

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 28 additions & 5 deletions rtmp/src/main/java/com/pedro/rtmp/flv/video/packet/H265Packet.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,7 @@ class H265Packet: BasePacket() {

private val header = ByteArray(8)
private val naluSize = 4
private val START_CODE = byteArrayOf(0x00, 0x00, 0x00, 0x01)
//first time we need send video config
private var configSend = false

Expand Down Expand Up @@ -111,11 +112,33 @@ class H265Packet: BasePacket() {
}
header[0] = (0b10000000 or (nalType shl 4) or VideoFourCCPacketType.CODED_FRAMES.value).toByte()
var offset = header.size
nals.forEach {
val nalSize = it.capacity()
buffer.writeUInt32(offset, nalSize)
it.get(buffer, offset + naluSize, nalSize)
offset += naluSize + nalSize
if (nals.size > 1) {
// Multi-slice access unit (e.g. Qualcomm SD888 HEVC encoder emits one
// slice segment per tile). YouTube's enhanced-RTMP HEVC ingest only
// consumes the first length-prefixed NAL of a video tag, so spec
// packaging yields a permanently "preparing" stream. Pack the AU as a
// single unit with Annex-B start codes between slices (2.7.2 behaviour,
// verified decodable by YouTube). Single-NAL frames are unaffected.
val joinedSize = size + START_CODE.size * (nals.size - 1)
buffer = ByteArray(header.size + naluSize + joinedSize)
buffer.writeUInt32(offset, joinedSize)
offset += naluSize
nals.forEachIndexed { index, nal ->
if (index > 0) {
System.arraycopy(START_CODE, 0, buffer, offset, START_CODE.size)
offset += START_CODE.size
}
val nalSize = nal.capacity()
nal.get(buffer, offset, nalSize)
offset += nalSize
}
} else {
nals.forEach {
val nalSize = it.capacity()
buffer.writeUInt32(offset, nalSize)
it.get(buffer, offset + naluSize, nalSize)
offset += naluSize + nalSize
}
}
System.arraycopy(header, 0, buffer, 0, header.size)
callback(FlvPacket(buffer, ts, buffer.size, FlvType.VIDEO))
Expand Down