bitstream_filters.texi 19 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697
  1. @chapter Bitstream Filters
  2. @c man begin BITSTREAM FILTERS
  3. When you configure your FFmpeg build, all the supported bitstream
  4. filters are enabled by default. You can list all available ones using
  5. the configure option @code{--list-bsfs}.
  6. You can disable all the bitstream filters using the configure option
  7. @code{--disable-bsfs}, and selectively enable any bitstream filter using
  8. the option @code{--enable-bsf=BSF}, or you can disable a particular
  9. bitstream filter using the option @code{--disable-bsf=BSF}.
  10. The option @code{-bsfs} of the ff* tools will display the list of
  11. all the supported bitstream filters included in your build.
  12. The ff* tools have a -bsf option applied per stream, taking a
  13. comma-separated list of filters, whose parameters follow the filter
  14. name after a '='.
  15. @example
  16. ffmpeg -i INPUT -c:v copy -bsf:v filter1[=opt1=str1:opt2=str2][,filter2] OUTPUT
  17. @end example
  18. Below is a description of the currently available bitstream filters,
  19. with their parameters, if any.
  20. @section aac_adtstoasc
  21. Convert MPEG-2/4 AAC ADTS to an MPEG-4 Audio Specific Configuration
  22. bitstream.
  23. This filter creates an MPEG-4 AudioSpecificConfig from an MPEG-2/4
  24. ADTS header and removes the ADTS header.
  25. This filter is required for example when copying an AAC stream from a
  26. raw ADTS AAC or an MPEG-TS container to MP4A-LATM, to an FLV file, or
  27. to MOV/MP4 files and related formats such as 3GP or M4A. Please note
  28. that it is auto-inserted for MP4A-LATM and MOV/MP4 and related formats.
  29. @section av1_metadata
  30. Modify metadata embedded in an AV1 stream.
  31. @table @option
  32. @item td
  33. Insert or remove temporal delimiter OBUs in all temporal units of the
  34. stream.
  35. @table @samp
  36. @item insert
  37. Insert a TD at the beginning of every TU which does not already have one.
  38. @item remove
  39. Remove the TD from the beginning of every TU which has one.
  40. @end table
  41. @item color_primaries
  42. @item transfer_characteristics
  43. @item matrix_coefficients
  44. Set the color description fields in the stream (see AV1 section 6.4.2).
  45. @item color_range
  46. Set the color range in the stream (see AV1 section 6.4.2; note that
  47. this cannot be set for streams using BT.709 primaries, sRGB transfer
  48. characteristic and identity (RGB) matrix coefficients).
  49. @table @samp
  50. @item tv
  51. Limited range.
  52. @item pc
  53. Full range.
  54. @end table
  55. @item chroma_sample_position
  56. Set the chroma sample location in the stream (see AV1 section 6.4.2).
  57. This can only be set for 4:2:0 streams.
  58. @table @samp
  59. @item vertical
  60. Left position (matching the default in MPEG-2 and H.264).
  61. @item colocated
  62. Top-left position.
  63. @end table
  64. @item tick_rate
  65. Set the tick rate (@emph{num_units_in_display_tick / time_scale}) in
  66. the timing info in the sequence header.
  67. @item num_ticks_per_picture
  68. Set the number of ticks in each picture, to indicate that the stream
  69. has a fixed framerate. Ignored if @option{tick_rate} is not also set.
  70. @item delete_padding
  71. Deletes Padding OBUs.
  72. @end table
  73. @section chomp
  74. Remove zero padding at the end of a packet.
  75. @section dca_core
  76. Extract the core from a DCA/DTS stream, dropping extensions such as
  77. DTS-HD.
  78. @section dump_extra
  79. Add extradata to the beginning of the filtered packets except when
  80. said packets already exactly begin with the extradata that is intended
  81. to be added.
  82. @table @option
  83. @item freq
  84. The additional argument specifies which packets should be filtered.
  85. It accepts the values:
  86. @table @samp
  87. @item k
  88. @item keyframe
  89. add extradata to all key packets
  90. @item e
  91. @item all
  92. add extradata to all packets
  93. @end table
  94. @end table
  95. If not specified it is assumed @samp{k}.
  96. For example the following @command{ffmpeg} command forces a global
  97. header (thus disabling individual packet headers) in the H.264 packets
  98. generated by the @code{libx264} encoder, but corrects them by adding
  99. the header stored in extradata to the key packets:
  100. @example
  101. ffmpeg -i INPUT -map 0 -flags:v +global_header -c:v libx264 -bsf:v dump_extra out.ts
  102. @end example
  103. @section eac3_core
  104. Extract the core from a E-AC-3 stream, dropping extra channels.
  105. @section extract_extradata
  106. Extract the in-band extradata.
  107. Certain codecs allow the long-term headers (e.g. MPEG-2 sequence headers,
  108. or H.264/HEVC (VPS/)SPS/PPS) to be transmitted either "in-band" (i.e. as a part
  109. of the bitstream containing the coded frames) or "out of band" (e.g. on the
  110. container level). This latter form is called "extradata" in FFmpeg terminology.
  111. This bitstream filter detects the in-band headers and makes them available as
  112. extradata.
  113. @table @option
  114. @item remove
  115. When this option is enabled, the long-term headers are removed from the
  116. bitstream after extraction.
  117. @end table
  118. @section filter_units
  119. Remove units with types in or not in a given set from the stream.
  120. @table @option
  121. @item pass_types
  122. List of unit types or ranges of unit types to pass through while removing
  123. all others. This is specified as a '|'-separated list of unit type values
  124. or ranges of values with '-'.
  125. @item remove_types
  126. Identical to @option{pass_types}, except the units in the given set
  127. removed and all others passed through.
  128. @end table
  129. Extradata is unchanged by this transformation, but note that if the stream
  130. contains inline parameter sets then the output may be unusable if they are
  131. removed.
  132. For example, to remove all non-VCL NAL units from an H.264 stream:
  133. @example
  134. ffmpeg -i INPUT -c:v copy -bsf:v 'filter_units=pass_types=1-5' OUTPUT
  135. @end example
  136. To remove all AUDs, SEI and filler from an H.265 stream:
  137. @example
  138. ffmpeg -i INPUT -c:v copy -bsf:v 'filter_units=remove_types=35|38-40' OUTPUT
  139. @end example
  140. @section hapqa_extract
  141. Extract Rgb or Alpha part of an HAPQA file, without recompression, in order to create an HAPQ or an HAPAlphaOnly file.
  142. @table @option
  143. @item texture
  144. Specifies the texture to keep.
  145. @table @option
  146. @item color
  147. @item alpha
  148. @end table
  149. @end table
  150. Convert HAPQA to HAPQ
  151. @example
  152. ffmpeg -i hapqa_inputfile.mov -c copy -bsf:v hapqa_extract=texture=color -tag:v HapY -metadata:s:v:0 encoder="HAPQ" hapq_file.mov
  153. @end example
  154. Convert HAPQA to HAPAlphaOnly
  155. @example
  156. ffmpeg -i hapqa_inputfile.mov -c copy -bsf:v hapqa_extract=texture=alpha -tag:v HapA -metadata:s:v:0 encoder="HAPAlpha Only" hapalphaonly_file.mov
  157. @end example
  158. @section h264_metadata
  159. Modify metadata embedded in an H.264 stream.
  160. @table @option
  161. @item aud
  162. Insert or remove AUD NAL units in all access units of the stream.
  163. @table @samp
  164. @item insert
  165. @item remove
  166. @end table
  167. @item sample_aspect_ratio
  168. Set the sample aspect ratio of the stream in the VUI parameters.
  169. @item video_format
  170. @item video_full_range_flag
  171. Set the video format in the stream (see H.264 section E.2.1 and
  172. table E-2).
  173. @item colour_primaries
  174. @item transfer_characteristics
  175. @item matrix_coefficients
  176. Set the colour description in the stream (see H.264 section E.2.1
  177. and tables E-3, E-4 and E-5).
  178. @item chroma_sample_loc_type
  179. Set the chroma sample location in the stream (see H.264 section
  180. E.2.1 and figure E-1).
  181. @item tick_rate
  182. Set the tick rate (num_units_in_tick / time_scale) in the VUI
  183. parameters. This is the smallest time unit representable in the
  184. stream, and in many cases represents the field rate of the stream
  185. (double the frame rate).
  186. @item fixed_frame_rate_flag
  187. Set whether the stream has fixed framerate - typically this indicates
  188. that the framerate is exactly half the tick rate, but the exact
  189. meaning is dependent on interlacing and the picture structure (see
  190. H.264 section E.2.1 and table E-6).
  191. @item crop_left
  192. @item crop_right
  193. @item crop_top
  194. @item crop_bottom
  195. Set the frame cropping offsets in the SPS. These values will replace
  196. the current ones if the stream is already cropped.
  197. These fields are set in pixels. Note that some sizes may not be
  198. representable if the chroma is subsampled or the stream is interlaced
  199. (see H.264 section 7.4.2.1.1).
  200. @item sei_user_data
  201. Insert a string as SEI unregistered user data. The argument must
  202. be of the form @emph{UUID+string}, where the UUID is as hex digits
  203. possibly separated by hyphens, and the string can be anything.
  204. For example, @samp{086f3693-b7b3-4f2c-9653-21492feee5b8+hello} will
  205. insert the string ``hello'' associated with the given UUID.
  206. @item delete_filler
  207. Deletes both filler NAL units and filler SEI messages.
  208. @item level
  209. Set the level in the SPS. Refer to H.264 section A.3 and tables A-1
  210. to A-5.
  211. The argument must be the name of a level (for example, @samp{4.2}), a
  212. level_idc value (for example, @samp{42}), or the special name @samp{auto}
  213. indicating that the filter should attempt to guess the level from the
  214. input stream properties.
  215. @end table
  216. @section h264_mp4toannexb
  217. Convert an H.264 bitstream from length prefixed mode to start code
  218. prefixed mode (as defined in the Annex B of the ITU-T H.264
  219. specification).
  220. This is required by some streaming formats, typically the MPEG-2
  221. transport stream format (muxer @code{mpegts}).
  222. For example to remux an MP4 file containing an H.264 stream to mpegts
  223. format with @command{ffmpeg}, you can use the command:
  224. @example
  225. ffmpeg -i INPUT.mp4 -codec copy -bsf:v h264_mp4toannexb OUTPUT.ts
  226. @end example
  227. Please note that this filter is auto-inserted for MPEG-TS (muxer
  228. @code{mpegts}) and raw H.264 (muxer @code{h264}) output formats.
  229. @section h264_redundant_pps
  230. This applies a specific fixup to some Blu-ray streams which contain
  231. redundant PPSs modifying irrelevant parameters of the stream which
  232. confuse other transformations which require correct extradata.
  233. A new single global PPS is created, and all of the redundant PPSs
  234. within the stream are removed.
  235. @section hevc_metadata
  236. Modify metadata embedded in an HEVC stream.
  237. @table @option
  238. @item aud
  239. Insert or remove AUD NAL units in all access units of the stream.
  240. @table @samp
  241. @item insert
  242. @item remove
  243. @end table
  244. @item sample_aspect_ratio
  245. Set the sample aspect ratio in the stream in the VUI parameters.
  246. @item video_format
  247. @item video_full_range_flag
  248. Set the video format in the stream (see H.265 section E.3.1 and
  249. table E.2).
  250. @item colour_primaries
  251. @item transfer_characteristics
  252. @item matrix_coefficients
  253. Set the colour description in the stream (see H.265 section E.3.1
  254. and tables E.3, E.4 and E.5).
  255. @item chroma_sample_loc_type
  256. Set the chroma sample location in the stream (see H.265 section
  257. E.3.1 and figure E.1).
  258. @item tick_rate
  259. Set the tick rate in the VPS and VUI parameters (num_units_in_tick /
  260. time_scale). Combined with @option{num_ticks_poc_diff_one}, this can
  261. set a constant framerate in the stream. Note that it is likely to be
  262. overridden by container parameters when the stream is in a container.
  263. @item num_ticks_poc_diff_one
  264. Set poc_proportional_to_timing_flag in VPS and VUI and use this value
  265. to set num_ticks_poc_diff_one_minus1 (see H.265 sections 7.4.3.1 and
  266. E.3.1). Ignored if @option{tick_rate} is not also set.
  267. @item crop_left
  268. @item crop_right
  269. @item crop_top
  270. @item crop_bottom
  271. Set the conformance window cropping offsets in the SPS. These values
  272. will replace the current ones if the stream is already cropped.
  273. These fields are set in pixels. Note that some sizes may not be
  274. representable if the chroma is subsampled (H.265 section 7.4.3.2.1).
  275. @item level
  276. Set the level in the VPS and SPS. See H.265 section A.4 and tables
  277. A.6 and A.7.
  278. The argument must be the name of a level (for example, @samp{5.1}), a
  279. @emph{general_level_idc} value (for example, @samp{153} for level 5.1),
  280. or the special name @samp{auto} indicating that the filter should
  281. attempt to guess the level from the input stream properties.
  282. @end table
  283. @section hevc_mp4toannexb
  284. Convert an HEVC/H.265 bitstream from length prefixed mode to start code
  285. prefixed mode (as defined in the Annex B of the ITU-T H.265
  286. specification).
  287. This is required by some streaming formats, typically the MPEG-2
  288. transport stream format (muxer @code{mpegts}).
  289. For example to remux an MP4 file containing an HEVC stream to mpegts
  290. format with @command{ffmpeg}, you can use the command:
  291. @example
  292. ffmpeg -i INPUT.mp4 -codec copy -bsf:v hevc_mp4toannexb OUTPUT.ts
  293. @end example
  294. Please note that this filter is auto-inserted for MPEG-TS (muxer
  295. @code{mpegts}) and raw HEVC/H.265 (muxer @code{h265} or
  296. @code{hevc}) output formats.
  297. @section imxdump
  298. Modifies the bitstream to fit in MOV and to be usable by the Final Cut
  299. Pro decoder. This filter only applies to the mpeg2video codec, and is
  300. likely not needed for Final Cut Pro 7 and newer with the appropriate
  301. @option{-tag:v}.
  302. For example, to remux 30 MB/sec NTSC IMX to MOV:
  303. @example
  304. ffmpeg -i input.mxf -c copy -bsf:v imxdump -tag:v mx3n output.mov
  305. @end example
  306. @section mjpeg2jpeg
  307. Convert MJPEG/AVI1 packets to full JPEG/JFIF packets.
  308. MJPEG is a video codec wherein each video frame is essentially a
  309. JPEG image. The individual frames can be extracted without loss,
  310. e.g. by
  311. @example
  312. ffmpeg -i ../some_mjpeg.avi -c:v copy frames_%d.jpg
  313. @end example
  314. Unfortunately, these chunks are incomplete JPEG images, because
  315. they lack the DHT segment required for decoding. Quoting from
  316. @url{http://www.digitalpreservation.gov/formats/fdd/fdd000063.shtml}:
  317. Avery Lee, writing in the rec.video.desktop newsgroup in 2001,
  318. commented that "MJPEG, or at least the MJPEG in AVIs having the
  319. MJPG fourcc, is restricted JPEG with a fixed -- and *omitted* --
  320. Huffman table. The JPEG must be YCbCr colorspace, it must be 4:2:2,
  321. and it must use basic Huffman encoding, not arithmetic or
  322. progressive. . . . You can indeed extract the MJPEG frames and
  323. decode them with a regular JPEG decoder, but you have to prepend
  324. the DHT segment to them, or else the decoder won't have any idea
  325. how to decompress the data. The exact table necessary is given in
  326. the OpenDML spec."
  327. This bitstream filter patches the header of frames extracted from an MJPEG
  328. stream (carrying the AVI1 header ID and lacking a DHT segment) to
  329. produce fully qualified JPEG images.
  330. @example
  331. ffmpeg -i mjpeg-movie.avi -c:v copy -bsf:v mjpeg2jpeg frame_%d.jpg
  332. exiftran -i -9 frame*.jpg
  333. ffmpeg -i frame_%d.jpg -c:v copy rotated.avi
  334. @end example
  335. @section mjpegadump
  336. Add an MJPEG A header to the bitstream, to enable decoding by
  337. Quicktime.
  338. @anchor{mov2textsub}
  339. @section mov2textsub
  340. Extract a representable text file from MOV subtitles, stripping the
  341. metadata header from each subtitle packet.
  342. See also the @ref{text2movsub} filter.
  343. @section mp3decomp
  344. Decompress non-standard compressed MP3 audio headers.
  345. @section mpeg2_metadata
  346. Modify metadata embedded in an MPEG-2 stream.
  347. @table @option
  348. @item display_aspect_ratio
  349. Set the display aspect ratio in the stream.
  350. The following fixed values are supported:
  351. @table @option
  352. @item 4/3
  353. @item 16/9
  354. @item 221/100
  355. @end table
  356. Any other value will result in square pixels being signalled instead
  357. (see H.262 section 6.3.3 and table 6-3).
  358. @item frame_rate
  359. Set the frame rate in the stream. This is constructed from a table
  360. of known values combined with a small multiplier and divisor - if
  361. the supplied value is not exactly representable, the nearest
  362. representable value will be used instead (see H.262 section 6.3.3
  363. and table 6-4).
  364. @item video_format
  365. Set the video format in the stream (see H.262 section 6.3.6 and
  366. table 6-6).
  367. @item colour_primaries
  368. @item transfer_characteristics
  369. @item matrix_coefficients
  370. Set the colour description in the stream (see H.262 section 6.3.6
  371. and tables 6-7, 6-8 and 6-9).
  372. @end table
  373. @section mpeg4_unpack_bframes
  374. Unpack DivX-style packed B-frames.
  375. DivX-style packed B-frames are not valid MPEG-4 and were only a
  376. workaround for the broken Video for Windows subsystem.
  377. They use more space, can cause minor AV sync issues, require more
  378. CPU power to decode (unless the player has some decoded picture queue
  379. to compensate the 2,0,2,0 frame per packet style) and cause
  380. trouble if copied into a standard container like mp4 or mpeg-ps/ts,
  381. because MPEG-4 decoders may not be able to decode them, since they are
  382. not valid MPEG-4.
  383. For example to fix an AVI file containing an MPEG-4 stream with
  384. DivX-style packed B-frames using @command{ffmpeg}, you can use the command:
  385. @example
  386. ffmpeg -i INPUT.avi -codec copy -bsf:v mpeg4_unpack_bframes OUTPUT.avi
  387. @end example
  388. @section noise
  389. Damages the contents of packets or simply drops them without damaging the
  390. container. Can be used for fuzzing or testing error resilience/concealment.
  391. Parameters:
  392. @table @option
  393. @item amount
  394. A numeral string, whose value is related to how often output bytes will
  395. be modified. Therefore, values below or equal to 0 are forbidden, and
  396. the lower the more frequent bytes will be modified, with 1 meaning
  397. every byte is modified.
  398. @item dropamount
  399. A numeral string, whose value is related to how often packets will be dropped.
  400. Therefore, values below or equal to 0 are forbidden, and the lower the more
  401. frequent packets will be dropped, with 1 meaning every packet is dropped.
  402. @end table
  403. The following example applies the modification to every byte but does not drop
  404. any packets.
  405. @example
  406. ffmpeg -i INPUT -c copy -bsf noise[=1] output.mkv
  407. @end example
  408. @section null
  409. This bitstream filter passes the packets through unchanged.
  410. @section prores_metadata
  411. Modify color property metadata embedded in prores stream.
  412. @table @option
  413. @item color_primaries
  414. Set the color primaries.
  415. Available values are:
  416. @table @samp
  417. @item auto
  418. Keep the same color primaries property (default).
  419. @item unknown
  420. @item bt709
  421. @item bt470bg
  422. BT601 625
  423. @item smpte170m
  424. BT601 525
  425. @item bt2020
  426. @item smpte431
  427. DCI P3
  428. @item smpte432
  429. P3 D65
  430. @end table
  431. @item transfer_characteristics
  432. Set the color transfer.
  433. Available values are:
  434. @table @samp
  435. @item auto
  436. Keep the same transfer characteristics property (default).
  437. @item unknown
  438. @item bt709
  439. BT 601, BT 709, BT 2020
  440. @end table
  441. @item matrix_coefficients
  442. Set the matrix coefficient.
  443. Available values are:
  444. @table @samp
  445. @item auto
  446. Keep the same transfer characteristics property (default).
  447. @item unknown
  448. @item bt709
  449. @item smpte170m
  450. BT 601
  451. @item bt2020nc
  452. @end table
  453. @end table
  454. Set Rec709 colorspace for each frame of the file
  455. @example
  456. ffmpeg -i INPUT -c copy -bsf:v prores_metadata=color_primaries=bt709:color_trc=bt709:colorspace=bt709 output.mov
  457. @end example
  458. @section remove_extra
  459. Remove extradata from packets.
  460. It accepts the following parameter:
  461. @table @option
  462. @item freq
  463. Set which frame types to remove extradata from.
  464. @table @samp
  465. @item k
  466. Remove extradata from non-keyframes only.
  467. @item keyframe
  468. Remove extradata from keyframes only.
  469. @item e, all
  470. Remove extradata from all frames.
  471. @end table
  472. @end table
  473. @anchor{text2movsub}
  474. @section text2movsub
  475. Convert text subtitles to MOV subtitles (as used by the @code{mov_text}
  476. codec) with metadata headers.
  477. See also the @ref{mov2textsub} filter.
  478. @section trace_headers
  479. Log trace output containing all syntax elements in the coded stream
  480. headers (everything above the level of individual coded blocks).
  481. This can be useful for debugging low-level stream issues.
  482. Supports AV1, H.264, H.265, (M)JPEG, MPEG-2 and VP9, but depending
  483. on the build only a subset of these may be available.
  484. @section truehd_core
  485. Extract the core from a TrueHD stream, dropping ATMOS data.
  486. @section vp9_metadata
  487. Modify metadata embedded in a VP9 stream.
  488. @table @option
  489. @item color_space
  490. Set the color space value in the frame header.
  491. @table @samp
  492. @item unknown
  493. @item bt601
  494. @item bt709
  495. @item smpte170
  496. @item smpte240
  497. @item bt2020
  498. @item rgb
  499. @end table
  500. @item color_range
  501. Set the color range value in the frame header. Note that this cannot
  502. be set in RGB streams.
  503. @table @samp
  504. @item tv
  505. @item pc
  506. @end table
  507. @end table
  508. @section vp9_superframe
  509. Merge VP9 invisible (alt-ref) frames back into VP9 superframes. This
  510. fixes merging of split/segmented VP9 streams where the alt-ref frame
  511. was split from its visible counterpart.
  512. @section vp9_superframe_split
  513. Split VP9 superframes into single frames.
  514. @section vp9_raw_reorder
  515. Given a VP9 stream with correct timestamps but possibly out of order,
  516. insert additional show-existing-frame packets to correct the ordering.
  517. @c man end BITSTREAM FILTERS