This is required to avoid glitches when seeking, as some formats (e.g. MP3) may use data from previous frames.