This sentence is slightly misleading. In their case, the reason interleaving is necessary seems to be because the information is scattered around and separating based on image-text pairs led to more confusing completions whereas a non-restricted sampling led to having better context.