Since pass @ K alignment is making sense (similar to human learning where having higher number of good quality students in a class makes overall performance more robust), I wonder if ordered preference during training by difficulty tiers has been tried yet? Aka - start of epoch batches should contain easy tasks and should progressively go towards difficult tasks.