Abstract: With the explosive growth of data volume and computing capability, federated learning, which involves constructing global models over multiple data islands, has demonstrated its advantages ...
LLM training data mixture optimization breaks when training pools shift — every prior proxy experiment becomes stale.