Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training.

Tue, 01 Jul 2025 01:00:00 +0200

Oleksiy Ostapenko, Charles Guille-Escuret, Luke Kumar, Max Tian, Denis Kocetkov, Gopeshh Subbaraj, Raymond Li, Joel Lamy-Poirier, Sébastien Paquet, Torsten Scholak:
Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training. CoRR abs/2507.22250 (2025)