Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models
Proposes Skill-It framework using skill dependency graphs to optimize data sampling, improving language model training efficiency.
Mayee F. Chen, Nicholas Roberts, Kush Bhatia et al.