2026-09-19T04:49:08Zhttps://digital.lib.washington.edu/server/oai/request

oai:digital.lib.washington.edu:1773/535122026-06-09T17:13:21Zcom_1773_4888col_1773_4909

Hajishirzi, Hannaneh Smith, Noah A. Wang, Yizhong 2025-08-01T22:19:48Z 2025-08-01T22:19:48Z 2025-08-01 2026 Wang_washington_0250E_28556.pdf https://hdl.handle.net/1773/53512 Thesis (Ph.D.)--University of Washington, 2026 Pretrained Language Models (LMs) have demonstrated remarkable general-purpose capabilities by encoding vast amounts of knowledge from the internet. However, effectively steering these models to serve diverse downstream applications, such as following instructions, chatting with users, using tools, or performing complex reasoning, poses another set of challenges that require diverse, high-quality, and increasingly costly training data. This dissertation explores scalable paradigms for structuring, creating, and optimizing data to facilitate the broader generalization of language models and enhance their critical capabilities.First, through the creation of the SuperNaturalInstructions benchmark—a large-scale dataset with over 1,600 NLP tasks—I demonstrate that unifying NLP tasks via natural language instructions enables model generalization at the task level. Second, I propose Self-Instruct, a novel framework where LMs generate their own instructional data to train themselves, thereby demonstrating model self-improvement. Third, I develop HyPER, a framework that routes preference annotation tasks between humans and AI to optimize data quality and collection efficiency for preference-based learning. Finally, I systematically study the impact of diverse open instruction-tuning datasets on LM capabilities, leading to the development of the Tülu series of openly available and highly capable models. Together, these efforts—unifying task structures, leveraging model-generated synthetic data, optimizing human-AI data partnerships, and fostering open data ecosystems—have demonstrated an effective path to building a strong, scalable, and community-driven data foundation for post-training language models. Finally, I envision future directions that can further enhance this data foundation for building more advanced and sustainable AI systems. application/pdf en_US CC BY Data Paradigms Data-centric AI Instruction Tuinng Language Models Post-Training Synthetic Data Artificial intelligence Computer science and engineering Scalable Data Paradigms for Steering General-Purpose Language Models Thesis Open Access open.access