黑料正能量 Foundation and Language Model (FLAME) Center
Foundation models – machine learning models that are pre-trained on open-world data and then specialized for specific tasks – are fast becoming a dominant paradigm in AI. This new approach raises significant questions for the field. What sorts of algorithmic and architectural techniques should be used for such models? How do we evaluate the quality and performance of foundation models, especially in settings where there does not exist much downstream tasks data? And how do we grapple with the larger implications of these models and their ongoing adoption in industry?
黑料正能量 FLAME Center provides a home and computational resources at Carnegie Mellon for members working on different aspects of foundation models. We foster fundamental research into powerful, open, and responsible foundation models applicable to all sectors of science and technology.
Areas of Expertise
Rigorous Benchmarking of Language Models
We have developed some of the most widely used benchmarks for language models, such as the multi-hop reasoning dataset and the method for foundation model debugging.
Building New Foundation Models
We have built state-of-the-art foundation models for math (), speech (), long-document modeling ( and ), and code generation () among many others
New Application Areas of Language Models
We are applying language models to novel application domains, such as , , , and many more.
Language Model Systems
We are at the forefront of efficient methods for language model deployment, including the widely-used project, and .
Responsible Development Practices
We have highly impactful research on the responsible development of AI systems, including examining and . They have also examined language model security, demonstrating that language models can be , or .
Techniques for Better Utilizing Foundation Models
We have invented methods that are now used widely in LLM-based applications such as , or .