๐ This fall I am applying to Ph.D. programs. I'm currently interested in the science of language modeling. I will be supported by the NSF CS Graduate Fellowship!
Building language models can, and should, be a rigorous science: I believe our fieldโs biggest bottleneck in doing so is the quality of our experimentation methodology [1] and the power of our evaluation signal [2]. This requires better interpretations of our existing measures of capability [3], new tools for observing how language models express behavior [4], and connecting tasks that are meaningful to our ability to learn, and generate, language [5, 6].
I work on these problems at Ai2 as part of the Open Language Model (OLMo) project, advised by Kyle Lo and Jesse Dodge. Previously, I completed my undergrad at Georgia Tech ๐, where I was fortunate to be advised by Prof. Wei Xu and work with Yao Dou and Mounica Maddela. I've also spent a few summers as an intern at AWS and at a healthcare startup Patientco. I enjoy reading, hiking, and making homebrew nitrogen cold brew. โ๏ธ โฐ๏ธ
Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation [code, data]
2 OLMo 2 Furious [code, models, data]
Establishing Task Scaling Laws via Compute-Efficient Model Ladders [code]
Evaluating LLMs on Chinese Idiom Translation
DataDecide: How to Predict Best Pretraining Data with Small Experiments [code, models]
Improving Minimum Bayes Risk Decoding with Multi-Prompt [code]
Towards a Path Dependent Account of Category Fluency [code]
Thresh: Unified, Customizable and Deployable Fine-Grained Text Evaluation [live tool]
Edit-level Simplification Evaluation using SALSA ๐ [code/data, metric]
LENS: A Learnable Evaluation Metric for Text Simplification [code/data, metric]
* = equal contribution
pip install lens-metric - A simple library to evalute text simplification using our LENS and LENS-SALSA LLMs on HuggingFace using only 5 lines of Python [demo].A few interesting corners of the internet I find worth checking out!
...
... to flip through
Games, Puzzles, and Computation by Erik Demaine
The Corrections by Jonathan Franzen
Society Must be Defended by Michel Foucault
Oblivion by David Foster Wallace
I also enjoy trying new coffee shops. Here's some recommendations across Atlanta, that I visited during my undergrad, and a growing list across Seattle.