🌻 This summer I am continuing my work as a PYI on the OLMo team at AI2 in Seattle working on a fully open ecosystem of language models!
I'm interested in understanding language model behavior. This includes fine-grained evaluation of LLM generation [1, 2], using measures of behavior to improve text generation [3], and interpreting language model behavior with existing theories of human cognition [4].
Previously, I completed my undergrad at Georgia Tech 🐝, where I was fortunate to be advised by Prof. Wei Xu and work with Yao Dou and Dr. Mounica Maddela. I've also spent a few summers as an intern at AWS and Patientco, a healthcare / fintech startup. I enjoy reading, hiking, and making homebrew nitrogen cold brew. ☕️ ⛰️
Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation [code, data]
Establishing Task Scaling Laws via Compute-Efficient Model Ladders [code]
Evaluating LLMs on Chinese Idiom Translation
DataDecide: How to Predict Best Pretraining Data with Small Experiments [code, models]
Improving Minimum Bayes Risk Decoding with Multi-Prompt [code]
Towards a Path Dependent Account of Category Fluency [code]
Thresh: Unified, Customizable and Deployable Fine-Grained Text Evaluation [live tool]
Edit-level Simplification Evaluation using SALSA 💃 [code/data, metric]
LENS: A Learnable Evaluation Metric for Text Simplification [code/data, metric]
* = equal contribution
pip install lens-metric - A simple library to evalute text simplification using our LENS and LENS-SALSA LLMs on HuggingFace using only 5 lines of Python [demo].A few interesting corners of the internet I find worth checking out!
...
... to flip through
Games, Puzzles, and Computation by Erik Demaine
The Corrections by Jonathan Franzen
Society Must be Defended by Michel Foucault
Oblivion by David Foster Wallace
I also enjoy trying new coffee shops. Here's some recommendations across Atlanta, that I visited during my undergrad, and a growing list across Seattle.