My research interests are primarily related to large language models, including reinforcement learning from human feedback (RLHF), open-endedness with LLMs, interpretability, evaluations, AI governance, and more.