Raj S. Shah

Ph.D. student at Interactive Computing, Georgia Tech.

IMG_0664.jpg

My research focuses on the practical use of AI to support human well-being. I approach this through three complementary directions: (1) Technical methods for LLM safety, robustness, and control. I develop techniques such as effective unlearning to protect users, watermarking for authorship verification, and continual learning in real environments. (2) Using pre-trained language models (PLMs) as computational models of human cognition. I use PLMs to better understand human cognition; developing theoretically grounded linking hypotheses, modeling reasoning patterns, and evaluating when and why model behavior aligns with or diverges from human judgments and developmental trajectories. Recently, I have been exploring the developmental alignment of models (check out the BabyLM workshop: https://babylm.github.io/index.html). (3) Benchmarks and evaluation protocols for practical scenarios and contexts. I design domain-specific evaluations for mental health, social-media visualizations, global representations, clinical documentation, and financial language modeling. These evaluations expose where AI failures have real human consequences. Overall, my research collectively aims to work towards value-aligned use of AI through technical methods combined with effective evaluations.

news

Jan 15, 2016 A simple inline announcement with Markdown emoji! :sparkles: :smile:
Nov 07, 2015 A long announcement with details
Oct 22, 2015 A simple inline announcement.

latest posts

selected publications

  1. How Well Do Deep Learning Models Capture Human Concepts? The Case of the Typicality Effect
    Siddhartha K Vemuri, Raj Sanjay Shah, and Sashank Varma
    arXiv preprint arXiv:2405.16128, 2024
  2. shah2024.png
    Development of Cognitive Intelligence in Pre-trained Language Models
    Raj Sanjay Shah, Khushi Bhardwaj, and Sashank Varma
    2024