Runpeng Dai

I am a final-year Ph.D. student at the University of North Carolina at Chapel Hill, advised by Prof. Hongtu Zhu. My research lies at the intersection of Reinforcement Learning and LLM Reasoning, with a focus on addressing real-world challenges in areas such as efficient inference and information retrieval.

Seeking full-time opportunities as an AI Researcher or AI/ML Engineer in the Bay Area or North Carolina.

profile photo

Research Highlights

  • RLVR for Real-world Applications
    • Efficient Exploration: Curiosity-Driven Exploration for RLVR training.
    • Parallel Reasoning: Parallel-R1, the first RL framework to teach LLMs parallel thinking.
    • Information Extraction: R1-RE, pioneer LLM reasoning for OOD Relation Extraction.
    • Information Retrieval: CoGR, co-evolving RL framework for industrial ads retrieval.
  • Efficient Reasoning & Test Time Scaling
    Developing intelligent agents and advanced post-training techniques for next-generation AI systems.
    • Adaptive Sampling: RL-Guided Sampling, a small RL controller that guides adaptive sampling for efficient test-time scaling.
    • Probing: Parallel-Probe, towards efficient parallel thinking via 2D probing.

Research Experience

Apple Logo
Apple Ads
Research Intern
May 2026 - August 2026
Mentor: Dr. Changsung Kang, Ms. Kaili Huang
  • Completed CoGR, a generative retrieval framework that trains a query generator and an item generator to co-evolve via reinforcement learning.
  • Applied to internal APP marketplace APP retrieval system.
Tencent Logo
Tencent AI Lab (Seattle)
Research Scientist Intern
May 2025 - August 2025
Mentor: Dr. Linfeng Song
  • Developed CDE, leveraging a model's intrinsic sense of curiosity to guide exploration in RLVR
  • Collaborated with fellow interns and colleagues on Parallel-R1 and VOGUE.
Baidu Logo
Baidu Qianfan
Research Intern
May 2024 - July 2024
  • Proposed a transformation-invariant sensitivity measure for LLMs and VLMs.
  • Applied the metric to safeguard vulnerable parameters during Quantization and Model Merging.

Selected Publications

hpp

It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning

(arXiv), 2026. Work done at Apple Ads.
[Paper]
hpp

Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling

EMNLP 2026 main, Conference on Empirical Methods in Natural Language Processing, 2026.
[Paper]
hpp

LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling

(arXiv), 2026.
[Paper]
hpp

CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models

ICLR 2026, International Conference on Learning Representations, 2026.
[Paper]
hpp

Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing

ICML 2026, International Conference on Machine Learning, 2026.
[Paper] [Code]
hpp

R1-RE: Cross-Domain Relation Extraction with RLVR

(Oral) ACL 2026 main, The 64th Annual Meeting of the Association for Computational Linguistics, 2026.
[Paper] [Code]
hpp

Parallel-R1: Towards Parallel Thinking via Reinforcement Learning

ICLR 2026, International Conference on Learning Representations, 2026.
[Paper] [Code][Over 200+ Stars]
hpp

Breach in the Shield: Unveiling the Vulnerabilities of Large Language Models

EACL 2026 main, European Chapter of the Association for Computational Linguistics, 2026.
[Paper]
hpp

Causal Deepsets for Off-policy Evaluation under Spatial or Spatio-temporal Interferences

(arXiv), 2024.
[Paper]
hpp

Deep Distributional Learning with Non-crossing Quantile Network

(arXiv), 2025.
[Paper]
hpp

Spatio-temporal Prediction of Fine-Grained Origin-Destination Matrices with Applications in Ridesharing

Journal of Computational and Graphical Statistics, 1-17, 2026.
[Paper]

Teaching & Professional Service

Teaching
Lecture recording thumbnail
Lecturer of Deep Learning Methods in Advanced Statistical Problems, providing a 2-hour section on LLMs. [Video P1] [Video P2]
JSM 2026, ENAR 2026, JSM 2025, ICSA 2024
BIOS740 course thumbnail
Teaching Assistant of BIOS740 Deep Learning for Biomedical Applications, University of North Carolina at Chapel Hill, Fall 2024, Fall 2025
Professional Service
Reviewer of JASA, NeurIPS, AAAI, ICLR, ICML
Awards & Honors
Graduate Travel Award Recipient, 2026, University of North Carolina at Chapel Hill
Gillings Global Health Expendable Scholarship, 2026, University of North Carolina at Chapel Hill
LAMBDA Research Grant, 2026
ICLR 2026 Travel Award

Life

Outside of research, I enjoy fishing both in freshwater and saltwater. My Fishing Photos in Instagram .