Runpeng Dai
I am a final-year Ph.D. student at the University of North Carolina at Chapel Hill, advised by Prof. Hongtu Zhu . My research lies at the intersection of Reinforcement Learning and LLM Reasoning , with a focus on addressing real-world challenges in areas such as efficient inference and information retrieval.
Seeking full-time opportunities as an AI Researcher or AI/ML Engineer in the Bay Area or North Carolina.
Research Highlights
RLVR for Real-world Applications
Efficient Exploration:
Curiosity-Driven Exploration for RLVR training.
Parallel Reasoning:
Parallel-R1 , the first RL framework to teach LLMs parallel thinking.
Information Extraction:
R1-RE , pioneer LLM reasoning for OOD Relation Extraction.
Information Retrieval:
CoGR , co-evolving RL framework for industrial ads retrieval.
Efficient Reasoning & Test Time Scaling
Developing intelligent agents and advanced post-training techniques for next-generation AI systems.
Adaptive Sampling:
RL-Guided Sampling , a small RL controller that guides adaptive sampling for efficient test-time scaling.
Probing:
Parallel-Probe , towards efficient parallel thinking via 2D probing.
Research Experience
May 2026 - August 2026
Completed CoGR , a generative retrieval framework that trains a query generator and an item generator to co-evolve via reinforcement learning.
Applied to internal APP marketplace APP retrieval system.
May 2025 - August 2025
Developed CDE , leveraging a model's intrinsic sense of curiosity to guide exploration in RLVR
Collaborated with fellow interns and colleagues on Parallel-R1 and VOGUE.
May 2024 - July 2024
Proposed a transformation-invariant sensitivity measure for LLMs and VLMs.
Applied the metric to safeguard vulnerable parameters during Quantization and Model Merging.
Selected Publications
Highlight
Deep RL
RLVR
Efficient Reasoning
Application
All
It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning
(arXiv) , 2026. Work done at Apple Ads.
[Paper]
Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling
EMNLP 2026 main , Conference on Empirical Methods in Natural Language Processing, 2026.
[Paper]
LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
(arXiv) , 2026.
[Paper]
CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models
ICLR 2026 , International Conference on Learning Representations, 2026.
[Paper]
Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing
ICML 2026 , International Conference on Machine Learning, 2026.
[Paper]
[Code]
R1-RE: Cross-Domain Relation Extraction with RLVR
(Oral) ACL 2026 main , The 64th Annual Meeting of the Association for Computational Linguistics, 2026.
[Paper]
[Code]
Parallel-R1: Towards Parallel Thinking via Reinforcement Learning
ICLR 2026 , International Conference on Learning Representations, 2026.
[Paper]
[Code] [Over 200+ Stars]
Breach in the Shield: Unveiling the Vulnerabilities of Large Language Models
EACL 2026 main , European Chapter of the Association for Computational Linguistics, 2026.
[Paper]
Causal Deepsets for Off-policy Evaluation under Spatial or Spatio-temporal Interferences
(arXiv) , 2024.
[Paper]
Deep Distributional Learning with Non-crossing Quantile Network
(arXiv) , 2025.
[Paper]
Spatio-temporal Prediction of Fine-Grained Origin-Destination Matrices with Applications in Ridesharing
Journal of Computational and Graphical Statistics , 1-17, 2026.
[Paper]
Teaching & Professional Service
Teaching
Professional Service
Reviewer of JASA, NeurIPS, AAAI, ICLR, ICML
Awards & Honors
Graduate Travel Award Recipient, 2026, University of North Carolina at Chapel Hill
Gillings Global Health Expendable Scholarship, 2026, University of North Carolina at Chapel Hill
LAMBDA Research Grant, 2026
ICLR 2026 Travel Award