Research and Development Interests
- Generative AI
- Reinforcement Learning
- AI Agent Systems with Planning
- Recommendation Systems
- Neural Architecture Design
- Large-Scale AI Systems
My AI Journey: From Learning to Building
• Built the first unified personalized recommender system integrating games and video content for Netflix, serving 300M+ users worldwide
• Multi-modal path prediction and interaction modeling for autonomous vehicles
• Scaling up neural networks for predictions such as CTR/conversions
• Research on reinforcement learning for bidding optimization
• Developed Gradient Temporal-Difference (GTD) algorithms, solving the fundamental "deadly triad" problem in reinforcement learning
Research in machine learning and memory mechanisms in neuronal systems
• Completed Deep Learning course (neural networks) with Geoff Hinton
• Advanced course project in deep learning
• Temporal memory research in randomly connected recurrent neural networks
• Unsupervised learning
Industry Experience
Recommender Systems
Netflix: Advanced recommender system for Netflix homepage serving 300M+ global users
Autonomous Driving
Cruise Automation: Deep learning models for safety-critical vehicle, pedestrian, and bike prediction
Advertising Technology
Criteo: Deep learning for category predictions and reinforcement learning frameworks for real-time bidding optimization
Mobile AI
Samsung: CNN compression for object detection and classification, Samsung Pay project
Academic Breakthrough in RL
Gradient-TD (GTD) Algorithms
Solved the "deadly triad" — a 16-year-old fundamental problem in reinforcement learning. Provided the first theoretical convergence guarantees for combining off-policy learning, function approximation, and bootstrapping.
Developed in close collaboration with Richard Sutton (PhD advisor), and in collaboration with Csaba Szepesvári on the theoretical aspects of stochastic convergence proofs for TDC and Greedy-GQ.
My work has been acknowledged in the preface and featured in Chapter 11 of "Reinforcement Learning: An Introduction" by Sutton and Barto.
Get In Touch
Interested in collaborating on AI missions or discussing ideas? I'd love to connect.
Get In Touch