Reward Optimizing Recommender Systems

Machine Learning Methods for Optimizing Business Metrics Observed at A/B Test Time
Erscheinungsjahr 2027
ISBN: 978-3-032-44425-7
Verlag: Springer

Buch, Englisch, 231 Seiten, Format (B × H): 155 mm x 235 mm

Readers of recent books and recommender systems papers will learn a great deal about a plethora of machine learning techniques used in recommender systems including collaborative filtering, content based recommender systems, click models, off policy estimation, reinforcement learning and contextual bandits. They will also learn about A/B testing, but it will be somewhat an afterthought.

This book is different, it makes optimizing for reward at A/B test time the central point of study. The methodology of A/B testing is described in detail, highlighting both its significant strengths and potential limitations. The remainder of the book is developed from this point of view. This foundational nature will require a more comprehensive discussion of inferential and causal theory than other treatments, providing a stronger understanding about how the disparate machine learning techniques for recommendation fit together.

Until now, it has required a great deal of industry experience to identify why approaches based on (say) a direct implementation of reinforcement learning are likely to fail in production. Readers of this book should gain this intuition with less need to make painful mistakes in the wild.

Zielgruppe

Research

Autoren/Hrsg.

Rohde, David

Fachgebiete

• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz
• Mathematik | Informatik EDV | Informatik Informatik Mathematik für Informatiker
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Information Retrieval
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Data Warehouse

Inhaltsverzeichnis

Chapter 1. Introduction.- Chapter 2. Reward Optimizing Recommender Systems.- Chapter 3. Traditional Techniques: Heuristics for Relevance.-  Chapter 4. Bayesian Decision Theory, Actions, Models, Decision Rules.- Chapter 5. Causation.- Chapter 6. Multi-Turn Recommender Systems.- Chapter 7. Attribution.- Chapter 8. Click Models.- Chapter 9. Engineering Constraints.- Chapter 10. Off-Policy Estimators.- Chapter 11. Conclusion.

Über Autor(innen)

David Rohde is a researcher specializing in Bayesian inference, causality, and recommender systems. His work focuses on developing machine learning algorithms to solve real-world problems, especially 

• Differences between academic conventions and in production recommender systems.
• Incorporating user feedback or bandit feedback (click signals and A/B testing) with other signals (content and collaborative filtering)
• Relevance of causal theory, off policy learning, reinforcement learning to real systems