null
Loading... Please wait...
FREE SHIPPING on All Unbranded Items LEARN MORE
Print This Page

Experimentation for Engineers (From A/B testing to Bayesian optimization)

List Price: $59.99
SKU:
9781617298158
Quantity:
Minimum Purchase
25 unit(s)
  • Availability: Confirm prior to ordering
  • Branding: minimum 50 pieces (add’l costs below)
  • Check Freight Rates (branded products only)

Branding Options (v), Availability & Lead Times

  • 1-Color Imprint: $2.00 ea.
  • Promo-Page Insert: $2.50 ea. (full-color printed, single-sided page)
  • Belly-Band Wrap: $2.50 ea. (full-color printed)
  • Set-Up Charge: $45 per decoration
FULL DETAILS
  • Availability: Product availability changes daily, so please confirm your quantity is available prior to placing an order.
  • Branded Products: allow 10 business days from proof approval for production. Branding options may be limited or unavailable based on product design or cover artwork.
  • Unbranded Products: allow 3-5 business days for shipping. All Unbranded items receive FREE ground shipping in the US. Inquire for international shipping.
  • RETURNS/CANCELLATIONS: All orders, branded or unbranded, are NON-CANCELLABLE and NON-RETURNABLE once a purchase order has been received.
  • Product Details

    Author:
    David Sweet
    Format:
    Paperback
    Pages:
    248
    Publisher:
    Manning (March 7, 2023)
    Language:
    English
    ISBN-13:
    9781617298158
    ISBN-10:
    1617298158
    Dimensions:
    7.375" x 9.25" x 0.3"
    File:
    Eloquence-SimonSchuster_08192026_P10502905_onix30-20260819.xml
    Folder:
    Eloquence
    List Price:
    $59.99
    As low as:
    $53.99
    Publisher Identifier:
    P-SS
    Discount Code:
    G
    Weight:
    14.96oz
    Case Pack:
    32
    Pub Discount:
    37
    Imprint:
    Manning
  • Overview

    Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries.

    In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to:

    Design, run, and analyze an A/B test
    Break the "feedback loops" caused by periodic retraining of ML models
    Increase experimentation rate with multi-armed bandits
    Tune multiple parameters experimentally with Bayesian optimization
    Clearly define business metrics used for decision-making
    Identify and avoid the common pitfalls of experimentation

    Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls.

    Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.

    About the technology
    Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions.

    About the book
    Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results.

    What's inside

    Design, run, and analyze an A/B test
    Break the “feedback loops” caused by periodic retraining of ML models
    Increase experimentation rate with multi-armed bandits
    Tune multiple parameters experimentally with Bayesian optimization

    About the reader
    For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy.

    About the author
    David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University.

    Table of Contents
    1 Optimizing systems by experiment
    2 A/B testing: Evaluating a modification to your system
    3 Multi-armed bandits: Maximizing business metrics while experimenting
    4 Response surface methodology: Optimizing continuous parameters
    5 Contextual bandits: Making targeted decisions
    6 Bayesian optimization: Automating experimental optimization
    7 Managing business metrics
    8 Practical considerations