Talk details
Powering User-Facing Analytics at Scale: How AB Tasty Serves Thousands of Experiments Daily
AB Tasty is your partner in web experience optimization. While we're widely recognized for A/B testing, our platform supports a broader suite of capabilities including feature experimentation, personalization, recommendation engines, and more. As we scale our offering to serve thousands of customers, one of the most critical components is analytics. Our users rely on fast, reliable insights to make product decisions, and we support this through multiple analytical interfaces: Data Explorer (self-service BI on a preselected set of dimensions/metrics), Reporting Pages, and Global Dashboard. Behind the scenes, this involves generating hundreds of thousands of reports per day, each potentially involving: terabytes of raw data, custom slicing and dicing across dozens of dimensions, tailored goal definitions per experiment, seconds response time expectations. In this presentation, we will introduce the key components of AB Tasty's data platform, then dive deep into how we use an in-house semantic layer to power real-time dashboards. You will learn: why we built our semantic layer instead of using off-the-shelf solutions like Cube, how we handle specific use cases such as population filtering by users or sessions, what challenges arise in serving highly customizable experimentation analytics at scale.

