Discover UI Design Decisions Of Leading Companies,
From Leaked Screenshots & A/B Tests.

This was a simple calendar picker experiment that Aribnb recently ran and eventually rolled out. The A/B test contains at least 4 simple UI changes which might have contributed to a positive outcome. And so this also shows us what a slightly better UI component looks like. View Leak

In this listing page experiment, Airbnb tried an very similar search interaction that is already present on Booking.com's homepage. Instead of only asking users for their destination, the search interaction was extended to prompt for travel dates and number of guests. View Leak

Netflix has been experimenting with the layout of their pricing plans. Challenging the more traditional pricing comparison table, instead they a/b tested three self-contained pricing plan tiles. This newer version however ended up being rejected as we noticed. View Leak

At first glance some A/B tests may seem like they are beautifully simple with a single controlled variable. Yet as we look at the experiment in more detail, more and more subtle differences start coming into view. This I think is the case with Amazon's most recent experiment where it seems that only a dropdown menu was shifted into a hamburger one - which ended up winning.  View Leak

When Bol ran their list vs grid view experiment, they also included a variation that tested for another very simple change: the exposure of menu options. That is, the listing page variant was designed to check if three more visible pull down options would be better or worse than just showing them hidden inside the pulldown. View Leak

Interestingly, Google was also discovered a/b testing the list vs grid pattern just as Bol finished a similar experiment this month. The Google experiment ran on one of their shopping results pages with the specific query for "flowers". And the outcome? Looks like the grid beat the list and was rolled out in this case.  View Leak

I am continously interested in answering and providing guidance on whether grid or list views are in general better, worse or indifferent as one of many UI patterns. To my surprise, Bol.com the leading Dutch web shop, has recently a/b tested this classic pattern which we were super lucky to detect on their red wine product listing pages. After anticipating their leaked design decision, we eventually learned that lists fared better for Bol. This of course we'll now use as additional and emerging evidence to tip the scales of probability (and hopefully better predict similar future experiments). View Leak

I was glad to detect this carousel experiment that Booking recently ran on their homepage because we've already seen similar experiments fail in the past. Instead of showing 5 location tiles, they tested a version that only showed 3 tiles at a time with an ability to slide for more - a carousel. It wasn't the automatic slider type that would unleash the wrath of Karl Gilis, but it was a user-invoked slider nevertheless. View Leak

In this tiny and well isolated experiment, Airbnb tried a slightly different approach to displaying customer ratings on their property (product) pages. From the observed implementation decision one month later, we learned that using decimal places for customer rating averages seems to be the better approach. :)  View Leak

Airbnb ran an experiment where they increased the size of the header photo on their Host signup landing page. And interestingly it was rejected a month later.   View Leak