runs a/b tests left and right with astronomical statistical power – so here we’re going to pry into some of their possible rational decisions. With the wonderful help of the Internet Archive I compared two snapshots between 2017 and 2018. Here is what I found (please leave your comment if you find anything else that;s different) :

  • It appears that new high level categories (Accommodations, Flights, Car Rentals, etc) have made their way into the top header. We can’t be sure whether this was a result of an experiment or just a business decision. What we do know is that this exact pattern has been tested on many other sites (with varying but mostly positive results).

  • Clearly the search box was centered with a strong one column layout, pushing the city cards downwards. Along with this change in position, the search form also gained additional padding – possibly removing any ambiguity that the search is the task that deserves the highest attention.

  • Combined Task Based Menus

    I love this pattern. Instead of showing two separate pull down menus for each check-in and check-out dates, some ultra intelligent human at Booking figured out that these two choices are actually part of the same task and grouped them together into a single box. The same approach was applied to the guest selection menu (rooms, adults and children options were grouped into a single menu).

  • Larger Form Fields

    The three core form fields (destination, check-in/out dates and guest selector) have increased in size, mostly from additional padding – possibly providing them with additional attention and making it easier to select (respecting Fitt’s Law).

  • Slightly Higher Button Contrast

    It looks like the button background color was darkened – providing more contrast against the white text. I wonder how many button color combinations they ran. 🙂

  • It seems like the option for the search type (All Properties, Vacation Rentals, Hotels) was removed. It might have been a perfect example of an unnecessary or ambiguous choice with users wishing to search for all of those options (“I wish to find all vacation hotels”). Removing ambiguity seems smart.

    Additionally, it’s also interesting how the two yes-no radio button choice for work travel evolved into a single checkbox – a simplification.

  • Removal Of Social Counts (Pattern #7) & Reassurances (Pattern #15)

    During design it’s important not to forget to test both the addition and removal of elements. This seems to have been the case with the removal of the “reassurances” and “social counts” (waving big numbers around) in the left column. Interestingly we also have some really powerful a/b tests on these patterns as well (with mixed results).

  • Instead of having 3 city cards, there are now 5. Could showing more results be better? We currently do have 1 a/b test about this.

  • Often you might find optimization and marketing experts rave about having a single focus for any given screen. This rule seems to have been challenged with the addition of more diverse search cues. Instead of mainly showing city thumbnails, the new version also contains visible: inspirational articles, types of rentals (Apartments, Resorts, Villas, etc.) and countries. Yes, arguably these are all still searches, but the calls to action clearly diversified.

  • Price Averages

    The new homepage shows average prices on top of the city cards – possibly setting up for anchoring. Could this idea be further extended onto property pages? For example, if a specific property has a lower price than the surrounding average, it could be communicated more clearly (opportunity as demonstrated by pattern #21).

  • Mixed Audience Calls To Action

    The rule of having a uniform call to action (per screen) is further challenged by the more visible messaging for property owners. Just below the city cards, a more visible invitation to list a property can be seen. The email signup call to action has also been made more prominent on the right.

  • Home
    It looks like Booking is trying to show links to collections with longer link titles. This very similar pattern has been supported and shared by Ronny from Microsoft. Similarly we also have some test results for the idea of linking to quality articles as a stepping stone in the conversion process.

  • Ghost Button Gives Way To A Solid Fill

    It looks like the “Subscribe” button gained a background fill (sending the ghosts away). To be fair, a secondary button to “List Your Property” appeared a little further down. Sometime in the future I’d like to gather more tests about Ghost Buttons and get a better pictures of its probability for better or for worse (I’m guessing the latter).

  • Inferring from the above screens is somewhat risky as we don’t really know if the above changes were tested or how they were decided on. There probably is some positive probability from these changes on such metrics as searches, leads, sales, bookings, etc. But if we want additional confidence I would recommend understanding the test results that are already available as more direct evidence. Of course running your own tests is always advised (if you wield enough statistical power). Nevertheless past test data is always a powerful asset in: planning, prioritizing, or designing your own tests (as we have many tests that also show negative effects – and those are the ones you really want to be aware of).

    Source link


    Please enter your comment!
    Please enter your name here