Study shows people prefer Bing over Google, Microsoft challenges you to take ‘Bing It On’ test

September 7, 2012 14 Email article | Print article

During their “ongoing tests to measure our relevancy, assess customer feedback and satisfaction, and examine our product in many different ways”, Microsoft discovered that “Bing was beating Google in our search relevancy tests” (surprise, surprise). Microsoft says they followed the trends for a few months then hired an independent third party, Answers Research (a marketing firm based out of San Diego, California), to conduct nationwide blind tests pitting Bing against Google to see which consumers really preferred.

For these blind tests, Answer Research selected a “representative sample” of nearly 1,000 people across the United States of ages 18 and up. These 1,000 people were chosen randomly and one of the requirements to participate was to have used a major search engine (any major search engine) at least once in the past month. The participants were not told that Microsoft commissioned the study.

Participants where shown Bing and Google side-by-side (with all branding removed from the search engines so as to not influence results) and asked to run ten separate search queries. After each query the participants where asked to rate which gave better results, “Left side search engine”, “Right side search engine”, or “Draw”. The scores were tallied at the end and participants told which search engine they picked during the blind test.

Curious as to the overall results provided by the study? 57.4% picked Bing results, 30.2% picked Google results, and 12.4 % said both were equal. Or, as Microsoft likes to put it, “people chose Bing search results over Google nearly 2:1″.

Of course the above study is a clever marketing ploy, especially since the study was done only in the United States — outside the USA is where Google really eats Microsoft’s lunch. I’m sure Google could commission a study that would show opposite results. (Funny how “independent studies” commissioned by self-interested parties work out, eh?) Because of skeptics, Microsoft doesn’t want you to just believe the results of the study; they want you to try the blind test yourself.

Microsoft has put together a Bing It On website which lets you run search queries on Bing and Google at the same time. Like the above-mentioned study, Bing It On removes all Bing/Google branding and whatnot to minimize bias people may have towards Google or Bing. Of course it isn’t possible to completely make Bing and Google look the same (I could tell which results were from Google and which were from Bing), but for the most part Microsoft has done a fair job.

Once you run a search query on Bing It On, you are asked to rate which provided better search results — “Results on left”, “Draw”, “Results on right”. At the end of the your five queries, Microsoft tallies your picks and shows you which search engine you blindly picked. While it isn’t exactly following the scientific method, it may indeed help you find out Bing isn’t as bad as you thought. Or maybe not. I ended up picking Google 5 out of 5 times… but that could be because I knew exactly which one was Google and which one was Bing.

To get started with Bing It On, hit up the link below. Be sure to share with us in the comments below which search engine you ended up picking!

Bing It On homepage

14 Comments »

  1. Jazz September 8, 2012 at 12:24 AM (comment permalink) -

    I could not be bothered. These so-called competency tests have never struck me as reliable measurement tools. There are too many variables involved.

    1
  2. oldtimer56 September 8, 2012 at 12:28 AM (comment permalink) -

    Agree with Jazz, personally I use Startpage.

    2
  3. Ashraf September 8, 2012 at 12:29 AM (comment permalink) -
    Mr. Boss

    @Jazz and @oldtimer56: Booooo, spoilsports. :-P

    3
  4. r0lZ September 8, 2012 at 12:55 AM (comment permalink) -

    Funny. I live in Belgium, and when I click on the http://www.bingiton.com link above, I’m automatically redirected to http://www.bing.be, the Bing only Belgian version of the M$ search engine. So, it appears that M$ does not want to let European peoples participate at the test. Biased!

    4
  5. meldasue September 8, 2012 at 3:22 AM (comment permalink) -

    Does Bing have an advanced search? If it does, I can’t figure out how to get there. My link bar link to Google goes straight to advanced search, which will always get better results than the regular search pages.

    5
  6. WobblyWombat September 8, 2012 at 4:30 AM (comment permalink) -

    Hmmm… it seems M$ have absolutely no interest in what the rest of the world thinks, but fair enough I s’pose – everything important and/or interesting happens in the USA doesn’t it?!?! The rest of the world is just a weird place full of foreigners – some of whom don’t even speak English, no matter how loudly you condescend at them! lol ;-)

    Here in the Antipodes, bingiton.com just redirects to bing.com FWIW.

    6
  7. oldtimer56 September 8, 2012 at 4:50 AM (comment permalink) -

    @Ashraf:
    Aw well, Startpage still uses google…So I reckon that counts for something!

    7
  8. fermier September 8, 2012 at 8:11 AM (comment permalink) -

    In my day there also was a study that concluded cigarette smoking was good for you, it “purified the lungs.” So much for this study.

    8
  9. fermier September 8, 2012 at 8:23 AM (comment permalink) -

    @meldasue: @WobblyWombat:

    The Bing advanced search used to be in a little box at the top right, it only appeared after you did a regular search. Now is gone completely, the little box is. Reason unknown.

    9
  10. Zapped Sparky September 8, 2012 at 8:48 AM (comment permalink) -

    Here in the UK I get redirected to the bing homepage as well.

    10
  11. Jazz September 8, 2012 at 9:52 AM (comment permalink) -

    @r0lZ:
    In my country it also redirects to bing.com. Looks like Bing is only intended for the USA, so I’ll have to use another search engine.

    11
  12. miky September 8, 2012 at 10:40 AM (comment permalink) -

    Thanks for the info, there is even a draw with nice prizes (but again only for US residents):

    http://www.bing.com/community/site_blogs/b/search/archive/2012/09/06/bing-challenge-sweeps.aspx

    12
  13. rover3500 September 8, 2012 at 11:42 PM (comment permalink) -

    The maps dont zoom as detailed is a bit annoying sometimes if you want to look close from above.The street view seems very limited compared to Google.If you add things like maps and other services that most people use on Android,there would be no contest as MS doesn’t have half the services

    13
  14. Caleb Stein September 10, 2012 at 9:49 PM (comment permalink) -

    Lol I picked Google for all five.

    14

Leave A Response »