{"id":7509,"date":"2024-06-06T19:18:27","date_gmt":"2024-06-06T17:18:27","guid":{"rendered":"https:\/\/searchstudies.org\/?page_id=7509"},"modified":"2024-08-27T19:11:58","modified_gmt":"2024-08-27T17:11:58","slug":"does-it-matter-which-search-engine-is-used","status":"publish","type":"page","link":"https:\/\/searchstudies.org\/de\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/","title":{"rendered":"Does It Matter Which Search Engine Is Used?"},"content":{"rendered":"<p><section class=\"kc-elm kc-css-234277 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-513508 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-251186 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-721203 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-701610\" style=\"height: 20px; clear: both; width:100%;\"><\/div>\n<div class=\"kc-elm kc-css-681209 kc-title-wrap\">\n\n\t<h1 class=\"kc_title\">A user study using post-task relevance judgments<\/h1>\n<\/div>\n<\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-359117 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-677349 kc_col-sm-3 kc_column kc_col-sm-3\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-743197 kc_shortcode kc_single_image\">\n\n        <img decoding=\"async\" src=\"https:\/\/searchstudies.org\/wp-content\/uploads\/2022\/10\/rat_logo_grau.png\" class=\"\" alt=\"\" \/>    <\/div>\n<\/div><\/div><div class=\"kc-elm kc-css-717476 kc_col-sm-9 kc_column kc_col-sm-9\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-534592 kc_text_block\"><\/p>\n<p><span style=\"font-style: inherit;\">This study\u00a0<\/span><span style=\"font-style: inherit;\">investigated <strong>the relevance of the search results<\/strong><\/span><strong><span style=\"font-style: inherit;\"> from<\/span><\/strong><span style=\"font-style: inherit;\"><strong> Google and Bing<\/strong> when users work freely on pre-defined tasks.<\/span><\/p>\n<p style=\"--tw-border-spacing-x: 0; --tw-border-spacing-y: 0; --tw-translate-x: 0; --tw-translate-y: 0; --tw-rotate: 0; --tw-skew-x: 0; --tw-skew-y: 0; --tw-scale-x: 1; --tw-scale-y: 1; --tw-scroll-snap-strictness: proximity; --tw-ring-offset-width: 0px; --tw-ring-offset-color: #fff; --tw-ring-color: #3b82f680; --tw-ring-offset-shadow: 0 0 #0000; --tw-ring-shadow: 0 0 #0000; --tw-shadow: 0 0 #0000; --tw-shadow-colored: 0 0 #0000;\">RAT was used to collect <strong>juror assessments<\/strong>.<\/p>\n<p>\n<\/div><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-317398 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-268708 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-361039\" style=\"height: 20px; clear: both; width:100%;\"><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-99390 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-189909 kc_col-sm-7 kc_column kc_col-sm-7\"><div class=\"kc-col-container\">\n<div class=\"kc-elm kc-css-781626 kc-title-wrap\">\n\n\t<h2 class=\"kc_title\">Abstract<\/h2>\n<\/div>\n<div class=\"kc-elm kc-css-288015 kc_text_block\"><\/p>\n<p>\n<span style=\"caret-color: #000000; color: #000000; font-family: 'Open Sans', icomoon, sans-serif;\">The objective of this research was to find out how the two search engines, Google and Bing, perform when users work freely on pre-defined tasks, and judge the relevance of the results immediately after finishing their search session. In a user study, 64 participants conducted two search tasks each, and then judged the results on the following: (1) the quality of the results they selected in their search sessions, (2) the quality of the results they were presented with in their search sessions (but which they did not click on), (3) the quality of the results from the competing search engine for their queries (which they did not see in their search session). We found that users heavily relied on Google, that Google produced more relevant results than Bing, that users were well able to select relevant results from the results lists and that users judged the relevance of results lower when they regarded a task as difficult and did not find the correct information.<\/span><\/p>\n<p>\n<\/div><\/div><\/div><div class=\"kc-elm kc-css-830383 kc_col-sm-5 kc_column kc_col-sm-5\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-348161 kc_shortcode kc_single_image\">\n\n        <img decoding=\"async\" src=\"https:\/\/searchstudies.org\/wp-content\/uploads\/2024\/07\/Screenshot-2024-07-13-at-11.43.36\u202fPM.png\" class=\"\" alt=\"\" \/>    <\/div>\n<\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-572464 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-272511 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-706377\" style=\"height: 20px; clear: both; width:100%;\"><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-796512 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-198304 kc_col-sm-1 kc_column kc_col-sm-1\"><div class=\"kc-col-container\"><\/div><\/div><div class=\"kc-elm kc-css-576764 kc_col-sm-9 kc_column kc_col-sm-9\"><div class=\"kc-col-container\">\n<div class=\"kc-elm kc-css-368406 kc-title-wrap\">\n\n\t<h2 class=\"kc_title\">RAT functionality used<\/h2>\n<\/div>\n<div class=\"kc-elm kc-css-976037 kc_text_block\"><\/p>\n<p><strong><span style=\"font-style: inherit;\">Juror assessments:<\/span><\/strong><b> <\/b>\u00a064 Participants<\/p>\n<p>\n<\/div><div class=\"kc-elm kc-css-507534\" style=\"height: 20px; clear: both; width:100%;\"><\/div><\/div><\/div><div class=\"kc-elm kc-css-258858 kc_col-sm-1 kc_column kc_col-sm-1\"><div class=\"kc-col-container\"><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-220745 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-768296 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-554379\" style=\"height: 20px; clear: both; width:100%;\"><\/div><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-50679 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-520922 kc_col-sm-9 kc_column kc_col-sm-9\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-218770\" style=\"height: 20px; clear: both; width:100%;\"><\/div>\n<div class=\"kc-elm kc-css-532060 kc-title-wrap\">\n\n\t<h2 class=\"kc_title\">Publications and presentations<\/h2>\n<\/div>\n<div class=\"kc-elm kc-css-606260 kc_text_block\"><\/p>\n<h4>Paper<\/h4>\n<p>S\u00fcnkler, S., &#038; Lewandowski, D. (2017). Does it matter which search engine is used? A user study using post-task relevance judgments. Proceedings of the Association for Information Science and Technology, 54(1), 405\u2013414. <a href=\"https:\/\/doi.org\/10.1002\/pra2.2017.14505401044\">https:\/\/doi.org\/10.1002\/pra2.2017.14505401044<\/a><\/p>\n<h4><\/h4>\n<p>\n<\/div><\/div><\/div><div class=\"kc-elm kc-css-966571 kc_col-sm-3 kc_column kc_col-sm-3\"><div class=\"kc-col-container\"><\/div><\/div><\/div><\/div><\/section><section class=\"kc-elm kc-css-799685 kc_row\"><div class=\"kc-row-container  kc-container\"><div class=\"kc-wrap-columns\"><div class=\"kc-elm kc-css-505201 kc_col-sm-12 kc_column kc_col-sm-12\"><div class=\"kc-col-container\"><div class=\"kc-elm kc-css-571750\" style=\"height: 20px; clear: both; width:100%;\"><\/div>\n<div class=\"kc-elm kc-css-688857 kc-call-to-action kc-cta-2 kc-is-button\">\n\n\t<div class=\"kc-cta-desc\"><h2>Want to learn more about RAT and the Search Studies research group? Sign up for our Newsletter!<\/h2><\/div><div class=\"kc-cta-button\"><a href=\"http:\/\/eepurl.com\/iMPUyw\" title=\"Sign up now\" target=\"_blank\">Sign up now!<\/a><\/div>\n<\/div>\n<div class=\"kc-elm kc-css-810404\" style=\"height: 60px; clear: both; width:100%;\"><\/div><\/div><\/div><\/div><\/div><\/section><\/p>","protected":false},"excerpt":{"rendered":"","protected":false},"author":19,"featured_media":6974,"parent":7099,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Does It Matter Which Search Engine Is Used? - Search Studies Research Group<\/title>\n<meta name=\"description\" content=\"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/searchstudies.org\/de\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Does It Matter Which Search Engine Is Used? - Search Studies Research Group\" \/>\n<meta property=\"og:description\" content=\"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).\" \/>\n<meta property=\"og:url\" content=\"https:\/\/searchstudies.org\/de\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/\" \/>\n<meta property=\"og:site_name\" content=\"Search Studies Research Group\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-27T17:11:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"287\" \/>\n\t<meta property=\"og:image:height\" content=\"215\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"2\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/\",\"url\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/\",\"name\":\"Does It Matter Which Search Engine Is Used? - Search Studies Research Group\",\"isPartOf\":{\"@id\":\"http:\/\/searchstudies.org\/de\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg\",\"datePublished\":\"2024-06-06T17:18:27+00:00\",\"dateModified\":\"2024-08-27T17:11:58+00:00\",\"description\":\"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).\",\"breadcrumb\":{\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage\",\"url\":\"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg\",\"contentUrl\":\"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg\",\"width\":287,\"height\":215},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/searchstudies.org\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"RAT Software\",\"item\":\"https:\/\/searchstudies.org\/rat-software\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Sample studies\",\"item\":\"https:\/\/searchstudies.org\/rat-software\/rat-studies\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Does It Matter Which Search Engine Is Used?\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/searchstudies.org\/de\/#website\",\"url\":\"http:\/\/searchstudies.org\/de\/\",\"name\":\"Search Studies Research Group\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/searchstudies.org\/de\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"de\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Does It Matter Which Search Engine Is Used? - Search Studies Research Group","description":"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/searchstudies.org\/de\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/","og_locale":"de_DE","og_type":"article","og_title":"Does It Matter Which Search Engine Is Used? - Search Studies Research Group","og_description":"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).","og_url":"https:\/\/searchstudies.org\/de\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/","og_site_name":"Search Studies Research Group","article_modified_time":"2024-08-27T17:11:58+00:00","og_image":[{"width":287,"height":215,"url":"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"2\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/","url":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/","name":"Does It Matter Which Search Engine Is Used? - Search Studies Research Group","isPartOf":{"@id":"http:\/\/searchstudies.org\/de\/#website"},"primaryImageOfPage":{"@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage"},"image":{"@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage"},"thumbnailUrl":"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg","datePublished":"2024-06-06T17:18:27+00:00","dateModified":"2024-08-27T17:11:58+00:00","description":"An overlap study comparing results from four search engines, using the Results Assessment Tool (RAT).","breadcrumb":{"@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/"]}]},{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#primaryimage","url":"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg","contentUrl":"https:\/\/searchstudies.org\/wp-content\/uploads\/2023\/12\/other.jpg","width":287,"height":215},{"@type":"BreadcrumbList","@id":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/does-it-matter-which-search-engine-is-used\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/searchstudies.org\/"},{"@type":"ListItem","position":2,"name":"RAT Software","item":"https:\/\/searchstudies.org\/rat-software\/"},{"@type":"ListItem","position":3,"name":"Sample studies","item":"https:\/\/searchstudies.org\/rat-software\/rat-studies\/"},{"@type":"ListItem","position":4,"name":"Does It Matter Which Search Engine Is Used?"}]},{"@type":"WebSite","@id":"http:\/\/searchstudies.org\/de\/#website","url":"http:\/\/searchstudies.org\/de\/","name":"Search Studies Research Group","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/searchstudies.org\/de\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"de"}]}},"_links":{"self":[{"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/pages\/7509"}],"collection":[{"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/comments?post=7509"}],"version-history":[{"count":9,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/pages\/7509\/revisions"}],"predecessor-version":[{"id":7690,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/pages\/7509\/revisions\/7690"}],"up":[{"embeddable":true,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/pages\/7099"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/media\/6974"}],"wp:attachment":[{"href":"https:\/\/searchstudies.org\/de\/wp-json\/wp\/v2\/media?parent=7509"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}