{"id":625342,"date":"2024-06-24T16:00:00","date_gmt":"2024-06-24T13:00:00","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/can-ai-perform-technical-seo-analysis-effectively\/"},"modified":"2024-06-24T16:00:00","modified_gmt":"2024-06-24T13:00:00","slug":"can-ai-perform-technical-seo-analysis-effectively","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/","title":{"rendered":"#Can AI perform technical SEO analysis effectively?"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a2762c2d57eb\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a2762c2d57eb\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/#Learn_how_ChatGPT_handles_Screaming_Frog_crawl_data_and_compare_its_insights_to_professional_SEO_tools_like_Ahrefs\" >Learn how ChatGPT handles Screaming Frog crawl data and compare its insights to professional SEO tools like Ahrefs.<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/#Leveraging_generative_AI_for_technical_SEO\" >Leveraging generative AI for technical SEO<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/#Analyzing_Screaming_Frog_crawl_data_for_insights_via_ChatGPT\" >Analyzing Screaming Frog crawl data for insights via ChatGPT<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/#Comparing_AI_insights_to_Ahrefs_technical_audit\" >Comparing AI insights to Ahrefs\u2019 technical audit<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/buradabiliyorum.com\/en\/can-ai-perform-technical-seo-analysis-effectively\/#The_final_verdict\" >The final verdict<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"subhead\" itemprop=\"alternativeHeadline\"><span class=\"ez-toc-section\" id=\"Learn_how_ChatGPT_handles_Screaming_Frog_crawl_data_and_compare_its_insights_to_professional_SEO_tools_like_Ahrefs\"><\/span>Learn how ChatGPT handles Screaming Frog crawl data and compare its insights to professional SEO tools like Ahrefs.<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><\/p>\n<div class=\"bialty-container\">\nGenerative AI has made significant strides in various fields, including SEO. <\/p>\n<p>This article explores a crucial question: Can AI effectively perform technical SEO analysis using raw crawl data? <\/p>\n<p>We\u2019ll examine the capabilities of ChatGPT in interpreting Screaming Frog crawl data and generating SEO recommendations.\u00a0<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-leveraging-generative-ai-for-technical-seo\"><span class=\"ez-toc-section\" id=\"Leveraging_generative_AI_for_technical_SEO\"><\/span>Leveraging generative AI for technical SEO<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>My Search Engine Land articles often examine in-depth technical applications where SEO and AI can collaborate, resulting in increased efficiencies. For example, I have used AI to generate alt text from image files or product de<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">script<\/a>ions from PIM data.<\/p>\n<p>However, many marketers are less technical and may struggle to blend OpenAI\u2019s API, Python and spreadsheets. Some marketers would rather hand AI the tech data and receive clear human insights.\u00a0<\/p>\n<p>As such, I thought I would produce an article examining the effectiveness of AI in interpreting technical SEO data. Even if you\u2019re not communicating with AI models via programmatic API access, many AI assistants (ChatGPT, Google Gemini) offer user-friendly chat interfaces. We will explore ChatGPT in this article.<\/p>\n<p>Lately, the ability of these AI-powered chat interfaces has been growing. For example, OpenAI\u2019s ChatGPT has recently evolved from GPT-4 to GPT-4o. The new GPT-4o model comes with many feature changes:<\/p>\n<ul>\n<li>GPT-4o is much faster than GPT-4. It has a similar standard of accuracy to GPT-4, while responding at pace, more similar to GPT-3.5-Turbo.<\/li>\n<li>GPT-4o is less reliant on plugins or custom GPTs to access web content.<\/li>\n<li>GPT-4o will seek web content far more frequently to generate its results, making the produced material \u201cfresher.\u201d<\/li>\n<li>Though true, the web is poorly curated and full of misinformation. Many feel that the refined data model of GPT-4, with fewer web requests \u2013 actually produced superior results to GPT-4o.<\/li>\n<li>There\u2019s no arguing that GPT-4o is at least comparable to GPT-4. It is much faster and far more interactive. It can work with more types of attached data, produce more types of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/social-mediaa\/\" data-internallinksmanager029f6b8e52c=\"1\" title=\"Social Media\" target=\"_blank\" rel=\"noopener\">media<\/a> and is web-capable.<\/li>\n<\/ul>\n<p>With GPT-4o now more capable of searching web content, it could be more helpful for marketers, even those who lack technical skills. However, there are concerns about its ability to access the web, as past experiences with tools like Google\u2019s Bard and Gemini showed inferior results.<\/p>\n<p>To test GPT-4o, we\u2019ll give it specific technical SEO crawl data instead of generic analysis tasks. This will help us see how much ChatGPT has improved and if it can be useful for technical SEO analysis.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-analyzing-screaming-frog-crawl-data-for-insights-via-chatgpt\"><span class=\"ez-toc-section\" id=\"Analyzing_Screaming_Frog_crawl_data_for_insights_via_ChatGPT\"><\/span>Analyzing Screaming Frog crawl data for insights via ChatGPT<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The \u201cinternal all\u201d export from Screaming Frog is the bread-and-butter foundation of most technical SEO insights.\u00a0<\/p>\n<p>That single export may be pivoted in several ways to comment on metadata issues, canonical tag conflicts, hreflang issues etc.\u00a0<\/p>\n<p>Will AI pick up on such issues? Will AI hallucinate or misdiagnose issues where none are present? Let\u2019s find out.<\/p>\n<p>We will use the Butcher\u2019s Dog Food company website as a testbed for these tests. They are a UK dog food supplier, and their site is about the right size for our proposed activities.<\/p>\n<p>First, we will crawl Butchersdogfood.co.uk:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"944\" height=\"513\" alt=\"Butchersdogfood.co.uk crawl data\" class=\"wp-image-443433\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data.png 944w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-600x326.png.webp 600w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-800x435.png.webp 800w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-200x109.png.webp 200w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-768x417.png.webp 768w\" data-lazy-sizes=\"(max-width: 944px) 100vw, 944px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data.png\"><img fetchpriority=\"high\" decoding=\"async\" width=\"944\" height=\"513\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data.png\" alt=\"Butchersdogfood.co.uk crawl data\" class=\"wp-image-443433\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data.png 944w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-600x326.png.webp 600w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-800x435.png.webp 800w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-200x109.png.webp 200w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-768x417.png.webp 768w\" sizes=\"(max-width: 944px) 100vw, 944px\"><\/figure>\n<\/div>\n<p>Over 3,000 internal addresses were discovered. Now, we can export the list of internal addresses to a CSV file:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1004\" height=\"628\" alt=\"Butchersdogfood.co.uk crawl data export\" class=\"wp-image-443434\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export.png 1004w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-540x338.png.webp 540w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-800x500.png.webp 800w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-181x113.png.webp 181w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-768x480.png.webp 768w\" data-lazy-sizes=\"(max-width: 1004px) 100vw, 1004px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1004\" height=\"628\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export.png\" alt=\"Butchersdogfood.co.uk crawl data export\" class=\"wp-image-443434\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export.png 1004w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-540x338.png.webp 540w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-800x500.png.webp 800w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-181x113.png.webp 181w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Butchersdogfood.co_.uk-crawl-data-export-768x480.png.webp 768w\" sizes=\"auto, (max-width: 1004px) 100vw, 1004px\"><\/figure>\n<\/div>\n<p>Now, we can feed the CSV file to GPT-4o and ask for some recommendations. Most people don\u2019t write prompts as complex as I do. They write shorter prompts and then refine them. As such, I will attempt to follow that behavior.<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"749\" height=\"777\" alt=\"Upload crawl data to GPT-4o \" class=\"wp-image-443435\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o-.png.webp 749w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--326x338.png.webp 326w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--578x600.png.webp 578w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--109x113.png.webp 109w\" data-lazy-sizes=\"(max-width: 749px) 100vw, 749px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o-.png.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"749\" height=\"777\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o-.png.webp\" alt=\"Upload crawl data to GPT-4o \" class=\"wp-image-443435\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o-.png.webp 749w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--326x338.png.webp 326w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--578x600.png.webp 578w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Upload-crawl-data-to-GPT-4o--109x113.png.webp 109w\" sizes=\"auto, (max-width: 749px) 100vw, 749px\"><\/figure>\n<\/div>\n<p>The response contained many recommendations, but most were disappointingly generic. For example, recommendations like this:<\/p>\n<ul>\n<li>\u201cSeveral URLs point to image files (e.g., PNG, JPEG). Ensure that all images are optimized for web usage to reduce load times. This includes compressing images and using appropriate formats.\u201d<\/li>\n<\/ul>\n<p>This recommendation is disappointing because ChatGPT actually did have access to response time and file-size data as per image addresses. So, the response could potentially have been more specific.<\/p>\n<p>Here\u2019s another example of very generic guidance:<\/p>\n<ul>\n<li>\u201cEnsure that canonical tags are correctly implemented to avoid duplicate content issues. Each page should have a self-referencing canonical tag unless it\u2019s a deliberate duplicate.\u201d<\/li>\n<\/ul>\n<p>Since ChatGPT has access to the datasheet, it should be able to work out (roughly) which URLs are the main addresses and which are not (parameters in the URL string, etc.). <\/p>\n<p>Thus, ChatGPT should be able to isolate canonical tag problems rather than give <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a> (and useless) guidance.<\/p>\n<p>Let\u2019s push it a bit harder:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"722\" height=\"759\" alt=\"GPT-4o crawl data-related prompts\" class=\"wp-image-443436\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts.png.webp 722w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-322x338.png.webp 322w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-571x600.png.webp 571w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-107x113.png.webp 107w\" data-lazy-sizes=\"(max-width: 722px) 100vw, 722px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts.png.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"722\" height=\"759\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts.png.webp\" alt=\"GPT-4o crawl data-related prompts\" class=\"wp-image-443436\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts.png.webp 722w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-322x338.png.webp 322w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-571x600.png.webp 571w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-related-prompts-107x113.png.webp 107w\" sizes=\"auto, (max-width: 722px) 100vw, 722px\"><\/figure>\n<\/div>\n<p>The guidance is still relatively vague, even when we iterate and create a more detailed prompt. Many pages are always missing canonical tags, such as image addresses, which do not support HTML. <\/p>\n<p>The response should have been more specific and detailed, explaining why certain addresses needed canonical tags but didn\u2019t have them.<\/p>\n<p>As part of the response above, some more detailed feedback was given:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"644\" height=\"591\" alt=\"GPT-4o crawl data recommendations\" class=\"wp-image-443437\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations.png.webp 644w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations-368x338.png.webp 368w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations-123x113.png.webp 123w\" data-lazy-sizes=\"(max-width: 644px) 100vw, 644px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations.png.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"644\" height=\"591\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations.png.webp\" alt=\"GPT-4o crawl data recommendations\" class=\"wp-image-443437\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations.png.webp 644w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations-368x338.png.webp 368w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-crawl-data-recommendations-123x113.png.webp 123w\" sizes=\"auto, (max-width: 644px) 100vw, 644px\"><\/figure>\n<\/div>\n<p>Wow, these recommendations are a total mess. <\/p>\n<p>In a way, they are impressive despite being totally wrong. I might expect an inexperienced junior SEO person whose been thrown into the technical SEO deep end to make similar recommendations.\u00a0<\/p>\n<p>The advice would be wrong, but there are indeed signs of intelligence. You must remember that it still takes some degree of intelligence to go off on tangents and produce relevant yet inaccurate analysis. The work is unusable, but there are signs of a genuine attempt.<\/p>\n<p>As humans, we\u2019re prone to holding AI to unfair standards. If AI produces something that is wrong or incorrect, we say that AI has failed to achieve human understanding. However, many of us (real humans) also fall short, and this happens often.\u00a0<\/p>\n<p>For me, the question is: Has AI failed in a way that demonstrates some human-like attempt at completing the task? <\/p>\n<p>I think signs are positive for the future in terms of such applications for accessible (chat interface) AI interactions. For now, though, it would be disastrous to act on the recommendations given.\u00a0<\/p>\n<p>Identifying a redirecting URL as potentially important (even though it is a redirecting address) and then assuming that work may or may not need to occur on the final destination URL is some of the most woolly thinking I have personally encountered.<\/p>\n<p>The only interesting pointer that ChatGPT was able to come up with was that a number of addresses on the site resulted in 301 redirects, and there may be some defective architecture:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"692\" height=\"197\" alt=\"GPT-4o interesting recommendation\" class=\"wp-image-443438\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation.png 692w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation-600x171.png.webp 600w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation-200x57.png.webp 200w\" data-lazy-sizes=\"(max-width: 692px) 100vw, 692px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation.png\"><img loading=\"lazy\" decoding=\"async\" width=\"692\" height=\"197\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation.png\" alt=\"GPT-4o interesting recommendation\" class=\"wp-image-443438\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation.png 692w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation-600x171.png.webp 600w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/GPT-4o-interesting-recommendation-200x57.png.webp 200w\" sizes=\"auto, (max-width: 692px) 100vw, 692px\"><\/figure>\n<\/div>\n<p>The above response was given after our very first message before we began pushing AI to think in more specific terms. This was actually the first recommendation that ChatGPT gave, and in some ways it is interesting:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"739\" height=\"824\" alt=\"Redirected image addresses from crawl data\" class=\"wp-image-443439\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data.png 739w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-303x338.png.webp 303w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-538x600.png.webp 538w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-101x113.png.webp 101w\" data-lazy-sizes=\"(max-width: 739px) 100vw, 739px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data.png\"><img loading=\"lazy\" decoding=\"async\" width=\"739\" height=\"824\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data.png\" alt=\"Redirected image addresses from crawl data\" class=\"wp-image-443439\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data.png 739w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-303x338.png.webp 303w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-538x600.png.webp 538w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Redirected-image-addresses-from-crawl-data-101x113.png.webp 101w\" sizes=\"auto, (max-width: 739px) 100vw, 739px\"><\/figure>\n<\/div>\n<p>There are around 100 redirecting addresses. Many of these are redirected image addresses. Some seem like they were once true pages or perhaps are trailing slash redirects. Others revolve around pagination.<\/p>\n<p>This was an interesting lead, but most other recommendations were generic or misleading. ChatGPT\u2019s attempt at specific advice was semi-intelligent, but the suggestions would have wasted time or caused more problems.\u00a0<\/p>\n<p>I\u2019d grade this work a D or E, though many machines wouldn\u2019t score that high on technical SEO from flat datasheets. I\u2019m impressed, but I don\u2019t recommend using AI for this level of technical SEO analysis yet.<\/p>\n<p><!-- START INLINE FORM --><\/p>\n<p><!-- END INLINE FORM --><\/p>\n<hr class=\"wp-block-separator has-text-color has-cyan-bluish-gray-color has-css-opacity has-cyan-bluish-gray-background-color has-background\">\n<h2 class=\"wp-block-heading\" id=\"h-comparing-ai-insights-to-ahrefs-technical-audit\"><span class=\"ez-toc-section\" id=\"Comparing_AI_insights_to_Ahrefs_technical_audit\"><\/span>Comparing AI insights to Ahrefs\u2019 technical audit<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Ahrefs has a sophisticated cloud-based SEO crawler. While Screaming Frog\u2019s data can be more accurate, Ahrefs still provides solid data and better insights. I use both tools for site audits.<\/p>\n<p>If we look at the output from a full Ahrefs technical SEO crawl, we may then be able to determine how close GPT-4o came to finding the truth. Let\u2019s look at the Ahrefs overview:<\/p>\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"862\" height=\"900\" alt=\"Comparing AI insights to Ahrefs\u2019 technical audit\" class=\"wp-image-443440\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit.png.webp 862w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-324x338.png.webp 324w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-575x600.png.webp 575w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-108x113.png.webp 108w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-768x802.png.webp 768w\" data-lazy-sizes=\"(max-width: 862px) 100vw, 862px\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit.png.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"862\" height=\"900\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit.png.webp\" alt=\"Comparing AI insights to Ahrefs\u2019 technical audit\" class=\"wp-image-443440\" srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit.png.webp 862w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-324x338.png.webp 324w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-575x600.png.webp 575w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-108x113.png.webp 108w,https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Comparing-AI-insights-to-Ahrefs-technical-audit-768x802.png.webp 768w\" sizes=\"auto, (max-width: 862px) 100vw, 862px\"><\/figure>\n<\/div>\n<p>Wow, that\u2019s an excellent rating! Well done to the Butcher\u2019s Dog Food team. <\/p>\n<p>Despite the high rating, some issues still persist. This is totally normal and is usually nothing to worry about.\u00a0<\/p>\n<p>What\u2019s interesting here is that the remaining issues revolve around redirecting addresses and images, which may have too large file sizes. This is interesting because these were some of the top issues picked out by our AI assistant based on Screaming Frog data.<\/p>\n<p>What does this mean? Was the AI right all along, and perhaps we judged ChatGPT too harshly for \u201cgeneric sounding\u201d recommendations that were actually accurate?\u00a0<\/p>\n<p>Yes and no. Humans often feel the need to defend their roles against advancing <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a>, which can create a bias against it. This bias is common, even among those in the digital field.<\/p>\n<p>However, this technology is not an immediate threat to technical SEO specialists. The advice given was not usable, but the AI\u2019s mistakes were intelligent, similar to those of an inexperienced human who shows promise.\u00a0<\/p>\n<p>The general focus of the insights, like redirects and image compression, was accurate even if the specific advice wasn\u2019t.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-the-final-verdict\"><span class=\"ez-toc-section\" id=\"The_final_verdict\"><\/span>The final verdict<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>GPT-4o is a vast improvement over GPT-3.5-Turbo. However, I\u2019m unconvinced that there is significant (or any) improvement over GPT-4, which seems to hallucinate less.\u00a0<\/p>\n<p>Currently, I see GPT-4o as a good middle ground between GPT-3.5-Turbo and GPT-4. To me, the results of GPT-4 seem superior. But GPT-4o is around as fast as GPT-3.5-Turbo and is more interactive.\u00a0<\/p>\n<p>I guess time will tell which model users will prefer. I\u2019m willing to wait longer for GPT-4 to produce superior output, even if that output is limited via a (curated) data model.<\/p>\n<p>ChatGPT\u2019s advice was poor. It missed key points and offered generic, unhelpful suggestions. Its attempt at specific advice also failed.<\/p>\n<p>However, there were signs of intelligence in its errors, similar to an inexperienced human making mistakes. This shows potential for improvement.<\/p>\n<p>For now, don\u2019t rely on this technology for technical SEO analysis, especially through simple chat interfaces. But keep an eye on it \u2013 an AI capable of providing valuable insights may be closer than we think.\n<\/p><\/div>\n<p><\/p>\n<div class=\"about-author\">\n    About the author<\/p>\n<div class=\"information\">\n<div class=\"author-module\">\n<div class=\"row\">\n<div class=\"col-12 col-lg-3 text-center\">\n<div class=\"avatar\">\n                        <img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" alt=\"James Allen\" width=\"140\" height=\"140\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2023\/09\/James-Allen.jpeg.webp\"><img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded-circle avatar-border\" src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2023\/09\/James-Allen.jpeg.webp\" alt=\"James Allen\" width=\"140\" height=\"140\">\n                                            <\/div>\n<\/p><\/div>\n<div class=\"col-12 col-lg-9\">\n<div class=\"about\">\n<div class=\"name\">\n                            <strong>James Allen<\/strong>\n                        <\/div>\n<div class=\"row g-2 pt-2\">\n<div class=\"col-auto\">\n                                    <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/www.linkedin.com\/in\/scriptedinsight\/\" aria-label=\"opens in a new tab\"><i class=\"fab fa-linkedin\"><\/i><\/a>\n                                <\/div>\n<\/p><\/div>\n<p>                        Hailing from the Midlands of the United Kingdom; James Allen has been working in search since 2009. Specialising in technical SEO early in his career, he is an auditor who is capable of ascertaining his own data. With a solid knowledge of XPath and some working knowledge of Python, James also dabbles in AI scripting (for example, combining the functions of BLIP with Open-AI&#8217;s GPT suite of technologies). James decided to split his career between then technical SEO, light API scripting and Analytics support disciplines. Due to this, he also has high familiarity with Google Analytics, Google Tag Manager and managing custom events within the data layer. James specialises in page-speed analysis, and utilising AI for SEO purposes.                  <\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more like this article, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/technology\/\" target=\"_blank\" rel=\"noopener\">Technology<\/a><\/span> category.<\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/searchengineland.com\/ai-technical-seo-analysis-443431\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learn how ChatGPT handles Screaming Frog crawl data and compare its insights to professional SEO tools like Ahrefs. Generative AI has made significant strides in various fields, including SEO. This article explores a crucial question: Can AI effectively perform technical SEO analysis using raw crawl data? We\u2019ll examine the capabilities of ChatGPT in interpreting Screaming&#8230;<\/p>\n","protected":false},"author":1,"featured_media":625343,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/searchengineland.com\/wp-content\/seloads\/2024\/06\/Can-AI-perform-technical-SEO-analysis-from-flat-data.png","fifu_image_alt":"","footnotes":""},"categories":[18],"tags":[149397,78070,148084],"class_list":["post-625342","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-artificial-intelligence-optimization-aio","tag-seo","tag-technical-optimization"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/625342","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=625342"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/625342\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/625343"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=625342"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=625342"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=625342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}