{"version":"1.0","provider_name":"Blog","provider_url":"https:\/\/elementor.com\/blog","author_name":"Itamar Haim","author_url":"https:\/\/elementor.com\/blog\/author\/itamarha\/","title":"What Is Robots.txt? Guide for Website Owners","type":"rich","width":600,"height":338,"html":"<blockquote class=\"wp-embedded-content\" data-secret=\"7u0BeIpSLg\"><a href=\"https:\/\/elementor.com\/blog\/what-is-robots-txt\/\">What Is Robots.txt? Guide for Website Owners<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/elementor.com\/blog\/what-is-robots-txt\/embed\/#?secret=7u0BeIpSLg\" width=\"600\" height=\"338\" title=\"&#8220;What Is Robots.txt? Guide for Website Owners&#8221; &#8212; Blog\" data-secret=\"7u0BeIpSLg\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script>\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/elementor.com\/blog\/wp-includes\/js\/wp-embed.min.js\n<\/script>\n","thumbnail_url":"https:\/\/elementor.com\/blog\/wp-content\/uploads\/2025\/07\/imgi_3_04.05.21_How-To-Perform-a-Comprehensive-Website-QA-Test_1200_628_2-1-1-scaled.jpeg","thumbnail_width":2560,"thumbnail_height":1340,"description":"If you've ever felt like your website is a sprawling city, you're not far off. It has public squares (your homepage), bustling avenues (your main content), and maybe some private alleyways or back offices you'd rather the general public not wander into (like admin pages or thank-you pages).\u00a0"}