How to use this tool
Pick a starting preset, add any paths you want to block and your sitemap URL, then download robots.txt and upload it to your site root.
Does robots.txt stop a page from appearing in Google?
No. It only blocks crawling. To keep a page out of Google use a noindex tag.
Where does robots.txt go?
In the root folder of your site so it opens at yourdomain.com/robots.txt.
More free tools
Meta Title & Description CheckerSchema Markup (JSON-LD) GeneratorXML Sitemap GeneratorUTM Link BuilderKeyword Density & Word CounterOpen Graph & Social Card PreviewURL Slug GeneratorHeading Structure CheckerHreflang Tag Generator301 Redirect & .htaccess GeneratorWord Counter & Reading TimeReadability Score (Flesch)Canonical Tag GeneratorImage CompressorWebP Converter