Edit file

File name : robots.txt

Content :# Crypto Pulse - robots.txt # Allow all bots to crawl the entire site User-agent: * Allow: / Allow: /images/ Allow: /styles.css Allow: /script.js Disallow: # Specific rules for Google User-agent: Googlebot Allow: / Crawl-delay: 0 # Specific rules for Bing User-agent: Bingbot Allow: / Crawl-delay: 1 # Block bad bots User-agent: AhrefsBot User-agent: SemrushBot Disallow: / # Sitemap location Sitemap: https://crypt0pulse.com/sitemap.xml # Cache settings # Allow search engines to cache all pages Request-rate: 10/10s # Comment: This is the robots.txt file for Crypto Pulse # Website: https://cryptopulseapp.com # Last Updated: 2025-10-30 # This file controls search engine bot access to the website

Save