# This says to apply these settings to ALL search engine spiders/crawlers # User-agent: * User-agent: Googlebot Disalow: /shop/product/pdf/* Disalow: /shop/product/https://* Disallow: /v1/* Disallow: /sentral.indoteknik.com* Sitemap: https://indoteknik.com/sitemap/products.xml Sitemap: https://indoteknik.com/sitemap/brands.xml Sitemap: https://indoteknik.com/sitemap/categories.xml Sitemap: https://indoteknik.com/sitemap/videos.xml