diff options
| author | Rafi Zadanly <zadanlyr@gmail.com> | 2023-07-11 16:53:33 +0700 |
|---|---|---|
| committer | Rafi Zadanly <zadanlyr@gmail.com> | 2023-07-11 16:53:33 +0700 |
| commit | 6e10da793b9c1acf71232fe741cf91d16a4db82a (patch) | |
| tree | 93314cea3a490dc3de4511fcb7c66d7d38e43cd9 | |
| parent | 3f68c2837f7f1ba6d934d5070ba09100d6e3574b (diff) | |
Update robots.txt
| -rw-r--r-- | public/robots.txt | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/public/robots.txt b/public/robots.txt index 418e72f1..59084da9 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -2,8 +2,6 @@ # User-agent: * # Version 1.0 -User-agent: AhrefsBot -User-agent: Yandex User-agent: Googlebot User-agent: Googlebot-mobile Disallow: /shop/product/pdf/* @@ -18,6 +16,11 @@ Disallow: /my/* Disallow: /shop/variant/* Disallow: /shop/search/* Disallow: /promo/* +Disallow: /shop/product/*/* + +User-agent: Adsbot-Google +Allow: /my/* +Allow: /shop/search/* User-agent: * Disallow: sentral.indoteknik.com/* |