templates/https_robots.txt.twig line 1

Open in your IDE?
  1. User-agent: Yandex
  2. Disallow: /captcha/
  3. Disallow: /en/captcha/
  4. Disallow: /management/
  5. Disallow: /account/*
  6. Disallow: */forum/*
  7. Disallow: /404.html
  8. Disallow: /*?*
  9. Disallow: */*?*
  10. Disallow: /en/
  11. Disallow: /page*
  12. Disallow: /page
  13. Disallow: */page*
  14. Disallow: */page
  15. Disallow: /*?page*
  16. Disallow: */*?page*
  17. Disallow: /reg/
  18. Disallow: /moskva/reg/
  19. Disallow: /login-form/
  20. Disallow: /remind/
  21. Disallow: /license/
  22. Sitemap: {{ sitemap_url }}
  23. Host: https://{{ host }}
  25. User-agent: Googlebot
  26. Disallow: /captcha/
  27. Disallow: /en/captcha/
  28. Disallow: /management/
  29. Disallow: /account/*
  30. Disallow: */forum/*
  31. Disallow: /404.html
  32. Disallow: /*?*
  33. Disallow: */*?*
  34. Disallow: /en/
  35. Disallow: /page*
  36. Disallow: /page
  37. Disallow: */page*
  38. Disallow: */page
  39. Disallow: /*?page*
  40. Disallow: */*?page*
  41. Sitemap: {{ sitemap_url }}