User-agent: Scrapy
Allow: /

Sitemap: https://logz.io/post-sitemap.xml
Sitemap: https://logz.io/page-sitemap.xml
Sitemap: https://logz.io/case-studies-sitemap.xml
Sitemap: https://logz.io/newsroom-sitemap.xml
Sitemap: https://logz.io/category-sitemap.xml
Sitemap: https://logz.io/post_tag-sitemap.xml
Sitemap: https://logz.io/author-sitemap.xml

User-Agent: *
Disallow: /readme.html
Disallow: /wp-admin/