1
0
Fork 0
mirror of https://github.com/terribleplan/next.js.git synced 2024-01-19 02:48:18 +00:00
next.js/examples/with-sitemap-and-robots-express-server/static/robots.txt

10 lines
160 B
Plaintext
Raw Normal View History

User-agent: *
Allow: /a
Allow: /b
Allow: /posts/*
Disallow: /
Disallow: /a/*
Disallow: /b/*
Disallow: /posts
Sitemap: https://sitemap-robots.now.sh/sitemap.xml