User-agent: *
Disallow: /search
Disallow: /admin
Disallow: /profile
Disallow: /login
Disallow: /register

Sitemap: https://theinternettoday.net/sitemap.xml