Remove Okta Custom Domain URLs From Search Engine Indexing
Last Updated:
Overview
Okta does not control custom domain URLs and cannot directly remove them from search engine indexes because administrators cannot modify the robots.txt file to block search engines due to security restrictions. Administrators must request the removal of URLs from Google search results directly or implement a fully self-hosted Sign-In Widget to manage the robots.txt file.
Applies To
- Okta Identity Engine (OIE)
- Okta Classic Engine
- Okta Custom Domains
- Google Search Console
- Self-Hosted Sign-In Widget
Cause
Okta does not control custom domain URLs and cannot directly remove them from search engine indexes because security restrictions prevent modifications to the robots.txt file.
Solution
How are Okta custom domain URLs removed from search engine indexing?
Remove an Okta site or specific pages from Google search results by following the official Google documentation to remove a hosted page or by implementing a fully self-hosted Sign-In Widget to gain full control over the robots.txt file.
- Follow the official Google documentation for removing information from search results to remove a page hosted on a site from Google. Remove a page hosted on your site from Google.
- Locate the option related to removing a result from a Google Search.
- Implement a fully self-hosted Sign-In Widget to gain full control over the robots.txt file and set rules for search engine crawlers.
- Review the Embedded Okta Sign-In Widget fundamentals for more information.
