This article explains that Okta does not control custom domain Uniform Resource Locators (URLs) and cannot directly remove them from search engine indexes. This article also provides information regarding the actions customers can take to prevent an Okta site from being searchable on Google.
- Okta Custom Domains
- Google Search Console
- Self-Hosted Sign-In Widget
Only the domain owner can request the removal of URLs from Google search results. If using Okta’s hosted sign-in experience or a custom domain managed by Okta, users cannot modify the robots.txt file to block search engines due to security restrictions.
- To un-index an Okta site or specific pages, follow the official Google documentation for removing information from search results: Remove a page hosted on your site from Google
- Locate the option related to removing a result from a Google Search.
- To gain full control over robots.txt, implement a fully self-hosted Sign-In Widget. This allows for the management of the robots.txt file and the setting of rules for search engine crawlers.
