Okta Advanced Server Access and Privileged Access RDP Fails From macOS or Linux Clients and Gateways
Last Updated:
Overview
Okta Advanced Server Access (ASA) and Okta Privileged Access (OPA) Remote Desktop Protocol (RDP) connections fail from macOS or Linux clients, or when routing connections through a gateway, because the target server only accepts the RDP security layer. Resolve this issue by updating the target server Group Policy Object (GPO) to negotiate the security layer. RDP connections from Windows clients succeed, but macOS, Linux, and gateway connections fail. The following error appears in MacFreeRDP or on the gateway:
SSL_NOT_ALLOWED_BY_SERVER
Applies To
- Okta Identity Engine (OIE)
- Okta Classic Engine
- Okta Advanced Server Access (ASA)
- Okta Privileged Access (OPA)
- Server Agent
- macOS
- Linux
Cause
The target server only accepts the RDP security layer for remote RDP connections. A group or local policy controls this setting.
Solution
What steps configure the RDP security layer on the target server?
Update the Group Policy Object (GPO) on the target server to negotiate the security layer and force the policy update.
- Open the group or local policy editor on the target server.
- Navigate to Computer configuration > Policies > Administrative templates > Windows components > Remote Desktop Services > Remote Desktop Session Host > Security.
- Enable the Require use of specific security layer for remote (RDP) connections policy and set it to Negotiate.
- Force changes to the GPO by running the following command:
gpupdate /force
