Currently regenerating a private key would cause access token request to fail as per the warning.
This prevents an ability to perform key rotation without interruptions.
> Regenerate private key? > This action cannot be undone. Your old key will stop working immediately. Are you sure you want to generate a new private key? Please consider supporting multiple keys so that as an integration access token requests will have time to update their keys without interruption.