I have the same issue, and when disabling Track Ir and using free look with Alt , you don't have the issue, view stays locked to the 3D Scope
With TrackIr enabled, view is not locked to the 3D scope of the RCO. Seems 3D scope is handled as a ACO type scope with track Ir enabled