I will refer to Risk-Free Rates (RFR) for greater generality, instead of OIS or SOFR. There are two dimensions to your question, I will treat them separately.
How to adjust a LIBOR vol surface to price RFR options?
When lacking RFR option quotes, I think there is no evident solution. Some pointers I would consider:
From anecdotal evidence I've seen for ...