I'm also not an expert on Windows audio drivers*** so, hopefully, someone who is will come along and give you better directions. I could give you a technical explanation, but I suspect most people would glaze over.
It's mostly likely to be some sort of problem with the audio interface drivers than with Reaper itself.
