Please speak as if you are an experienced university professor and give me advice.

I just did a quiz for my students. It is forbidden to use calculator in the exam, but a student reported to me after the quiz that he saw another student cheating by using calculator. I wonder if I should let it go because it is very difficult to prove this has happened?