I imagine from his angle, side on, Oliver couldn't be sure whether it hit the arm. I tend to agree though. It would have been a suitable incident for the referee to look at the monitor. One of those that had the referee given the penalty, it wouldn't have been overturned either