Semantic novelty modulates neural responses to visual change across the human brain

Our continuous visual experience in daily life is dominated by change. Previous research has focused on the effects of visual motion, eye movements or the transition between events, but has failed to capture their full impact across the brain. Using intracranial recordings in humans, we investigate the neural responses to these sources of novelty during the natural experience of watching film. Responses to saccades and film cuts were much stronger than those to visual motion, extending far beyond traditional visual processing areas. Film cuts associated with semantic event boundaries elicit strong and specific responses in higher-order brain areas. Saccades associated with high visual novelty also elicit strong neural responses. Specific locations in higher-order brain areas show selectivity to either high or low-novelty saccade, as well as face or non-face targets. In summary, visual and semantic novelty drive much of the human brain, while exhibiting specialization to specific forms of novelty. Teaser When watching movies, the entire brain responds to film cuts, eye movements and motion, with stronger responses when something new happens.