Interactivity is not how you react to what you see. It is how you change what you see. To be interactive, a game (or any art) needs to be capable of being intentionally altered by the viewer’s actions.
Interactivity is often confused with participation, particularly by narrativist and simulationist game makers.