For decades, computers have only tracked where we are pointing. AI can now also understand what the user is pointing at. This transforms pixels into structured entities, such as places, dates, and objects
The shift from spatial pointer (where?) to semantic pointer (what?) is a fundamental interface paradigm shift—equivalent in magnitude to moving from command-line to GUI. When pixels become actionable entities, every surface becomes an AI interface.