Sony's New AI Patent Predicts Button Presses Using Finger-Camera Tech

Sony has recently filed a patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," which aims to reduce latency in future gaming hardware. This patent was first highlighted by Tech4gamers and could potentially revolutionize the gaming experience on PlayStation consoles.

With the introduction of PlayStation Spectral Super Resolution (PSSR) on the PlayStation 5 Pro, Sony has already shown its commitment to enhancing visual quality. However, as newer graphics technologies like frame generation can introduce additional latency, making games feel less responsive, Sony is now exploring solutions to mitigate this issue.

The patent details a system that combines a machine-learning AI model with external sensors, such as a camera focused on your controller, to predict your next input. This predictive approach aims to streamline the "timed release of user commands," thus reducing the delay between your actions and the game's response. Sony's filing explains, "there can be latency between the user's input action and the system's subsequent processing and execution of the command. This in turn results in delayed execution of the command and unintended consequences in the game itself."

One example provided in the patent involves using camera input as a feed for the machine learning model to anticipate the first user command. Another innovative aspect considers using the controller's buttons as sensors, leveraging Sony's experience with analog buttons in past controllers.

While it's uncertain whether this exact technology will be implemented in the PlayStation 6, Sony's interest in reducing latency is clear, especially given the rise of technologies like FSR 3 and DLSS 3, which can add frame latency. This focus on latency reduction is particularly crucial for genres like twitch shooters, where high framerates and low latency are essential for competitive play.

Sony's exploration into reducing latency through AI and sensor technology signals a promising future for gamers, potentially enhancing responsiveness without sacrificing visual quality. Whether this patent will directly influence future hardware remains to be seen, but it's evident that Sony is dedicated to improving the gaming experience.