Whether it be on Twitch or any other streaming platform, viewers tend to backseat their favorite streamers quite a lot, and Sony may have just found the perfect way to let chat do it more effectively. Sony has filed a patent (US-12752199-B2) describing a system where viewers can control an adaptive cursor or provide sentiment-based reactions presented to the livestreamer during gameplay. In this way, viewers may also affect gameplay through direct interference.
Sony Patent to Help Streamers
The patent covers many ways for viewers to interact with the livestreamer through the game. This can include on-screen reactions or emojis that provide haptic feedback, if desired. Showing a cursor on the screen to guide or backseat a livestreamer to show, e.g., where the weak point of a boss is, where to shoot a virtual ball, where an enemy might appear, etc.
Most importantly, this system is not exclusive to the PlayStation ecosystem. The patent describes this as:
“A system herein may include server and client components which may be connected over a network such that data may be exchanged between the client and server components. The client components may include one or more computing devices including game consoles such as Sony PlayStation® or a game console made by Microsoft or Nintendo or other manufacturer, virtual reality (VR) headsets, augmented reality (AR) headsets, portable televisions (e.g., smart TVs, Internet-enabled TVs), portable computers such as laptops and tablet computers, and other mobile devices including smart phones.”
A viewer can control a cursor on the livestreamer’s game screen that is game-context aware and can automatically change its appearance based on the environment or the context. Viewers can also use persistent stickers on the player’s screen.
“In certain example implementations, the output may include the cursor being presented in an appearance associated with an ongoing game context for the computer game. Additionally or alternatively, the output may include the cursor being presented in an appearance relevant to a current game event.”
This interaction is not simply an overlay on top of the game screen because the viewer can “influence the game environment in real-time.” The patent describes how a viewer may “create temporary bridges, or manipulate objects within the game. These interactions impact the streamer’s game progress, potentially leading to secret passages or ‘easter eggs’ where hidden items in the game are revealed.”
The reaction or emoji aspect is another interesting part of the patent. Viewers can send emojis, stickers, sounds, and other predefined reactions to appear on the screen. Some settings allow these reactions to trigger a change in the game itself or provide haptic feedback to the controller, headset, phone, or another connected, supported device.
“Additionally or alternatively, the processor assembly may be configured to present haptic feedback to the first person based on the graphic-based reaction, where the haptic feedback may vary based on a reaction type associated with the graphic-based reaction.”
This interaction is a good way for a community to engage and possibly even compete with one another. The patent explains how the player may be awarded trophies or rewards based on viewer reactions, and a viewer could also be rewarded based on their level of interaction.
Now, you can already think of a ton of ways a viewer might jeopardize a livestreamer or act in an unpleasant way. That is why this system lets the livestreamer set predefined actions that limit what the viewer can do. It’s also possible to restrict cursor input during cutscenes or give cursor access only to a specific viewer.
“As another example, the cursor control command may be a first cursor control command and the processor assembly may be configured to execute the first cursor control command during a first portion of the computer game. Per this example, the processor assembly may also be configured to determine that a cutscene is occurring and, based on the determination, decline to process additional cursor control commands.”
The patent has no earlier iterations, meaning this is the first time Sony has described this system. It goes beyond traditional viewer-livestreamer interactions and could elevate the current experience further. So, the next time you see a livestreamer clip-farming or being unable to solve a puzzle, this is how you might send your message through.
Source: Search “12752199” on USPTO.
What are your thoughts on Sony’s new patent? Let us know your thoughts on the Insider Gaming Discord server.
For your next read, check out the price point of Hollow Knight in Fortnite, find out about the latest Twitch Drops in ARC Raiders, and don’t forget to sign up for our newsletter.
Tom Henderson is Insider Gaming's Co-Founder and Editor-In-Chief. When he's not running one of the industry's leading independent video game websites, he's probably playing an FPS like Call of Duty,…
More from Tom Henderson
Comments