Apple's patent FIG. 1 presented below is
a diagram of a system for a vehicle
to project an interactive scene onto a surface
for interaction with a user of the projection system.
More specifically, the projection system #100 could act as a display for a computer, with one or more gesture sensors as inputs to control the computer. For example, the projected scene may be an interface to a vehicle, the Internet, a closed network or computers, other connected hardware, etc. that is controlled by the gestures of the user and displayed through the projected scene.
In a way, what Apple is describing could represent a heads-up display on a windshield for the driver and yet act as a chessboard on a passenger window.
Apple goes on to point to a projection controller #102 that may communicate with a projector #114 or other type of image creator. The projector may be any device which projects an image onto a surface. In general, the image may be projected on any surface by the projector, including vertical surfaces, horizontal surface, angled surfaces, rounded surfaces, and the like.
For example, a bright image projector, such as a laser painter, may be utilized by the system #100. In general, the illumination of the image may be bright enough to produce a significant contrast compared to the surrounding medium, through the use of high intensity, and/or colored lights.
These illumination sources include visible light laser sources which can rapidly paint shapes faster than they eye can process, or high illuminance projectors which can focus an image at various distances.
In one particular implementation, a direct scan laser device or devices may form an image by reflecting laser beams off of a fast tip-tilt Micro-Electro-Mechanical System (MEMS) mirror which can scan through the angular area of an image faster than a human can perceive the motion.
The system can use an external network (#104) to access the internet and have headline news be projected onto a surface be it the windshield or back of a car seat where the driver or passengers can obtain information about maps, routes and annoying ads from nearby stores. Let's hope the latter feature is optional.
Apple later notes that the driver will be able to call on Siri change the windshield interface with information that they need or want at any given moment.
Apple's patent Figure 2 below is a flowchart of a method for a vehicle to project an interactive scene onto a surface for interaction with a user of the projection system.
Apple's patent Figure 3 is a diagram illustrating projecting a welcoming interactive scene from a vehicle; Figure 4 is a diagram illustrating projecting an access interface interactive scene from a vehicle; Figure 5 is a diagram illustrating projecting a game interface interactive scene from a vehicle.
Apple further notes that based on one or more user inputs (such as user gestures received at the system), the projected scene may be altered or new scenes may be projected.
In addition, control over some aspects of the vehicle (such as unlocking of doors, starting of the motor, etc.) may be controlled through the interactive scene and the detected gestures of the users. Thus, through the projection of the interactive scene and the detection of a user's engagement with the scene, a user experience with a vehicle or other projection system may be provided.
Elaborating on patent FIG. 3 noted above, Apple notes that messages may include any image and/or may be projected onto any surface. In addition to the welcome interactive scene #304, other welcoming scenarios are also contemplated.
For example, one initial interactive scene may include a red carpet image. The red carpet image may unfurl or otherwise be animated as the identified user approaches the vehicle. In addition, as the identified user interacts with the scene 304, the interactive scene may be altered. For example, as the person walks on the projected carpet surface, the projected image may interact with the person or sound effects may be emitted from the vehicle.
Such interactions may include sparks or other dynamic animations at or near the user's feet during a step or sound effects of cheering people or flashing lights may be activated.
In Apple's FIG. 9 below, the projection controller is integrated with or otherwise associated with an autonomous vehicle or other type of vehicle to interact with a user of the vehicle.
Security Scenario
In a security scenario, Apple states that as the passengers or drivers are detected by the projection system the projection system may activate one or more security features, such as sending an indication of the passenger's position to the vehicle at which time the doors of the vehicle may be locked.
In this manner, the vehicle may automatically lock the doors by detecting the location of a user in relation to the projected interactive scene with no other indication or action of the user.
In addition, a particular gesture or command provided by the driver or passenger may initiate an emergency activation or any other security feature.The emergency sequence may include one or more flashing lights on the vehicle or in a projected image, one or more emitted sounds or alarms, and/or the activation of a video recorder to capture images surrounding the vehicle.
Apple's patent application was filed back in August 2017 and published by the World Intellectual Property Organization (WIPO) February 22, 2018. Considering that this is a patent application, the timing of such a product to market is unknown at this time.
Some of Apple's inventors include: Apple's Manager, Special Projects Engineering Program Bivin Varghese; Mira Mistra, Technologist; Clarisse Mazuir, Technologist; Malcolm Northcott; Sensor Systems Engineer; Albert Golko, Product Development Engineering Director; and Mike Cretella, Engineering Manager.