The invention is part of Apple's acquisition of Flyby Media, one of the inventors of the patent is Oriel Bergig, who earned a Ph.D. in computer vision and augmented reality at Ben Gurion University in Israel.As Apple unveiled ARKit and the original Deep TrueDepth Camera, which we know is one of the first patents they developed for the AR project.
Other sample sketches for composition, such as in a 3D AR scene based on the In-Place Augmented Reality method, are shown in Figure 8. Figure 11 is an additional sample image that includes embedded AR content for assembly of instructions, This embedded content is shown in a 3D AR scene based on the In-Place Augmented Reality method.
More specifically, Figure 11 represents an embedded AR assembly instruction for a piece of furniture, such as a kitchen table, which will be presented in a 3D AR scenario according to the In-Place AR method.
As part of its patenting background, Apple discussed 4D barcodes and a ARToolKit repository (maintained by the Human Interface Technology Laboratory at the University of Washington), a software library for building AR applications that further described the use of these barcodes in PlayStation and Game Boy games.
The newly granted apple patent number is 9,824,495, while Apple initially filed its patent application in the first quarter of 2010 and was officially announced today by the U.S. Patent and Trademark Office.