Apple's Imaging & Sensing Team behind the TrueDepth Camera Invents a SPAD Detector with Modulated Sensitivity
Today the US Patent & Trademark Office published a patent application from Apple titled "SPAD Detector Having Modulated Sensitivity" that relates to SPAD detectors, i.e., light detectors using single-photon avalanche diodes (SPADs). More particularly, the present embodiments relate to various techniques for modulating the sensitivity of a SPAD detector.
Some of Apple's top camera engineers reside in Apple's imaging and sensing group in Israel where the TrueDepth camera technology was invented starting with PrimeSense. This multi-disciplinary group of engineers is responsible for architecture, design, and development of these highly complex sensing systems for all Apple products. One of the engineers listed on today's patent application is Tal Kaitz, who is listed as "Algorithm team leader."
Two other engineers listed on today's patent include: Andrew McMahon, Camera Architecture & Sensing Silicon Designer with his specialties including CMOS image sensor design, digital design (RTL through GDSII), camera design; and Thierry Oggier with experience in 3D imaging, camera development, depth sensor camera technologies, pixel technologies and more.
On the web we find that "A single photon is the indivisible minimum energy unit of light, and therefore, detectors with the capability of single-photon detection are ultimate tools for weak light detection. So far, single-photon detectors (SPDs) have been widely used in numerous applications such as quantum communication, quantum information processing, Lidar and photoluminescence.
Most near-infrared SPDs can be sorted into three principal categories of devices: photomultiplier tubes, superconducting devices and semiconductor single-photon avalanche diodes (SPADs). Apart from these devices, there are also some new technologies for single-photon detection such as quantum-dot optically gated field-effect transistor3 and quantum dot resonant tunneling diodes. Up-conversion detectors combining the nonlinear optical process of sum frequency generation and Si SPADs are still considered to belong to semiconductor devices."
In today's patent application, Apple notes that SPAD detectors are utilized in a variety of applications, such as low-light detection applications, time-of-flight (TOF) applications, and time-correlated single photon counting applications.
Apple's patent FIG. 1 above shows one example of a system that includes one or more SPAD detectors; FIG. 2, which Apple highlights, depicts one example of a line scan system; FIG. 18 shows a block diagram of a pixel array having a sensitivity that can be modulated.
Apple notes that there are issues with how SPADs function today and their invention describes their effort to modulate the sensitivity of a single-photon avalanche diode (SPAD) detector over time.
In one aspect, Apple's team notes that their invention covers a SPAD detector has an array of SPAD pixels that includes a reference sub-array and an imaging sub-array. A method for operating the pixel array includes detecting a time to enable an operation of an imaging SPAD in the imaging sub-array using a reference SPAD in the reference sub-array, and in response to detecting the time, enabling the operation of the imaging SPAD such that the imaging SPAD detects photons.
A non-uniform histogram is then constructed based on a time of flight of each detected photon. The non-uniform histogram includes a first bin that represents a first span of time, and a second bin that represents a different second span of time. The first bin provides the SPAD detector with a first sensitivity to photons and the second bin a second sensitivity to photons that is different from the first sensitivity.
Unless you're familiar with this technology, today's patent filing is a very difficult read. For engineers in this field who eat bolts and diodes for breakfast, check out Apple's full patent application / invention here.
For the rest of us, it's clear that Apple's imaging and sensing group in Israel is doing some amazing work advancing Apple's TrueDepth Camera and preparing to take it to the next level which could eventually lead to introducing in-air gesturing commands and beyond.
The collage of photos above came from Apple's Israeli facility via one of Apple's Engineers
Patently Apple presents a detailed summary of patent applications and/or granted patents with associated graphics for journalistic news purposes as each such patent application is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent application should be read in its entirety for full and accurate details. About Making Comments on our Site: Patently Apple reserves the right to post, dismiss or edit any comments. Those using abusive language or negative behavior will result in being blacklisted on Disqus.