1
|
Zuo J, Bai J, Choi S, Basiri A, Chen X, Wang C, Yao Y. Chip-integrated metasurface full-Stokes polarimetric imaging sensor. LIGHT, SCIENCE & APPLICATIONS 2023; 12:218. [PMID: 37673857 PMCID: PMC10482842 DOI: 10.1038/s41377-023-01260-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 07/27/2023] [Accepted: 08/09/2023] [Indexed: 09/08/2023]
Abstract
Polarimetric imaging has a wide range of applications for uncovering features invisible to human eyes and conventional imaging sensors. Chip-integrated, fast, cost-effective, and accurate full-Stokes polarimetric imaging sensors are highly desirable in many applications, which, however, remain elusive due to fundamental material limitations. Here we present a chip-integrated Metasurface-based Full-Stokes Polarimetric Imaging sensor (MetaPolarIm) realized by integrating an ultrathin (~600 nm) metasurface polarization filter array (MPFA) onto a visible imaging sensor with CMOS compatible fabrication processes. The MPFA is featured with broadband dielectric-metal hybrid chiral metasurfaces and double-layer nanograting polarizers. This chip-integrated polarimetric imaging sensor enables single-shot full-Stokes imaging (speed limited by the CMOS imager) with the most compact form factor, records high measurement accuracy, dual-color operation (green and red) and a field of view up to 40 degrees. MetaPolarIm holds great promise to enable transformative applications in autonomous vision, industry inspection, space exploration, medical imaging and diagnosis.
Collapse
Grants
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 2048230 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- 1809997 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- ECCS-1542160 NSF | ENG/OAD | Division of Electrical, Communications and Cyber Systems (ECCS)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
- DE-EE0008999 DOE | Advanced Research Projects Agency - Energy (Advanced Research Projects Agency - Energy - U.S. Department of Energy)
Collapse
Affiliation(s)
- Jiawei Zuo
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
| | - Jing Bai
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
| | - Shinhyuk Choi
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
| | - Ali Basiri
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
| | - Xiahui Chen
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
| | - Chao Wang
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA
- Biodesign Center for Molecular Design and Biomimetics, Arizona State University, 85281, Tempe, AZ, USA
| | - Yu Yao
- School of Electrical, Computer and Energy Engineering, Arizona State University, 85281, Tempe, AZ, USA.
- Center for Photonic Innovation, Arizona State University, 85281, Tempe, AZ, USA.
| |
Collapse
|
4
|
Harris CR, Millman KJ, van der Walt SJ, Gommers R, Virtanen P, Cournapeau D, Wieser E, Taylor J, Berg S, Smith NJ, Kern R, Picus M, Hoyer S, van Kerkwijk MH, Brett M, Haldane A, Del Río JF, Wiebe M, Peterson P, Gérard-Marchant P, Sheppard K, Reddy T, Weckesser W, Abbasi H, Gohlke C, Oliphant TE. Array programming with NumPy. Nature 2020; 585:357-362. [PMID: 32939066 PMCID: PMC7759461 DOI: 10.1038/s41586-020-2649-2] [Citation(s) in RCA: 4369] [Impact Index Per Article: 873.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Accepted: 06/17/2020] [Indexed: 12/27/2022]
Abstract
Array programming provides a powerful, compact and expressive syntax for accessing, manipulating and operating on data in vectors, matrices and higher-dimensional arrays. NumPy is the primary array programming library for the Python language. It has an essential role in research analysis pipelines in fields as diverse as physics, chemistry, astronomy, geoscience, biology, psychology, materials science, engineering, finance and economics. For example, in astronomy, NumPy was an important part of the software stack used in the discovery of gravitational waves1 and in the first imaging of a black hole2. Here we review how a few fundamental array concepts lead to a simple and powerful programming paradigm for organizing, exploring and analysing scientific data. NumPy is the foundation upon which the scientific Python ecosystem is constructed. It is so pervasive that several projects, targeting audiences with specialized needs, have developed their own NumPy-like interfaces and array objects. Owing to its central position in the ecosystem, NumPy increasingly acts as an interoperability layer between such array computation libraries and, together with its application programming interface (API), provides a flexible framework to support the next decade of scientific and industrial analysis. NumPy is the primary array programming library for Python; here its fundamental concepts are reviewed and its evolution into a flexible interoperability layer between increasingly specialized computational libraries is discussed.
Collapse
Affiliation(s)
| | - K Jarrod Millman
- Brain Imaging Center, University of California, Berkeley, Berkeley, CA, USA. .,Division of Biostatistics, University of California, Berkeley, Berkeley, CA, USA. .,Berkeley Institute for Data Science, University of California, Berkeley, Berkeley, CA, USA.
| | - Stéfan J van der Walt
- Brain Imaging Center, University of California, Berkeley, Berkeley, CA, USA. .,Berkeley Institute for Data Science, University of California, Berkeley, Berkeley, CA, USA. .,Applied Mathematics, Stellenbosch University, Stellenbosch, South Africa.
| | | | - Pauli Virtanen
- Department of Physics, University of Jyväskylä, Jyväskylä, Finland.,Nanoscience Center, University of Jyväskylä, Jyväskylä, Finland
| | | | - Eric Wieser
- Department of Engineering, University of Cambridge, Cambridge, UK
| | | | - Sebastian Berg
- Berkeley Institute for Data Science, University of California, Berkeley, Berkeley, CA, USA
| | | | | | - Matti Picus
- Berkeley Institute for Data Science, University of California, Berkeley, Berkeley, CA, USA
| | | | - Marten H van Kerkwijk
- Department of Astronomy and Astrophysics, University of Toronto, Toronto, Ontario, Canada
| | - Matthew Brett
- Brain Imaging Center, University of California, Berkeley, Berkeley, CA, USA.,School of Psychology, University of Birmingham, Edgbaston, Birmingham, UK
| | - Allan Haldane
- Department of Physics, Temple University, Philadelphia, PA, USA
| | | | - Mark Wiebe
- Department of Physics and Astronomy, The University of British Columbia, Vancouver, British Columbia, Canada.,Amazon, Seattle, WA, USA
| | - Pearu Peterson
- Quansight, Austin, TX, USA.,Independent researcher, Saue, Estonia.,Department of Mechanics and Applied Mathematics, Institute of Cybernetics at Tallinn Technical University, Tallinn, Estonia
| | - Pierre Gérard-Marchant
- Department of Biological and Agricultural Engineering, University of Georgia, Athens, GA, USA.,France-IX Services, Paris, France
| | - Kevin Sheppard
- Department of Economics, University of Oxford, Oxford, UK
| | - Tyler Reddy
- CCS-7, Los Alamos National Laboratory, Los Alamos, NM, USA
| | - Warren Weckesser
- Berkeley Institute for Data Science, University of California, Berkeley, Berkeley, CA, USA
| | | | - Christoph Gohlke
- Laboratory for Fluorescence Dynamics, Biomedical Engineering Department, University of California, Irvine, Irvine, CA, USA
| | | |
Collapse
|
6
|
Lupsasca A, Kapec D, Shi Y, Gates DEA, Strominger A. Polarization whorls from M87* at the event horizon telescope. Proc Math Phys Eng Sci 2020; 476:20190618. [PMID: 32523409 DOI: 10.1098/rspa.2019.0618] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2019] [Accepted: 04/09/2020] [Indexed: 11/12/2022] Open
Abstract
The event horizon telescope (EHT) is expected to soon produce polarimetric images of the supermassive black hole at the centre of the neighbouring galaxy M87. There are indications that this black hole is rapidly spinning. General relativity predicts that such a high-spin black hole has an emergent conformal symmetry near its event horizon. In this paper, we use this symmetry to analytically predict the polarized near-horizon emissions to be seen at the EHT and find a distinctive pattern of whorls aligned with the spin.
Collapse
Affiliation(s)
- Alexandru Lupsasca
- Center for the Fundamental Laws of Nature, Harvard University, Cambridge, MA 02138, USA.,Society of Fellows, Harvard University, Cambridge, MA 02138, USA
| | - Daniel Kapec
- Center for the Fundamental Laws of Nature, Harvard University, Cambridge, MA 02138, USA.,School of Natural Sciences, Institute for Advanced Study, Princeton, NJ 08540, USA
| | - Yichen Shi
- Center for the Fundamental Laws of Nature, Harvard University, Cambridge, MA 02138, USA
| | - Delilah E A Gates
- Center for the Fundamental Laws of Nature, Harvard University, Cambridge, MA 02138, USA
| | - Andrew Strominger
- Center for the Fundamental Laws of Nature, Harvard University, Cambridge, MA 02138, USA
| |
Collapse
|
11
|
Obuchi T, Ikeda S, Akiyama K, Kabashima Y. Accelerating cross-validation with total variation and its application to super-resolution imaging. PLoS One 2017; 12:e0188012. [PMID: 29216215 PMCID: PMC5720762 DOI: 10.1371/journal.pone.0188012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2016] [Accepted: 10/30/2017] [Indexed: 11/19/2022] Open
Abstract
We develop an approximation formula for the cross-validation error (CVE) of a sparse linear regression penalized by ℓ1-norm and total variation terms, which is based on a perturbative expansion utilizing the largeness of both the data dimensionality and the model. The developed formula allows us to reduce the necessary computational cost of the CVE evaluation significantly. The practicality of the formula is tested through application to simulated black-hole image reconstruction on the event-horizon scale with super resolution. The results demonstrate that our approximation reproduces the CVE values obtained via literally conducted cross-validation with reasonably good precision.
Collapse
Affiliation(s)
- Tomoyuki Obuchi
- Department of Mathematical and Computing Science/Tokyo Institute of Technology, Yokohama 226-8502, Japan
- * E-mail:
| | - Shiro Ikeda
- The Institute of Statistical Mathematics, Tachikawa, Tokyo, 190-8562, Japan
| | - Kazunori Akiyama
- Haystack Observatory/Massachusetts Institute of Technology, Westford, MA, 01886, United States of America
- National Astronomy Observatory of Japan, Osawa 2-21-1, Mitaka, Tokyo 181-8588, Japan
- Black Hole Initiative, Harvard University, Cambridge, MA, 02138, United States of America
| | - Yoshiyuki Kabashima
- Department of Mathematical and Computing Science/Tokyo Institute of Technology, Yokohama 226-8502, Japan
| |
Collapse
|