ESE Faculty Hosted Talk: “Deep Learned Optical Multiplexing for Microscopy”

Abstract: Fourier ptychographic microscopy is a technique that achieves a high space-bandwidth product, i.e. high resolution and high field-of-view. In Fourier ptychographic microscopy, variable illumination patterns are used to collect multiple low-resolution images. These low-resolution images are then computationally combined to create an image with resolution exceeding that of any single image from the microscope. Due to the necessity of acquiring multiple low-resolution images, Fourier ptychographic microscopy has poor temporal resolution. Our aim is to improve temporal resolution in Fourier ptychographic microscopy, achieving single-shot imaging without sacrificing space-bandwidth product. We use physical preprocessing and example-based super-resolution to achieve this goal by trading off generality of the imaging approach.

In example-based super-resolution, the function relating low-resolution images to their high-resolution counterparts is learned from a given dataset. We take the additional step of optimizing the imaging hardware in order to collect more informative low-resolution images. We show that this “physical preprocessing” allows for improved image reconstruction with deep learning in Fourier ptychographic microscopy.