HOUSTON – (March 5, 2018) – Lenses are no longer necessary for some microscopes, according to Rice University engineers developing FlatScope, a thin fluorescent microscope whose abilities promise to surpass those of old-school devices.
A paper in Science Advances by Rice engineers Ashok Veeraraghavan, Jacob Robinson, Richard Baraniuk and their labs describes a wide-field microscope thinner than a credit card, small enough to sit on a fingertip and capable of micrometer resolution over a volume of several cubic millimeters.
FlatScope eliminates the tradeoff that hinders traditional microscopes in which arrays of lenses can either gather less light from a large field of view or gather more light from a smaller field.
The Rice team began developing the device as part of a federal initiative by the Defense Advanced Research Projects Agency as an implantable, high-resolution neural interface. But the device's potential is much greater. The researchers claim FlatScope, an advance on the labs' earlier FlatCam, could be used as an implantable endoscope, a large-area imager or a flexible microscope.
"We think of this as amping up FlatCam so it can solve even bigger problems," Baraniuk said.
Traditional fluorescent microscopes are essential tools in biology. They pick up fluorescent signals from particles inserted into cells and tissues that are illuminated with specific wavelengths of light. The technique allows scientists to probe and track biological agents with nanometer-scale resolution.
But like all traditional microscopes, telescopes and cameras, their resolution depends on the size of their lenses, which can be large and heavy and limit their use in biological applications.
The Rice team takes a different approach. It uses the same charge-coupled device (CCD) chips found in all electronic cameras to capture incoming light, but the comparisons stop there. Like the FlatCam project that inspired it, FlatScope's field of view equals the size of the CCD sensor, which can be as large or as small as required. It's flat because it replaces the array of lenses in a traditional microscope with a custom amplitude mask.
This mask, which resembles a bar code, sits directly in front of the CCD. Light that comes through the mask and hits the sensor becomes data that a computer program interprets to produce images.
The algorithm can focus on any part of the three-dimensional data the scope captures and produce images of objects smaller than a micron anywhere in the field.
That resolution is what makes the device a microscope, Robinson said. "A camera in your mobile phone or DSLR typically gets on the order of 100-micron resolution," he said. "When you take a macro photo, the resolution is about 20 to 50 microns.
"I think of a microscope as something that allows you to image things on the micron scale," he said. "That means things that are smaller than the diameter of a human hair, like cells, parts of cells or the fine structure of fibers."
Achieving that resolution required modifications to the FlatCam mask to further cut the amount of light that reaches the sensor as well as a rewrite of their software, Robinson said. "It wasn't as trivial as simply applying the FlatCam algorithm to the same techniques we used to image things that are far away," he said.
The mask is akin to the aperture in a lensed camera that focuses light onto the sensor, but it's only a few hundred micrometers from the sensor and allows only a fraction of the available light to get through, limiting the amount of data to simplify processing.
"In the case of a megapixel camera, that computational problem requires a matrix of a million times a million elements," Robinson said. "It's an incredibly big matrix. But because we break it down through this pattern of rows and columns, our matrix is just 1 million elements."
That cuts the data for each snapshot from six terabytes to a more practical 21 megabytes, which translates to short processing times. From early versions of FlatCam that required an hour or more to process an image, FlatScope captures 30 frames of 3-D data per second.
Veeraraghavan said the burgeoning internet of things may provide many applications for flat cameras and microscopes. That in turn would drive down costs. "One of the big advantages of this technology compared with traditional cameras is that because we don't need lenses, we don't need postfabrication assembly," he said. "We can imagine this rolling off a fabrication line."
But their primary targets are medical uses, from implantable scopes for the clinic to palm-sized microscopes for the battlefield. "To be able to carry a microscope in your pocket is a neat technology," Veeraraghavan said.
The researchers noted that while their current work is focused on fluorescent applications, FlatScope could also be used for bright-field, dark-field and reflected-light microscopy. They suggested an array of FlatScopes on a flexible background could be used to match the contours of a target.
Rice graduate students Jesse Adams and Vivek Boominathan are lead authors of the paper. Co-authors are graduate students Daniel Vercosa and Fan Ye. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering. Robinson is an assistant professor, and Veeraraghavan is an associate professor of electrical and computer engineering.
The National Science Foundation and the Defense Advanced Research Projects Agency funded the research.
Read the open-access paper at http://advances.sciencemag.org/content/3/12/e1701548
This news release can be found online at http://news.rice.edu/2018/03/05/rice-team-designs-lens-free-fluorescent-microscope/
Follow Rice News and Media Relations via Twitter @RiceUNews
Video produced by Brandon Martin/Rice University
Rice team developing flat microscope for the brain: http://news.rice.edu/2017/07/12/rice-team-developing-flat-microscope-for-the-brain-2/
No lens? No problem for FlatCam: http://news.rice.edu/2015/11/23/no-lens-no-problem-for-flatcam-2/
Baraniuk Lab: http://richb.rice.edu
Veeraraghavan Lab: https://www.ece.rice.edu/~av21/
Robinson Lab: http://www.robinsonlab.com
Images for download:
FlatScope is being developed at Rice University for use as a fluorescent microscope able to capture three-dimensional data and produce images from anywhere within the field of view. (Credit: Jeff Fitlow/Rice University)
Rice University graduate students Vivek Boominathan, left, and Jesse Adams set up an experiment with FlatScope, a tiny, lens-less camera they have configured for use as a fluorescent microscope able to capture three-dimensional data and produce images from anywhere within the field of view. (Credit: Jeff Fitlow/Rice University)
FlatScope, developed at Rice University, captures three-dimensional data that passes through a mask and to a fingernail-sized camera chip. It sends that data to a computer that processes it back into an image. The camera may be used as an implantable endoscope, a large-area imager or a flexible microscope. (Credit: Jeff Fitlow/Rice University)
Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation's top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,970 undergraduates and 2,934 graduate students, Rice's undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for quality of life and for lots of race/class interaction and No. 2 for happiest students by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger's Personal Finance. To read "What they're saying about Rice," go to http://tinyurl.com/RiceUniversityoverview.
Related Journal Article