10. Theia: API for Diabetic Retinopathy Screening
Open API and Documentation
theia.media.mit.edu
Drag and Drop Web Demo
Swedish et al
11. Visual Urban Sensing
Naik, Glaeser, Hidalgo, Raskar (email: naik@mit.edu)
Crowdsourcing
Computer Vision
+
3.6/10
Sentiment Analysis
for Street-level Images
Quantifying Urban Change
Applications: Real estate, Data-driven urban policy and planning
Decline
Improvement
streetscore.media.mit.edu
How to use computer vision
and crowdsourcing to
evaluate the appearance of
cities across the world
at street-level resolution and
global scale?
12. Smartphone spectroscopy for consumer applications
Rechargeable battery
Arduino pro mini Bluetooth module
Spectrometer chip
LED
FilterLight switch
Power switch
Application in rapid testing of food quality: Chlorophyll fluorescence in fruits
Anshuman Das, Akshat Wahi, Ishan Kothari and Ramesh Raskar
13. Hand-held 3D Imager for biomedical applications
3D imaging of throat and tonsils for
evaluation of obstructive sleep apnea
Anshuman Das, Tulio Valdez, Ramesh Raskar et. Al.,
Biomed. Opt. Express 7, 1445-1457 (2016)
3D imaging of the tympanic membrane
for accurately detecting ear infections
Anshuman Das, Julio Estrada, Ramesh Raskar et. Al.,
Proc. SPIE, 9303, 93031F (2015)
41. Real-time Localization
Imaging Real Time Localization
Kadambi, Zhao, Shi, Raskar. "Occluded Imaging with Time of Flight Sensors." ACM ToG
2016 (Pres. at SIGGRAPH)
50. Application: Fluorescence Lifetime Imaging
ToF Imaging : Relative Phase Ecodes Distance Info
FLIM : Relative Phase Ecodes Lifetime Info
Probing Function
Response
Time Domain FLIM
ToF Imaging
FLIM Imaging
Frequency Domain FLIM
Excitation Fluorescence
Lifetime
Parameterizes Lifetime
51. Application: Fluorescence Lifetime Imaging
Bhandari, Barsi, Raskar, 2016
Blind and reference-free fluorescence lifetime
estimation via consumer time-of-flight sensors
52. Location + Fluoro Lifetime Behind Diffuser
Satat et al. Nature Comm (2015)
Bhandari et al. 2015
53. Imaging Behind Thick Scattering Media
1.5cm
Thick
Diffuser
Hidden Scene Reconstruction with ToF
Satat et al. “Imaging Through Thick Medium Using Time-Resolved Measurement” COSI (2015)
My work involves creative new ways to play with light by co-designing optical and digital processing.
My work lies at the INTERSECTION of processing of photons and processing of bits.
At MERL, I transformed the field of computational photography, with key papers and impact on products
At Media Lab, I invented a new field ‘computational light transport’
If I turn this laser point ON and OFF in a trillionth of a second .. i.e. in a few femto-second ..
I will create a packate of photons ..
less than a milimeter long ..
Bullet of light .. Traveling a million times faster than ord bullet
What if we send this bullet of photons to shatter into this bottle
How does light look in slow motion
The whole sequence is less than a nanosecond stretched to about 10 seconds i.e. 10 billion times slowed down
If an oridinary bullet, same distance at such a slow motion video, do you know how long you will have to sit here to watch the movie? A day, a week .. a whole year .. it will be a very boring movie ..
Clean_coke_mulSlow2v1.mov
so we have to use a stroboscopic sampling method to fire the bullet millions of times and do clever sync and record raw data, and use computational techniques to to weave together femto-video.
World’s fastest videos
Same photo about 10 million times to get enough photons
World’s fastest slowest camera ..
Superman can fly and heroes can becomes invisible .. But what about a new power for a future super-hero ..
To see around corners ..
My idea is to use the multiple bounces of light i.e. echoes of light.
Echoes of sound -> Echoes of light
We all know about echoes of sound.
But sounds travels slow and we can actually hear the echoes
Light travels fast so we need specialized hardware to ‘listen’ to these echoes.
So we end up using light sources and cameras that run at a trillion frames per second (not a million and not a billion, but trillion)
And to see deep inside the body with endoscopes that look in narrow channels in lungs
Or colons
Colonoscopy/cardioscopy
Provide oral health solutions via a tooth brush that takes achieves x-ray like screening
Ancient text witout damaging books
How can we drive on foggy, crowded streets
As if it is a sunny day on a clear road