SlideShare a Scribd company logo
Presented herein is part of my large scale vision of a digital scaffold.
REMOTE SENSING & THE DIGITAL SCAFFOLD
TABLE OF CONTENTS
Digital Scaffold Defined
Remote Sensing Defined
Visible Light Imaging
Intro to the Electromagnetic Spectrum
Multispectral Imaging
Passive vs. Active Sensors
From the Macrocosm to the Microcosm
Game Changing Game Theory
Why Hasn’t This Been Built Before?
Time & Space Visualized
What is “the digital scaffold?”
Topography
Bathymetry
GISImagery
Meteorology
BiofeedbackAcoustic
Flora & Fauna
HUMAN FACTORS
Political
Economic
Social
Media
ART
REMOTE SENSING
(Simplified) Types of
Data That Can Be
Cognitively
intertwined to allow
for new meaning
making and
exploration
Why should we start with visualizing time & space?
Loom : Tapestry
Canvas : Painting
Foundation : Building
How do you visualize time & space?
CREATED CONTENT COLLECTED CONTENT
Built by Hand Built by Sensor
(Remote Sensing)
VS
+
&
Faster to Collect,
Higher Resolution/ Accuracy,
Harder to Process
Defining ‘Remote Sensing:’
REMOTE SENSING
Diagnostic Imaging
Multispectral Imaging
Hyperspectral Imaging
Earth Observation Systems
Photonic Sensing
Etc…
Collected Visual Data
Visualizing time & space starts with what we can SEE
Visible Light: Photography: What is it?
Traditional Photography Digital Photography
USING LIGHT TO CAPTURE A 2D IMAGE
Visible Light: Photography: What is it used for? How has it been used?
Captures a 2D moment in time
Exploration,
Survey,
& Science
Novelty Family
Record
Keeping
Experiential
Record
Keeping
Everything
1800s 1900s 2000s
Visible Light: Photography: Who Uses it & Stores it?
Government,
Science&
Exploration, &
Wealthy
Professional
Industries,
Hobbyists, &
Artists
Stored:
Everyone for
Everything
Note: Video Following Similar Path
Visible Light: Aerial Photography
USING LIGHT TO CAPTURE A 2D IMAGE FROM A HEIGHT
Captures a Bird’s Eye View, Time lapse
Visible Light: Aerial Photography: What is it used for? How has it been used?
Surveillance, Exploration, Science,
Commercial Mapping
Surveillance, ExplorationSurveillance
1800s 1900s 2000s
Drones
Visible Light: Aerial Photography: Who Uses it & Stores it?
Science/Academia,
Government, &
Exploration
Professional
Industries,
Hobbyists, &
Artists
Stored:
Everyone for
Mapping
Visible Light: Photogrammetry—What is it?
Close Range Photogrammetry
(of an object/space)
Aerial Photogrammetry
(of a landscape)
USING PHOTOGRAPH GEOMETRY TO BUILD A 3D MODEL
Visible Light: Photogrammetry—What is it used for?
Cultural Heritage Diagnostics Geospatial Intelligence
Visible Light: Photogrammetry: Who Uses it & Stores it?
Science/Academia,
Government,
Museums,
Exploration
Real Estate
Industry,
Hobbyists, &
Artists
Stored:
Visible Light: Structured Light Scanning (SLS): What is it?
USING CALIBRATED LIGHT PATTERNS TO CREATE A 3D MODEL
High-Resolution SLS Low-Resolution SLS
Visible Light: Structured Light Scanning (SLS): What is it used for?
Object/Space
Recognition in Gaming
Diagnostic Imaging
Science/Academia,
Museums
Gaming Industry,
Hobbyists, &
Artists
Stored:
Visible Light: Structured Light Scanning (SLS): Who uses it? Who stores the data
Visible Light: Terrestrial Light Detection & Ranging (tLiDAR): What is it?
USING LIGHT TO CAPTURE A 3D SPATIAL ‘IMAGE’
(aka Laser Scanning, Linear mode)
Visible Light: Terrestrial Light Detection & Ranging (tLiDAR): What is it used for?
High resolution imaging of interiors and exteriors, natural and man-made
Industry
(Mining &
Manufacturing),
Exploration
Science/Academia,
Structural Engineering
(Building Information
Modelling (BIM))
Stored:
Visible Light: Terrestrial Light Detection & Ranging (tLiDAR): What is it used for?
Visible Light: Aerial LiDAR (aLiDAR): What is it?
USING LIGHT TO CAPTURE A 3D IMAGE FROM A HEIGHT
Landscape imaging
Visible Light: Aerial LiDAR (aLiDAR): What is it used for?
Government
Surveillance,
Exploration
Science/Academia,
Real Estate Industry, BIM
Stored:
Visible Light: Aerial LiDAR (aLiDAR): What uses it? Who stores it?
Visible Light: Geiger LiDAR (gLiDAR): What is it?
USING LIGHT TO CAPTURE A 3D IMAGE FROM A HEIGHT
(BUT FASTER, DENSER)
Visible Light: Geiger LiDAR (gLiDAR): What is it used for?
USING LIGHT TO CAPTURE A 3D IMAGE FROM A HEIGHT
(DENSER, FASTER, USES LESS POWER)
Government &
Government
Related Industry
Stored:
Visible Light: Geiger LiDAR (gLiDAR): Who uses it? Who stores the data?
Visible Light: Single-photon LiDAR: What is it?
USING LIGHT TO CAPTURE A
3D IMAGE FROM A HEIGHT
(BUT FASTER, DENSER,
USES LESS ENERGY)
Visible Light: Single-photon LiDAR: What is it used for?
USING LIGHT TO CAPTURE A 3D IMAGE FROM A HEIGHT
(DENSER, FASTER, USES EVEN LESS POWER)
Government &
Government
Related Industry
Stored:
Visible Light: Single-photon LiDAR: Who uses it? Who stores the data?
Need some of their powers combined….
2001: English Heritage
2016: Tanzle
All of this represents the visible—but what
about the invisible?
Intro to the rest of the electromagnetic spectrum, active vs. passive sensing
Multispectral vs hyperspectral imaging
Multispectral Imaging in Action:
Seeing Beyond The Visible: X-Radiation (X-Rays)
• CT Scans (computerized tomography)
• PET Scans (position emission tomography)
• SPECT (single photon emission computed tomography)
Seeing Beyond The Visible: X-Ray: Tomography (consider it a 3D X-ray)
Seeing Beyond The Visible: Radio Waves: Magnetic Resonance Imaging (MRI/fMRI)
(partial radio waves to make an organic “x-ray”)
Seeing Beyond The Visible: Radio Waves: Synthetic Aperture Radar (SAR)
Seeing Beyond The Visible: Radio Waves: Ground Penetrating Radar (GPR)
Seeing Beyond The Visible: Ultrasound
Seeing Beyond The Visible: Ultrasound: Sonar
(Side-Scan Sonar & Multibeam EchoSounders (MBES)  most bathymetry)
Seeing Beyond The Visible: Infrared: Thermography
Seeing Beyond The Visible: Earth Observation Systems (satellites)
Seeing Beyond The Visible: Space Telescopes
This is just part of the macrocosm.
It also extends to the
microcosm…
• TEM transmission electron microscopes
• SEM Scanning electron microscopes
• WMF wide field microscopes
• LSCSM laser scanning confocal microscopy
• Structured illumination microscopy
• Atomic force microscopy
• Fourier Transform Infrared Spectroscopy (FTIR)
• X-Ray Fluorescence (XRF)
The Rise of Sensors: The IoT to the IoE
Cognitively Intertwined Digital Scaffold + streaming “Big Data” =
my version of the ultimate bigger, better, meaning making-system
Game Changer for Game Theory
Better, Informed Decision Making
Why hasn’t this been built before?: Outlining Challenges
Access, Sensor, Storage, & Processing….
Lack of interdisciplinary cooperation for
building better systems
Lack of pipeline awareness
THERE’S A NEED FOR BIGGER,
BETTER, ERGONOMIC SYSTEMS
OF DATA INTEGRATION---
SO LET’S GO BUILD THEM

More Related Content

Remote Sensing and the Digital Scaffold