SlideShare a Scribd company logo
Automating Workflow from
Raw Data to Repository:
Collaborative Software Engineering

James F. Bowring
Computer Science Department
College of Charleston

EarthCube End-User Domain Workshop
for Rock Deformation & Mineral Physics
Alexandria VA, 13 November 2013
Roadmap
Background

EarthCube
EARTHTIME as Mainstream Science
Software Chasm
CIRDLES as Mainstream Solution Provider
Thoughts

Questions

13 November 2013

Jim Bowring EarthCube Alexandria

2
Background
College of Charleston: Teaching / Research

Software Design / Engineering / Testing
EarthCube: Governance & Software

EARTHTIME: Collaborator
CIRDLES: PI

13 November 2013

Jim Bowring EarthCube Alexandria

3
13 November 2013

Jim Bowring EarthCube Alexandria

Photo courtesy of C. Frank StarmerJuly 2005
4
EarthCube
Structure
&
Tectonic
s

Geodesy
Solar
Terrestria
l

Aeronom
y

Meteorology
Magnetospheric
Physics
PaleoClimate

Solid and
Aqueous
Geochem
-istry

Space
Weather

Climate &
Large
Scale
Dynamic
s

NCAR
Atmospheric
Chemistr
y

EarthCube
CI

Geobiolo
gy &
Geo Ed &
PaleoenWorkforc
tology
e
Geophysi
Training
Cryosphe
cs &
Sediment
re & Ice
Geody-ology &
Dynamic
namics
Stratis
graphy
Critical
Hydrolog
Zone &
y
Soil
Science
Geomorphology

Bioinformati
cs

Physical
Oceanography
Biologica
l
Oceanography

Biology
Ecosyste
ms

Software
&
Modeling

High Perf
Computin
g

Semantic
s&
Ontologi
es

13 November 2013

Igneous
Petrology
& Volcanology

Marine
Geology

Ocean
Drilling &
Engineering

Chemical
Oceanography
Algorith
ms &
Data
Mining

Ocean
Educatio
n

Marine
Geophysi
cs

Jim Bowring EarthCube Alexandria

5
Goal:
calibrate earth history and develop the
geochronological techniques necessary to produce
high precision dates

Requires:
robust software for data reduction, analysis, and
archiving to support both science and education

13 November 2013

Jim Bowring EarthCube Alexandria

6
EARTHTIME
Software Requirements
open-source applications for full real-time
interactive data reduction and uncertainty
propagation
provide extensible plug-n-play models
provide graphical and statistical tools
produce publication-ready artifacts
automatically capture meta-data

produce a standardized & extensible record
for transport to / from archival databases
13 November 2013

Jim Bowring EarthCube Alexandria

7
Software Chasm
Kelly: domain-independent software
engineering solutions serve to isolate
the scientific-computing community
[IEEE Software 2007]

Wilson: treat scientific software with
scientific rigor
[American Scientist 2006]

13 November 2013

Jim Bowring EarthCube Alexandria

8
CIRDLES
Cyber Infrastructure Research and
Development Lab for the Earth Sciences
CIRDLES.org

Collaborative domain-specific software
engineering research to produce tools that
advance science

13 November 2013

Jim Bowring EarthCube Alexandria

9
Collaborative Development Process

13 November 2013

Jim Bowring EarthCube Alexandria

10
Long Tail Solution

13 November 2013

Jim Bowring EarthCube Alexandria

11
Archive with a Click !

13 November 2013

Jim Bowring EarthCube Alexandria

12
Thoughts:
Automating Workflow
from Raw Data to Repository

EarthCube must serve scientists and science
Collaborative Software / CI Engineering

Long-term support for software products
Less tedium, more science
Semantic Web Open World Assumption
13 November 2013

Jim Bowring EarthCube Alexandria

13
Questions ?

13 November 2013

Jim Bowring EarthCube Alexandria

14

More Related Content

Cyberscience, Software Engineering & Automated Workflows in Geoscience: Perspectivies from EARTHTIME and GeoChron, by Jim Bowring, College of Charleston