SlideShare a Scribd company logo
13/08/15
1
A	
  Short(er)	
  
Introduc0on	
  To	
  
Deep	
  Learning	
  
Dr.	
  Brian	
  Mac	
  Namee	
  
University	
  College	
  Dublin	
  
13/08/15
2
Deep Learning
Google Trends: http://www.google.com/trends/
2005 2007 2009 2011 2013 2015
Kaggle Digit Recogniser Contest
https://www.kaggle.com/c/digit-recognizer
MNIST Dataset from Yan LeCun
http://yann.lecun.com/exdb/mnist/index.html
13/08/15
3
The standard approach to using machine learning
to build a system to recognise these different digits
is to first engineer a high-level respresentation
Percent filled: 0.37
Number of loops: 2
Direction 0: 0.2
Direction 1: 0.6
Direction 2: 0.1
Direction 3: 0.4
Percent filled: 0.11
Number of loops: 0
Direction 0: 0.1
Direction 1: 0.4
Direction 2: 0.0
Direction 3: 0.5
0
1
2
3
Percent filled: 0.29
Number of loops: 1
Direction 0: 0.2
Direction 1: 0.5
Direction 2: 0.4
Direction 3: 0.2
The standard approach to using machine learning
to build a system to recognise these different digits
is to first engineer a high-level respresentation
Percent filled: 0.37
Number of loops: 2
Direction 0: 0.2
Direction 1: 0.6
Direction 2: 0.1
Direction 3: 0.4
Percent filled: 0.11
Number of loops: 0
Direction 0: 0.1
Direction 1: 0.4
Direction 2: 0.0
Direction 3: 0.5
0
1
2
3
Percent filled: 0.29
Number of loops: 1
Direction 0: 0.2
Direction 1: 0.5
Direction 2: 0.4
Direction 3: 0.2
Using this reperesentation (6 features) we could
train a decision tree that would manage to correctly
recognise about 8 out of every 10 digits
13/08/15
4
Engineering	
  representa0ons,	
  is	
  one	
  of	
  the	
  most	
  
important	
  and	
  >me	
  consuming	
  jobs	
  in	
  most	
  
predic>ve	
  analy>cs	
  projects,	
  and	
  needs	
  a	
  blend	
  of	
  
technical	
  exper>se	
  and	
  domain	
  exper>se	
  
	
  
	
  
Representa0on	
  learning	
  is	
  a	
  set	
  of	
  methods	
  that	
  
allows	
  a	
  machine	
  to	
  be	
  fed	
  with	
  raw	
  data	
  and	
  to	
  
automa>cally	
  discover	
  the	
  representa>ons	
  needed	
  
for	
  detec>on	
  or	
  classifica>on	
  
[LeCun	
  etal,	
  2014]	
  
Deep Learning
Yann LeCun, Yoshua Bengio & Geoffrey Hinton
http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html
Rosenbla='s	
  
perceptron	
  
from	
  1957	
  was	
  
the	
  earliest	
  
example	
  of	
  
representa0on	
  
learning,	
  and	
  
the	
  first	
  neural	
  
network	
  

Recommended for you

Illustrative Introductory CNN
Illustrative Introductory CNNIllustrative Introductory CNN
Illustrative Introductory CNN

An illustrative introduction on CNN. Maybe one of the most visually understandable but precise slide on CNN in your life. I made this slide as an intern in DATANOMIQ Gmbh URL: https://www.datanomiq.de/ *This slide is not finished yet. If you like it, please give me some feedback to motivate me.

deep learningmachine learningcnn
Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...

This document summarizes research on using deep convolutional networks for multi-class image classification on a large dataset from a product image classification Kaggle competition. The dataset contains over 5 million images across 5270 categories. Several CNN models were tested including ResNet, ResNext, DenseNet, and WideResNet. WideResNet achieved the best results with over 40% accuracy, while ResNext was the slowest. Training the models required significant computing resources and time due to the large dataset size. Future work includes submitting results to the Kaggle competition after more training epochs.

computer visionneural networkdeep learning
Build a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flowBuild a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flow

A perfect working model to detect mnist dataset using TensorFlow. Dataset: http://yann.lecun.com/exdb/mnist/ For code check the below GitHub links: https://github.com/Jitudebz/psychic-pancake

13/08/15
5
Each image is composed of
28 x 28 = 784 pixels each
containing a grayscale
value between 0 and 255
13/08/15
6
This low-level representation uses a
vector of 784 features, each with values
between 0 and 255
13/08/15
7
0
1
2
3
4
5
6
7
8
9
A simple
representation learning
approach to the digit
recognition problem
could use a multi-
layer perceptron to
make predictions using
the low-level
representation
0
1
2
3
4
5
6
7
8
9
13/08/15
8
0
1
2
3
4
5
6
7
8
9
This neural network
could manage to
correctly recognise
about 9 out of
every 10 digits
Deep-­‐learning	
  methods	
  are	
  representa0on-­‐
learning	
  methods	
  with	
  mul>ple	
  levels	
  of	
  
representa>on,	
  obtained	
  by	
  composing	
  simple	
  
but	
  non-­‐linear	
  modules	
  that	
  each	
  transform	
  the	
  
representa>on	
  at	
  one	
  level	
  (star>ng	
  with	
  the	
  raw	
  
input)	
  into	
  a	
  representa>on	
  at	
  a	
  higher,	
  slightly	
  
more	
  abstract	
  level.	
  	
  
[LeCun	
  etal,	
  2014]	
  
Deep Learning
Yann LeCun, Yoshua Bengio & Geoffrey Hinton
http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html

Recommended for you

Rsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature ImportanceRsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature Importance

In this talk, Javier Antorán discusses the importance of uncertainty when it comes to ML interpretability. He offers a new uncertainty-based interpretability technique called CLUE and compares it to existing model interpretability techniques in two usability studies. Javier is a Ph.D. student at the University of Cambridge. His research interests include Bayesian deep learning, uncertainty in machine learning, representation learning, and information theory.

explainabilityaimachine learning
Visual cryptography for color images
Visual cryptography for color imagesVisual cryptography for color images
Visual cryptography for color images

This document summarizes research on visual cryptography for encrypting images. It discusses how visual cryptography works by encrypting a secret image into multiple shares such that only combining a sufficient number of shares reveals the secret image. Early schemes worked for binary and grayscale images, while later work extended this to color images. Color images can be encrypted by expanding each pixel into small color subpixels and distributing the color combinations across shares. These schemes allow for encryption and decryption with little computation and without requiring secret keys.

ansarinaorshamir
Handwritten Digit Recognition
Handwritten Digit RecognitionHandwritten Digit Recognition
Handwritten Digit Recognition

The main objective of this paper is to recognize and predict handwritten digits from 0 to 9 where data set of 5000 examples of MNIST was given as input. As we know as every person has different style of writing digits humans can recognize easily but for computers it is comparatively a difficult task so here we have used neural network approach where in the machine will learn on itself by gaining experiences and the accuracy will increase based upon the experience it gains. The dataset was trained using feed forward neural network algorithm. The overall system accuracy obtained was 95.7% Jyoti Shinde | Chaitali Rajput | Prof. Mrunal Shidore | Prof. Milind Rane"Handwritten Digit Recognition" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-2 , February 2018, URL: http://www.ijtsrd.com/papers/ijtsrd8384.pdf http://www.ijtsrd.com/engineering/electronics-and-communication-engineering/8384/handwritten-digit-recognition/jyoti-shinde

electronics & communication engineering
13/08/15
9
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
A deep learning
appraoch could
manage to correctly
recognise about 10
out of every 10
digits
13/08/15
10
Deep	
  neural	
  networks	
  seem	
  to	
  brilliantly	
  address	
  
the	
  selec0vity-­‐invariance	
  dilemma	
  that	
  is	
  
fundamental	
  to	
  all	
  efforts	
  to	
  learn	
  to	
  classify	
  
objects:	
  they	
  produce	
  representa>ons	
  that	
  are	
  
selec>ve	
  to	
  	
  the	
  aspects	
  of	
  the	
  image	
  that	
  are	
  
important	
  for	
  discrimina>on,	
  but	
  that	
  are	
  
invariant	
  to	
  irrelevant	
  aspects	
  
	
  
Deep	
  networks	
  hold	
  records	
  for	
  problems	
  in	
  
image	
  recogni0on,	
  speech	
  recogni0on,	
  and	
  text	
  
classifica0on	
  amongst	
  other	
  areas	
  
Hardware	
  
Data	
  Algorithms	
  
Applica>ons	
  
13/08/15
11
Thank You
Questions?
Fundamentals of Machine
Learning for Predictive Data
Analytics: Algorithms, Worked
Examples, and Case Studies
John D. Kelleher, Brian Mac Namee and
Aoife D'Arcy
www.machinelearningbook.com

More Related Content

What's hot

MNIST and machine learning - presentation
MNIST and machine learning - presentationMNIST and machine learning - presentation
MNIST and machine learning - presentation
Steve Dias da Cruz
 
Facial Emotion Detection Project
Facial Emotion Detection ProjectFacial Emotion Detection Project
Facial Emotion Detection Project
EmilyJoseph18
 
Neural Networks Ver1
Neural  Networks  Ver1Neural  Networks  Ver1
Neural Networks Ver1
ncct
 
Illustrative Introductory CNN
Illustrative Introductory CNNIllustrative Introductory CNN
Illustrative Introductory CNN
YasutoTamura1
 
Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...
Ashis Kumar Chanda
 
Build a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flowBuild a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flow
DebasisMohanty37
 
Rsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature ImportanceRsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature Importance
Alessya Visnjic
 
Visual cryptography for color images
Visual cryptography for color imagesVisual cryptography for color images
Visual cryptography for color images
IIT Delhi
 
Handwritten Digit Recognition
Handwritten Digit RecognitionHandwritten Digit Recognition
Handwritten Digit Recognition
ijtsrd
 
Visual Cryptography in Meaningful Shares
Visual Cryptography in Meaningful SharesVisual Cryptography in Meaningful Shares
Visual Cryptography in Meaningful Shares
Debarko De
 
Convolutional neural network
Convolutional neural networkConvolutional neural network
Convolutional neural network
Itachi SK
 
Visual cryptography scheme for color images
Visual cryptography scheme for color imagesVisual cryptography scheme for color images
Visual cryptography scheme for color images
IAEME Publication
 
Mnist report ppt
Mnist report pptMnist report ppt
Mnist report ppt
RaghunandanJairam
 
Facial keypoint recognition
Facial keypoint recognitionFacial keypoint recognition
Facial keypoint recognition
Akrita Agarwal
 
Image classification with Deep Neural Networks
Image classification with Deep Neural NetworksImage classification with Deep Neural Networks
Image classification with Deep Neural Networks
Yogendra Tamang
 
Fast Algorithms for Quantized Convolutional Neural Networks
Fast Algorithms for Quantized Convolutional Neural NetworksFast Algorithms for Quantized Convolutional Neural Networks
Fast Algorithms for Quantized Convolutional Neural Networks
NECST Lab @ Politecnico di Milano
 
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGESA NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
IJTET Journal
 
Data analytics with python introductory
Data analytics with python introductoryData analytics with python introductory
Data analytics with python introductory
Abhimanyu Dwivedi
 
Visual cryptography1
Visual cryptography1Visual cryptography1
Visual cryptography1
Pratiksha Patil
 
Visual Cryptography
Visual CryptographyVisual Cryptography
Visual Cryptography
AneeshGKumar
 

What's hot (20)

MNIST and machine learning - presentation
MNIST and machine learning - presentationMNIST and machine learning - presentation
MNIST and machine learning - presentation
 
Facial Emotion Detection Project
Facial Emotion Detection ProjectFacial Emotion Detection Project
Facial Emotion Detection Project
 
Neural Networks Ver1
Neural  Networks  Ver1Neural  Networks  Ver1
Neural Networks Ver1
 
Illustrative Introductory CNN
Illustrative Introductory CNNIllustrative Introductory CNN
Illustrative Introductory CNN
 
Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...Multi-class Image Classification using deep convolutional networks on extreme...
Multi-class Image Classification using deep convolutional networks on extreme...
 
Build a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flowBuild a simple image recognition system with tensor flow
Build a simple image recognition system with tensor flow
 
Rsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature ImportanceRsqrd AI - ML Interpretability: Beyond Feature Importance
Rsqrd AI - ML Interpretability: Beyond Feature Importance
 
Visual cryptography for color images
Visual cryptography for color imagesVisual cryptography for color images
Visual cryptography for color images
 
Handwritten Digit Recognition
Handwritten Digit RecognitionHandwritten Digit Recognition
Handwritten Digit Recognition
 
Visual Cryptography in Meaningful Shares
Visual Cryptography in Meaningful SharesVisual Cryptography in Meaningful Shares
Visual Cryptography in Meaningful Shares
 
Convolutional neural network
Convolutional neural networkConvolutional neural network
Convolutional neural network
 
Visual cryptography scheme for color images
Visual cryptography scheme for color imagesVisual cryptography scheme for color images
Visual cryptography scheme for color images
 
Mnist report ppt
Mnist report pptMnist report ppt
Mnist report ppt
 
Facial keypoint recognition
Facial keypoint recognitionFacial keypoint recognition
Facial keypoint recognition
 
Image classification with Deep Neural Networks
Image classification with Deep Neural NetworksImage classification with Deep Neural Networks
Image classification with Deep Neural Networks
 
Fast Algorithms for Quantized Convolutional Neural Networks
Fast Algorithms for Quantized Convolutional Neural NetworksFast Algorithms for Quantized Convolutional Neural Networks
Fast Algorithms for Quantized Convolutional Neural Networks
 
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGESA NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
A NEW VISUAL CRYPTOGRAPHY TECHNIQUE FOR COLOR IMAGES
 
Data analytics with python introductory
Data analytics with python introductoryData analytics with python introductory
Data analytics with python introductory
 
Visual cryptography1
Visual cryptography1Visual cryptography1
Visual cryptography1
 
Visual Cryptography
Visual CryptographyVisual Cryptography
Visual Cryptography
 

Viewers also liked

Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
Josh Patterson
 
Introduction to Deep Learning
Introduction to Deep LearningIntroduction to Deep Learning
Introduction to Deep Learning
Adam Rogers
 
Intro to Machine Learning
Intro to Machine LearningIntro to Machine Learning
Intro to Machine Learning
Corey Chivers
 
Machine learning for dummies
Machine learning for dummiesMachine learning for dummies
Machine learning for dummies
Alexandre Uehara
 
Machine learning for dummies - Azuges November 2016
Machine learning for dummies - Azuges November 2016Machine learning for dummies - Azuges November 2016
Machine learning for dummies - Azuges November 2016
Carlos Landeras Martínez
 
Pybcn machine learning for dummies with python
Pybcn machine learning for dummies with pythonPybcn machine learning for dummies with python
Pybcn machine learning for dummies with python
Javier Arias Losada
 
Deep learning intro
Deep learning introDeep learning intro
Deep learning intro
beamandrew
 
How to Spot a Bear - An Intro to Machine Learning for SEO
How to Spot a Bear - An Intro to Machine Learning for SEOHow to Spot a Bear - An Intro to Machine Learning for SEO
How to Spot a Bear - An Intro to Machine Learning for SEO
Tom Anthony
 
Machine Learning for Dummies
Machine Learning for DummiesMachine Learning for Dummies
Machine Learning for Dummies
Venkata Reddy Konasani
 
Deep Learning through Examples
Deep Learning through ExamplesDeep Learning through Examples
Deep Learning through Examples
Sri Ambati
 

Viewers also liked (10)

Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
Deep Learning Intro - Georgia Tech - CSE6242 - March 2015
 
Introduction to Deep Learning
Introduction to Deep LearningIntroduction to Deep Learning
Introduction to Deep Learning
 
Intro to Machine Learning
Intro to Machine LearningIntro to Machine Learning
Intro to Machine Learning
 
Machine learning for dummies
Machine learning for dummiesMachine learning for dummies
Machine learning for dummies
 
Machine learning for dummies - Azuges November 2016
Machine learning for dummies - Azuges November 2016Machine learning for dummies - Azuges November 2016
Machine learning for dummies - Azuges November 2016
 
Pybcn machine learning for dummies with python
Pybcn machine learning for dummies with pythonPybcn machine learning for dummies with python
Pybcn machine learning for dummies with python
 
Deep learning intro
Deep learning introDeep learning intro
Deep learning intro
 
How to Spot a Bear - An Intro to Machine Learning for SEO
How to Spot a Bear - An Intro to Machine Learning for SEOHow to Spot a Bear - An Intro to Machine Learning for SEO
How to Spot a Bear - An Intro to Machine Learning for SEO
 
Machine Learning for Dummies
Machine Learning for DummiesMachine Learning for Dummies
Machine Learning for Dummies
 
Deep Learning through Examples
Deep Learning through ExamplesDeep Learning through Examples
Deep Learning through Examples
 

Similar to Brian Mac Namee - Predict Webinar 3 - Short Intro to Deep Learing

Convolutional Neural Networks
Convolutional Neural NetworksConvolutional Neural Networks
Convolutional Neural Networks
TayleeGray
 
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
inventionjournals
 
Face Recognition Based Intelligent Door Control System
Face Recognition Based Intelligent Door Control SystemFace Recognition Based Intelligent Door Control System
Face Recognition Based Intelligent Door Control System
ijtsrd
 
Automatic grading of diabetic retinopathy through machine learning
Automatic grading of diabetic retinopathy through machine learning   Automatic grading of diabetic retinopathy through machine learning
Automatic grading of diabetic retinopathy through machine learning
SupriyaKamatgi
 
IRJET- Automated Detection of Gender from Face Images
IRJET-  	  Automated Detection of Gender from Face ImagesIRJET-  	  Automated Detection of Gender from Face Images
IRJET- Automated Detection of Gender from Face Images
IRJET Journal
 
最近の研究情勢についていくために - Deep Learningを中心に -
最近の研究情勢についていくために - Deep Learningを中心に - 最近の研究情勢についていくために - Deep Learningを中心に -
最近の研究情勢についていくために - Deep Learningを中心に -
Hiroshi Fukui
 
Face Detection and Recognition using Back Propagation Neural Network (BPNN)
Face Detection and Recognition using Back Propagation Neural Network (BPNN)Face Detection and Recognition using Back Propagation Neural Network (BPNN)
Face Detection and Recognition using Back Propagation Neural Network (BPNN)
IRJET Journal
 
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
IRJET Journal
 
IRJET - Fake Currency Detection using CNN
IRJET -  	  Fake Currency Detection using CNNIRJET -  	  Fake Currency Detection using CNN
IRJET - Fake Currency Detection using CNN
IRJET Journal
 
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural NetworkTargeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
ijceronline
 
Hand Written Digit Classification
Hand Written Digit ClassificationHand Written Digit Classification
Hand Written Digit Classification
ijtsrd
 
Blood Cell Image Classification for Detecting Malaria using CNN
Blood Cell Image Classification for Detecting Malaria using CNNBlood Cell Image Classification for Detecting Malaria using CNN
Blood Cell Image Classification for Detecting Malaria using CNN
IRJET Journal
 
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
IRJET Journal
 
Deep Learning: concepts and use cases (October 2018)
Deep Learning: concepts and use cases (October 2018)Deep Learning: concepts and use cases (October 2018)
Deep Learning: concepts and use cases (October 2018)
Julien SIMON
 
Neural network based numerical digits recognization using nnt in matlab
Neural network based numerical digits recognization using nnt in matlabNeural network based numerical digits recognization using nnt in matlab
Neural network based numerical digits recognization using nnt in matlab
ijcses
 
Deep learning for pose-invariant face detection in unconstrained environment
Deep learning for pose-invariant face detection in unconstrained environmentDeep learning for pose-invariant face detection in unconstrained environment
Deep learning for pose-invariant face detection in unconstrained environment
IJECEIAES
 
IRJET- Spot Me - A Smart Attendance System based on Face Recognition
IRJET- Spot Me - A Smart Attendance System based on Face RecognitionIRJET- Spot Me - A Smart Attendance System based on Face Recognition
IRJET- Spot Me - A Smart Attendance System based on Face Recognition
IRJET Journal
 
Report face recognition : ArganRecogn
Report face recognition :  ArganRecognReport face recognition :  ArganRecogn
Report face recognition : ArganRecogn
Ilyas CHAOUA
 
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
IJCNCJournal
 
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
IJCNCJournal
 

Similar to Brian Mac Namee - Predict Webinar 3 - Short Intro to Deep Learing (20)

Convolutional Neural Networks
Convolutional Neural NetworksConvolutional Neural Networks
Convolutional Neural Networks
 
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
Face Recognition System Using Local Ternary Pattern and Signed Number Multipl...
 
Face Recognition Based Intelligent Door Control System
Face Recognition Based Intelligent Door Control SystemFace Recognition Based Intelligent Door Control System
Face Recognition Based Intelligent Door Control System
 
Automatic grading of diabetic retinopathy through machine learning
Automatic grading of diabetic retinopathy through machine learning   Automatic grading of diabetic retinopathy through machine learning
Automatic grading of diabetic retinopathy through machine learning
 
IRJET- Automated Detection of Gender from Face Images
IRJET-  	  Automated Detection of Gender from Face ImagesIRJET-  	  Automated Detection of Gender from Face Images
IRJET- Automated Detection of Gender from Face Images
 
最近の研究情勢についていくために - Deep Learningを中心に -
最近の研究情勢についていくために - Deep Learningを中心に - 最近の研究情勢についていくために - Deep Learningを中心に -
最近の研究情勢についていくために - Deep Learningを中心に -
 
Face Detection and Recognition using Back Propagation Neural Network (BPNN)
Face Detection and Recognition using Back Propagation Neural Network (BPNN)Face Detection and Recognition using Back Propagation Neural Network (BPNN)
Face Detection and Recognition using Back Propagation Neural Network (BPNN)
 
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
IRJET- Convolutional Neural Networks for Automatic Classification of Diabetic...
 
IRJET - Fake Currency Detection using CNN
IRJET -  	  Fake Currency Detection using CNNIRJET -  	  Fake Currency Detection using CNN
IRJET - Fake Currency Detection using CNN
 
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural NetworkTargeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
Targeted Visual Content Recognition Using Multi-Layer Perceptron Neural Network
 
Hand Written Digit Classification
Hand Written Digit ClassificationHand Written Digit Classification
Hand Written Digit Classification
 
Blood Cell Image Classification for Detecting Malaria using CNN
Blood Cell Image Classification for Detecting Malaria using CNNBlood Cell Image Classification for Detecting Malaria using CNN
Blood Cell Image Classification for Detecting Malaria using CNN
 
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
IRJET-Multiclass Classification Method Based On Deep Learning For Leaf Identi...
 
Deep Learning: concepts and use cases (October 2018)
Deep Learning: concepts and use cases (October 2018)Deep Learning: concepts and use cases (October 2018)
Deep Learning: concepts and use cases (October 2018)
 
Neural network based numerical digits recognization using nnt in matlab
Neural network based numerical digits recognization using nnt in matlabNeural network based numerical digits recognization using nnt in matlab
Neural network based numerical digits recognization using nnt in matlab
 
Deep learning for pose-invariant face detection in unconstrained environment
Deep learning for pose-invariant face detection in unconstrained environmentDeep learning for pose-invariant face detection in unconstrained environment
Deep learning for pose-invariant face detection in unconstrained environment
 
IRJET- Spot Me - A Smart Attendance System based on Face Recognition
IRJET- Spot Me - A Smart Attendance System based on Face RecognitionIRJET- Spot Me - A Smart Attendance System based on Face Recognition
IRJET- Spot Me - A Smart Attendance System based on Face Recognition
 
Report face recognition : ArganRecogn
Report face recognition :  ArganRecognReport face recognition :  ArganRecogn
Report face recognition : ArganRecogn
 
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
 
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
On The Performance of Intrusion Detection Systems with Hidden Multilayer Neur...
 

Recently uploaded

Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
KAMAL CHOUDHARY
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
Sally Laouacheria
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
Safe Software
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
Aurora Consulting
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
rajancomputerfbd
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
Best Programming Language for Civil Engineers
Best Programming Language for Civil EngineersBest Programming Language for Civil Engineers
Best Programming Language for Civil Engineers
Awais Yaseen
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
shanthidl1
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
Matthew Sinclair
 
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
BookNet Canada
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
Larry Smarr
 
The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
Larry Smarr
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
Measuring the Impact of Network Latency at Twitter
Measuring the Impact of Network Latency at TwitterMeasuring the Impact of Network Latency at Twitter
Measuring the Impact of Network Latency at Twitter
ScyllaDB
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
Stephanie Beckett
 

Recently uploaded (20)

Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
Best Programming Language for Civil Engineers
Best Programming Language for Civil EngineersBest Programming Language for Civil Engineers
Best Programming Language for Civil Engineers
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
 
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
 
The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
Measuring the Impact of Network Latency at Twitter
Measuring the Impact of Network Latency at TwitterMeasuring the Impact of Network Latency at Twitter
Measuring the Impact of Network Latency at Twitter
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
 

Brian Mac Namee - Predict Webinar 3 - Short Intro to Deep Learing

  • 1. 13/08/15 1 A  Short(er)   Introduc0on  To   Deep  Learning   Dr.  Brian  Mac  Namee   University  College  Dublin  
  • 2. 13/08/15 2 Deep Learning Google Trends: http://www.google.com/trends/ 2005 2007 2009 2011 2013 2015 Kaggle Digit Recogniser Contest https://www.kaggle.com/c/digit-recognizer MNIST Dataset from Yan LeCun http://yann.lecun.com/exdb/mnist/index.html
  • 3. 13/08/15 3 The standard approach to using machine learning to build a system to recognise these different digits is to first engineer a high-level respresentation Percent filled: 0.37 Number of loops: 2 Direction 0: 0.2 Direction 1: 0.6 Direction 2: 0.1 Direction 3: 0.4 Percent filled: 0.11 Number of loops: 0 Direction 0: 0.1 Direction 1: 0.4 Direction 2: 0.0 Direction 3: 0.5 0 1 2 3 Percent filled: 0.29 Number of loops: 1 Direction 0: 0.2 Direction 1: 0.5 Direction 2: 0.4 Direction 3: 0.2 The standard approach to using machine learning to build a system to recognise these different digits is to first engineer a high-level respresentation Percent filled: 0.37 Number of loops: 2 Direction 0: 0.2 Direction 1: 0.6 Direction 2: 0.1 Direction 3: 0.4 Percent filled: 0.11 Number of loops: 0 Direction 0: 0.1 Direction 1: 0.4 Direction 2: 0.0 Direction 3: 0.5 0 1 2 3 Percent filled: 0.29 Number of loops: 1 Direction 0: 0.2 Direction 1: 0.5 Direction 2: 0.4 Direction 3: 0.2 Using this reperesentation (6 features) we could train a decision tree that would manage to correctly recognise about 8 out of every 10 digits
  • 4. 13/08/15 4 Engineering  representa0ons,  is  one  of  the  most   important  and  >me  consuming  jobs  in  most   predic>ve  analy>cs  projects,  and  needs  a  blend  of   technical  exper>se  and  domain  exper>se       Representa0on  learning  is  a  set  of  methods  that   allows  a  machine  to  be  fed  with  raw  data  and  to   automa>cally  discover  the  representa>ons  needed   for  detec>on  or  classifica>on   [LeCun  etal,  2014]   Deep Learning Yann LeCun, Yoshua Bengio & Geoffrey Hinton http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html Rosenbla='s   perceptron   from  1957  was   the  earliest   example  of   representa0on   learning,  and   the  first  neural   network  
  • 5. 13/08/15 5 Each image is composed of 28 x 28 = 784 pixels each containing a grayscale value between 0 and 255
  • 6. 13/08/15 6 This low-level representation uses a vector of 784 features, each with values between 0 and 255
  • 7. 13/08/15 7 0 1 2 3 4 5 6 7 8 9 A simple representation learning approach to the digit recognition problem could use a multi- layer perceptron to make predictions using the low-level representation 0 1 2 3 4 5 6 7 8 9
  • 8. 13/08/15 8 0 1 2 3 4 5 6 7 8 9 This neural network could manage to correctly recognise about 9 out of every 10 digits Deep-­‐learning  methods  are  representa0on-­‐ learning  methods  with  mul>ple  levels  of   representa>on,  obtained  by  composing  simple   but  non-­‐linear  modules  that  each  transform  the   representa>on  at  one  level  (star>ng  with  the  raw   input)  into  a  representa>on  at  a  higher,  slightly   more  abstract  level.     [LeCun  etal,  2014]   Deep Learning Yann LeCun, Yoshua Bengio & Geoffrey Hinton http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html
  • 9. 13/08/15 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 A deep learning appraoch could manage to correctly recognise about 10 out of every 10 digits
  • 10. 13/08/15 10 Deep  neural  networks  seem  to  brilliantly  address   the  selec0vity-­‐invariance  dilemma  that  is   fundamental  to  all  efforts  to  learn  to  classify   objects:  they  produce  representa>ons  that  are   selec>ve  to    the  aspects  of  the  image  that  are   important  for  discrimina>on,  but  that  are   invariant  to  irrelevant  aspects     Deep  networks  hold  records  for  problems  in   image  recogni0on,  speech  recogni0on,  and  text   classifica0on  amongst  other  areas   Hardware   Data  Algorithms   Applica>ons  
  • 11. 13/08/15 11 Thank You Questions? Fundamentals of Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies John D. Kelleher, Brian Mac Namee and Aoife D'Arcy www.machinelearningbook.com