SlideShare a Scribd company logo
Bridging Realities
With WebXR and Web Bluetooth
Peter O’Shaughnessy + Diego González
+
@samsunginternet
Здраво
Peter
@poshaughnessy
Diego
@diekus
• ChromiumBased
• Evergreen browser
• Android L +
Source: http://gs.statcounter.com/browser-market-share/mobile/worldwide
54.95% 17.27% 13.38% 5.09%
The Physical andDigital worlds are
merging
Virtual Reality
Bridging Realitites
VR is out of
the Hype
Cycle
-John Root
bit.ly/xr-not-just-games
“Just about every vehicle you've
occupied in the last two decades was
prototypedin VR”
Jaron Lanier
“Walmart is putting 17,000 VR
headsets in its stores for training”
The Verge
Augmented &
Mixed Reality
Headset-based Mobile-based
Hololens
Magic Leap
North Star
ARKit (iOS)
ARCore (Android)
ARCore and ARKit
• Positionaltracking
• Surfacedetection
• Light estimation
• Objectdetection(ARKit2)
• Persistent& shareable(ARKit2)
Bridging Realitites
Bridging Realitites
VR + AR + MR = XR
Internet of Things
10 million Bluetooth
enabled devices shipping
every day
ABI Research
Smart Everything
Your smartphone is becoming a remote
control for thereal world
XR + IoT
XR can help us understand our
“big data”
bit.ly/xr-big-data
“VR is amazing at conveying
complexity with lucidity”
Jaron Lanier
bit.ly/artik-bridge
VR Tranquilitie
bit.ly/vr-tranq
AR can enhance the real world with
key data and controls in realtime
Bridging Realitites
What aboutthe web?
The web is the most wide-reaching
platform
Web techis familiar
HTML
JavaScript
CSS
69.8%
68.5%
65.1%
Top 3 most popular technologies – Stack Overflow Developer Survey
2018
The web lets you dive rightin
Source: https://www.blog.google/products/google-ar-vr/augmented-reality-web-everyone/
Progressive Enhancement
web
This specification describes support for
accessing virtual reality (VR) and augmented
reality (AR) devices, including sensors and
head-mounted displays, on the Web
XR
Dance Tonite
LCD SoundSystem /
Google
A-Painter
Mozilla
Toyota Australia
Dr. Who Time
Travel
BBC / goodboy
Ford Expedition
WebVR is already here
WebVR browser support
WebAR is coming.
We can experiment now.
Camera access
since ~2012
(getUserMedia)
“We’re going from computers with
cameras… to computers with eyes, that can
see”
Benedict Evans
AR.js
What about ARCore / ARKit for the
web?
• three.ar.js fromGoogle
• three.xr.js from Mozilla
• aframe-xr from Mozilla
*
What about the web and IoT?
Bridging Realitites
Bridging Realitites
Web of Things
Project Things from Mozilla
iot.mozilla.org
Web Bluetooth
web
The first version of this specification allows web
pages, running on a UA in the Central role, to
connect to GATT Servers over either a BR/EDR
or LE connection.
Bluetooth
Requires user action & HTTPS
Web Bluetooth browser support
Android, Mac, Windows (Chrome), Chrome OS, Linux*
*bit.ly/web-bluetooth-support
bit.ly/web-bluetooth-drone-vid
bit.ly/hedgehog-vr
Demo time
Demo time
Nordic
Thingy:52
3D assets
WebBluetooth
WebXR
A-Frame
Webbrowser
@samsunginternet
Хвала вам
Peter
@poshaughnessy
Diego
@diekus

More Related Content

Bridging Realitites

Editor's Notes

  1. Description of the browser. Samsung 2nd largest contr to open source chromium project Evergreen browser Ships on Samsung galaxy devices -
  2. Among the largest mobile browsers in the world. With 5% marketshare worldwide and 3rd place in north America and Europe.
  3. Major theme is the uber trend of physical and digital worlds merging. Driven by a number of key technologies, of which we’re going to start with…
  4. Now that we are talking about data, there’s something interesting I want to show you: As a friend pointed out to me recently, Take a look at gartners Hype Cycle for Emerging Tech from last year. Focus specifically on the Slope of Enlightenment… brace yourselves cause VR is coming?
  5. Now that we are talking about data, there’s something interesting I want to show you: VR is officially out of Gartner’s Hype Cycle for Emerging Tech for 2018.
  6. Digital creativity – art in 3D, meditation / psychiatry, e.g. treating phobias, remote education/training (Learnbrite) and even memory palaces (technique used by memory masters - place objects in a virtual space you can walk around, to help remember them better)
  7. Might not see people using it everyday But a lot is going on behing the scenes, used to create lots of things we use everyday
  8. Tech that is being used to try to disrupt the market and enhance everyday tasks
  9. AR/MR – other ways that these world merge together, new types of experiences
  10. Augmented and Mixed reality headsets, and mobile based AR
  11. These frameworks give you the ability to
  12. This is an example of AR mobile tech from sotherby’s, where you can position elements in real space to get an idea of how they fit in the environment
  13. This other example scans the ground and give you information about how to line up your putt to hit it in the hole
  14. Explain the emcompassing technologies in XR
  15. The other tech that is helping us merge our worlds is the IoT
  16. We often think of IoT as just devices that connected directly to the internet but it also encompasses smart devices that we can control and communicate with
  17. And if you look at websites like kickstarter, we can see a plethora of devices that range from … Meaning that…
  18. Lets talk about how these are combined together
  19. One of the things XR can help with is visualization all the data coming from all the devices connected. We can understand it better if we visualize it better.
  20. VR as J Lanier said, is amazing at conveying complexity with lucidity. There’s nothing more natural for us humans than inhabiting a 4-Dimensional world.
  21. As in this example where VR is being used to visualize all the data coming from different sensors in this physical bridge…
  22. Or this ither examples used to visualize in a creative way information about decibel level (noise pollution) in different cities around the globe
  23. And referring to the topic of AR, it can be used to …
  24. Heres an example from leap motion, combining this with smart lighting you can control the lights in your room with a gesture
  25. The interesting fact here is that there is close alignment in the technology choices of professional developer and the developer population overall.
  26. So let me present to you webvr/xr And what does this men for xr and the web??
  27. It’s not officially supported in the specification, but it will be enabled in a future revision of the upcoming webxr spec.
  28. To start, we’ve had access from the camera since around 2012, …
  29. But the camera feed is not enough. We need to go from computers with cameras to computers with eyes. We need to understand the image and the environment that is around us. Starting to be able to do that on the web. Here’s a simple example…
  30. * Available in chrome with an origin trial
  31. The Web of Things is a developing web standard for providing a universal system for talking to Things, and for Things to talk to each other – based around URLs and standard APIs – a.k.a. “the application layer of the Internet of Things”
  32. But its not only through wifi that we can do these things, we can also access devices using Bluetooth. And the web has an API for doing this called…
  33. Current implementations are Bluetooth Low Energy. Up and coming specification
  34. One thing to note is that, being the web, security plays a major role here. Because of this, webBT requires a user action, and agreeing to pair with a device using a pairing prompt and is only possible over HTTPS
  35. Its implemented in chromium-based browsers, like Samsung Internet, Chrome and Opera. Except iOS it’s available on the major desktop and mobile OS’s - it arrived in Windows in Chrome stable v70 in just the last day or two.
  36. Its implemented in chromium based browsers. This means Samsung Intenret, Chrome and Opera. Its available in most OS, and recently came to Windows in Chrome beta
  37. Its implemented in chromium based browsers. This means Samsung Intenret, Chrome and Opera. Its available in most OS, and recently came to Windows in Chrome beta hedgehog-vr
  38. So lets show you a demo.
  39. So lets show you a demo.
  40. The appearance of new specialized browsers: Browser like Samsung internet for Gear VR, Chrome for Daydream, Oculus Browser and Firefox Reality.
  41. They can allow customization of the space, like changing the skybox, of positioning 3D objects around.
  42. We can see also the integration of new workflows in our experiences, where XR content can fluidly go between flat and immersive in an easy seamless way.
  43. Let’s think about running into a 360 video or a 3d model on an application, where the mobile device can detect when a VR headset is plug in and automatically transfer the user to the xr experience
  44. And finally a new axis, in which we might be able to position different elements, and maybe even extend this to DOM elements in virtual space.
  45. This is an example done by the lensvr team in Bulgaria, which sparks a lot of ideas onto future use cases of depth in traditional web scenarios.