IVE Industry Focused Event - Defence Sector 2024
•
0 likes•233 views
These are slides from the Defence Industry event orgranized by the Australian Research Centre for Interactive and Virtual Environments (IVE). This was held on April 18th 2024, and showcased IVE research capabilities to the South Australian Defence industry.
Report
Share
IVE Industry Focused Event - Defence Sector 2024
- 1. Australian Research Centre for Interactive and Virtual Environments Positively changing the world through changing people’s realities https://unisa.edu.au/ive/
- 2. Acknowledgment of Country We acknowledge this land that we meet on today is the traditional lands of the Kaurna people and that we respect their spiritual relationship with their country. We also acknowledge the Kaurna people as the custodians of the Adelaide region and that their cultural and heritage beliefs are still as important to the living Kaurna people today.
- 3. Darryn Smart Acting Chief, Sensors and Effectors Division, Defence Science and Technology Group
- 4. Darryn Smart Acting Chief Sensors & Effector Division Defence Science & Technology Group Edinburgh SA, Australia DSTG, UniSA & Industry – Working Together to ensure Australia maintains a Tactical Advantage 18th April 2024
- 5. Defence Strategic Review 2023 “DSTG and ASCA to enable research and industry sectors to focus (our) work on development of advanced and asymmetric capabilities in key technology areas.”
- 6. Defence Science & Technology Group Group Purpose Statement To develop innovative technologies that can be delivered by industry and transitioned into Defence capability To shape innovation, science and technology within Defence and across the nation Defence Innovation, Science & Technology Strategy
- 7. DAIRNet
- 8. SCHED
- 9. ANFF-SA
- 10. Foundational Collaboration & Partnering IS&T Capabilities Workforce Advanced & Asymmetric Capabilities
- 12. Thank You
- 13. IVE Overview
- 18. A world leader in AR & VR technologies • Leaders in Australia for AR and VR research • #3 in the world for the number of AR publications (2 x MIT) • A unique alignment of computer science, neuroscience, art, architecture, and design • Focusing on transforming industry and solving large-scale societal challenges
- 19. IVE Leadership Team Professor Bruce Thomas Founding Director Professor Mark Billinghurst Director Professor Ning Gu Deputy Director Professor Ian Gwilt A/Professor Ross Smith Dr Joanne Zucco Dr Peter Schumacher Dr Gun Lee Dr Deirdre Feeney Dr Julie Nichols Professor Ina Bornkessel- Schlesewsky A/Professor Erik Champion
- 20. Research Groups Membership totals over 130 people including academics, researchers and PhD students distributed over multiple campuses
- 21. Facilities A suite of mixed reality visualisation environments enabling up to full scale simulation
- 22. Research Capabilities • Human Computer Interaction • Data Visualisation Techniques • Enhancing Health & Medical Procedures • Real-time Empathic Collaboration • Design & Visualisation of Architecture • Human Centred Industrial Design • Sensory Data Collection and Analysis • Cognitive Neuroscience and Psychology • Human & Computing Creative Nexus
- 23. Application Areas • Education • Defence • Manufacturing • Agriculture • Design • Health • Creative • Urban design
- 25. ARIVE Network Australasian Researchers in Interactive and Virtual Environments Collecting together all the best AR/VR researchers in Australia and NZ - 9 institutions, 260 researchers, > 30 million USD in funding Industry research consortium
- 26. Key Research Groups • Studio for Complex Human Environment Design (SCHED) • Wearable Computing • Empathic Computing • Cognitive Neuroscience Contributing to the Defence Sector
- 27. Studio for Complex Human Environment Design (SCHED)
- 28. Complex Space Design Applying human-centred design practices to the design of complex, confined, high-stakes, high-intensity habitable spaces Submarine Habitability Design • Control room • Sleeping berths • Galley
- 29. Complex Space Design Command and Control Rooms • S&T support from Agile C2 STaR Shot • Dr Alexander Kalloniatis • Plan MURA • Supporting future designs of the ops room • Preparing the way for integrating capabilities from diverse agencies • Human-centred design practices for the application of ISO 11064 • Anticipation and integration of new technologies Applying human-centered design principles to the industrial design of control rooms
- 30. Complex Space Design RAES – Real Anthropometry Experience System A tool that uses: • Body scanning • Games engines • VR • DHMs So, designers can: • Easily manipulate DHMs • Export them to CAD to support the design • Gain empathic experiences Developing tools for the application of Digital Human Manikins for design
- 31. Complex Space Design Developing tools for the application of Digital Human Manikins for design RAES – Real Anthropometry Experience System A tool that uses: • Body scanning • Games engines • VR • DHMs So, designers can: • Easily manipulate DHMs • Export them to CAD to support the design • Gain empathic experiences
- 34. Immersive Visualisation Training Support Systems Visual Analytics
- 35. Training Support Systems Immersive Visualisation Hardware prototyping Robotics interaction Visual Analytics Digital Twins Collaborative Sensemaking
- 36. Visualisation – “help people understand the world by revealing and communicating insights within the data around us.”
- 37. Visualisation – “help people understand the world by revealing and communicating insights within the data around us.”
- 38. Narrative Visualisation • Data as a narrative to support mental models • Combine rich data sources into a single cohesive view Exposing the story behind complex large data
- 39. Immersive Analytics • Directly touch and grab data • Exceed the limits of a desktop monitor • Natural collaborative environment Intuitively exploring complex data relationships through immersive visualisation techniques
- 40. Immersive Digital Twins • Immersive modelling of complex platforms • One-to-one mapping of CAD models • Collaborative training and familiarisation • Visualise real-time data from the platform Using digital twins for training and maintenance in difficult or high-risk environments
- 42. Empathic Computing Empathy is ... “Seeing with the eyes of another, listening with the ears of another, and feeling with the heart of another.” - Alfred Adler (1870~1937) Experiencing the reality of another. Using AR/VR/MR technology to develop systems that support deeper understanding
- 43. Immersive Remote Collaboration AR/VR/MR technology to enable technical support from a remote expert
- 44. Asynchronous Spatial Collaboration AR technology to capture and replay expert’s operation for training and shift work
- 45. Shared Emotional Understanding Physiological sensors to capture and share emotional status for personal connection Physiological sensors Shared data visualisation Enhanced emotional cues
- 46. Empathic Computing • Experience Capture • 360/3D AR/VR/MR teleconferencing • Expert demonstration capture and replay • Natural Interaction • Augmented non-verbal communication cues • Adaptive multi-scale avatars • Implicit Understanding • Sharing emotion with physiological sensors • EEG hyper-scanning for MR collaboration Immersive Collaboration and Shared Experience across Space and Time
- 48. Cognitive Neuroscience Online measurement of cognitive load We can tell how hard brains are working Training and human performance Improving the performance of high performers Team performance in naturalistic settings with real-world tasks Measurement of brains where it's most useful Inter-brain synchrony Understanding the mechanisms of collaboration Your brain and how to use it
- 49. Online measurement of cognitive load
- 50. Training and human performance
- 51. Team performance in naturalistic settings
- 52. Team performance in naturalistic settings • Resting-state EEG predicts performance • Resting-state EEG can reliably differentiate between members within a dyad • Task-related theta and alpha activity during easy training tasks predicted later performance on complex training to a greater extent than prior behaviour
- 54. Engaging with IVE A range of industry engagement and partnership options: Student Sponsorship • Final year projects, PhD support, industry placement Joint co-funded research • ARC linkage grants, Defence Innovation Partnership Grants, ASCA Emerging Disruptive Technologies bids Fully-funded projects • Targeted research, commercialisation Strategic Partnerships • ARIVE membership, long term initiatives
- 55. Example: Meta & CSIRO • A cohort-based, industry-driven, multi-disciplinary graduate program • Provide entrepreneurial thinking and skills in AI and emerging tech • Meta supported cohort on XR Health and Safety 3-year project 3 Universities (UniSA, UQ, Monash) 7 PhD, 6 Masters, 21 Honours students $200K/year investment (1/3 the total cost) Meta commercialises research outcomes CSIRO Next Generation Graduate Program
- 56. Demonstrations Research Capability Demonstration Cognitive Neuroscience Mind Reading for Beginners Collaborative Systems Shared Sphere ARTips Data Analytics Tilt-5 Collaborative Visualisation Data Visualisation Narrative Visualisation Human Centred Design Real-Time Posing & Capturing of Manikins Human Robot Interaction CLIVE the Robotic Dog VR Training Roxplorer Digital Twin Visualisation Ozmap
- 57. Thank You Headquarters Australian Research Centre for Interactive and Virtual Environments UniSA Mawson Lakes Campus Mawson Lakes, South Australia 5095 Australia IVECentre@unisa.edu.au