SlideShare a Scribd company logo

Cases for Financial Market

•
•
K
Karina Matos

The two-page document covers a wide range of topics, beginning with contact information for Eduardo Kassner and then moving to discuss industry trends in areas like IoT, data

Related slideshows

Staying ahead in the cyber security game - Sogeti + IBM
Staying ahead in the cyber security game - Sogeti + IBMStaying ahead in the cyber security game - Sogeti + IBM
Staying ahead in the cyber security game - Sogeti + IBM
 
Cybersecurity: Mock Cyberwar Game
Cybersecurity: Mock Cyberwar Game Cybersecurity: Mock Cyberwar Game
Cybersecurity: Mock Cyberwar Game
 
The Amazing Ways Retail Giant Zalando Is Using Artificial Intelligence
The Amazing Ways Retail Giant Zalando Is Using Artificial IntelligenceThe Amazing Ways Retail Giant Zalando Is Using Artificial Intelligence
The Amazing Ways Retail Giant Zalando Is Using Artificial Intelligence
 
1 of 50
Download to read offline
Eduardo Kassner C h i e f T e c h n o l o g y & I n n o v a t i o n O f f i c e r O n e C o m m e r c i a l P a r t n e r M i c r o s o f t C o r p o r a t i o n I t w i l l b e m y p l e a s u r e t o c o n n e c t w i t h y o u , e d u a r d o k @ m i c r o s o f t . c o m t w i t t e r . c o m / e k a s s n e r w w w . l i n k e d i n . c o m / i n / e k a s s n e r
Cases for Financial Market
Industry Trends
IoT Source: Keystone Strategy, 2016 $100M average increase in operating income among the most digitally transformed enterprises 73% of companies survey are actively investing in IoT Data Growth Source: link Less than 1% is analyzed $200 billion global market by 2020 Less than 20% is secured Huge amounts of Data Cloud shift will affect more than $1 trillion in IT spending by 2020 60% computing in the public cloud by 2025 4.4 50 163 2013 2020 2025 1 Zettabyte = 1 Billion Terabytes 1.3 Zettabyte: Estimated to be all Internet traffic in 2016 Huge Opportunity to secure & learn Cyber Threats 63% of confirmed data breaches involve weak, default, or stolen passwords >80% of employees admit using non- approved SaaS apps for work purposes 32% of businesses reported to be affected by cybercrimes 2 Billion records compromised in the last year 99+ DAYS between infiltration and detection $17 MILLION of cost/business impact per breach Cybercrimes Data Breaches Shadow IT Access to Technology Source: http://www.gartner.com/newsroom/id/3142917 1 million/hour new devices coming online by 2020 Source: World Economic Forum Drones 3D Printing Industrial Robots DNA Sequencing Solar 2000 – $2.7 BN 2007 - $10 M 2017 - $50 2007 – $100K 2013 - $700 2007 – $40K 2014 - $100 2007 – $550K 2014 - $20 1984 – $30 2014 - $0.16 Cost per kWh
4.4 50 163 2013 2020 2025 1 Zettabyte = 1 Billion Terabytes 1.3 Zettabyte: Estimated to be all Internet traffic in 2016 Data Growth Smart City 250 PB per day Connected Factory 1 PB per day Autonomous Vehicle 5 TB per day Smart Office 150 GB per day 68 Smart Home 50 GB per day Smart Devices 20B IoT devices Stadium 200 TB per game People 1.5 GB per day
It’s our recognition that if you go to bed as an industrial company, you will wake up as a software company. Jeffrey Immelt, CEO, GE Silicon Valley is coming. We are going to work hard to make our services as seamless and competitive as theirs. Jamie Dimon, JP Morgan CEO BDMS ARE BECOMING THE REAL BUYERS OF DIGITAL 45% 55% Business Decision Makers IT Decision Makers 2018 IT Spend Nearly half of all IT spend will be controlled by BDMs by 2018 Source: IDC Futurescape, “Worldwide IT Industry 2016 Predictions” FOCUS By Year-End 2017, Over 70% of the G500 Will Have Dedicated Digital Transformation and Innovation Teams 1 BENEFIT “Businesses that use AI, big data and IoT technologies to uncover new business insights “will steal $1.2 trillion per annum from their less informed peers by 2020” 2 PUBLIC CLOUD GROWTH By 2019, 3rd Platform Technologies (cloud, mobile, social, and big data technologies) and Services Will Drive Nearly 75% of IT Spending — Growing at Twice the Rate of the Total IT Market 1 INVESTMENT By 2020, 50% of the G2000 Will See the Majority of Their Business Depend on Their Ability to Create Digitally Enhanced Products, Services, and Experiences1 (1) IDC FutureScape: Worldwide IT Industry 2017 Predictions (2) IDC: Worldwide IT industry FutureScape, Nov.
The Opportunity
Blockchain Trend:
Blockchain Financial Trading Deal origination POs for new securities Derivatives trading Total Return Swaps (TRS) 2nd generation derivatives Collateral management Settlements Payments Transferring of value Crowd Funding Peer-to-peer lending Trade reporting & risk visualizations Betting & prediction markets Insurance Claim filings MBS/Property payments Claims processing & admin Fraud prediction Telematics & ratings Medical Records sharing Prescription sharing Compliance Personalized medicine DNA sequencing Media Digital rights mgmt Game monetization Art authentication Purchase & usage monitoring Ticket purchases Fan tracking Ad click fraud reduction Resell of authentic assets Real time auction & ad placements Computer Science Micronization of work (pay for algorithms, tweets, ad clicks, etc.) Expanse of marketplace Disbursement of work Direct to developer payments API platform plays Notarization & certification P2P storage & compute sharing DNS Asset Titles Diamonds Designer brands Car leasing & sales Home Mortgages & payments Land title ownership Digital asset records Identity Personal Objects Families of objects Digital assets Multifactor Auth Refugee tracking Education & badging Purchase & review tracking Employer & Employee reviews Government Voting Vehicle registration WIC, Vet, SS, benefits, distribution Licensing & identification Copyrights Supply Chain Dynamic ag commodities pricing Real time auction for supply delivery Pharmaceutical tracking & purity Agricultural food authentication Shipping & logistics management IoT Device to Device payments Device directories Operations (e.g. water flow) Grid monitoring Smart home & office management Cross-company maintenance markets Payments Micropayments (apps, 402) B2B international remittance Tax filing & collection Rethinking wallets & banks Consumer Digital rewards Uber, AirBNB, Apple Pay P2P selling, craigslist Cross company, brand, loyalty tracking
Big Data (Databricks) Trend:
Business problems that are ripe for Databricks prototyping Health & Life Sciences SOCIAL ANALYTICS • Real-time patient feedback via topic modelling • Analytics across publication data IoT DEVICE ANALYTICS • Aggregation of streaming events • Predictive Maintenance • Anomaly Detection GPU IMAGE PROCESSING • Graphic Intensive workloads • Deep learning using Tensor Flow • Pattern recognition CLINICAL & CLAIMS DATA • Claims Data Warehouse • Readmission Predictions • Efficacy and Comparative analytics • Prescription Adherence • Market Access Analysis GENOMICS & PRECISION MEDICINE • Single Cell Sequencing • Biomarker, Genetic, Variant & Population Analytics • ADAM & HAIL on Databricks Financial Services MARKETING ANALYTICS • Recommendation Engine • Predictive Analytics and Targeted Advertising • Fast Marketing and Multi-channel engagement • Customer Sentiment Analysis CREDIT ANALYTICS • Enterprise DataHub • Regulatory and Compliance Analysis • Credit Risk Management • Automated Credit Analytics RISK AND FRAUD, THREAT DETECTION • Real-time anomaly detection • Card Monitoring and Fraud Detection • Security Threat Identification • Risk Aggregation FINANCIAL MODELING • Commercial/Retail Banking, Securities, Trading & Investment models • Decision Science, Simulations and Forecasting • Investment recommendations CUSTOMER ANALYTICS • Customer 360 • Customer Segmentation • Reduce Customer Churn • Underwriting, Servicing • and Delinquency Handling • Insights for new Products Security CYBER SECURITY & PREDICTIVE ANALYTICS • Prevention of DDoS attacks • Threat Classifications • Data Loss/anomaly detection in Streaming • Cybermetrics and changing use patterns FINE-GRAINED DATA ANALYTICS SECURITY • Role-based access controls • Auditing and Governance • File Integrity Monitoring • Row level and Column level Access permissions SECURITY COMPLIANCE REPORTING • Ad-hoc/Historic incident reports • SOC/NOC dashboards • Deep OS Auditing • Data Loss Detection in IoT • User behavior Analytics FRAUD DETECTION AND PREVENTION • e-Tailing • Inventory monitoring • Social media monitoring • Phishing scams • Piracy protection SECURITY INTELLIGENCE • Real-time data correlation • Anomaly detection • Security context, enrichment • Offence scoring, prioritization • Security Orchestration
AI Trend:
Cases for Financial Market
Cases for Financial Market
Cases for Financial Market
Design AI Responsibly Fairness Reliability & Safety Privacy & Security Inclusiveness Transparency Accountability Bias Evolve Good use Accessibility Consent & Explanation Responsibility Partnership on AI Set of companies Tech Industry and outside that has come together to formulate best practices and principles around the engagement and influence of AI on people and society Defining the principles to AI • How to design AI Systems Responsibly? • What principles do we need to protect people? • How do we Govern AI’s use? • Impact of AI on Economies and Jobs? Progress to date: Internally established Aether board Industry: Partnership on AI, OpenAI, AI Now Institute. news.microsoft.com/futurecomputed Drive To Avoid
Why is Microsoft different
est 2 orth urope rance entral A orth A entral rance outh est outh ermany ortheast ermany est entral ermany orth est urope o ast Bra il outh outh Africa orth outheast Asia ast Asia hina ast hina orth orea entral orea outh apan ast apan est Australia outheast Australia ast Australia entral, Australia entral 2 est India entral India outh India outh Africa est anada ast anada entral orth entral ermany entral wit erland orth wit erland est ast , ast 2, o irginia o Iowa entral est est entral o entralouth entral o Ari ona o Te as A ailable region Announced region A ailability ones present
>90% of Fortune 500 use the Microsoft Cloud
Applications Infrastructure Management Databases & middleware App frameworks & tools DevOps
USGovGlobalRegionalIndustry  ISO 27001:2013  ISO 27017:2015  ISO 27018:2014  ISO 22301:2012  ISO 9001:2015  ISO 20000-1:2011  SOC 1 Type 2  SOC 2 Type 2  SOC 3  CSA STAR Certification  CSA STAR Attestation  CSA STAR Self-Assessment  WCAG 2.0  FedRAMP High  FedRAMP Moderate  EAR  DoD DISA SRG Level 5  DoD DISA SRG Level 4  DoD DISA SRG Level 2  DFARS  DoE 10 CFR Part 810  NIST SP 800-171  NIST CSF  Section 508 VPATs  PCI DSS Level 1  GLBA  FFIEC  Shared Assessments  FISC (Japan)  FCA (UK)  MAS + ABS (Singapore)  23 NYCRR 500  HIPAA BAA  HITRUST  21 CFR Part 11 (GxP)  MARS-E  NHS IG Toolkit (UK)  NEN 7510:2011 (Netherlands)  FERPA  CDSA  MPAA  FACT (UK)  DPP (UK)  SOX  Argentina PDPA  Australia CCSL / IRAP  Canada Privacy Laws  China GB 18030:2005  China DJCP (MLPS) Level 3  Germany C5  India MeitY  Japan CS Mark Gold  Japan My Number Act  Netherlands BIR 2012  New Zealand Gov CIO Fwk  Singapore MTCS Level 3  Spain ENS  Spain DPA  UK Cyber Essentials Plus  UK G-Cloud  UK PASF  FIPS 140-2  ITAR  CJIS  IRS 1075 Azure covers 71 compliance offerings… more than any cloud provider Deepest and most comprehensive compliance coverage in the industry  China TRUCS / CCCPPF  EN 301 549  EU ENISA IAF  EU Model Clauses  EU – US Privacy Shield  Germany IT-Grundschutz workbook https://aka.ms/AzureCompliance
Lets Envision Success
Please help me take this order
Cases for Financial Market
Cases for Financial Market
Cases for Financial Market
Media Backup and Archival for a Large Movie Studio Need Post-production / visual effects processing for a major upcoming movie was halted due to inaccessibility of production media content Technical Solution: Individual Studios encrypt and backup media content to low-cost Azure Blob Storage. They use a mixture of hardware, OS and software platform - MacOS, Linux, Windows, Synology NAS, Aspera Servers Connectivity to Azure is vital from across world-wide shooting locations, often with low-connectivity speeds Production Media from various shooting locations were constantly backed up to Azure Blob Storage using Synology NAS Cloud Backup. Customer wanted to recovery large data volumes (~25TBs of Data) from Azure Backup. Benefit: The media was recovered in 1.5 hours and movie production resumed Studio/ Show 1 Microsoft Azure Azure West US Studio/ Show 2 Studio/ Show 3 Backup Extraction Azure Blob Backup Extraction Azure Blob Azure Blob Backup Extraction Azure Blob Azure Blob Azure Blob (Cool) Azure Blob
Home Banking for credit card and loan provider European Bank Need A Credit card management and loan issuing company needed to modernize their Home Banking portal and application, so they decided to move it to the cloud. Solution The solution for migrating to Azure had to initially consider all the legacy systems in use, feasibility of said migration and inherent impacts and risks to service availability. This was therefore a top priority in which migration, code refactoring and compatibilities where analyzed and when applicable quantified in terms of effort for project planning and implementation. The final architecture and project included the upgrade of various legacy systems such as HIS from 2003 version to 2012, the inclusion of Highly Available Barracuda WAF's (for enhanced security) and application and data layers with an ExpressRoute circuit for communication with backend.
Container Orchestrator on Azure for Core Banking Platform Cloud Integration in the German Financial Services Industry Need A large German bank recognized that more flexibility was needed for defining their infrastructure as code and deploying their dev and test containerized environments of their Core Banking Platform on-demand in the cloud. Jenkins CI/CD Pipelines were the ideal integration point for Azure infrastructure as code, and significantly increased the flexibility and efficiency of the dev/test architecture. Business Impact Faster delivery times. The development team can more flexibly deploy and test their web and backend core banking platform without waiting for limited on-premise hardware to be available. Cheaper and more efficient. Because dev and test environments can be easily deleted when they are no longer needed (in contrast to on-premise hardware), the team is making their development and test environments more efficient and economical, and helping drive cost savings at the bank. Ease of future expansion. The solution can be further expanded for production environments, and grow with the development, test and deployment needs of the team.
Private Banker Assistant Bot Problem Private banking to VIPs is a very valuable business. Time spend by private bankers on email requests from VIPs is expensive. Validation of email request is needed. Solution Use private banker bot to intercept mails to private banker. Bot can execute on low value transactions and inform private banker. Bot can setup high value transactions and only execute on approval from private banker. Multifactor Auth is used to validated mail from VIP. Value Quicker response for high value customers (VIP) at lower cost Notes Bot is invisible to customers it is there to assist private banker. Various service are looked at like enquiries, invites to events, responses, banking transactions etc. Private Banker Assistant VIP interaction Understanding Routing Personal BankerFunction Customer request email Understand customer intent (balance, transfer, new service Unique request Mail gets forwarded to Personal Banker Balance enquiry Response email to VIP Inform Personal Banker New Service Information New Service Activation Transfer funds Personal Banker Authorize VIP verifies request Logic App Multi-Factor Authentication Office 365 Office 365 Office 365 LUIS Execute Transaction Execute Transaction Prepare Transaction Logic App Logic App Execute Transaction Logic App Web App Linguistics API New queryAudit Info
Analytics for calls of Contact Centers company with 90K+ Customer Agents Need extract full text from low quality audios generated by IVR Solution Offering: Audio files are compressed in a proprietary format and uploaded onto Azure. Once in Azure, we have built an open architecture to process this audio (merge different audios together). Transcribed the call, send data to a data lake and the analysis and predictions. Queue controlling this process to automate as much as possible. Benefits: Other vendors have similar solutions but: - They use a small subset of the calls. We do all - Detect an agent who is not cordial enough, or is not following a script. …and so on . The insights help on boot creation, agent ranking and training among others.
Lost Package Finding Systems based on Cognitive Services Need Everyday this company transports ~13M packages. Of those, approximately 3,000 don’t make it to their destination for various reasons such as bad labels, packaging or damage. The team in charge of lost packages can recover 45% but they wanted more. Technical Solution : use Cognitive APIs such as Vision to search from pictures of the “lost” items as well as improve upon the matches via advanced text analysis segmenting the problem by attribute Azure Search DocumentDB Vision API Color Model Storage blob App Service User Phone website (generic) User Vision API Texture Model Text API Entity Extraction Custom API Word2Vec Custyom API Future 1 Microsoft Azure Enhanced Info Posted Cognitive Services APIs Azure ML Workbench Models Search Example: Color (Black) & Texture (Smooth) & Category (Electronics) -> It might be a cell phone
Designed to Disrupt eBook by MS Press htttp://aka.ms/designedtodisrupt Designed to Disrupt: Reimagine Your Apps and Transform Your Industry, to help you: • Use cloud technology to give your company a competitive edge by accessing new markets, enhancing your customers’ e perience, and increasing operational efficiency. • Learn from companies who have successfully used innovative technologies—such as cognitive services, Internet of Things (IoT) and bots—to grow their businesses. • Create a digital journey roadmap, with envisioning sessions to reimagine your company’s goals and practical tools to bring your visions to life.
?
Cloud Migration & Operational Best Practices
Azure Expert MSP Migrations (esp. App and DC migration competency) Cloud architecture – Scalable, fail-over etc. App re-platforming Business health assessment Among other capabilities to be determined in this process Multi-layer subscription management App assessment and optimization Automated ticketing and support (ITSM) DR strategy for NOC/SOC Change management et.), Among other capabilities to be determined in this process Managed billing PaaS expertise, automated provisioning and decommissioning of environments Audit management And succession planning for people (IAM, security, stability) Enhanced cloud SLAs Cloud assessments Security by design Cloud native app development Expectation that partners have the DevOps, SecOps and SysOps capabilities across all to offer Managed Services A well configured, secure, reliant, and best performing application or infrastructure Migrations (esp. App and DC migration competency) Cloud architecture – Scalable, fail-over etc. App re-platforming Business health assessment Among other capabilities to be determined in this process Multi-layer subscription management App assessment and optimization Automated ticketing and support (ITSM) DR strategy for NOC/SOC Change management et.), Among other capabilities to be determined in this process Managed billing PaaS expertise, automated provisioning and decommissioning of environments Audit management And succession planning for people (IAM, security, stability) Enhanced cloud SLAs Cloud assessments Security by design Cloud native app development Expectation that partners have the DevOps, SecOps and SysOps capabilities across all to offer Managed Services A well configured, secure, reliant, and best performing application or infrastructure
Cloud Migration (Simple, Complex, Packaged, Innovation) Application Catalogue SaaS - Contract PaaS – Re architect IaaS - Migrate Secure - Comply Automate - Resilience Operate - Optimize Debt - Sprawl Optimization Migration Testing Migration - Roadmap Operation Playbooks Cost Optimization Center of Excellence Compliance Playbooks Security Playbooks Workshops (Apps, Security, Migration) Business Case – Metrics - Objectives Requirements (Data, Sec, Compliance, Ops) Define Tools - Approach – App & Data Discovery CLOUD APPROACH (Start with 3-5 apps) Subscription Setup (IAM, Security, Network, Data) Ops Setup (Monitoring, Automation, Cost Mgmt, Support) Org Change Mgmt – Skills Enablement Plan • SOC 1 Type 2 (SSAE 16) attestation report • SOC 2 Type 2 (AT 101) attestation report • SOC 3 report • ISO/IEC 27001:2013 detailed audit report • ISO/IEC 27001:2013 Statement of Applicability (SoA) • PCI DSS 3.1 Report on Compliance (RoC) • FedRAMP System Security Plan • UK G-Cloud Risk Management Accredit. Document Set (RMADS) • FISC Reference/EULA • Platform Penetration Test • Risk Management SOP • Microsoft Information Security Policy • Cloud Security Alliance CCM v3.0.1 • 21 CFR Part 11 FDA (GxP) qualification guidelines • Content Delivery and Security Association certification • Many more at aka.ms/azurebom MICROSOFT TRUST CENTER Sample Compliance Bill of Materials CLOUD TOOLING *not intended as an endorsement or as a complete list MS Azure Portal Azure Policy Cost Management Azure Monitor Backup Site Recovery Azure Migration Network Watcher Cloud Shell Azure Service health Azure Advisor Application Insights Log Analytics Scheduler Security Center Azure Managed Apps OMS
Cloud Operations P95 CPU utilizationBENEFITS OF CLOUD Automation Insight Optimization Agility & Innovation 0 20 40 60 80 100 12:00 AM 2:00 AM 4:00 AM 6:00 AM 8:00 AM 10:00 AM 12:00 PM 2:00 PM 4:00 PM 6:00 PM 8:00 PM 10:00 PM CPU Utilization CLOUD SERVICE MANAGEMENT MANIFESTO ✓ Business Service Management Focus ✓ Azure Technical Expertise, IaaS, PaaS, and SaaS Experience ✓ Cloud Lifecycle Tooling ✓ Assessment and Design Practice (Center of Excellence) ✓ Build and Migration Practice (Center of Excellence) ✓ Cloud Operations and Service Management ✓ Security and Governance Practice (Center of Excellence) ✓ Cloud SLAs, Customer Satisfaction, and Cost Optimization ✓ Continual Improvement and Process Optimization ✓ Telemetry Usage and Adherence IT vs CLOUD PROVIDER DevOps Teams Global Support Security & Compliance Service Management Microsoft Azure • Envisioning & Automation • Customer Satisfaction • Billing & show back • Cost & Perf Optimization • Incident & problem management • SLA Management • Continuous Improvement • Security, IAM, Data • Migration Services • Data Lifecycle Infrastructure • Subscription & Governance • Telemetry, Monitoring • Networking Connectivity IaaS PaaS Services IT 12% Pause savings 82% Total savings 70% Resize savings
Providing experiences for customers where they want it Data Governance Balanced DecentralizedFederatedSelectiveCentralized Data Data Management Reporting & Analytics Decisions and activities are jointly shared between IT and the business Business users operate with autonomy The business exerts contr ol over decision making and activities, with limited input from IT Selective decisions and activities are owned by the business Single point of control and decision making; limited input from outside IT Information Risk Management Council Security Governance Risk Management Policy & Procedures Metrics & Reporting Training & Awareness Operations Leadership/Roles & Responsibilities Executive Sponsors Extended Team Core Team OS & Devices Legal • Regulatory • Privacy Finance • Compliance • Internal Audit
Results of a Multi Year • Faster and better decisions on adoption • Azure service providers anticipate cloud needs • IT readily has the knowledge required for adoption • IT readily has mitigation plans for inhibitors • IT is the reference customer for Microsoft cloud services • IT actively adjusts efforts based on progress ACCELERATE SIMPLIFY SHOWCASE MIGRATION FACTORY APPROACH - MULTI YEAR CIO Progress Dashboard Application Consolidation Dashboard REPORT ON SUCCESS AND BENEFITS
Enterprise Cloud Strategy eBook by MS Press http://aka.ms/enterprisecloudstrategybook or http://tinyurl.com/ Lead the journey to the cloud and drive innovation! Discover what makes the cloud so compelling to enterprises; with which applications you should start your cloud journey; how your organization will change, and how skill sets will evolve; how to measure progress; how to think about security, compliance, and business buy-in; and how to exploit the ever-growing feature set that the cloud offers to gain strategic and competitive advantage.
THANK YOU. I t w i l l b e m y p l e a s u r e t o c o n n e c t w i t h y o u , e d u a r d o k @ m i c r o s o f t . c o m t w i t t e r . c o m / e k a s s n e r w w w . l i n k e d i n . c o m / i n / e k a s s n e r
Cases for Financial Market
Cases for Financial Market
Inspiration Purchasing Experience Departure Experience In-Flight Experience ReflectionArrival Experience Reimagining the customer experience Anywhere Anywhere Lobby Lounge Gate Airplane Destination Flight Operations Ground Operations Airport Operations Gate Arrivals Ground
MS Airlines architecture
Cases for Financial Market
Citizen experience journey map Digital Hotspots • Sensor Networks and City Dashboards • Open Data Portals • Intelligent Parking Systems • Intelligent Building Systems • Smart Street Lighting • Social Listening and Sentiment Analysis Systems • Integrated CRM Based Services • Student Information Systems and Student Analytics • Population Health Mgmt Solutions • Augmented Reality Solutions Using city services Using city buildings Participating in city life
Consolidation of a Data Warehouse to run multiple analysis and ML experiments concurrently Need Data Scientist Team needed the agility to use different tools & versions, to reduce resource contention between teams and even with other stakeholders, as well as to easily present results to business. They where currently replicating very large data to different data estates in order to run analysis and experiments, as each wanted to interface to the data with different tools and APIs. This generated a LOT of waste. Solution Azure Data Warehouse proved both, faster and cheaper centralization of data than Hive and other similar approaches. Creative approaches like Cosmos DB + Search opened the door for non traditional data exploration. Business Benefits Large consolidation and reduction of the storage and optimal utilization of resources. On Premises Data Lake Data Factory Raw Data Azure Data Lake Store Raw Data Azure Data Warehouse Raw Data Filtered, Classified & Reshaped Data HDInsight Cooked Data Segmentation Cosmos DB Samples Azure Search Facets & Exploration HDInsight Cooked Data Tableau BI HDInsight Cooked Data Modelling Azure SQL Data Scientists Results Power BI Dashboarding & Result Presentation
Dynamically shipping routes change system Blob Storage HD Insight Blob Storage Data Lake SQL DW Power BI Data Factory Input Raw Data Extraction Extracted Data Storage Query Layer Output • Shipment data • Vessel schedules • Key words • News & Weather from web Event Hub Stream Analytics Key words Mobile App The current situation does not allow a customer to change the selected route for a shipment, that has the potential to delay shipments due to disruptions along the selected route. The solution allows the company and its customers to change a specific route based on disruptions along the current route. I.e. change from sea shipping to land shipping, due to a weather, or threat conditions (typhoon, terror attacks, etc) along the route.

More Related Content

Cases for Financial Market

  • 1. Eduardo Kassner C h i e f T e c h n o l o g y & I n n o v a t i o n O f f i c e r O n e C o m m e r c i a l P a r t n e r M i c r o s o f t C o r p o r a t i o n I t w i l l b e m y p l e a s u r e t o c o n n e c t w i t h y o u , e d u a r d o k @ m i c r o s o f t . c o m t w i t t e r . c o m / e k a s s n e r w w w . l i n k e d i n . c o m / i n / e k a s s n e r
  • 4. IoT Source: Keystone Strategy, 2016 $100M average increase in operating income among the most digitally transformed enterprises 73% of companies survey are actively investing in IoT Data Growth Source: link Less than 1% is analyzed $200 billion global market by 2020 Less than 20% is secured Huge amounts of Data Cloud shift will affect more than $1 trillion in IT spending by 2020 60% computing in the public cloud by 2025 4.4 50 163 2013 2020 2025 1 Zettabyte = 1 Billion Terabytes 1.3 Zettabyte: Estimated to be all Internet traffic in 2016 Huge Opportunity to secure & learn Cyber Threats 63% of confirmed data breaches involve weak, default, or stolen passwords >80% of employees admit using non- approved SaaS apps for work purposes 32% of businesses reported to be affected by cybercrimes 2 Billion records compromised in the last year 99+ DAYS between infiltration and detection $17 MILLION of cost/business impact per breach Cybercrimes Data Breaches Shadow IT Access to Technology Source: http://www.gartner.com/newsroom/id/3142917 1 million/hour new devices coming online by 2020 Source: World Economic Forum Drones 3D Printing Industrial Robots DNA Sequencing Solar 2000 – $2.7 BN 2007 - $10 M 2017 - $50 2007 – $100K 2013 - $700 2007 – $40K 2014 - $100 2007 – $550K 2014 - $20 1984 – $30 2014 - $0.16 Cost per kWh
  • 5. 4.4 50 163 2013 2020 2025 1 Zettabyte = 1 Billion Terabytes 1.3 Zettabyte: Estimated to be all Internet traffic in 2016 Data Growth Smart City 250 PB per day Connected Factory 1 PB per day Autonomous Vehicle 5 TB per day Smart Office 150 GB per day 68 Smart Home 50 GB per day Smart Devices 20B IoT devices Stadium 200 TB per game People 1.5 GB per day
  • 6. It’s our recognition that if you go to bed as an industrial company, you will wake up as a software company. Jeffrey Immelt, CEO, GE Silicon Valley is coming. We are going to work hard to make our services as seamless and competitive as theirs. Jamie Dimon, JP Morgan CEO BDMS ARE BECOMING THE REAL BUYERS OF DIGITAL 45% 55% Business Decision Makers IT Decision Makers 2018 IT Spend Nearly half of all IT spend will be controlled by BDMs by 2018 Source: IDC Futurescape, “Worldwide IT Industry 2016 Predictions” FOCUS By Year-End 2017, Over 70% of the G500 Will Have Dedicated Digital Transformation and Innovation Teams 1 BENEFIT “Businesses that use AI, big data and IoT technologies to uncover new business insights “will steal $1.2 trillion per annum from their less informed peers by 2020” 2 PUBLIC CLOUD GROWTH By 2019, 3rd Platform Technologies (cloud, mobile, social, and big data technologies) and Services Will Drive Nearly 75% of IT Spending — Growing at Twice the Rate of the Total IT Market 1 INVESTMENT By 2020, 50% of the G2000 Will See the Majority of Their Business Depend on Their Ability to Create Digitally Enhanced Products, Services, and Experiences1 (1) IDC FutureScape: Worldwide IT Industry 2017 Predictions (2) IDC: Worldwide IT industry FutureScape, Nov.
  • 9. Blockchain Financial Trading Deal origination POs for new securities Derivatives trading Total Return Swaps (TRS) 2nd generation derivatives Collateral management Settlements Payments Transferring of value Crowd Funding Peer-to-peer lending Trade reporting & risk visualizations Betting & prediction markets Insurance Claim filings MBS/Property payments Claims processing & admin Fraud prediction Telematics & ratings Medical Records sharing Prescription sharing Compliance Personalized medicine DNA sequencing Media Digital rights mgmt Game monetization Art authentication Purchase & usage monitoring Ticket purchases Fan tracking Ad click fraud reduction Resell of authentic assets Real time auction & ad placements Computer Science Micronization of work (pay for algorithms, tweets, ad clicks, etc.) Expanse of marketplace Disbursement of work Direct to developer payments API platform plays Notarization & certification P2P storage & compute sharing DNS Asset Titles Diamonds Designer brands Car leasing & sales Home Mortgages & payments Land title ownership Digital asset records Identity Personal Objects Families of objects Digital assets Multifactor Auth Refugee tracking Education & badging Purchase & review tracking Employer & Employee reviews Government Voting Vehicle registration WIC, Vet, SS, benefits, distribution Licensing & identification Copyrights Supply Chain Dynamic ag commodities pricing Real time auction for supply delivery Pharmaceutical tracking & purity Agricultural food authentication Shipping & logistics management IoT Device to Device payments Device directories Operations (e.g. water flow) Grid monitoring Smart home & office management Cross-company maintenance markets Payments Micropayments (apps, 402) B2B international remittance Tax filing & collection Rethinking wallets & banks Consumer Digital rewards Uber, AirBNB, Apple Pay P2P selling, craigslist Cross company, brand, loyalty tracking
  • 11. Business problems that are ripe for Databricks prototyping Health & Life Sciences SOCIAL ANALYTICS • Real-time patient feedback via topic modelling • Analytics across publication data IoT DEVICE ANALYTICS • Aggregation of streaming events • Predictive Maintenance • Anomaly Detection GPU IMAGE PROCESSING • Graphic Intensive workloads • Deep learning using Tensor Flow • Pattern recognition CLINICAL & CLAIMS DATA • Claims Data Warehouse • Readmission Predictions • Efficacy and Comparative analytics • Prescription Adherence • Market Access Analysis GENOMICS & PRECISION MEDICINE • Single Cell Sequencing • Biomarker, Genetic, Variant & Population Analytics • ADAM & HAIL on Databricks Financial Services MARKETING ANALYTICS • Recommendation Engine • Predictive Analytics and Targeted Advertising • Fast Marketing and Multi-channel engagement • Customer Sentiment Analysis CREDIT ANALYTICS • Enterprise DataHub • Regulatory and Compliance Analysis • Credit Risk Management • Automated Credit Analytics RISK AND FRAUD, THREAT DETECTION • Real-time anomaly detection • Card Monitoring and Fraud Detection • Security Threat Identification • Risk Aggregation FINANCIAL MODELING • Commercial/Retail Banking, Securities, Trading & Investment models • Decision Science, Simulations and Forecasting • Investment recommendations CUSTOMER ANALYTICS • Customer 360 • Customer Segmentation • Reduce Customer Churn • Underwriting, Servicing • and Delinquency Handling • Insights for new Products Security CYBER SECURITY & PREDICTIVE ANALYTICS • Prevention of DDoS attacks • Threat Classifications • Data Loss/anomaly detection in Streaming • Cybermetrics and changing use patterns FINE-GRAINED DATA ANALYTICS SECURITY • Role-based access controls • Auditing and Governance • File Integrity Monitoring • Row level and Column level Access permissions SECURITY COMPLIANCE REPORTING • Ad-hoc/Historic incident reports • SOC/NOC dashboards • Deep OS Auditing • Data Loss Detection in IoT • User behavior Analytics FRAUD DETECTION AND PREVENTION • e-Tailing • Inventory monitoring • Social media monitoring • Phishing scams • Piracy protection SECURITY INTELLIGENCE • Real-time data correlation • Anomaly detection • Security context, enrichment • Offence scoring, prioritization • Security Orchestration
  • 16. Design AI Responsibly Fairness Reliability & Safety Privacy & Security Inclusiveness Transparency Accountability Bias Evolve Good use Accessibility Consent & Explanation Responsibility Partnership on AI Set of companies Tech Industry and outside that has come together to formulate best practices and principles around the engagement and influence of AI on people and society Defining the principles to AI • How to design AI Systems Responsibly? • What principles do we need to protect people? • How do we Govern AI’s use? • Impact of AI on Economies and Jobs? Progress to date: Internally established Aether board Industry: Partnership on AI, OpenAI, AI Now Institute. news.microsoft.com/futurecomputed Drive To Avoid
  • 18. est 2 orth urope rance entral A orth A entral rance outh est outh ermany ortheast ermany est entral ermany orth est urope o ast Bra il outh outh Africa orth outheast Asia ast Asia hina ast hina orth orea entral orea outh apan ast apan est Australia outheast Australia ast Australia entral, Australia entral 2 est India entral India outh India outh Africa est anada ast anada entral orth entral ermany entral wit erland orth wit erland est ast , ast 2, o irginia o Iowa entral est est entral o entralouth entral o Ari ona o Te as A ailable region Announced region A ailability ones present
  • 19. >90% of Fortune 500 use the Microsoft Cloud
  • 21. USGovGlobalRegionalIndustry  ISO 27001:2013  ISO 27017:2015  ISO 27018:2014  ISO 22301:2012  ISO 9001:2015  ISO 20000-1:2011  SOC 1 Type 2  SOC 2 Type 2  SOC 3  CSA STAR Certification  CSA STAR Attestation  CSA STAR Self-Assessment  WCAG 2.0  FedRAMP High  FedRAMP Moderate  EAR  DoD DISA SRG Level 5  DoD DISA SRG Level 4  DoD DISA SRG Level 2  DFARS  DoE 10 CFR Part 810  NIST SP 800-171  NIST CSF  Section 508 VPATs  PCI DSS Level 1  GLBA  FFIEC  Shared Assessments  FISC (Japan)  FCA (UK)  MAS + ABS (Singapore)  23 NYCRR 500  HIPAA BAA  HITRUST  21 CFR Part 11 (GxP)  MARS-E  NHS IG Toolkit (UK)  NEN 7510:2011 (Netherlands)  FERPA  CDSA  MPAA  FACT (UK)  DPP (UK)  SOX  Argentina PDPA  Australia CCSL / IRAP  Canada Privacy Laws  China GB 18030:2005  China DJCP (MLPS) Level 3  Germany C5  India MeitY  Japan CS Mark Gold  Japan My Number Act  Netherlands BIR 2012  New Zealand Gov CIO Fwk  Singapore MTCS Level 3  Spain ENS  Spain DPA  UK Cyber Essentials Plus  UK G-Cloud  UK PASF  FIPS 140-2  ITAR  CJIS  IRS 1075 Azure covers 71 compliance offerings… more than any cloud provider Deepest and most comprehensive compliance coverage in the industry  China TRUCS / CCCPPF  EN 301 549  EU ENISA IAF  EU Model Clauses  EU – US Privacy Shield  Germany IT-Grundschutz workbook https://aka.ms/AzureCompliance
  • 23. Please help me take this order
  • 27. Media Backup and Archival for a Large Movie Studio Need Post-production / visual effects processing for a major upcoming movie was halted due to inaccessibility of production media content Technical Solution: Individual Studios encrypt and backup media content to low-cost Azure Blob Storage. They use a mixture of hardware, OS and software platform - MacOS, Linux, Windows, Synology NAS, Aspera Servers Connectivity to Azure is vital from across world-wide shooting locations, often with low-connectivity speeds Production Media from various shooting locations were constantly backed up to Azure Blob Storage using Synology NAS Cloud Backup. Customer wanted to recovery large data volumes (~25TBs of Data) from Azure Backup. Benefit: The media was recovered in 1.5 hours and movie production resumed Studio/ Show 1 Microsoft Azure Azure West US Studio/ Show 2 Studio/ Show 3 Backup Extraction Azure Blob Backup Extraction Azure Blob Azure Blob Backup Extraction Azure Blob Azure Blob Azure Blob (Cool) Azure Blob
  • 28. Home Banking for credit card and loan provider European Bank Need A Credit card management and loan issuing company needed to modernize their Home Banking portal and application, so they decided to move it to the cloud. Solution The solution for migrating to Azure had to initially consider all the legacy systems in use, feasibility of said migration and inherent impacts and risks to service availability. This was therefore a top priority in which migration, code refactoring and compatibilities where analyzed and when applicable quantified in terms of effort for project planning and implementation. The final architecture and project included the upgrade of various legacy systems such as HIS from 2003 version to 2012, the inclusion of Highly Available Barracuda WAF's (for enhanced security) and application and data layers with an ExpressRoute circuit for communication with backend.
  • 29. Container Orchestrator on Azure for Core Banking Platform Cloud Integration in the German Financial Services Industry Need A large German bank recognized that more flexibility was needed for defining their infrastructure as code and deploying their dev and test containerized environments of their Core Banking Platform on-demand in the cloud. Jenkins CI/CD Pipelines were the ideal integration point for Azure infrastructure as code, and significantly increased the flexibility and efficiency of the dev/test architecture. Business Impact Faster delivery times. The development team can more flexibly deploy and test their web and backend core banking platform without waiting for limited on-premise hardware to be available. Cheaper and more efficient. Because dev and test environments can be easily deleted when they are no longer needed (in contrast to on-premise hardware), the team is making their development and test environments more efficient and economical, and helping drive cost savings at the bank. Ease of future expansion. The solution can be further expanded for production environments, and grow with the development, test and deployment needs of the team.
  • 30. Private Banker Assistant Bot Problem Private banking to VIPs is a very valuable business. Time spend by private bankers on email requests from VIPs is expensive. Validation of email request is needed. Solution Use private banker bot to intercept mails to private banker. Bot can execute on low value transactions and inform private banker. Bot can setup high value transactions and only execute on approval from private banker. Multifactor Auth is used to validated mail from VIP. Value Quicker response for high value customers (VIP) at lower cost Notes Bot is invisible to customers it is there to assist private banker. Various service are looked at like enquiries, invites to events, responses, banking transactions etc. Private Banker Assistant VIP interaction Understanding Routing Personal BankerFunction Customer request email Understand customer intent (balance, transfer, new service Unique request Mail gets forwarded to Personal Banker Balance enquiry Response email to VIP Inform Personal Banker New Service Information New Service Activation Transfer funds Personal Banker Authorize VIP verifies request Logic App Multi-Factor Authentication Office 365 Office 365 Office 365 LUIS Execute Transaction Execute Transaction Prepare Transaction Logic App Logic App Execute Transaction Logic App Web App Linguistics API New queryAudit Info
  • 31. Analytics for calls of Contact Centers company with 90K+ Customer Agents Need extract full text from low quality audios generated by IVR Solution Offering: Audio files are compressed in a proprietary format and uploaded onto Azure. Once in Azure, we have built an open architecture to process this audio (merge different audios together). Transcribed the call, send data to a data lake and the analysis and predictions. Queue controlling this process to automate as much as possible. Benefits: Other vendors have similar solutions but: - They use a small subset of the calls. We do all - Detect an agent who is not cordial enough, or is not following a script. …and so on . The insights help on boot creation, agent ranking and training among others.
  • 32. Lost Package Finding Systems based on Cognitive Services Need Everyday this company transports ~13M packages. Of those, approximately 3,000 don’t make it to their destination for various reasons such as bad labels, packaging or damage. The team in charge of lost packages can recover 45% but they wanted more. Technical Solution : use Cognitive APIs such as Vision to search from pictures of the “lost” items as well as improve upon the matches via advanced text analysis segmenting the problem by attribute Azure Search DocumentDB Vision API Color Model Storage blob App Service User Phone website (generic) User Vision API Texture Model Text API Entity Extraction Custom API Word2Vec Custyom API Future 1 Microsoft Azure Enhanced Info Posted Cognitive Services APIs Azure ML Workbench Models Search Example: Color (Black) & Texture (Smooth) & Category (Electronics) -> It might be a cell phone
  • 33. Designed to Disrupt eBook by MS Press htttp://aka.ms/designedtodisrupt Designed to Disrupt: Reimagine Your Apps and Transform Your Industry, to help you: • Use cloud technology to give your company a competitive edge by accessing new markets, enhancing your customers’ e perience, and increasing operational efficiency. • Learn from companies who have successfully used innovative technologies—such as cognitive services, Internet of Things (IoT) and bots—to grow their businesses. • Create a digital journey roadmap, with envisioning sessions to reimagine your company’s goals and practical tools to bring your visions to life.
  • 34. ?
  • 36. Azure Expert MSP Migrations (esp. App and DC migration competency) Cloud architecture – Scalable, fail-over etc. App re-platforming Business health assessment Among other capabilities to be determined in this process Multi-layer subscription management App assessment and optimization Automated ticketing and support (ITSM) DR strategy for NOC/SOC Change management et.), Among other capabilities to be determined in this process Managed billing PaaS expertise, automated provisioning and decommissioning of environments Audit management And succession planning for people (IAM, security, stability) Enhanced cloud SLAs Cloud assessments Security by design Cloud native app development Expectation that partners have the DevOps, SecOps and SysOps capabilities across all to offer Managed Services A well configured, secure, reliant, and best performing application or infrastructure Migrations (esp. App and DC migration competency) Cloud architecture – Scalable, fail-over etc. App re-platforming Business health assessment Among other capabilities to be determined in this process Multi-layer subscription management App assessment and optimization Automated ticketing and support (ITSM) DR strategy for NOC/SOC Change management et.), Among other capabilities to be determined in this process Managed billing PaaS expertise, automated provisioning and decommissioning of environments Audit management And succession planning for people (IAM, security, stability) Enhanced cloud SLAs Cloud assessments Security by design Cloud native app development Expectation that partners have the DevOps, SecOps and SysOps capabilities across all to offer Managed Services A well configured, secure, reliant, and best performing application or infrastructure
  • 37. Cloud Migration (Simple, Complex, Packaged, Innovation) Application Catalogue SaaS - Contract PaaS – Re architect IaaS - Migrate Secure - Comply Automate - Resilience Operate - Optimize Debt - Sprawl Optimization Migration Testing Migration - Roadmap Operation Playbooks Cost Optimization Center of Excellence Compliance Playbooks Security Playbooks Workshops (Apps, Security, Migration) Business Case – Metrics - Objectives Requirements (Data, Sec, Compliance, Ops) Define Tools - Approach – App & Data Discovery CLOUD APPROACH (Start with 3-5 apps) Subscription Setup (IAM, Security, Network, Data) Ops Setup (Monitoring, Automation, Cost Mgmt, Support) Org Change Mgmt – Skills Enablement Plan • SOC 1 Type 2 (SSAE 16) attestation report • SOC 2 Type 2 (AT 101) attestation report • SOC 3 report • ISO/IEC 27001:2013 detailed audit report • ISO/IEC 27001:2013 Statement of Applicability (SoA) • PCI DSS 3.1 Report on Compliance (RoC) • FedRAMP System Security Plan • UK G-Cloud Risk Management Accredit. Document Set (RMADS) • FISC Reference/EULA • Platform Penetration Test • Risk Management SOP • Microsoft Information Security Policy • Cloud Security Alliance CCM v3.0.1 • 21 CFR Part 11 FDA (GxP) qualification guidelines • Content Delivery and Security Association certification • Many more at aka.ms/azurebom MICROSOFT TRUST CENTER Sample Compliance Bill of Materials CLOUD TOOLING *not intended as an endorsement or as a complete list MS Azure Portal Azure Policy Cost Management Azure Monitor Backup Site Recovery Azure Migration Network Watcher Cloud Shell Azure Service health Azure Advisor Application Insights Log Analytics Scheduler Security Center Azure Managed Apps OMS
  • 38. Cloud Operations P95 CPU utilizationBENEFITS OF CLOUD Automation Insight Optimization Agility & Innovation 0 20 40 60 80 100 12:00 AM 2:00 AM 4:00 AM 6:00 AM 8:00 AM 10:00 AM 12:00 PM 2:00 PM 4:00 PM 6:00 PM 8:00 PM 10:00 PM CPU Utilization CLOUD SERVICE MANAGEMENT MANIFESTO ✓ Business Service Management Focus ✓ Azure Technical Expertise, IaaS, PaaS, and SaaS Experience ✓ Cloud Lifecycle Tooling ✓ Assessment and Design Practice (Center of Excellence) ✓ Build and Migration Practice (Center of Excellence) ✓ Cloud Operations and Service Management ✓ Security and Governance Practice (Center of Excellence) ✓ Cloud SLAs, Customer Satisfaction, and Cost Optimization ✓ Continual Improvement and Process Optimization ✓ Telemetry Usage and Adherence IT vs CLOUD PROVIDER DevOps Teams Global Support Security & Compliance Service Management Microsoft Azure • Envisioning & Automation • Customer Satisfaction • Billing & show back • Cost & Perf Optimization • Incident & problem management • SLA Management • Continuous Improvement • Security, IAM, Data • Migration Services • Data Lifecycle Infrastructure • Subscription & Governance • Telemetry, Monitoring • Networking Connectivity IaaS PaaS Services IT 12% Pause savings 82% Total savings 70% Resize savings
  • 39. Providing experiences for customers where they want it Data Governance Balanced DecentralizedFederatedSelectiveCentralized Data Data Management Reporting & Analytics Decisions and activities are jointly shared between IT and the business Business users operate with autonomy The business exerts contr ol over decision making and activities, with limited input from IT Selective decisions and activities are owned by the business Single point of control and decision making; limited input from outside IT Information Risk Management Council Security Governance Risk Management Policy & Procedures Metrics & Reporting Training & Awareness Operations Leadership/Roles & Responsibilities Executive Sponsors Extended Team Core Team OS & Devices Legal • Regulatory • Privacy Finance • Compliance • Internal Audit
  • 40. Results of a Multi Year • Faster and better decisions on adoption • Azure service providers anticipate cloud needs • IT readily has the knowledge required for adoption • IT readily has mitigation plans for inhibitors • IT is the reference customer for Microsoft cloud services • IT actively adjusts efforts based on progress ACCELERATE SIMPLIFY SHOWCASE MIGRATION FACTORY APPROACH - MULTI YEAR CIO Progress Dashboard Application Consolidation Dashboard REPORT ON SUCCESS AND BENEFITS
  • 41. Enterprise Cloud Strategy eBook by MS Press http://aka.ms/enterprisecloudstrategybook or http://tinyurl.com/ Lead the journey to the cloud and drive innovation! Discover what makes the cloud so compelling to enterprises; with which applications you should start your cloud journey; how your organization will change, and how skill sets will evolve; how to measure progress; how to think about security, compliance, and business buy-in; and how to exploit the ever-growing feature set that the cloud offers to gain strategic and competitive advantage.
  • 42. THANK YOU. I t w i l l b e m y p l e a s u r e t o c o n n e c t w i t h y o u , e d u a r d o k @ m i c r o s o f t . c o m t w i t t e r . c o m / e k a s s n e r w w w . l i n k e d i n . c o m / i n / e k a s s n e r
  • 45. Inspiration Purchasing Experience Departure Experience In-Flight Experience ReflectionArrival Experience Reimagining the customer experience Anywhere Anywhere Lobby Lounge Gate Airplane Destination Flight Operations Ground Operations Airport Operations Gate Arrivals Ground
  • 48. Citizen experience journey map Digital Hotspots • Sensor Networks and City Dashboards • Open Data Portals • Intelligent Parking Systems • Intelligent Building Systems • Smart Street Lighting • Social Listening and Sentiment Analysis Systems • Integrated CRM Based Services • Student Information Systems and Student Analytics • Population Health Mgmt Solutions • Augmented Reality Solutions Using city services Using city buildings Participating in city life
  • 49. Consolidation of a Data Warehouse to run multiple analysis and ML experiments concurrently Need Data Scientist Team needed the agility to use different tools & versions, to reduce resource contention between teams and even with other stakeholders, as well as to easily present results to business. They where currently replicating very large data to different data estates in order to run analysis and experiments, as each wanted to interface to the data with different tools and APIs. This generated a LOT of waste. Solution Azure Data Warehouse proved both, faster and cheaper centralization of data than Hive and other similar approaches. Creative approaches like Cosmos DB + Search opened the door for non traditional data exploration. Business Benefits Large consolidation and reduction of the storage and optimal utilization of resources. On Premises Data Lake Data Factory Raw Data Azure Data Lake Store Raw Data Azure Data Warehouse Raw Data Filtered, Classified & Reshaped Data HDInsight Cooked Data Segmentation Cosmos DB Samples Azure Search Facets & Exploration HDInsight Cooked Data Tableau BI HDInsight Cooked Data Modelling Azure SQL Data Scientists Results Power BI Dashboarding & Result Presentation
  • 50. Dynamically shipping routes change system Blob Storage HD Insight Blob Storage Data Lake SQL DW Power BI Data Factory Input Raw Data Extraction Extracted Data Storage Query Layer Output • Shipment data • Vessel schedules • Key words • News & Weather from web Event Hub Stream Analytics Key words Mobile App The current situation does not allow a customer to change the selected route for a shipment, that has the potential to delay shipments due to disruptions along the selected route. The solution allows the company and its customers to change a specific route based on disruptions along the current route. I.e. change from sea shipping to land shipping, due to a weather, or threat conditions (typhoon, terror attacks, etc) along the route.