This document discusses the future of data and the Azure data ecosystem. It highlights that by 2025 there will be 175 zettabytes of data in the world and the average person will have over 5,000 digital interactions per day. It promotes Azure services like Power BI, Azure Synapse Analytics, Azure Data Factory and Azure Machine Learning for extracting value from data through analytics, visualization and machine learning. The document provides overviews of key Azure data and analytics services and how they fit together in an end-to-end data platform for business intelligence, artificial intelligence and continuous intelligence applications.
Power BI is a business analytics service that enables you to see all of your data through a single pane of glass. Live Power BI dashboards and reports...
BI: new of the buzz words that everyone is talking about but what is it? How can it be used to make a impact in my organization? How do I get started? In this session, we will talk about it and show you a live example in Office 365's SharePoint Online.
Objectives/Outcomes: In this session, participants will learn:
1. What is BI
2. What is Microsoft's Power BI
3. Case Studies
4. How can I get it
Power BI is a self-service business intelligence tool that allows users to analyze data and create reports and visualizations. It includes components for data discovery, analysis, and visualization both on-premises using Excel and in the cloud using the Power BI service. The tool integrates with Office 365 and allows users to discover, visualize, and share insights from data.
Power BI Tutorial For Beginners | Power BI Tutorial | Power BI Demo | Power B...
( Power BI Training - https://www.edureka.co/power-bi-training )
This Edureka videoon "Power BI Tutorial" will provide you with the fundamental knowledge on Power BI (Blog: https://goo.gl/uFTDU3). Below are the topics covered in this tutorial:
1. Why do we need Business Intelligence?
2. What is Self Service Business Intelligence?
3. Why Power BI?
4. What is Power BI?
5. Demo: Report and Dashboard Creation
Business intelligence dashboards and data visualizations serve as a launching point for better business decision making. Learn how you can leverage Power BI to easily build reports and dashboards with interactive visualizations.
Explain about power BI Overview from Power BI Desktop, Power BI Service, Power BI Report Server and Power BI Mobile that consume all BI Data from Dataset and datamodel
Groupby -Power bi dashboard in hour by vishal pawar-Presentation
Power BI Dashboard in an hour with Various Slides.
Target Audience:
Useful for Develops and DBA those who want to know what is Power BI and How we can utilize various features.
Also session will be useful for anyone who wants learn Power BI from basic.
Abstract:
In this session, We will walk through various features of Power BI, How Power BI can transform your company’s data into rich visuals and Easy yet powerful Analytics solutions for your whole organization.
At end of session with following Power BI Dashboard example
sp_Blitz in Dashboard
SQL Server Info Dashboard
Twitter Dashboard
World Dashboard
Most important takeaways from session –
You will be learning basics of Power BI with the additional perk of analyzing sp_Blitz in Power BI.
Various features of Power BI making you from ZERO to HERO
After this session, you will be able to analyze data into Power BI
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
This Edureka tutorial on "Getting started with Power BI" will provide you the fundamental knowledge of Power BI. Below are the topics covered in this tutorial:
1. What is Self Service Business Intelligence?
2. Why Power BI?
3. What is Power BI?
4. Demo on Power BI
This slide deck explains in a comprehensive way what Power BI is, how the Power BI architecture looks like and what the usage scenarios are for using Power BI and related tools
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
This Edureka Power BI Dashboard Tutorial will take you through step by step creation of Power BI dashboard. It helps you learn different functionalities present in Power BI tool with a demo on superstore dataset. You will learn how to create a Power BI dashboard by taking out multiple insights from superstore dataset and representing them visually.
Presented to The Ottawa IT Community Meetup Group (Ottawa SQL - PASS Chapter) on Thursday September 19
Powerful Self-Service BI in Excel 2013 - Data search and discovery with Power Query (formerly "Data Explorer"), analyzing and modeling with Power Pivot, visualizing and exploring with Power View and Power Map (formerly codename "GeoFlow")
Power BI consists of several components for data transformation, modeling, visualization, and natural language querying. Power Query is used to connect to data sources, clean the data, and publish to Power BI or Excel. Power Pivot is an in-memory data modeling tool using DAX. Power View enables creation of reports and visualizations. Power Map visualizes geospatial data in 3D. Power BI Desktop is a development tool and Power Q&A allows natural language questions over published models.
Power BI for Big Data and the New Look of Big Data Solutions
New features in Power BI give it enterprise tools, but that does not mean it automatically creates an enterprise solution. In this talk we will cover these new features (composite models, aggregations tables, dataflow) as well as Azure Data Lake Store Gen2, and describe the use cases and products of an individual, departmental, and enterprise big data solution. We will also talk about why a data warehouse and cubes still should be part of an enterprise solution, and how a data lake should be organized.
This document discusses Power BI, a Microsoft tool for data visualization and analytics. It covers what Power BI is, its components like Power Query, Power Pivot, and Power View. It also discusses the building blocks of Power BI like datasets, reports, dashboards and tiles. The document demonstrates how to install Power BI and introduces some key concepts like DAX and different types of visualizations. It aims to provide an overview of Power BI, its capabilities and how to use some of its main features.
This document provides an overview and instructions for attending a "Dashboard in a Day" workshop on Microsoft Power BI. It includes prerequisites for the workshop, such as having a computer that meets minimum system requirements and having a Power BI account. The agenda outlines the topics to be covered, including introductions, building reports and dashboards in Power BI Desktop and the Power BI service, and opportunities for questions. Resources are provided on connecting to the workshop wireless network and engaging with the broader Power BI community.
Optimiser votre infrastructure SQL Server avec Azure
Dans cette session nous vous présenterons les différentes manières d'utiliser SQL Server dans une infrastructure Cloud (Microsoft Azure). Seront présentés des scénarios hybrides, de migration, de backup, et d'hébergement de bases de données SQL Server en mode IaaS ou PaaS.
This document provides an overview of a course on implementing a modern data platform architecture using Azure services. The course objectives are to understand cloud and big data concepts, the role of Azure data services in a modern data platform, and how to implement a reference architecture using Azure data services. The course will provide an ARM template for a data platform solution that can address most data challenges.
Azure SQL DB Managed Instances Built to easily modernize application data layer
The document discusses Azure SQL Database Managed Instance, a new fully managed database service that provides SQL Server compatibility. It offers seamless migration of SQL Server workloads to the cloud with full compatibility, isolation, security and manageability. Customers can realize up to a 406% ROI over on-premises solutions through lower TCO, automatic management and scaling capabilities.
Azure Days 2019: Business Intelligence auf Azure (Marco Amhof & Yves Mauron)
In dieser Session stellen wir ein Projekt vor, in welchem wir ein umfassendes BI-System mit Hilfe von Azure Blob Storage, Azure SQL, Azure Logic Apps und Azure Analysis Services für und in der Azure Cloud aufgebaut haben. Wir berichten über die Herausforderungen, wie wir diese gelöst haben und welche Learnings und Best Practices wir mitgenommen haben.
Azure Data Factory for Redmond SQL PASS UG Sept 2018
Azure Data Factory is a fully managed data integration service in the cloud. It provides a graphical user interface for building data pipelines without coding. Pipelines can orchestrate data movement and transformations across hybrid and multi-cloud environments. Azure Data Factory supports incremental loading, on-demand Spark, and lifting SQL Server Integration Services packages to the cloud.
Azure provides cloud computing services including infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS) that allow users to rapidly setup environments, scale resources to meet demands, and increase efficiency. Azure offers a wide range of services such as compute, storage, databases, analytics, machine learning, IoT, and security to help users migrate existing applications or build new cloud-native applications. The document outlines key scenarios for using Azure such as development/testing, lift and shift of existing applications, big data analytics, and identity management to provide a starting point for leveraging the cloud platform
So you got a handle on what Big Data is and how you can use it to find business value in your data. Now you need an understanding of the Microsoft products that can be used to create a Big Data solution. Microsoft has many pieces of the puzzle and in this presentation I will show how they fit together. How does Microsoft enhance and add value to Big Data? From collecting data, transforming it, storing it, to visualizing it, I will show you Microsoft’s solutions for every step of the way
Azure SQL Database now has a Managed Instance, for near 100% compatibility for lifting-and-shifting applications running on Microsoft SQL Server to Azure. Contact me for more information.
1 Introduction to Microsoft data platform analytics for release
Part 1 of a conference workshop. This forms the morning session, which looks at moving from Business Intelligence to Analytics.
Topics Covered: Azure Data Explorer, Azure Data Factory, Azure Synapse Analytics, Event Hubs, HDInsight, Big Data
This document discusses ETL patterns in the cloud using Azure Data Factory. It covers topics like ETL vs ELT, the importance of scale and flexible schemas in cloud ETL, and how Azure Data Factory supports workflows, templates, and integration with on-premises and cloud data. It also provides examples of nightly ETL data flows, handling schema drift, loading dimensional models, and data science scenarios using Azure data services.
The breath and depth of Azure products that fall under the AI and ML umbrella can be difficult to follow. In this presentation I’ll first define exactly what AI, ML, and deep learning is, and then go over the various Microsoft AI and ML products and their use cases.
The document discusses Azure Data Factory and its capabilities for cloud-first data integration and transformation. ADF allows orchestrating data movement and transforming data at scale across hybrid and multi-cloud environments using a visual, code-free interface. It provides serverless scalability without infrastructure to manage along with capabilities for lifting and running SQL Server Integration Services packages in Azure.
The new Microsoft Azure SQL Data Warehouse (SQL DW) is an elastic data warehouse-as-a-service and is a Massively Parallel Processing (MPP) solution for "big data" with true enterprise class features. The SQL DW service is built for data warehouse workloads from a few hundred gigabytes to petabytes of data with truly unique features like disaggregated compute and storage allowing for customers to be able to utilize the service to match their needs. In this presentation, we take an in-depth look at implementing a SQL DW, elastic scale (grow, shrink, and pause), and hybrid data clouds with Hadoop integration via Polybase allowing for a true SQL experience across structured and unstructured data.
This document provides an overview of 6 modules related to SQL Server workshops:
- Module 1 covers database design and architecture sessions
- Module 2 focuses on intelligent query processing, data classification/auditing, database recovery, data virtualization, and replication capabilities
- Module 3 discusses the big data landscape, including data growth drivers, common use cases, and scale-out processing approaches like Hadoop and Spark
Azure Machine Learning Services provides an end-to-end, scalable platform for operationalizing machine learning models. It allows users to deploy models everywhere from containers and Kubernetes to SQL Datawarehouse and Cosmos DB. It also offers tools to boost data science productivity, increase experimentation, and automate model retraining. The platform seamlessly integrates with Azure services and is built to deploy models globally at scale with high availability and low latency.
Modern Business Intelligence and Advanced Analytics
This document summarizes how businesses can transform through business intelligence (BI) and advanced analytics using Microsoft's modern BI platform. It outlines the Power BI and Azure Analysis Services tools for visualization, data modeling, and analytics. It also discusses how Collective Intelligence and Microsoft can help customers accelerate their move to a data-driven culture and realize benefits like increased productivity and cost savings by implementing BI and advanced analytics solutions in the cloud. The presentation includes demonstrations of Power BI and Azure Analysis Services.
This are my keynote slides from SQL Saturday Oregon 2023 on AI and the Intersection of AI, Machine Learning and Economnic Challenges as a Technical Specialist
This document discusses migrating high IO SQL Server workloads to Azure. It begins by explaining that every company has at least one "whale" workload that requires high CPU, memory and IO. These whales can be challenging to move to the cloud. The document then provides tips on determining if a workload's issue is truly high IO or caused by another factor. It discusses various wait events that may indicate IO problems and tools for monitoring IO performance. Finally, it covers some considerations for IO in the cloud.
This document provides an overview of options for running Oracle solutions on Microsoft Azure infrastructure as a service (IaaS). It discusses architectural considerations for high availability, disaster recovery, storage, licensing, and migrating workloads from Oracle Exadata. Key points covered include using Oracle Data Guard for replication and failover, storage options like Azure NetApp Files that can support Exadata workloads, and identifying databases that are not dependent on Exadata features for lift and shift to Azure IaaS. The document aims to help customers understand how to optimize their use of Oracle solutions when deploying to Azure.
This document provides guidance and best practices for migrating database workloads to infrastructure as a service (IaaS) in Microsoft Azure. It discusses choosing the appropriate virtual machine series and storage options to meet performance needs. The document emphasizes migrating the workload, not the hardware, and using cloud services to simplify management like automated patching and backup snapshots. It also recommends bringing existing monitoring and management tools to the cloud when possible rather than replacing them. The key takeaways are to understand the workload demands, choose optimal IaaS configurations, leverage cloud-enabled tools, and involve database experts when issues arise to address the root cause rather than just adding resources.
This document discusses strategies for managing ADHD as an adult. It begins by describing the three main types of ADHD - inattentive, hyperactive-impulsive, and combined. It then lists some of the biggest challenges of ADHD like executive dysfunction, disorganization, lack of attention, procrastination, and internal preoccupation. The document provides tips and strategies for overcoming each challenge through organization, scheduling, list-making, breaking large tasks into small ones, and using technology tools. It emphasizes finding accommodations that work for the individual and their specific ADHD presentation and challenges.
This document provides guidance and best practices for using Infrastructure as a Service (IaaS) on Microsoft Azure for database workloads. It discusses key differences between IaaS, Platform as a Service (PaaS), and Software as a Service (SaaS). The document also covers Azure-specific concepts like virtual machine series, availability zones, storage accounts, and redundancy options to help architects design cloud infrastructures that meet business requirements. Specialized configurations like constrained VMs and ultra disks are also presented along with strategies for ensuring high performance and availability of database workloads on Azure IaaS.
Turning ADHD into "Awesome Dynamic Highly Dependable"
Kellyn Gorman shares her experience living with ADHD and strategies for turning it into a positive. She discusses how ADHD impacted her childhood and how it still presents challenges as an adult. However, with the right tools and understanding of her needs, she is able to find success. She provides tips for organizing, prioritizing tasks, managing distractions, and accessing support. The key is learning about ADHD and how to structure one's environment and routine to play to one's strengths rather than fighting against the condition.
Migrating Oracle workloads to Azure requires understanding the workload and hardware requirements. It is important to analyze the workload using the Automatic Workload Repository (AWR) report to accurately size infrastructure needs. The right virtual machine series and storage options must be selected to meet the identified input/output and capacity needs. Rather than moving existing hardware, the focus should be migrating the Oracle workload to take advantage of cloud capabilities while ensuring performance and high availability.
This document discusses overcoming silos when implementing DevOps for a new product at a company. The teams involved were dispersed globally and siloed in their tools and processes. Challenges included isolating workload sizes, choosing a Linux image, and team ownership issues. The solution involved aligning teams, automating deployment with Bash scripts called by Terraform and Azure DevOps, and evolving the automation. This improved communication, decreased teams from 120 people to 7, and increased deployments and profits for the successful project.
This document discusses best practices for migrating database workloads to Azure Infrastructure as a Service (IaaS). Some key points include:
- Choosing the appropriate VM series like E or M series optimized for database workloads.
- Using availability zones and geo-redundant storage for high availability and disaster recovery.
- Sizing storage correctly based on the database's input/output needs and using premium SSDs where needed.
- Migrating existing monitoring and management tools to the cloud to provide familiarity and automating tasks like backups, patching, and problem resolution.
This document provides an overview of how to successfully migrate Oracle workloads to Microsoft Azure. It begins with an introduction of the presenter and their experience. It then discusses why customers might want to migrate to the cloud and the different Azure database options available. The bulk of the document outlines the key steps in planning and executing an Oracle workload migration to Azure, including sizing, deployment, monitoring, backup strategies, and ensuring high availability. It emphasizes adapting architectures for the cloud rather than directly porting on-premises systems. The document concludes with recommendations around automation, education resources, and references for Oracle-Azure configurations.
Pass Summit Linux Scripting for the Microsoft Professional
This is the second session of the learning pathway at PASS Summit 2019, which is still a stand alone session to teach you how to write proper Linux BASH scripts
This document discusses techniques for optimizing Power BI performance. It recommends tracing queries using DAX Studio to identify slow queries and refresh times. Tracing tools like SQL Profiler and log files can provide insights into issues occurring in the data sources, Power BI layer, and across the network. Focusing on optimization by addressing wait times through a scientific process can help resolve long-term performance problems.
The document provides tips and tricks for scripting success on Linux. It begins with introducing the speaker and emphasizing that the session will focus on best practices for those already familiar with BASH scripting. It then details various tips across multiple areas: setting the shell and environment variables, adding headers and comments to scripts, validating input, implementing error handling and debugging, leveraging utilities like CRON for scheduling, and ensuring scripts continue running across sessions. The tips are meant to help authors write more readable, maintainable, and reliable scripts.
This document discusses connecting Oracle Analytics Cloud (OAC) Essbase data to Microsoft Power BI. It provides an overview of Power BI and OAC, describes various methods for connecting the two including using a REST API and exporting data to Excel or CSV files, and demonstrates some visualization capabilities in Power BI including trends over time. Key lessons learned are that data can be accessed across tools through various connections, analytics concepts are often similar between tools, and while partnerships exist between Microsoft and Oracle, integration between specific products like Power BI and OAC is still limited.
Mentors provide guidance and support, while sponsors use their influence to advocate for and promote a protege's career. Obtaining both mentors and sponsors is important for advancing in one's field and overcoming biases, yet women often have fewer sponsors than men. The document outlines strategies for how women can find and work with sponsors, and how men can act as allies in supporting women. Developing representation of women in technology fields through mentorship and sponsorship can help initiatives become self-sustaining over time.
Kellyn Pot'Vin-Gorman presented on GDPR compliance. Some key points include:
- GDPR went into effect in May 2018 and covers any data belonging to an EU citizen.
- Fines for non-compliance can be up to 4% of annual revenue or €20 million.
- DBAs play a role in identifying critical data, auditing processes, and reporting on compliance.
- An AI tool assessed the privacy policies of 14 major companies and found they all failed to meet GDPR requirements.
- Achieving compliance requires security frameworks, data mapping, encryption, access controls, and dedicated teams.
Quality Patents: Patents That Stand the Test of Time
Is your patent a vanity piece of paper for your office wall? Or is it a reliable, defendable, assertable, property right? The difference is often quality.
Is your patent simply a transactional cost and a large pile of legal bills for your startup? Or is it a leverageable asset worthy of attracting precious investment dollars, worth its cost in multiples of valuation? The difference is often quality.
Is your patent application only good enough to get through the examination process? Or has it been crafted to stand the tests of time and varied audiences if you later need to assert that document against an infringer, find yourself litigating with it in an Article 3 Court at the hands of a judge and jury, God forbid, end up having to defend its validity at the PTAB, or even needing to use it to block pirated imports at the International Trade Commission? The difference is often quality.
Quality will be our focus for a good chunk of the remainder of this season. What goes into a quality patent, and where possible, how do you get it without breaking the bank?
** Episode Overview **
In this first episode of our quality series, Kristen Hansen and the panel discuss:
⦿ What do we mean when we say patent quality?
⦿ Why is patent quality important?
⦿ How to balance quality and budget
⦿ The importance of searching, continuations, and draftsperson domain expertise
⦿ Very practical tips, tricks, examples, and Kristen’s Musts for drafting quality applications
https://www.aurorapatents.com/patently-strategic-podcast.html
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data.
The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs.
Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution!
Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.
Power BI is a business analytics service that allows users to analyze data and share insights. It includes dashboards, reports, and datasets that can be viewed on mobile devices. Power BI integrates with various data sources and platforms like SQL Server, Azure, and Office 365. It provides self-service business intelligence capabilities for end users to explore and visualize data without assistance from IT departments.
Power BI is a business intelligence tool that converts data from different sources into attractive dashboards and reports. It includes Power BI Desktop for creating reports, Power BI Service for publishing reports, and Power BI mobile apps for viewing reports and dashboards. Power BI Desktop can import or directly query data from various sources like files, databases, and the web. It allows users to transform, visualize, and analyze data to gain insights. The imported data is stored in the Power BI service, while direct query leaves the data in its source.
Power BI is a business analytics service that enables you to see all of your data through a single pane of glass. Live Power BI dashboards and reports...
BI: new of the buzz words that everyone is talking about but what is it? How can it be used to make a impact in my organization? How do I get started? In this session, we will talk about it and show you a live example in Office 365's SharePoint Online.
Objectives/Outcomes: In this session, participants will learn:
1. What is BI
2. What is Microsoft's Power BI
3. Case Studies
4. How can I get it
Power BI is a self-service business intelligence tool that allows users to analyze data and create reports and visualizations. It includes components for data discovery, analysis, and visualization both on-premises using Excel and in the cloud using the Power BI service. The tool integrates with Office 365 and allows users to discover, visualize, and share insights from data.
Power BI Tutorial For Beginners | Power BI Tutorial | Power BI Demo | Power B...Edureka!
( Power BI Training - https://www.edureka.co/power-bi-training )
This Edureka videoon "Power BI Tutorial" will provide you with the fundamental knowledge on Power BI (Blog: https://goo.gl/uFTDU3). Below are the topics covered in this tutorial:
1. Why do we need Business Intelligence?
2. What is Self Service Business Intelligence?
3. Why Power BI?
4. What is Power BI?
5. Demo: Report and Dashboard Creation
Business intelligence dashboards and data visualizations serve as a launching point for better business decision making. Learn how you can leverage Power BI to easily build reports and dashboards with interactive visualizations.
Explain about power BI Overview from Power BI Desktop, Power BI Service, Power BI Report Server and Power BI Mobile that consume all BI Data from Dataset and datamodel
Groupby -Power bi dashboard in hour by vishal pawar-Presentation Vishal Pawar
Power BI Dashboard in an hour with Various Slides.
Target Audience:
Useful for Develops and DBA those who want to know what is Power BI and How we can utilize various features.
Also session will be useful for anyone who wants learn Power BI from basic.
Abstract:
In this session, We will walk through various features of Power BI, How Power BI can transform your company’s data into rich visuals and Easy yet powerful Analytics solutions for your whole organization.
At end of session with following Power BI Dashboard example
sp_Blitz in Dashboard
SQL Server Info Dashboard
Twitter Dashboard
World Dashboard
Most important takeaways from session –
You will be learning basics of Power BI with the additional perk of analyzing sp_Blitz in Power BI.
Various features of Power BI making you from ZERO to HERO
After this session, you will be able to analyze data into Power BI
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...Edureka!
This Edureka tutorial on "Getting started with Power BI" will provide you the fundamental knowledge of Power BI. Below are the topics covered in this tutorial:
1. What is Self Service Business Intelligence?
2. Why Power BI?
3. What is Power BI?
4. Demo on Power BI
This slide deck explains in a comprehensive way what Power BI is, how the Power BI architecture looks like and what the usage scenarios are for using Power BI and related tools
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | EdurekaEdureka!
This Edureka Power BI Dashboard Tutorial will take you through step by step creation of Power BI dashboard. It helps you learn different functionalities present in Power BI tool with a demo on superstore dataset. You will learn how to create a Power BI dashboard by taking out multiple insights from superstore dataset and representing them visually.
Presented to The Ottawa IT Community Meetup Group (Ottawa SQL - PASS Chapter) on Thursday September 19
Powerful Self-Service BI in Excel 2013 - Data search and discovery with Power Query (formerly "Data Explorer"), analyzing and modeling with Power Pivot, visualizing and exploring with Power View and Power Map (formerly codename "GeoFlow")
Power BI consists of several components for data transformation, modeling, visualization, and natural language querying. Power Query is used to connect to data sources, clean the data, and publish to Power BI or Excel. Power Pivot is an in-memory data modeling tool using DAX. Power View enables creation of reports and visualizations. Power Map visualizes geospatial data in 3D. Power BI Desktop is a development tool and Power Q&A allows natural language questions over published models.
Power BI for Big Data and the New Look of Big Data SolutionsJames Serra
New features in Power BI give it enterprise tools, but that does not mean it automatically creates an enterprise solution. In this talk we will cover these new features (composite models, aggregations tables, dataflow) as well as Azure Data Lake Store Gen2, and describe the use cases and products of an individual, departmental, and enterprise big data solution. We will also talk about why a data warehouse and cubes still should be part of an enterprise solution, and how a data lake should be organized.
This document discusses Power BI, a Microsoft tool for data visualization and analytics. It covers what Power BI is, its components like Power Query, Power Pivot, and Power View. It also discusses the building blocks of Power BI like datasets, reports, dashboards and tiles. The document demonstrates how to install Power BI and introduces some key concepts like DAX and different types of visualizations. It aims to provide an overview of Power BI, its capabilities and how to use some of its main features.
This document provides an overview and instructions for attending a "Dashboard in a Day" workshop on Microsoft Power BI. It includes prerequisites for the workshop, such as having a computer that meets minimum system requirements and having a Power BI account. The agenda outlines the topics to be covered, including introductions, building reports and dashboards in Power BI Desktop and the Power BI service, and opportunities for questions. Resources are provided on connecting to the workshop wireless network and engaging with the broader Power BI community.
Dans cette session nous vous présenterons les différentes manières d'utiliser SQL Server dans une infrastructure Cloud (Microsoft Azure). Seront présentés des scénarios hybrides, de migration, de backup, et d'hébergement de bases de données SQL Server en mode IaaS ou PaaS.
This document provides an overview of a course on implementing a modern data platform architecture using Azure services. The course objectives are to understand cloud and big data concepts, the role of Azure data services in a modern data platform, and how to implement a reference architecture using Azure data services. The course will provide an ARM template for a data platform solution that can address most data challenges.
Azure SQL DB Managed Instances Built to easily modernize application data layerMicrosoft Tech Community
The document discusses Azure SQL Database Managed Instance, a new fully managed database service that provides SQL Server compatibility. It offers seamless migration of SQL Server workloads to the cloud with full compatibility, isolation, security and manageability. Customers can realize up to a 406% ROI over on-premises solutions through lower TCO, automatic management and scaling capabilities.
Azure Days 2019: Business Intelligence auf Azure (Marco Amhof & Yves Mauron)Trivadis
In dieser Session stellen wir ein Projekt vor, in welchem wir ein umfassendes BI-System mit Hilfe von Azure Blob Storage, Azure SQL, Azure Logic Apps und Azure Analysis Services für und in der Azure Cloud aufgebaut haben. Wir berichten über die Herausforderungen, wie wir diese gelöst haben und welche Learnings und Best Practices wir mitgenommen haben.
Azure Data Factory for Redmond SQL PASS UG Sept 2018Mark Kromer
Azure Data Factory is a fully managed data integration service in the cloud. It provides a graphical user interface for building data pipelines without coding. Pipelines can orchestrate data movement and transformations across hybrid and multi-cloud environments. Azure Data Factory supports incremental loading, on-demand Spark, and lifting SQL Server Integration Services packages to the cloud.
Azure provides cloud computing services including infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS) that allow users to rapidly setup environments, scale resources to meet demands, and increase efficiency. Azure offers a wide range of services such as compute, storage, databases, analytics, machine learning, IoT, and security to help users migrate existing applications or build new cloud-native applications. The document outlines key scenarios for using Azure such as development/testing, lift and shift of existing applications, big data analytics, and identity management to provide a starting point for leveraging the cloud platform
So you got a handle on what Big Data is and how you can use it to find business value in your data. Now you need an understanding of the Microsoft products that can be used to create a Big Data solution. Microsoft has many pieces of the puzzle and in this presentation I will show how they fit together. How does Microsoft enhance and add value to Big Data? From collecting data, transforming it, storing it, to visualizing it, I will show you Microsoft’s solutions for every step of the way
Azure SQL Database now has a Managed Instance, for near 100% compatibility for lifting-and-shifting applications running on Microsoft SQL Server to Azure. Contact me for more information.
1 Introduction to Microsoft data platform analytics for releaseJen Stirrup
Part 1 of a conference workshop. This forms the morning session, which looks at moving from Business Intelligence to Analytics.
Topics Covered: Azure Data Explorer, Azure Data Factory, Azure Synapse Analytics, Event Hubs, HDInsight, Big Data
Azure Data Factory ETL Patterns in the CloudMark Kromer
This document discusses ETL patterns in the cloud using Azure Data Factory. It covers topics like ETL vs ELT, the importance of scale and flexible schemas in cloud ETL, and how Azure Data Factory supports workflows, templates, and integration with on-premises and cloud data. It also provides examples of nightly ETL data flows, handling schema drift, loading dimensional models, and data science scenarios using Azure data services.
The breath and depth of Azure products that fall under the AI and ML umbrella can be difficult to follow. In this presentation I’ll first define exactly what AI, ML, and deep learning is, and then go over the various Microsoft AI and ML products and their use cases.
The document discusses Azure Data Factory and its capabilities for cloud-first data integration and transformation. ADF allows orchestrating data movement and transforming data at scale across hybrid and multi-cloud environments using a visual, code-free interface. It provides serverless scalability without infrastructure to manage along with capabilities for lifting and running SQL Server Integration Services packages in Azure.
The new Microsoft Azure SQL Data Warehouse (SQL DW) is an elastic data warehouse-as-a-service and is a Massively Parallel Processing (MPP) solution for "big data" with true enterprise class features. The SQL DW service is built for data warehouse workloads from a few hundred gigabytes to petabytes of data with truly unique features like disaggregated compute and storage allowing for customers to be able to utilize the service to match their needs. In this presentation, we take an in-depth look at implementing a SQL DW, elastic scale (grow, shrink, and pause), and hybrid data clouds with Hadoop integration via Polybase allowing for a true SQL experience across structured and unstructured data.
This document provides an overview of 6 modules related to SQL Server workshops:
- Module 1 covers database design and architecture sessions
- Module 2 focuses on intelligent query processing, data classification/auditing, database recovery, data virtualization, and replication capabilities
- Module 3 discusses the big data landscape, including data growth drivers, common use cases, and scale-out processing approaches like Hadoop and Spark
Azure Machine Learning Services provides an end-to-end, scalable platform for operationalizing machine learning models. It allows users to deploy models everywhere from containers and Kubernetes to SQL Datawarehouse and Cosmos DB. It also offers tools to boost data science productivity, increase experimentation, and automate model retraining. The platform seamlessly integrates with Azure services and is built to deploy models globally at scale with high availability and low latency.
This document summarizes how businesses can transform through business intelligence (BI) and advanced analytics using Microsoft's modern BI platform. It outlines the Power BI and Azure Analysis Services tools for visualization, data modeling, and analytics. It also discusses how Collective Intelligence and Microsoft can help customers accelerate their move to a data-driven culture and realize benefits like increased productivity and cost savings by implementing BI and advanced analytics solutions in the cloud. The presentation includes demonstrations of Power BI and Azure Analysis Services.
Similar to Cepta The Future of Data with Power BI (20)
This are my keynote slides from SQL Saturday Oregon 2023 on AI and the Intersection of AI, Machine Learning and Economnic Challenges as a Technical Specialist
This document discusses migrating high IO SQL Server workloads to Azure. It begins by explaining that every company has at least one "whale" workload that requires high CPU, memory and IO. These whales can be challenging to move to the cloud. The document then provides tips on determining if a workload's issue is truly high IO or caused by another factor. It discusses various wait events that may indicate IO problems and tools for monitoring IO performance. Finally, it covers some considerations for IO in the cloud.
This document provides an overview of options for running Oracle solutions on Microsoft Azure infrastructure as a service (IaaS). It discusses architectural considerations for high availability, disaster recovery, storage, licensing, and migrating workloads from Oracle Exadata. Key points covered include using Oracle Data Guard for replication and failover, storage options like Azure NetApp Files that can support Exadata workloads, and identifying databases that are not dependent on Exadata features for lift and shift to Azure IaaS. The document aims to help customers understand how to optimize their use of Oracle solutions when deploying to Azure.
This document provides guidance and best practices for migrating database workloads to infrastructure as a service (IaaS) in Microsoft Azure. It discusses choosing the appropriate virtual machine series and storage options to meet performance needs. The document emphasizes migrating the workload, not the hardware, and using cloud services to simplify management like automated patching and backup snapshots. It also recommends bringing existing monitoring and management tools to the cloud when possible rather than replacing them. The key takeaways are to understand the workload demands, choose optimal IaaS configurations, leverage cloud-enabled tools, and involve database experts when issues arise to address the root cause rather than just adding resources.
This document discusses strategies for managing ADHD as an adult. It begins by describing the three main types of ADHD - inattentive, hyperactive-impulsive, and combined. It then lists some of the biggest challenges of ADHD like executive dysfunction, disorganization, lack of attention, procrastination, and internal preoccupation. The document provides tips and strategies for overcoming each challenge through organization, scheduling, list-making, breaking large tasks into small ones, and using technology tools. It emphasizes finding accommodations that work for the individual and their specific ADHD presentation and challenges.
This document provides guidance and best practices for using Infrastructure as a Service (IaaS) on Microsoft Azure for database workloads. It discusses key differences between IaaS, Platform as a Service (PaaS), and Software as a Service (SaaS). The document also covers Azure-specific concepts like virtual machine series, availability zones, storage accounts, and redundancy options to help architects design cloud infrastructures that meet business requirements. Specialized configurations like constrained VMs and ultra disks are also presented along with strategies for ensuring high performance and availability of database workloads on Azure IaaS.
Kellyn Gorman shares her experience living with ADHD and strategies for turning it into a positive. She discusses how ADHD impacted her childhood and how it still presents challenges as an adult. However, with the right tools and understanding of her needs, she is able to find success. She provides tips for organizing, prioritizing tasks, managing distractions, and accessing support. The key is learning about ADHD and how to structure one's environment and routine to play to one's strengths rather than fighting against the condition.
Migrating Oracle workloads to Azure requires understanding the workload and hardware requirements. It is important to analyze the workload using the Automatic Workload Repository (AWR) report to accurately size infrastructure needs. The right virtual machine series and storage options must be selected to meet the identified input/output and capacity needs. Rather than moving existing hardware, the focus should be migrating the Oracle workload to take advantage of cloud capabilities while ensuring performance and high availability.
This document discusses overcoming silos when implementing DevOps for a new product at a company. The teams involved were dispersed globally and siloed in their tools and processes. Challenges included isolating workload sizes, choosing a Linux image, and team ownership issues. The solution involved aligning teams, automating deployment with Bash scripts called by Terraform and Azure DevOps, and evolving the automation. This improved communication, decreased teams from 120 people to 7, and increased deployments and profits for the successful project.
This document discusses best practices for migrating database workloads to Azure Infrastructure as a Service (IaaS). Some key points include:
- Choosing the appropriate VM series like E or M series optimized for database workloads.
- Using availability zones and geo-redundant storage for high availability and disaster recovery.
- Sizing storage correctly based on the database's input/output needs and using premium SSDs where needed.
- Migrating existing monitoring and management tools to the cloud to provide familiarity and automating tasks like backups, patching, and problem resolution.
This document provides an overview of how to successfully migrate Oracle workloads to Microsoft Azure. It begins with an introduction of the presenter and their experience. It then discusses why customers might want to migrate to the cloud and the different Azure database options available. The bulk of the document outlines the key steps in planning and executing an Oracle workload migration to Azure, including sizing, deployment, monitoring, backup strategies, and ensuring high availability. It emphasizes adapting architectures for the cloud rather than directly porting on-premises systems. The document concludes with recommendations around automation, education resources, and references for Oracle-Azure configurations.
This is the second session of the learning pathway at PASS Summit 2019, which is still a stand alone session to teach you how to write proper Linux BASH scripts
This document discusses techniques for optimizing Power BI performance. It recommends tracing queries using DAX Studio to identify slow queries and refresh times. Tracing tools like SQL Profiler and log files can provide insights into issues occurring in the data sources, Power BI layer, and across the network. Focusing on optimization by addressing wait times through a scientific process can help resolve long-term performance problems.
The document provides tips and tricks for scripting success on Linux. It begins with introducing the speaker and emphasizing that the session will focus on best practices for those already familiar with BASH scripting. It then details various tips across multiple areas: setting the shell and environment variables, adding headers and comments to scripts, validating input, implementing error handling and debugging, leveraging utilities like CRON for scheduling, and ensuring scripts continue running across sessions. The tips are meant to help authors write more readable, maintainable, and reliable scripts.
This document discusses connecting Oracle Analytics Cloud (OAC) Essbase data to Microsoft Power BI. It provides an overview of Power BI and OAC, describes various methods for connecting the two including using a REST API and exporting data to Excel or CSV files, and demonstrates some visualization capabilities in Power BI including trends over time. Key lessons learned are that data can be accessed across tools through various connections, analytics concepts are often similar between tools, and while partnerships exist between Microsoft and Oracle, integration between specific products like Power BI and OAC is still limited.
Mentors provide guidance and support, while sponsors use their influence to advocate for and promote a protege's career. Obtaining both mentors and sponsors is important for advancing in one's field and overcoming biases, yet women often have fewer sponsors than men. The document outlines strategies for how women can find and work with sponsors, and how men can act as allies in supporting women. Developing representation of women in technology fields through mentorship and sponsorship can help initiatives become self-sustaining over time.
Kellyn Pot'Vin-Gorman presented on GDPR compliance. Some key points include:
- GDPR went into effect in May 2018 and covers any data belonging to an EU citizen.
- Fines for non-compliance can be up to 4% of annual revenue or €20 million.
- DBAs play a role in identifying critical data, auditing processes, and reporting on compliance.
- An AI tool assessed the privacy policies of 14 major companies and found they all failed to meet GDPR requirements.
- Achieving compliance requires security frameworks, data mapping, encryption, access controls, and dedicated teams.
Quality Patents: Patents That Stand the Test of TimeAurora Consulting
Is your patent a vanity piece of paper for your office wall? Or is it a reliable, defendable, assertable, property right? The difference is often quality.
Is your patent simply a transactional cost and a large pile of legal bills for your startup? Or is it a leverageable asset worthy of attracting precious investment dollars, worth its cost in multiples of valuation? The difference is often quality.
Is your patent application only good enough to get through the examination process? Or has it been crafted to stand the tests of time and varied audiences if you later need to assert that document against an infringer, find yourself litigating with it in an Article 3 Court at the hands of a judge and jury, God forbid, end up having to defend its validity at the PTAB, or even needing to use it to block pirated imports at the International Trade Commission? The difference is often quality.
Quality will be our focus for a good chunk of the remainder of this season. What goes into a quality patent, and where possible, how do you get it without breaking the bank?
** Episode Overview **
In this first episode of our quality series, Kristen Hansen and the panel discuss:
⦿ What do we mean when we say patent quality?
⦿ Why is patent quality important?
⦿ How to balance quality and budget
⦿ The importance of searching, continuations, and draftsperson domain expertise
⦿ Very practical tips, tricks, examples, and Kristen’s Musts for drafting quality applications
https://www.aurorapatents.com/patently-strategic-podcast.html
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionBert Blevins
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data.
The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs.
Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution!
Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsMydbops
This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization.
Key Takeaways:
* Understand why connection pooling is essential for high-traffic applications
* Explore various connection poolers available for PostgreSQL, including pgbouncer
* Learn the configuration options and functionalities of pgbouncer
* Discover best practices for monitoring and troubleshooting connection pooling setups
* Gain insights into real-world use cases and considerations for production environments
This presentation is ideal for:
* Database administrators (DBAs)
* Developers working with PostgreSQL
* DevOps engineers
* Anyone interested in optimizing PostgreSQL performance
Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services
Best Practices for Effectively Running dbt in Airflow.pdfTatiana Al-Chueyr
As a popular open-source library for analytics engineering, dbt is often used in combination with Airflow. Orchestrating and executing dbt models as DAGs ensures an additional layer of control over tasks, observability, and provides a reliable, scalable environment to run dbt models.
This webinar will cover a step-by-step guide to Cosmos, an open source package from Astronomer that helps you easily run your dbt Core projects as Airflow DAGs and Task Groups, all with just a few lines of code. We’ll walk through:
- Standard ways of running dbt (and when to utilize other methods)
- How Cosmos can be used to run and visualize your dbt projects in Airflow
- Common challenges and how to address them, including performance, dependency conflicts, and more
- How running dbt projects in Airflow helps with cost optimization
Webinar given on 9 July 2024
YOUR RELIABLE WEB DESIGN & DEVELOPMENT TEAM — FOR LASTING SUCCESS
WPRiders is a web development company specialized in WordPress and WooCommerce websites and plugins for customers around the world. The company is headquartered in Bucharest, Romania, but our team members are located all over the world. Our customers are primarily from the US and Western Europe, but we have clients from Australia, Canada and other areas as well.
Some facts about WPRiders and why we are one of the best firms around:
More than 700 five-star reviews! You can check them here.
1500 WordPress projects delivered.
We respond 80% faster than other firms! Data provided by Freshdesk.
We’ve been in business since 2015.
We are located in 7 countries and have 22 team members.
With so many projects delivered, our team knows what works and what doesn’t when it comes to WordPress and WooCommerce.
Our team members are:
- highly experienced developers (employees & contractors with 5 -10+ years of experience),
- great designers with an eye for UX/UI with 10+ years of experience
- project managers with development background who speak both tech and non-tech
- QA specialists
- Conversion Rate Optimisation - CRO experts
They are all working together to provide you with the best possible service. We are passionate about WordPress, and we love creating custom solutions that help our clients achieve their goals.
At WPRiders, we are committed to building long-term relationships with our clients. We believe in accountability, in doing the right thing, as well as in transparency and open communication. You can read more about WPRiders on the About us page.
Transcript: Details of description part II: Describing images in practice - T...BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
How Social Media Hackers Help You to See Your Wife's Message.pdfHackersList
In the modern digital era, social media platforms have become integral to our daily lives. These platforms, including Facebook, Instagram, WhatsApp, and Snapchat, offer countless ways to connect, share, and communicate.
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Bert Blevins
Today’s digitally connected world presents a wide range of security challenges for enterprises. Insider security threats are particularly noteworthy because they have the potential to cause significant harm. Unlike external threats, insider risks originate from within the company, making them more subtle and challenging to identify. This blog aims to provide a comprehensive understanding of insider security threats, including their types, examples, effects, and mitigation techniques.
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Chris Swan
Have you noticed the OpenSSF Scorecard badges on the official Dart and Flutter repos? It's Google's way of showing that they care about security. Practices such as pinning dependencies, branch protection, required reviews, continuous integration tests etc. are measured to provide a score and accompanying badge.
You can do the same for your projects, and this presentation will show you how, with an emphasis on the unique challenges that come up when working with Dart and Flutter.
The session will provide a walkthrough of the steps involved in securing a first repository, and then what it takes to repeat that process across an organization with multiple repos. It will also look at the ongoing maintenance involved once scorecards have been implemented, and how aspects of that maintenance can be better automated to minimize toil.
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxSynapseIndia
Your comprehensive guide to RPA in healthcare for 2024. Explore the benefits, use cases, and emerging trends of robotic process automation. Understand the challenges and prepare for the future of healthcare automation
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
Mitigating the Impact of State Management in Cloud Stream Processing SystemsScyllaDB
Stream processing is a crucial component of modern data infrastructure, but constructing an efficient and scalable stream processing system can be challenging. Decoupling compute and storage architecture has emerged as an effective solution to these challenges, but it can introduce high latency issues, especially when dealing with complex continuous queries that necessitate managing extra-large internal states.
In this talk, we focus on addressing the high latency issues associated with S3 storage in stream processing systems that employ a decoupled compute and storage architecture. We delve into the root causes of latency in this context and explore various techniques to minimize the impact of S3 latency on stream processing performance. Our proposed approach is to implement a tiered storage mechanism that leverages a blend of high-performance and low-cost storage tiers to reduce data movement between the compute and storage layers while maintaining efficient processing.
Throughout the talk, we will present experimental results that demonstrate the effectiveness of our approach in mitigating the impact of S3 latency on stream processing. By the end of the talk, attendees will have gained insights into how to optimize their stream processing systems for reduced latency and improved cost-efficiency.
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...Toru Tamaki
Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr "A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models" arXiv2023
https://arxiv.org/abs/2307.12980
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
7. Not Just One
Step
It’s not just connect Power BI to
data sources, it’s:
Extract
Transform
Load
◦ But where to?
◦ How?
◦ What is required?
9. Data Science VM
• Customized pre-configured
VM for data science pros
Deep Learning VM
• GPU based VM for training
deep learning models
Azure Machine Learning
• Predictive analytics services for
creating, deploying, &
managing predictive models
DataScienceTools
VisualizationTools
Reference
Architecture
Azure
Azure Active Directory
• Identity management & authentication across
Azure resources
Data sources
• Relational databases
• File exports
• Big data sources
Azure Data Factory
• PaaS hybrid ETL/ELT
service
• Can move data via
Data Factory Pipelines
or SSIS packages
Power BI
• SaaS analytics
• Excel integration
• Seamless, native
integration w/
Azure data sources
Excel
• Self-service analytics
• Pivot tables & charts
3rd Party
Visualization Tools
• Tools connecting
to SQL & Analysis
Services
AzureSynapseAnalytics
Azure Analysis Services
• PaaS semantic model
• Centralized calculations,
hierarchies, KPIs, etc.
• In-memory, compressed
Azure SQL Database
• PaaS SQL database
• Built in DR & HA
• On-demand scale
DataMarts&VirtualizedLayer
Azure Data Catalog
• Fully managed cloud metadata repository
• Enable data discovery & capturing team tribal knowledge
Azure Monitor
• Monitor cloud & on-premises environments to
maintain performance & availability
Power BI
Report Server
• Paginated reports
• Pixel perfect reports
• Document
generation
• Data driven
subscriptions
SQL Pool
SQL
Python
.NET
Java
R
Scala
Azure Synapse Studio
• Management
• Monitoring
• Security
• MetaStore
10. My Scripts to Deploy this All…
https://github.com/Dbakevlar/Modern-Data-Warehouse
12. Azure Synapse Analytics
Integrated data platform for BI, AI and continuous intelligence
Platform
Azure
Data Lake Storage
Common Data Model
Enterprise Security
Optimized for Analytics
METASTORE
SECURITY
MANAGEMENT
MONITORING
DATA INTEGRATION
Analytics Runtimes
PROVISIONED ON-DEMAND
Form Factors
SQL
Languages
Python .NET Java Scala R
Experience Synapse Analytics Studio
Artificial Intelligence / Machine Learning / Internet of Things
Intelligent Apps / Business Intelligence
METASTORE
SECURITY
MANAGEMENT
MONITORING
13. Azure (15) Database & DW (26) File Storage (6) NoSQL (3) Services and App (28) Generic (4)
Blob storage Amazon Redshift Oracle Amazon S3 Cassandra Amazon MWS Oracle Service Cloud Generic HTTP
Cosmos DB - SQL API DB2 Phoenix File system Couchbase Common Data Service PayPal Generic OData
Cosmos DB - MongoDB API Drill PostgreSQL FTP MongoDB Concur QuickBooks Generic ODBC
Data Explorer Google BigQuery Presto Google Cloud Storage Dynamics 365 Salesforce Generic REST
Data Lake Storage Gen1 Greenplum SAP BW Open Hub HDFS Dynamics AX Salesforce Service Cloud
Data Lake Storage Gen2 HBase SAP BW via MDX SFTP Dynamics CRM Salesforce Marketing Cloud
Database for MariaDB Hive SAP HANA Google AdWords SAP Cloud for Customer (C4C)
Database for MySQL Apache Impala SAP table HubSpot SAP ECC
Database for PostgreSQL Informix Spark Jira ServiceNow
File Storage MariaDB SQL Server Magento Shopify
SQL Database Microsoft Access Sybase Marketo Square
SQL Database MI MySQL Teradata Office 365 Web table
SQL Data Warehouse Netezza Vertica Oracle Eloqua Xero
Search index Oracle Responsys Zoho
Table storage
90+ Connectors out of the box
15. Develop Hub
Overview
It provides development experience to
query, analyze, model data
Benefits
Multiple languages to analyze data
under one umbrella
Switch over notebooks and scripts
without loosing content
Code intellisense offers reliable code
development
16. OVER clause
Defines a window or specified set of rows within a query
result set
Computes a value for each row in the window
Aggregate functions
COUNT, MAX, AVG, SUM, APPROX_COUNT_DISTINCT,
MIN, STDEV, STDEVP, STRING_AGG, VAR, VARP,
GROUPING, GROUPING_ID, COUNT_BIG, CHECKSUM_AGG
Ranking functions
RANK, NTILE, DENSE_RANK, ROW_NUMBER
Analytical functions
LAG, LEAD, FIRST_VALUE, LAST_VALUE, CUME_DIST,
PERCENTILE_CONT, PERCENTILE_DISC, PERCENT_RANK
ROWS | RANGE
PRECEDING, UNBOUNDING PRECEDING, CURRENT ROW,
BETWEEN, FOLLOWING, UNBOUNDED FOLLOWING
Windowing functions
SELECT
ROW_NUMBER() OVER(PARTITION BY PostalCode ORDER BY SalesYTD DESC
) AS "Row Number",
LastName,
SalesYTD,
PostalCode
FROM Sales
WHERE SalesYTD <> 0
ORDER BY PostalCode;
Row Number LastName SalesYTD PostalCode
1 Mitchell 4251368.5497 98027
2 Blythe 3763178.1787 98027
3 Carson 3189418.3662 98027
4 Reiter 2315185.611 98027
5 Vargas 1453719.4653 98027
6 Ansman-Wolfe 1352577.1325 98027
1 Pak 4116870.2277 98055
2 Varkey Chudukaktil 3121616.3202 98055
3 Saraiva 2604540.7172 98055
4 Ito 2458535.6169 98055
5 Valdez 1827066.7118 98055
6 Mensa-Annan 1576562.1966 98055
7 Campbell 1573012.9383 98055
8 Tsoflias 1421810.9242 98055
Azure Synapse Analytics > SQL >
17. Overview
A materialized view pre-computes, stores, and maintains its
data in Azure SQL Data Warehouse like a table.
Materialized views are automatically updated when data in
underlying tables are changed. This is a synchronous
operation that occurs as soon as the data is changed.
The auto caching functionality allows SQL DW Query
Optimizer to consider using indexed view even if the view is
not referenced in the query.
Supported aggregations: MAX, MIN, AVG, COUNT,
COUNT_BIG, SUM, VAR, STDEV
Benefits
Automatic and synchronous data refresh with data changes
in base tables. No user action is required.
High availability and resiliency as regular tables
Materialized views
-- Create indexed view
CREATE INDEXED VIEW Sales.vw_Orders
WITH
(
DISTRIBUTION = ROUND_ROBIN |
HASH(ProductID)
)
AS
SELECT SUM(UnitPrice*OrderQty) AS Revenue,
OrderDate,
ProductID,
COUNT_BIG(*) AS OrderCount
FROM Sales.SalesOrderDetail
GROUP BY OrderDate, ProductID;
GO
-- Disable index view and put it in suspended mode
ALTER INDEX ALL ON Sales.vw_Orders DISABLE;
-- Re-enable index view by rebuilding it
ALTER INDEX ALL ON Sales.vw_Orders REBUILD;
Azure Synapse Analytics > SQL >
20. SQL On-Demand
Overview
An interactive query service that provides T-SQL queries over
high scale data in Azure Storage.
Benefits
Serverless
No infrastructure
Pay only for query execution
No ETL
Offers security
Data integration with Databricks, HDInsight
T-SQL syntax to query data
Supports data in various formats (Parquet, CSV, JSON)
Support for BI ecosystem
Azure Synapse Analytics > SQL >
Azure Storage
SQL On
Demand
Query
Power BI
Azure Data Studio
SSMS
SQL DW
Read and write
data files
Curate and transform data
Sync table
definitions
Read and write
data files
21. Languages
Overview
Supports multiple languages to develop
notebook
• PySpark (Python)
• Spark (Scala)
• .NET Spark (C#)
• Spark SQL
Benefits
Allows to write multiple languages in one
notebook
%%<Name of language>
Offers use of temporary tables across
languages
23. What Happens to Existing Azure SQL
Data Warehouse?
Its not going “away”
Current SQL Data Warehouses will continue
Azure Portal will soon display “Synapse SQL Pool”, which is more accurately named
◦ SQL Pool
◦ SQL On-demand
◦ Spark Pool
◦ Code Artifacts
◦ Metadata
24. Data Is Ready- Now What?
Push to Azure DB
Leave in Azure Data Lake Storage
Connect to Analysis Services for Multi-dimensional Modeling
Power BI for final modeling and visualizations/reports/dashboards/apps
Use third party tools with data
42. What Kinds of Visualizations?
Choose from numerous modern visualization types:
◦ Filter data:
◦ Slicer
◦ Display numeric values:
◦ Card, Multi Row Card, Table, Matrix, KPI
◦ Graphically visualize data:
◦ Bar, Column, Line, Combo, Scatter, Waterfall, Pie, Donut,
Funnel, Treemap, Gauge, R Script
◦ Spatially visualize data:
◦ Map, Filled map, Shape map (preview)
https://powerbi.microsoft.com/en-us/developers/custom-visualization/
43. Custom Visuals
Custom visuals can be imported to extend beyond the out-of-the-box visualizations
◦ A gallery of visuals created by the Power BI community is available at https://app.powerbi.com/visuals
◦ Browse through the visuals or submit one of your
own for others to use
◦ The list of available visuals is growing each month
◦ Custom visuals will render in the Power BI service
46. What Data
Sources
Can Power
BI Connect
TO?
Over 100 different data sources
What is available in the service may be
be different than the desktop
If hybrid connection, (on-prem/non-
Azure cloud) the Power BI Gateway
will be required
47. Get [A LOT
OF] Data
**Custom connectors can also
be created.
50. Modeling Data
Work in Data View to inspect, explore, and understand data in the
model
It is a different experience from how you can view tables, columns, and
data in Query Editor
This is a view of the data after it has been loaded into the model
53. Measures
Uses DAX, (Data Analysis Expressions)
Over 200 functions, operators and constructs
Incredibly flexible
Similar to Excel formulas, (MDX) but designed to work with relational data
54. KPIs
Key Performance Indicators, (KPIs) also called
“strategic measures”
◦ Helps understand if company goals are being
achieved
◦ Goal values must be part of the dataset in Power BI
55. KPI Demonstration
Choose the data
Choose the timeline for the KPI
Sort by the indicator
Change to a KPI visual
Update any fields
61. Row Level Security
Excludes data from visualizations and reports
Is set up at report level
Uses DAX Filters
Filters assigned to roles
Assigned to users and groups through roles
Admins can test out roles before releasing to
production
64. Power BI Gateway
The Power BI Gateway—Personal is used to refresh supported on-
premises data sources
Only available in 64-bit
Runs as a service if configured with an administrator account;
otherwise runs as an application
Data transfer is secured (SSL) through Azure Service Bus
Often no requirement to open firewall ports, (unless VM installation)
Certain scenarios cannot be scheduled for data refresh:
Custom SQL statements
Excel worksheet data
Direct Connect or DirectQuery data sources
65. Power BI Gateway- Enterprise
Installation of the On-Premises Data Gateway serves large groups of users
to refresh supported on-premises data sources
It is the successor to the Power BI Gateway—Enterprise
IT can:
Centrally manage the set of users who have access to the underlying data
sources
Gain visibility into gateway usage, such as most commonly accessed data
sources, and the users accessing them
Data sources:
SQL Server Analysis Services
(Multidimensional and Tabular modes)
SQL Server
Oracle, Teradata, SAP HANA…
78. Content Packs to Apps- Why?
Allows for distinct collection of reports/dashboards/visualizations
One link to access them all vs. searching
Package and distribute
Notifications, alerting and row level security
79. Creating a Content Pack/App
Significantly Easy
No Code Solution
Allows you to share multiple reports/dashboards/datasets with groups/users
Can embed URL to other applications
81. Summary
Power BI has extensive visualizations, reporting and
dashboard analytics features
Ability to pull data from over 100 data sources
As part of the larger analytics solution with Azure
Synapse Analytics, an enterprise solution for
analytics, IOT and machine learning can be created
with ease.
82. Resources
Power BI site
http://powerbi.microsoft.com
Power BI documentation
http://support.powerbi.com/
Power BI community
http://community.powerbi.com/
Power BI blog
http://blogs.msdn.com/b/powerbi/
83. References
Power BI Desktop knowledge base
https://support.powerbi.com/knowledgebase/topics/68530-power-bi-desktop
Tips and tricks for creating reports in Power BI Desktop
https://support.powerbi.com/knowledgebase/articles/464157-tips-and-tricks-for-
creating-reports-in-power-bi-d
DAX Resource Center
http://social.technet.microsoft.com/wiki/contents/articles/1088.dax-resource-
center.aspx
Power BI Visuals Gallery
https://app.powerbi.com/visuals
A ZB of data is 1 trillion GB and currently, we currently product 16.3ZB per year
Up from .01ZB in 2013, 50ZB in 2019
49% of this in public clouds
Over 30% will be created in real time by IOT and other devices
$1.6 trillian in sales by 2025 from IOT
1 interaction every 18 seconds
most popular IoT devices of streaming device, home automation, and smart speaker are found in over 20% of homes in the United States.
23% of IOT investment is in Smart City initiatives
It won’t be as much about collecting all the data, but strategically choosing what to collect that is of value
Where in education, “unique student identifier” numbers make it possible for data to be readily aggregated without revealing individual identity and for analysts to investigate things like learning gains by pupils in various schools and circumstances.
Data is now the key strategic asset whether we’re talking about business, healthcare, or education.
Everything that’s happening in the world around us - is producing incredibly rich data that can help us create new experiences, new efficiencies, new models and even new inventions.
Leveraging this data can be the differentiator for your students, classroom, school, and district.
While data is pervasive, actionable intelligence from data is elusive.
The educators that I’ve been working with want to transform data to intelligent action and reinvent their education processes.
In the past, this has not been easy.
To do this, these educators need to be able to effectively and quickly analyze their data – so they can move from seeing “what happened” and understanding “why it happened” to predicting “what will happen” and ultimately, knowing “what should I do”.
Doing so will allow them to become an even more intelligent and effective educator.
The Microsoft data platform brings AI to your data so you gain deep knowledge about your business and customers like never before. Only Microsoft brings machine learning to database engines and to the edge, for faster predictions and better security.
What we used to deploy
Customers often needed the same ecosystem to achieve their goals.
Limitless Analytics Service
Houses the thing most companies want: two primary analytics systems: Datawarehouses and data lakes
Petabyte SCALE
Very simple to deploy for customers
For those of use that use SQL, this offers us advanced functions to work with analytics queries that are essential to our job.
Current Limitations:
If MIN/MAX aggregates are used in the SELECT list, the indexed view will automatically be disabled when UPDATE and DELETE occur in the referenced base tables. Run ALTER INDEX with REBUILD to re-enable the indexed view
Only INNER JOIN is supported
Only HASH and ROUND_ROBIN distributions are supported
Only CLUSTERED COLUMNSTORE INDEX is supported
ALTER VIEW is not supported
Power BI
Power BI is a cloud-based business analytics service that enables anyone to visualize and analyze data with greater speed, efficiency, and understanding. It connects users to a broad range of live data through easy-to-use dashboards, provides interactive reports, and delivers compelling visualizations that bring data to life.
Power BI in many ways is a connector between people and the power of the Microsoft Data Platform including data that lives in the cloud, your on-premise databases, in Excel spreadsheets or text files.
You don’t have to be a technical expert, data scientist, or statistician to take advantage of the wide variety of intelligence analytical capabilities that we have - statistical analysis, machine learning, building custom application.
All of this advanced technology and the value of converting data into intelligence flows through Power BI.
Stay connected from any device
Power BI mobile apps are available for iPhone, iPad, Android Phone, and Windows 8.1.
Power BI dashboards
With updates to Power BI customers can now see all their data through a single pane of glass. Live Power BI dashboards show visualizations and KPIs from data that reside both on-premises and in the cloud, providing a consolidated view across their business regardless of where their data lives.
Simplifying how you interact with data, natural language query is built into the dashboard allowing users to type questions and receive answers from data in the form of interactive visualizations.
You can then explore their data further by drilling through the dashboard into the underlying reports, discovering new insights that they can pin back to the dashboard to monitor performance going forward.
Go over top features
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/topics/65160-visualizations-in-reports
Tip: Hover the cursor of each icon to reveal a tooltip description of the visualization type
https://app.powerbi.com/visuals
https://www.census.gov/programs-surveys/ase/data.html
Doownload data and then bring into Power BI with get data
The three views provide alternate user experiences to work with their model.
Create queries and use the Query Editor to filter, cleanse and reshape data
Configure/refine relationships to establish the foundations of a model
Enrich the model with calculation logic and formatting
Design interactive reports with a broad range of modern data visualizations
Publish solutions directly to the Power BI service
Ability to transform data right from Power BI. Data can be saved, refreshed
Import and direct query with transformation
Rename columns, tables from the data modeling interface or from the main visuals.
Power BI knowledgebase: https://support.powerbi.com/knowledgebase/articles/663202-data-view-in-power-bi-desktop
Measures calculate a result from an expression formula. When you create your own measures, you’ll use the Data Analysis Expressions (DAX) formula language. DAX includes a library of over 200 functions, operators, and constructs. Its library provides immense flexibility in creating measures to calculate results for just about any data analysis need.
DAX formulas are a lot like Excel formulas. DAX even has many of the same functions as Excel, such like DATE, SUM, and LEFT. But, DAX’s functions are meant to work with relational data like we have in Power BI Desktop.
To build a KPI example, use the kscope tbl pbix and use revenue
Indicator - controls the indicator’s display units and decimal places.
Trend axis - when set to On, the visual shows the trend axis as the background of the KPI visual.
Goals - when set to On, the visual shows the goal and the distance from the goal as a percentage.
Color coding > Direction - people consider some KPIs better for higher values and consider some better for lower values. For example, earnings versus wait time. Typically a higher value of earnings is better versus a higher value of wait time. Select high is good and, optionally, change the color settings.
Insert Ask your data
Ask questions like, “What is the “calculation/column/row” over the “calculation/column/rows”
Power BI will create the best visual to display the data.
It will offer best suggestions based on what is already built
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/topics/70394-q-a-in-power-bi
View Performance Analyzer
Using a common web page, we’ll “scrape” data from an HTML page and create a table to be used for analytics
https://www.edweek.org/ew/issues/education-statistics/index.html
Pull in table and do an HTML scrape
Pull it in as is and separated
Transform the data by splitting the column
Rename the columns
Build out visuals from the data
Allows hybrid connectivity to Power BI from on-prem data sources and non-Azure cloud
Must be managed by your organization
Easy to set up and maintain
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/articles/474669-data-refresh-in-power-bi
Power BI Knowledgebase: https://powerbi.microsoft.com/en-us/documentation/powerbi-gateway-enterprise/
A dashboard often has all info clearly displayed. It can be interactive when research is required, but should give a clear view of the current status of a situation or scenario.
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/topics/65158-all-about-dashboards
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/topics/65158-all-about-dashboards
Power BI Knowledgebase: https://support.powerbi.com/knowledgebase/topics/65158-all-about-dashboards
Note: Live dashboards can be achieved with Azure Stream Analytics integration or the Power BI REST API. Both topics are covered later in this course.
Ability to use Excel from Power BI with a .odc file, (office Data connection) file
May need to download OLE DB plugin to be used with this, a one-time download
Can generate a QR Code of the report to be used to access it/share the report
View Notifications, NOT WHERE YOU SET THEM UP.
Settings, which we’ll get to in a minute.
Download- Demonstrate
Help & Support, plus feedback
Storage Admin- Manage Group Storage will take you to the current workspace storage you’re in. If you want to switch, click on the workspace and then options settings Manage Group Storage.
Content packs are just as they sound- content created in the format you want from various reports, dashboards, etc.
They are being replaced by Power BI Apps
Managed embedded codes here for any that might need updating or testing.
Considerable configuration options for Power BI service here
Under dashborads, datasets and workbooks, there are settings here for each one in each category.
For datasets, this is where you can configure your connection settings for the gateway of data sources that require a gateway.
See all your data lineage in a report, dashboard, app
This is the lineage for the data for my app.
Use this slide to provide relevant resources to allow attendees to continue with deeper content.
Use this slide to provide relevant resources to allow attendees to continue with deeper content.