Inside Azure Diagnostics

Inside Azure Diagnostics
Pittsburgh Tech Fest
June 7th, 2014

17
COLUMBUS, OH OCTOBER 17, 2014 CLOUDDEVELOP.ORG

1 / The need for diagnostic data in cloud applications
2 / Data we can we monitor
3 / Using the Microsoft Azure Diagnostic Agent
4 / Real-world guidance for troubleshooting Microsoft Azure apps

node.js
C#
Java
Agile
- vs -
Waterfall

Scenario
o
o
o
o
o
o
We have a problem

Resolution
o Step 0 – Enable Azure
diagnostics
• Set key performance
counters
o Step 1 – Add logging
statements around key
functionality
• Especially external services
o Step 3 – Test, test, test
o Step 4 – Analyze
o Step 5 – Fix it
Scenario
o
o
o
o
o
o

worker roles
web roles
Diagnostic Data – 4x

Diagnostic Item Table Name Blob Container Name
Windows Event Logs WADWindowsEventLogsTable
Performance Counters WADPerformanceCountersTable
Trace Log Statements WADLogsTable
Azure Diagnostic Infrastructure
Logs
WADDiagnosticInfrastructureLogs
Custom Logs
(i.e. log4net, NLog, etc.)
<custom>
IIS Logs WADDirectoriesTable* wad-iis-logfiles
IIS Failed Request Logs WADDirectoriesTable* wad-iis-failedreqlogfiles
Crash Dumps WADDirectoriesTable*
* Location of the blob log file is specified in the Container field and name of the blob in the RelativePath field. The
AbsolutePath field contains the name of the file as it existed on the role instance.

o Trace logs
o IIS logs
o Infrastructure logs
o No transfer
o OnStart()
o Overrides default
o diagnostics.wadcfg
o Overrides
imperative

public override bool OnStart()
{
// Create the DiagnosticMonitorConfiguration object to use for configuring the monitoring agent.
DiagnosticMonitorConfiguration config = DiagnosticMonitor.GetDefaultInitialConfiguration();
// Performance Counter configuration
config.PerformanceCounters.DataSources.Add(new PerformanceCounterConfiguration
{
CounterSpecifier = @"Processor(_Total)% Processor Time",
SampleRate = TimeSpan.FromSeconds(30)
});
config.PerformanceCounters.ScheduledTransferPeriod = TimeSpan.FromMinutes(1);
// Log configuration
config.Logs.ScheduledTransferLogLevelFilter = LogLevel.Information;
config.Logs.ScheduledTransferPeriod = TimeSpan.FromMinutes(1);
// Event Log configuration
config.WindowsEventLog.DataSources.Add("Application!*");
config.WindowsEventLog.DataSources.Add("System!*");
config.WindowsEventLog.ScheduledTransferLogLevelFilter = LogLevel.Warning;
config.WindowsEventLog.ScheduledTransferPeriod = TimeSpan.FromMinutes(1);
// Start the diagnostic monitor with the new configuration
DiagnosticMonitor.Start("Microsoft.WindowsAzure.Plugins.Diagnostics.ConnectionString", config);
return base.OnStart();
}
Impacts local agent only!

Declarative Configuration
using Visual Studio

1. wad-control-container
2. Imperative code
3. Declarative configuration
4. Default configuration

Instruct WAD to transfer specific data sources to storage
Overwrites current diagnostic configuration
http://msdn.microsoft.com/en-us/library/gg433075.aspx

Additional host-level data – not DiagnosticAgent.exe

o
o Vital information
o
o
o
o Day-to-day operational data
o
o
o
o

Compute node
resource usage
Windows Event
logs
Database
queries
response times
Application
specific
exceptions
Database
connection &
cmd failures
Microsoft Azure
Storage
Analytics
Process for Azure hosted solutions is not that different
from traditional, on-premises solutions.

o http://bit.ly/1eomek9
o http://bit.ly/1mVHN3u
o http://bit.ly/1k1YkjI
o http://bit.ly/Q33mkU
o
http://bit.ly/1qp4omC

Inside Azure Diagnostics

Related slideshows

More Related Content

Inside Azure Diagnostics

Editor's Notes