Showing posts with label BI tools. Show all posts
Showing posts with label BI tools. Show all posts

Sunday, August 12, 2012

What’s the deal with PowerPivot?


“Insanity: doing the same thing over and over again and expecting different results.”Albert Einstein

I’ve struggled for months to not only understand PowerPivot but to make use of it in my daily healthcare analytics. I read the same Microsoft hoping to uncover the “magic” of DAX. As I dive deeper into Microsoft’s BI stack, PowerPivot keeps coming up.
I now realize that there are two core concepts that I must master:
· The various data models supported by PowerPivot (Check out Data models in PowerPivot)
· The practical use of “Filter Context” (Check out PowerPivot’s Filter Context from a SQL perspective)

Before I write about my new found understanding of PowerPivot, I want to describe why PowerPivot is even needed. In my daily life, I use SQL to extract data from relational databases like Oracle and SQL Server. I use Excel to present that data in an interactive model or to simply pass data to an end-user.
PivotTables had become an after thought before using data cubes. PivotTables make possible to display data cubes in Excel. Mainly PivotTables are analytic tools that allow one to dynamically query data. In SQL terms, PivotTables perform aggregation functions like SUM and COUNT in each cell. This is great until you want to produce a useful metric like ER rates per 1000 or percent compliance rates. There are tricks such as using a PivotTable as a source for another PivotTable. PivotTables aren’t as flexible as a well written SQL statement.
Enter PowerPivot! Now you can,
· Extract data from multiple data sources (text, data cubes, relational databases)
· Create complex formulas that answer real-world questions using DAX
· Prototype new data-sets and pass to cube developers for the creation of robust data cubes.
· Perform Business Intelligence analysis and ad-hoc analysis without knowing MDX (the language of cubes)
· Share your PowerPivot model through SharePoint to allow others to directly connect to it
That’s nice but, what’s the big deal with PowerPivot? Let’s take a typical data-set and a PivotTable
ID
Product
Color
amount
1
Pen
Red
2
3
Pencil
Blue
6
5
Pen
Blue
10
7
Pencil
Red
10
I created the PivotTable below by:
· I created an Excel Table (using my favorite shortcut Ctrl-T)
· Click “Summarize with PivotTable” from the table’s design ribbon
· Dragged Color into Row labels
· Dragged Name into Column labels
· Dragged amount into Values and leaving the “Summarize values as” SUM function
· No Slicer or PivotTable’s report filters were used
You get something like below,
Sum of amount
Column Labels
Row Labels
Pen
Pencil
Blue
10
6
Red
2
10
Not too useful. Let me switch to my SQL analogy. One can think of each cell in the PivotTable as executing a single dynamically created SQL statement.
Column Label (Product)
Row Label (Color)
Pen
Pencil
Blue
select sum(amount)
from data_table
where Color = 'Blue' and Product = 'Pen'
select sum(amount)
from data_table
where Color = 'Blue' and Product = 'Pencil'
Red
select sum(amount)
from data_table
where Color = 'Red' and Product = 'Pen'
select sum(amount)
from data_table
where Color = 'Red' and Product = 'Pencil'

Each of the 4 cells in my PivotTable executes a query from my data_table. In the cell that intersects Pen and Blue, SUM(amount) function will execute only for rows in the data_table where Color = 'Blue' and Product = 'Pen', producing the amount of 10. No matter where I place this PivotTable in my worksheet or the entire workbook, this cell will always execute the SUM(amount) function where Color = 'Blue' and Product = 'Pen'. By adding a field to the report filter or adding a slicer, the “where” clause statement automatically includes that additional attribute.
What’s so great about PowerPivot? It allows you to change the “where” clause statement. This wasn’t possible prior to PowerPivot’s introduction. This is typically the domain of the cube developers who utilize Microsoft’s SSAS and MDX. The door is now open for an Excel Power user or analyst to create useful cube-like data models. Now, I can compute the sum of all items from my data_table and place the result next to individual amounts already in the PivotTable. I can blend my data_table with another table and display a related item in the PivotTable.
In my next post, I’ll discuss the data model concept behind PowerPivot. In order to utilize DAX, you have to understand how to arrange your data.

Monday, February 20, 2012

New SQL Server 2012 BI tools

 Three things cannot be long hidden: the sun, the moon, and the truth.”- Buddha

In Microsoft’s case, try as they might to be cute in naming their new products that no one understands, BI professionals have uncovered key features. I bring this up because many organizations are Microsoft-centric. Microsoft doesn’t make it easy to understand how to fully utilize their technologies.
Microsoft will launch their newest version of the venerable database system, SQL Server 2012 (Online launch event) on March 7.
New tools in SQL Server 2012 that I found:
  • SQL Server Data Tools (SSDT) – the tool to develop database models, SSRS reports, SSIS packages, and more.

It will replace the Business Intelligence Development Studio (BIDS). Check out SQL Server’s Pro’s write-up.
  • BI Semantic Tabular Model – Allows an analyst, as well as a developer, to create data models that can be published on SharePoint. In Microsoft’s vision (See in diagram below), developers create multi-dimensional models (cubes) and business analysts create tabular models.
Thanks to James Serra’s blog entry for clearing up Microsoft’s marketing mumbo-jumbo.

An analyst can design a data model by visually linking tables and writing DAX (Data Analysis Expressions language) formulas to encapsulate business logic.
Check out this slide deck
Check out demo
  • PowerView PowerView is an interactive data exploration, visualization, and presentation experience. It provides intuitive ad-hoc reporting for business users such as data analysts, business decision makers, and information workers.

















Features:
      • Interactive, web-based report authoring & sharing
      • Powerful BI data layout with new visualization
      • Multi-view story board in tool, and Export to PowerPoint & present interactively with data
      • Runs off PowerPivot BI data, or other SQL 2012 tabular models
      • Smart and powerful querying, with zero configuration for filtering
Check out the Demo 1 or Demo 2

Monday, October 24, 2011

BI tools for data analysis

I recently performed a Google search on selecting Business Intelligence (BI) software tools. The first prominent link led me to read the white paper, How to Choose the right Business Intelligence Technology, I like how the article lays out the various styles of analysis. It goes on to describe the Microsoft tools needed to implement the each style. 


The article got me thinking about my quest to define the role of the analyst. Reading the blog "Reporting vs. Analysis: What’s the Difference?", help formalize my thoughts. Check out Brent Dykes's key thoughts on the differences between reporting and analysis:

Data Reporting is...
  • Organizing data into informational summaries 
  • following a push approach, where reports are pushed to users who are then expected to extract meaningful insights and take appropriate actions for themselves (i.e., self-serve) 
  • Outputs: canned reports, dashboards, and alerts (reports sent to users based on a triggering event) 
  • providing no or limited context about what’s happening in the data. In some cases, the end users already possess the necessary context to understand and interpret the data correctly. 
  • not going to answer the “so what?” question on its own
Data analysis is...
  • Exploring data and reports in order to extract meaningful insights 
  • Following a pull approach, where particular data is pulled by an analyst in order to answer specific business questions. 
  • Outputs: Ad hoc responses (reports) and Analysis presentations (a comprehensive, deep-dive analysis) 
  • Providing context which is critical to good analysis. In order to tell a meaningful story with the data to drive specific actions, context becomes an essential component of the story line. 
  • Emphasizing data points that are significant, unique, or special - and explain why they are important to the business 
Upon retrospect, I would add one more style of BI reporting to their list of 5 styles.I call it:

Business Analysis
This style is performed by a business/clinical/health data/data analyst with the purpose of answering a business question that leads to action. The analysis must sniff out the business question through questioning and discovering the appropriate business context. The end user will receive a written analysis with supporting charts and tables. The analyst will need tools that allow to him/her sift through sometimes millions of rows and find a meaningful summaries of this data.

Tool Options to support Business Analysis

MS Excel and Power Pivot for MS Excel

The most versatile tool in Microsoft's arsenal continues to be MS Excel. Excel can consume SQL data extracts, data cubes, and external data from vendors. Utilize various built-in functions and add-ins to perform analysis on the data points. With the Power Pivot add-in installed, Excel merge disparate data sources with relative ease. You can even create your own data cube of the source data.

MS Word
Yes, Word is a tool. One needs to express the end results of analysis in a coherent and organized fashion. Word provides to means to accomplish this.

MS Outlook
I know that it is strange to list Outlook as a BI tool. Here is my thought, rarely is an analysis so compelling that it leads to immediate action. Part of the analsyst's job is to follow-up with the business user. If no action is taken then the analysis was neither useful or needed. Utilizing Tasks and Calendar events to track follow-up conversations is vital to a successful analysis.

Describe impact on an organization
I've heard "we have lots of data but no information". In order to answer a business question, one must transform data into a meaningful story. Given the right data and the appropriate tools, an analyst can create a compelling story that can be understood by many.

I find myself travelling down this path toward insights and actionable data. After walking down the reporting path for many years, this will be a major paradigm shift.