10 years of BI Magic Quadrant

Every February the Gartner group publishes its Magic Quadrant (MQ) report on the Business Intelligence segment. As covered in previous years (2012, 2013, 2014), its centerpiece is a 2-dimensional quadrant of the Vision (x-axis) vs. Execution (y-axis) space. When this year’s report came out about 3 weeks ago, it completed a decade worth of data (each year from 2008 to 2017) on about 20-25 companies each year. Here is the latest 2017 picture (with trajectory from previous year):


I have collected the MQ position data in a simple Google Docs spreadsheet here. The usual disclaimers are worth repeating:

  • Gartner does not publish the x,y coordinates as they caution against using them directly for interpretation.
  • To approximate the data, I screen-scraped them from images revealed by Google search, which introduces both inaccuracies and the possibility of (my) clerical transcription error.
  • Changes in the x,y coordinate for one company from one year to the next are a combination of how that company evolved as well as how Gartner’s formula (also not published) may have changed. For example, from 2015 to 2016 many companies “deteriorated” in the ranking as can be seen from the following graphic:


  • It is unlikely that so many companies deteriorate in their execution in unison. More likely, the formula changed and shifted the evaluation landscape upwards, meaning companies that stayed the same on the previously used factors now slipped downwards. (I read somewhere that Gartner wanted to have only 3 companies in the leader quadrant – an instance of curve-fitting if you will.) Whatever the reason, this shift removed all but three companies from the upper rectangle on execution.
  • That said, relative changes between companies in the same year are still meaningful, as they are all graded on the same formula.

Naturally, it is of interest to study the current leaders – Microsoft, Tableau and Qlik. Here is the dynamic evolution of these three competitors MQ positions over the last decade as GIF:

mq_leaders_allFrom the entire trajectory (left) one can see that all of them have been leaders for many years.

Tableau joined the leader board in Feb-2013 from the status as challenger. It went public in May-2013 (ticker symbol DATA) and has grown into a company with close to $1B in annual revenue and > 3000 employees. It has had particularly consistent ratings on Execution scores since then. Many of the visualization metaphors it has introduced are commoditized by now, with a desktop designer tool for both Windows and Mac, a robust server product as well as a free public cloud-based option. For any company of such size it is a challenge to grow fast enough and it needs to both stay ahead of the competition as well as diversify into adjacent markets. Its stock price reached lofty heights of $127 (roughly $10B market cap) by mid-2015, but saw a drop to ~$80 by year-end 2015 and then cut in half one month later ($41 on Feb-1, 2016), from where it has only modestly recovered to around $52. Most SW products nowadays are offered as a service, which Tableau still hasn’t transitioned to as much as others have. That said, it’s Aug-2016 hiring of Adam Selipsky from Amazon Web Services indicates this transition and focus on Tableau Online and scale.

Microsoft is in a unique position for many reasons: It has a very healthy and diverse product portfolio across Windows, Office, Server, Cloud, and others. Most of these help build out a complete BI stack, helping it in the Vision dimension. Furthermore, it can subsidize the development of a large product and offer it free to capture market share. Unlike Tableau, the Power BI price point is near zero, which has helped it acquire a large community of developers, which in turn provides a growing gallery of solutions and plug-in visualization components. Lastly, Power BI is very well integrated with products such as Excel, SharePoint and SQL Server. Many enterprises already invested in the Microsoft stack will find it very easy to leverage the BI functionality.

I don’t have personal experience with QlikView, but enjoy reading on Andrei Pandre’s visualization Blog about it. Qlik was always a bit different, focusing on complex analytics more than mainstream tooling, and it having been taken private in Mar-2016 seems to have reduced its leadership status.

Another Blog I quite enjoy reading is (such as the 2017 article on the BI MQ by author Bruno Aziza).

I would summarize various factors influencing the BI solutions over the last few years:

  • Visualization tools and galleries – BI tools have reached a high level of maturity around the  generation of dashboards with interconnected components as well as complex interactive visuals such as treemaps or animated bubble charts. Composing the visual presentation is often the smallest part of a BI project, with proper data-mining often taking an order of magnitude more effort and resources.
  • ETL Commoditization – the need to support data-wrangling as part of the solution, not a mix of add-on tools. Microsoft’s SSIS, Tableau’s Maestro, Alteryx Designer Tools, etc.
  • Hybrid Cloud and On-Premise solution – Most enterprises want a combination of some (often historically invested) On-Premise data store / analytics capabilities with newer (typically subscription-based) Cloud-based services.
  • Big Data abilities and Stream processing – Need to integrate popular data visualization tools (Excel, Tableau, Power BI, QlikView) with big data platforms such as Hadoop. Furthermore, ability to analyze data as it is ingested in real-time without the time-consuming post-processing for dimensional analysis (data cubes)
  • Predictive Analytics and Machine Learning – Move focus from reporting (past, what happened?) via alerting (present, what’s happening?) to predicting (future, what will happen?)


Two weeks ago I attended the HIMSS’17 conference in Orlando (HIMSS = Healthcare Information Management System Society). I was particularly interested in the Clinical and Business Intelligence track and exhibitors in that space. My overall impression is that adoption of BI tools in Healthcare is still somewhat limited, with the bigger operational challenges around system interoperability and data exchanges, as well as adoption of digital tools (tablets, portals, Electronic Health Record, etc.) by patients, physicians, and providers.

I did see specialty solution providers such as Dimensional Insight. While impressive, their approach seems decidedly old school and traditional. I doubt that any company can sustain a lead in this space by maintaining a focus on their proprietary core technology (such as their Diver platform / data-cube technology). Proper componentization, standard interface support (such as HL7 FHIR) and easy-to-integrate building blocks will win broader practical acceptance than closed-system proprietary approaches.

There are some really interesting systems being applied to healthcare such as IBM’s Watson Health or the new platform from Health Catalyst. But that is a story for another Blog post…

Leave a comment

Posted by on March 5, 2017 in Industrial


Magic Quadrant Business Intelligence 2014

Over the last two years we have posted some visualization and interpretation of Gartner’s Magic Quadrant Analysis on BI companies. The previous articles in 2012 and 2013.

A Blog reader contacted me about the 2014 update; he sent me the {x,y} coordinate data for 2014 and so it was relatively straightforward to update the public Tableau workbook for it. Here is the image of all 29 companies with their changes from 2013 to 2014:

Gartner’s Magic Quadrant for Business intelligence, changes from 2013 to 2014

Gartner’s Magic Quadrant for Business intelligence, changes from 2013 to 2014

With the slider controls for Execution and Vision as well as the changes thereof, it is easy to filter the dashboard interactively. For example, there were a dozen companies who improved in their execution score (moving up in the quadrant):

Subset of companies who improved execution over the last year.

Subset of companies who improved execution over the last year.

Most of the companies improving their execution are niche players, with SAP being the only leader improving its execution score.

Most of the leaders improved in their vision score (moving right in the quadrant), including Tableau, QlikTech, Tibco and SAS.

Subset of companies who improved vision over the last year.

Subset of companies who improved vision over the last year.


7 companies, most of them leaders, lost ground on both execution and vision (moving to the bottom-left):

Companies who lost ground on both execution and vision in 2014

Companies who lost ground on both execution and vision in 2014


Lastly, I have updated the Public Tableau workbook with the Magic Quadrant as originally published in 2012 with the data for 2013 and 2014. (Click here for the interactive drawing.)

Public Tableau workbook with 7 years of BI Magic Quadrant data.

Public Tableau workbook with 7 years of BI Magic Quadrant data.

1 Comment

Posted by on September 28, 2014 in Industrial


Tags: , , , ,

Apple’s Health App and HealthKit – Platforms for Next Gen Healthcare?

Business Analytics 3.0

mobile-applicationsGame on….I think we just witnessed a big next generation leap in Healthcare Data and Analytics.  Apple jumped into the health information business on June 2, 2014, launching both a new health app and a cloud-based health information platform with IOS 8.

The new App, called simply “Health”, will collect a number of body metrics including blood pressure, heart rate, and stats on diet and exercise.  Health will constantly monitor key health metrics (like blood sugar or blood pressure), and if any of them begin to move outside the healthy range, the app can send a notification to the user’s doctor.

The Health app will share all its information with a new cloud platform called “HealthKit.” The new health cloud platform is designed to act as a global repository for all the user’s health information. It will accept data collected by a variety of third-party devices and apps. For instance Nike is now working to…

View original post 526 more words

Leave a comment

Posted by on June 2, 2014 in Medical


Tags: ,

Visualizing Voting Preferences for World Values

The other day I listened to a presentation by Melinda Gates prepared for the United Nations to deliver an update about progress towards the Millennium Development Goals (MDG). The eight goals of the MDG had been embraced by the UN back in 2005 for the time target of 2015. So it is reasonable to see whether the world is on track to reach each of these eight goals. To summarize, from the MDG Wikipedia page:

  1. Eradicating extreme poverty and hunger
  2. Achieving universal primary education
  3. Promoting gender equality and empowering women
  4. Reducing child mortality rates
  5. Improving maternal health
  6. Combating HIV/AIDS, malaria, and other diseases
  7. Ensuring environmental sustainability
  8. Developing a global partnership for development

A good listing of reports, statistics and updates can be found on the UN website here.

Sample Vote for 6 of 16 MDG choices

Sample Vote for 6 of 16 MDG choices

At the end of Melinda’s presentation is a link to a UN global survey on the MDG goals after 2015. I took this survey and found the visualization of voting results quite interesting. First, one is asked to select six out of a list of sixteen (6 of 16) goals which one thinks have the highest impact for a future better world. (The survey methodology is described in more detail here.) Here is a sample vote:

A nice touch is that for each of the sixteen goals there is a different color and when you check that goal, one of the sixteen areas on the stylized globe is filled with that color. Personal data such as name is optional, but some demographic information is required, including age, gender, educational level and country. Next, one can look at a summary of all currently tallied votes and compare them interactively to ones own vote (checkmarks on the right).


It is perhaps not surprising that I voted very similar to others in similar demographic cohorts.

  • Country: I picked five of the Top five goals like all other voters living in the US. I included ‘Political freedoms’ in my top six, which in the US only ranks 11th.
  • Age: I shared five of the Top six goals with people in my age group (world-wide). The one I did not check was ranked 4th (Better job opportunities). When you mouse over one of the goals, the display changes to highlight this goal in all columns:
Interactive Vote Analysis with highlighted goal

Interactive Vote Analysis with highlighted goal

  • Gender: Here I picked four of the Top five goals (did not include the ‘Better job opportunities’).
  • Education: I voted very similar to people with very high HDI (Human Development Index, a visualization of which we covered in a previous post) with five of the Top six.

From the above, it seems somewhat surprising that voters in the US did not ascribe a higher value to ‘Better job opportunities’, given how much economic values and topics like unemployment seem to dominate the media. That said, these votes should be a reflection about which goals are most valuable for making the world a better place – not just your own home country. Worldwide it seems that other, more fundamental goals are judged by voters in the US to be more important than ‘Better Job opportunities’.

Another chart on the results page is showing a heat map of the world countries based on how many votes have been submitted. I thought it was interesting that Ghana had submitted about twice as many votes as all of the US, and Nigeria about 7x as many. The country with most voters at this time is India, but not far ahead of Nigeria.


A fairly useless dynamic animation in this map is a map pin drop of four people who voted similarly to me. I found this too anecdotal to be of any real interest and downright annoying that I couldn’t turn it off. and just focus on the vote heat map. For example, the total number of votes should be displayed in the Legend. I vaguely remember that it was several hundred thousand from 194 countries prior to starting the survey, but couldn’t get that data to display again without clicking on the Vote Again:


Leave a comment

Posted by on September 21, 2013 in Education, Medical, Scientific


Personal Analytics with the Suunto Ambit

Suunto Ambit

Half a year ago my wife bought me the Suunto Ambit multi-function sport watch and heart rate monitor. It is a fantastic device, with very precise GPS, lots of add-on functionality and an interesting online portal and community.

There is some configuration and setup involved, such as pairing the Ambit with your heart rate belt and in the case of cycling with a cadence pod. You charge the batteries by plugging it into a USB port, which is also the way how you upload the data form the device to your computer or a website.

While the device itself and its programmability is quite advanced, I want to focus here on the associated online portal called where you can upload and visualize all your data for free – and share it with friends or the community if you’re so inclined. This amount of personal data collecting and analyzing is a fairly recent phenomenon, often referred to as Personal Analytics.

Each recorded session with the Suunto can be uploaded and classified into one of many sports, such as hiking, cycling, basketball, or indoor exercise. Each session is called a move, and with the portal you can collectively visualize all your moves. The current theme at has a black background with mostly orange bars and charts. One of the first controls to organize your moves is either a list or a calendar control.

Calendar Control for Moves

Calendar Control for Moves

This already gives you a good overview over the type of sports activities and the distribution over weekday and weekends. A summary display is available in various forms, such as the following simple bar charts.

Summary information about heart rate zones

Summary information about heart rate zones

Another display format summarizes your selected moves, such as all moves in a particular month together with commensurate calorie consumption and breakdown of hours by type of move.

Moves Summary Display

Moves Summary Display

You can now select either a single or multiple moves (or group by the type of move) and display more information about this particular move. Note the x-axis can be set to display either distance or time and one can zoom in on any part of the entire recorded move. One can alos overlay multiple measures in the same chart by selecting more than one factor, although I find this to lead to very busy and confusing charts.

Graph and BarChart details per move

Graph and BarChart details per move

There are many individual measurements available for display, some based on individual sensors (like heart rate or GPS location or temperature or altitude / air pressure), others based on calculations and estimates (such as speed, recovery parameter “R&R”, EPOC or VO2).


Of particular interest to me as a cyclist is the ability to overlay the GPS-track on a Google map. Not only is it a very detailed recording of the route, but it is color-coded based on the currently selected measure. For example, the color-range shows the heart rate in the same colors as the above bar charts. One can clearly see where one is just warming up at the beginning (low heart rate, green color) or where one is riding up “into the red”, i.e. towards the limits of one’s own heart rate. Selecting points along the route displays some information about that particular point of the ride.

One interesting feature would be a time-geo correlation of any portable photo camera when taking pictures along the ride. Based on synchronized time one could then easily geo-code the photos even without any GPS capability within the camera itself.

The Suunto Ambit can do a lot more, including customizing the display mode and storing your configurations in so-called apps. One idea I have for this is to display an estimate of the total calorie consumption for a known route when continuing at the current pace (but I haven’t played with the programming yet). The Ambit seems to be particularly well suited to hiking, mountain biking or skiing due to its altimeter; however I don’t get to leverage that in flat Florida. Only the few bridges over the Intracoastal waterway show up as bumps in the vertical – with the corresponding acceleration of the heart rate on the uphill side.

One of the downsides is the fact that the heart rate sensor worn around the chest does not work in the water. Hence any swimming in the Ocean or the pool can not be measured precisely. (I replace the measurements with estimates.) And sure enough, just recently Suunto announced the new Ambit 2, which overcomes this limitation. Such is the world of new electronic toys, that the half-life of their innovation is getting shorter and shorter.

Bubble Chart of set of rides

Bubble Chart of set of rides

Measures in Bubble Chart

Measures in Bubble Chart

One last chart I wanted to point out is the flexible bubble chart. Shown above is a selection of all my rides in the first half of 2013 (47 rides minus two outliers, very long rides which would have changed the scale and compressed the rest of the chart). This gives a good feel for the distribution and variance of personal rides over a longer period of time – from the quick half hour duration to the more typical rides of a good 2 hours. Note that one can select any of about 30 measures in any of the three drop-down boxes (X-Axis, Y-Axis, Bubble-Size).

One side-effect of measuring and visualizing so many moves is that we find some interesting differences in our respective exercise habits and corresponding energy consumption. While I burn most of my calories on the bicycle, my wife gets more exercise out of indoor circuit exercises and Yoga than I do. For me, after literally decades of recreational cycling, I can raise my heart rate to much higher levels for extended periods of time on the bike compared to indoor circuit exercises. In a way that is not surprising, given the strength and oxygen consumption of the large leg muscles compared to smaller shoulder and arm muscles. But I would not have expected the difference to be so pronounced and could not have quantified it nearly as precisely as without such personal analytics.

It can be expected that the field of healthcare and personal analytics will converge and provide much more personalized data and insight into the specific life of any patient. Medical indicators like heart rate, blood sugar, blood pressure or factors like exercise and diet will become much more quantifiable and individually tracked over time. The hope is that this will also lead to better, more personal and generally more preventive care and medical treatments to any personal condition.

Leave a comment

Posted by on June 30, 2013 in Recreational


Tags: , ,

Apple, Amazon, Google, Microsoft

Last year we looked at the four companies and compared their business model over two quarters: Apple (hardware), Amazon (retail), Google (advertising), Microsoft (software). It struck me how far the integrated Wolfram Alpha technology has come in the last two years. It combines the symbolic computing capabilities of the Mathematica platform with curated data (for example financial data) and some pretty impressive linguistic analysis capabilities for free-form text input.

For example, in Wolfram Alpha, just type in the following query: “Googe vs. Amazon vs. Apple vs. Microsoft” The results are shown as a series of three screen-shots below:




Not only do you get the various data such as the fundamentals or the analysis of a mean-variance optimal portfolio displayed, but you get all the code needed to programmatically load such data. For example, if you want to get the breakdown of the analyst ratings, the system will expand it as follows:


So far we haven’t done any coding or bothered with integrating any data source. This amount of integration and automation is pretty impressive. I am often surprised how few companies are taking advantage of such advanced technology platforms.

Leave a comment

Posted by on April 28, 2013 in Financial


Tags: , , ,

Visualizing Conversion Rates (Funnels, Bullet Charts)

Most sales processes go through a series of stages, from first contact through successive engagement of the potential client to the close. One can think of these as special cases of attrition-based workflows. These are very typical in online (B2C eCommerce) or tele-marketing (call centers) and companies usually collect a lot of data around the conversion rates at each step. How can one visualize such workflows?

One metaphor for these processes is that of a sales funnel. A lot of leads feed in on one side, and at each stage fewer pass through to the next. It is then straightforward to want to visualize such funnels, such as shown here by Tableau.

Tutorial video explaining how to create a funnel chart using Tableau

Tutorial video explaining how to create a funnel chart using Tableau (Source: Tableau Training Video)

Aside from the somewhat tedious steps involved – custom field calculations, left-right duplication of the chart, etc. – it turns out, however, that funnel charts are not easy to interpret. For example, it is not well suited to answer the following questions:

  • What’s the percentage reduction at each step?
  • Comparing two or more funnels, which has better conversions at each step?
  • What are the absolute numbers in each step?
  • Are the conversion rates above or below targets at each step?

Ash Maurya from Spark59 wrote a very useful article on this topic entitled “Why not the funnel chart?“. In it he looks specifically at comparisons of funnels (current vs. prior time intervals or A|B testing).

Time Series comparison of funnel performance (Source: Ash Maurya's Spark59 Blog)

Time Series comparison of funnel performance (Source: Ash Maurya’s Spark59 Blog)

In a next step he shows that the funnel shape doesn’t add to the readability. Instead simple bar charts can do just as well:

Same information with Bar Charts (Source: Ash Maurya's Spark59 Blog)

Same information with Bar Charts (Source: Ash Maurya’s Spark59 Blog)

For a multi-step funnel, the problem remains that with the first step set to 100%, subsequent steps often have fairly small percentages and thus are hard to read and compare. Suppose you are sending emails to 100,000 users, 30% of which click on a link in the email, of which only 10% (3% of total) proceed to register, of which only 10% (0.3% of total) proceed to subscribe to a service. Bars with 3% or even 0.3% of the original length will be barely visible. One interesting variation is to normalize each step in the funnel such that the new, expected conversion number (or that from the prior period) is scaled back to 100%. In that scenario it is easy to see which steps are performing above or below expectations. (Here big jump in Registrations from Jan to Feb, then small drop in Mar.)

Bar Charts with absolute vs. relative numbers

Bar Charts with absolute vs. relative numbers

Next, Ash Maurya uses the Bullet Chart as introduced by Stephen Few in 2008. The Bullet Chart is a variation of a Bar Chart that uses grey-scale bands to indicate performance bands (such as poor – ok – good) as well as a target to see whether the performance was above or below expectations. The target bar allows to combine two charts into just one, giving a compact representation of the relative performance:

Funnel Chart showing funnel performance (Source: Ash Maurya's Spark59 Blog)

Bullet Chart showing funnel performance (Source: Spark59 Blog)

Various authors have looked at how to create such bullet charts in Excel. For example Peltier Tech has looked at this in this article called “How to make horizontal bullet graphs in Excel“. There is still quite some effort involved in creating such charts, as Excel doesn’t directly support bullet charts. Adding color may make sense, although it quickly leads to overuse of color when used in a dashboard (as Stephen Few points out in his preference for grey scales).

Funnel Graphs in Excel (Source: Peltier's Excel Blog)

Bullet Graphs in Excel (Source: Peltier’s Excel Blog)

Another interesting approach comes from Chandoo with an approximation of a bullet graph in cells (as compared to a separate Excel chart object). In this article “Excel Bullet Graphs” he shows how to use conditional formatting and custom formulae to build bullet graphs in a series of cells which can then be included in a table, one chart in each row of the table.

In-Cell Funnel Graph in Excel (Source: Chandoo's Blog)

In-Cell Bullet Graph in Excel (Source: Chandoo’s Blog)

It is somewhat surprising that modern data visualization tools do not yet widely support bullet charts out of the box.

Measuring how marketing efforts influence conversions can be difficult, especially when your customers interact with multiple marketing channels over time before converting. To that end, Google has introduced multi-channel funnels (MCF) in Google Analytics, as well as released an API to report on MCFs. This enables new sets of graphs, which we may cover in a separate post.


Posted by on March 31, 2013 in Industrial


Tags: , , ,

%d bloggers like this: