Executive Dashboards

Contrary to first impression, an “executive dashboard” is not found in a CIO’s car. Rather, an executive dashboard, also known as a manager dashboard, executive cockpit, or digital cockpit, is a child of what in the 1980s was referred to as the Executive Information System (EIS). These systems, and their web-based progeny, all have the same goal: bringing critical information to decision makers and improve the performance of their business.

“Companies are finding it’s much better to allow a manager to make an immediate decision in response to a market opportunity than to force him to wait for the CFO…“Who uses them and why?
An executive dashboard (referred to as “dashboard” for the rest of this article) is an intranet for a select group of users. These users tend to be executives—VPs and above, the people who are the main decision-makers in the company.

However, not all new dashboards are for executives and their ilk. As organizations push to become more nimble (and hence more competitive), dashboards are now being developed for managers of all stripes. When developing a dashboard, don’t be surprised if you hear phrases such as: “Every employee a CFO.” These reflect a realization by companies that faster decision-making helps them succeed. This means giving managers the ability to make decisions on their own. Companies are finding it’s much better to allow a manager to make an immediate decision in response to a market opportunity than to force him to wait for the CFO, or some other executive, to be alerted to the opportunity and then make a decision.

A dashboard supports a manager or executive by doing three things:

  1. It answers fundamental questions about the business or business unit.
    The dashboard should answer basic business questions: fundamental questions about the health of the business that can be financial, operational, or comparative in nature, such as:

    • Did I reach my sales numbers this month?

    • How many widgets did we sell in China last year?
    • How many widgets are we producing per month at the Chicago factory?
    • How often do employees call in sick at our Miami store? On what days are they most likely to call in sick?
    • Is revenue growing on a month-to-month or week-to-week basis?
    • How am I doing in comparison to my competitors?

    These sorts of questions can often take a full-time administrator and several spreadsheets to answer. Currency of information is important, but not as important as having the right information.

    Each particular executive or manager will have their own statistics (called Key Performance Indicators, or KPIs) that are important to them, but often companies will also have a standard set of measures that has been applied across the organization. This eases comparison of managers and executives to one another. Basic KPIs can be combined to form a scorecard, and organizations that have a scorecard likely will want it to be a part of their dashboards.

  2. It alerts the user to issues or problems in such areas as production, sales, and revenue.
    Closely related to the first point, a dashboard should alert the executive or manager when something goes wrong. How an “alert” is defined is based on the needs of the business. Some example alerts would be:
    • A product defect rate is going above an acceptable level.

    • Absenteeism is becoming a problem at a particular store or factory.
    • Average delivery time is falling below normal.
    • Sales targets are not being met.
    • Operational expenses are growing beyond an acceptable rate.

    Every dashboard needs to have an alert system that communicates when a critical figure has been passed or is about to be passed. In this case, currency of information is extremely important.

  3. It helps make decisions that impact the business.
    Finally, the executive or manager will use the information from a dashboard to make decisions. Sometimes these decisions can be very straightforward and can be answered by a single KPI, but more often business decisions will be complex and require a variety of inputs. Examples of these decisions are:
    • Do I increase or decrease production?

    • Do I need to change my product mix to be more competitive?
    • Should I close shop in Des Moines?
    • Do I need to hire more salespeople?
    • Why is the business not growing as fast as planned?

These types of questions require the ability to explore a series of KPIs. Also, they require drilling down into figures based on time or region, or selecting and comparing variables. In this case, it is important that the information is presented in a way that helps the executive or manager come to a conclusion about the issue they’re confronting, and construct a rationale to support the decision they make.

The backbone of the dashboard
The heart of any dashboard is the KPI. KPIs can measure all sorts of things, such as:

  • Inventory levels

  • Monthly gross profit
  • Sales revenue by business unit, by product, by region
  • Revenue forecasts
  • Top customers
  • Number of consultants engaged
  • Accounts receivable
  • Employee attendance rates

These measures can be financial or operational, but at the very least they should say something important to the user about the business. KPIs are most often presented in tables, charts, and graphs. Different executives and managers will need different KPIs to support their views of the business.

Data sources
For any project, understanding the technology is important. For a dashboard project this is doubly so. My advice is: become good friends with your technologists and understand as much as you can about what they’re doing.

The data for each KPI has to come from somewhere. For each KPI it is important to know:

  • Which system or database will provide the data?

  • What is the format of the data?
  • How the data will be abstracted from that system?
  • Will it be moved to a data warehouse or some other environment where it will be cleaned up and analyzed?
  • Will a person need to review the data before it can be disseminated?
  • How will the data be pulled into tables and graphs?

The source data will often be kept in a variety of places. Some of these will be operational systems, such as SAP or PeopleSoft, and some will be data warehouses. It is important for information architects to understand where the data is coming from, and how it is getting into the dashboard. Data accessibility will have an impact on how the dashboard is designed.

It can help reassure the street
As a side note, companies have also used dashboards in recent years as a way to tell Wall Street that their CEO and executive staff are aware of the financial state of the company.

CEOs are now expected to be responsible for the financial integrity of their company, and dashboards have been touted as a way to ensure that the CEO is aware of all financial aspects of the company.

Personalization/Customization
During the requirements-gathering phase of the project, executives and managers will voice the need for different KPIs. Also, based on their level within the organization, some information may have to be protected from some users. Information architects should have a clear understanding of these limitations to ensure that the right data is delivered to the right people.

Users will also want to customize the dashboard. The dashboard’s interface should also allow users to pick which KPIs they see first, as well as set their own alert levels. Users’ interests may change over time, and alert levels can change depending on the business environment. Pre-set alert levels should be programmed into the dashboard, if these are known, but unless the business requirements state otherwise, users should be allowed to change these to suit their situations.

Finally, the more robust portal servers will allow integration of other business systems into the dashboard, such as email, news feeds, and so on. These should be included, if possible, since they will only increase the value of the dashboard and the likelihood that the user will, in fact, use it.

Since not everyone is interested in the same set of KPIs, and since the structure of the company may require that some information is screened from particular users, a good portal server will be required, or a server platform that can provide similar functionality. If the company already has portal software, then it would be wise to take advantage of this.

Gathering requirements
Dashboard projects can sometimes move a bit slower than other projects because the target audience—executives, mostly—are harder to schedule time with. If the dashboard is for senior executives (the CEO, for example), then it will be very unlikely you will be able to interview your users (with the likelihood decreasing as the size of the company increases). Usually, at this point, the client will appoint someone to identify the needs of the senior executives, and he or she should be able to provide you with most of the information you need.

However, there are some other things you can do to help make the dashboard as useful as possible:

  • Interview administrative assistants and technical support staff.
    These people respond to the needs (and whims and desires) of executives on a daily basis. They will be able to inform you of how the executives like to get their information (print vs. screen vs. PDA, etc.) as well as what other sources of information the executive uses. Keep note of any failed information systems (there are usually a few) that were supposed to make the executive’s life better, but were accessed only once or twice for demonstration purposes and are no longer used.
  • Understand the business.
    While this should be true for any corporate web project, it is extremely important for a dashboard project. You’ll want to know more than just what products and services the company sells, but things like:

    • What are their lines of business?

    • How do they report revenue?
    • Is the company is growth mode or managing for profitability?
    • What is the company’s overall business strategy?

    If the company is public, read the annual report, or go to Yahoo! Finance and review the company information. Since executives are usually striving to please shareholders (and increase the stock price), it’s important to understand how investors look at the company, and what the major issues are, such as problems with debt or flagging product sales. This will help give context to the KPIs executives will ask for.

  • Be aware of similar but different KPIs.
    You should be aware that, especially in large organizations that are the result of several mergers, a KPI may have been created in one group that is similar to, but not exactly like, a KPI generated in another group. For each KPI it will be important to know how it was generated, how long it has been around, and the exact formula used to generate the KPI. If you are merging two KPIs into one, understand how the KPIs are similar or different, and what the effect of losing one of these will have on an executive or manager.

    Balancing these needs can be politically tricky, but should be manageable.

  • Consider access issues.
    Access issues are important to consider especially when creating a site for users who are almost always pressed for time, as executives and senior managers generally are. To ensure your dashboard gets used, spend some time during the requirements-gathering phase to understand how executives currently get the information that will be newly presented in the dashboard. Understand what they like and dislike about how they get the information.
  • Choose an effective delivery system.
    A dashboard can have amazing information design, a smoothly functioning back end, and can satisfy every whim and desire of the executive, but it still may not be used because the executive or manager travels so much they only use their wireless handheld, or because they’re used to reading everything on paper, or because their administrative assistant doesn’t know how to find it and therefore doesn’t open it up for them.

    Also, don’t underestimate the power of having reports hand-delivered. For people who have an enormous amount of information to look at, printed reports is one way of controlling that flow. When interviewing an executive’s administrative assistant, ask them about the best way to deliver the dashboard to ensure it gets used by the executive.

  • Plan for security.
    Given the type of information that is being displayed, security will play a big role in the development and design of the site. There will be two aspects of security you will need to confront: who gets to see what; and how is the site protected. Personalization will allow you to control who sees what (see above), but controlling access to the site also needs to be considered.

    The best is to take advantage of a current Single Sign On (SSO) solution, if one has been developed, or use the network login, if that is possible. Otherwise, one is faced with having to generate a new set of user names and passwords for users to memorize. Given that most of these users are pressed for time and already overwhelmed with systems that are supposed to help them, a new set of user names and passwords can severely hamper the success of a new dashboard.

    Balancing security concerns and ease of access concerns may confront you with some tough decisions. Try and resolve these issues as soon as possible in the project.

  • Understanding the technology
    A large part of ensuring the success of a dashboard project will be getting the technology right. As an IA, you will probably not be expected to manage this part of the project, but it will be critical that you understand the possibilities and limitations of technology. The following are some things to keep in mind.

    Business intelligence
    Business Intelligence (BI) is an area of technology that is concerned with gathering and analyzing financial and operational information. Most likely, the systems from which data will need to be extracted are BI systems. It is also likely that there will be other BI projects with which the project team will have to coordinate. These projects are normally managed through the technology department.

    There are many companies that provide systems and software for the BI space, and they all offer a variety of features. Some of the players currently develop systems to manage business information, such as SAP, PeopleSoft, and Siebel. Others develop data warehouses and analytic tools such as data-mining tools. Some of the players here are Oracle, Hyperion, Cognos, and Business Objects. This is by no means a complete list, and each vendor offers a different set of capabilities. Most have some sort of dashboard offering that is tied into their own system.

    However, the information needed to create an effective dashboard rarely lives in just one system or database. Most organizations use a variety of these systems and may even have a few home-grown solutions as well, including Excel spreadsheets. On a recent project, the client captured much of their financial information in Hyperion Essbase, operational information in SAP, and sales information in Siebel.

    Moreover, many of these systems are not known for their ease of use. Often they present too much—or too little—data, and sometimes they are not customizable by the user. The graphs themselves may be confusing.

    Real-time data
    At some point you will have to define what you mean by real-time data. Very rarely will this mean instantaneous data. Often, data is exported out of one system and into another on a daily or weekly basis. Financial figures are revised often, and sometimes only reported on a weekly basis. Sometimes there is data manipulation that needs to occur to bring the data into the right format. Almost always, companies are tinkering with their data systems in an attempt to improve or consolidate them. All of this will have an effect on the accessibility of data, and how current it will be when it is abstracted.

    Understanding exactly what information the executive or manager needs, and why they need it, will help you make a decision on how current the data needs to be on the dashboard. Sometimes data that is a little older may even be better, since the executive or manager will have more faith in its reliability.

    Reporting software
    Before designing functionality for the dashboard, it is best to understand which charting software will be used and how it will impact chart and graph design. Many BI systems will export tables and graphs that can be pulled into a dashboard. Crystal Reports is a popular charting option, but there are many other providers of charting software such as JFreeCharts, Big Charts, and Object Planet’s Easy Charts. All of these charting programs have benefits and drawbacks, and all of them will place some limitations on chart and graph design.

    Once charting software is chosen, you might perform a test to help clarify its limitations. Design one chart or graph, and then try to generate that using the charting software. You may find that you can’t make the font as small as you would like, or that other design elements cannot be represented as you intend. It’s better to find this out sooner rather than later.

    Another thing to keep in mind is that not all reporting software generates charts on the fly. Especially if charting is a part of a BI system, be sure you understand how often charts are generated, as some BI charting applications generate charts on a daily basis, rather than on demand.

    “3-D options may look nice, but they add a lot of excess ‘chartjunk’ and detract from the story you’re trying to tell.”Information design
    You should keep in mind that dashboard projects often come about because of frustration with existing systems. Often, the current BI systems have not been stitched together in a meaningful way (there are too many of them, or they are not integrated), or the systems are less than useful because the information is presented in a way that is not immediately comprehensible or useful.

    For an information architect (at least for me) this is the most exciting challenge: Organizing data in a way that is meaningful for the user, as opposed to reflecting how the systems collect and manage data. It is the essential Tufte challenge: how to take massive amounts of data and clearly tell the story inherent within it.

    Tables, charts, and graphs
    Most KPIs, if not all of them, will be displayed using tables, charts, and graphs. Most reporting software packages offer the basic graph options—pie charts, column graphs, bar graphs, and line graphs—and then some. These should be enough to represent the KPIs you’ve selected for the dashboard. However, even within these basic types, there are variations you should be aware of. Review Information Graphics by Robert L. Harris for a complete exploration of data displays. You should be able to find the appropriate table, chart, or graph from this book.

    When using reporting software, be wary of options that look great, but don’t tell the story you’d like to communicate. For example, 3-D options may look nice, but they add a lot of excess “chartjunk” and detract from the story you’re trying to tell. For the busy executive, quick comprehension outweighs a pretty picture every time.

    Data exploration
    There are two important dimensions to data that the executive or manager must be allowed to explore: time and scope.

    The user must be able to compare the data to either the past or the projected future. Incorporating past data will help give the executive or manager perspective on current data. Incorporating projections will help the user see where they are headed if the current state remains unchanged. Almost every KPI should have some time element incorporated into it for these reasons.

    Scope refers to the ability to drill down into data, or roll up data. For example, if an executive is experiencing extreme growth for his or her business unit, they will want to know who or what is responsible. Giving them the ability to drill down in data based on geography, or sub-group, or some other variable, will help provide them with answers to their critical questions.

    The ability to navigate along these dimensions will improve the value of the dashboard immeasurably.

    Conclusion
    The steps one follows to build an executive dashboard are not too different, if at all, from the steps one would follow to build a “normal” website (if there is such a thing). However, the target audience, and the types of information being presented, place demands on the project which are different from the average web project. It may also require the Information Architect to spend more time worrying about technology than he or she is used to.

    But, putting these issues aside, designing an executive dashboard presents an almost pure data-design challenge-one of the few an IA can find in the web world. It gives the IA an opportunity to understand specific questions, and then try to answer those questions using data presented in tables, charts, and graphs. As an IA who also considers himself an information designer, this is a wonderful opportunity indeed.


    Articles

    • Betts, Mitch (April 14, 2003). “Management Dashboards Becoming Mainstream:” ComputerWorld.
    • Krell, Eric” (March 1, 2003). “Gauge Performance by the Dashboard:” Internet World
      Magazine.
    • Orlov, Laurie M. (December 2002). “Use Business Intelligence To Manage
      Velocity:” Forrester TechStrategy Report.
    • Tedeschi, Bob (July 29, 2002).“E-Commerce Report; Digital cockpits are a faster,
      much closer way of tracking performance in a corporation’s every corner:” New York
      Times.

    Books

    • Harris, Robert L. (1999). Information Graphics: A Comprehensive Illustrated Reference:
      Institute of Electrical & Electronics Engine.
    • Norton, David P. and Kaplan, Robert S. (1996). The Balanced Scorecard: Translating
      Strategy into Action
      : Harvard Business School Press.
    • Any of the Tufte books

    • Alex Kirtland is a Senior Information Architect and Experience Lead at SBI.Razorfish where he’s
      worked for the past three-and-a-half years. He’s worked with a variety of companies and
      organizations, including Kodak, Verizon, Avaya, Western Union, and the Federal Reserve Bank
      of New York. Besides executive dashboards, he’s also worked on metadata strategy and
      user research/usability projects. If you want to learn more about him please visit his website www.huangkirtland.com.

Posted in Interfaces, Special topic: Intranets, Visual and Visible | 6 Comments »

6 Comments

  • ji

    November 29, 2003 at 11:56 am

    thanks alex for good article.

    Just wanted comment on some of the patterns of the dashboards from variety of sources.

    Lack of personalization and customization of dashboards by the end users is a huge road block to gettig them to be really useful.

    Althoug security is a big concern, we do have let end users customize their dashboard’s contents – not just type of graphs getting displayed or look/feel. This is espically true for business end users.

  • William

    December 3, 2003 at 1:17 pm

    Bare with me as I make this long-winded point. With respect to the Executive Dashboard comment”…3-D options may look nice, but they add a lot of excess “chartjunk” and detract from the story you’re trying to tell. For the busy executive, quick comprehension outweighs a pretty picture every time.”

    It seems to me that only a left-brained person could make this comment with bias. We must keep in mind that the whole professional occupation of Information Architecture was an invention of the right-brained author Richard Saul Wurman who emphazed the importance of organizing the patterns inherent in data, making the complex clear. Almost all his work was visual in nature. I resent you left-brained writers thinking that there is no place for visualization.

    What am I talking about? The theory of the structure and functions of the mind suggests that the two different sides of the brain control two different “modes” of thinking. It also suggests that each of us prefers one mode over the other.

    Experimentation has shown that the two different sides, or hemispheres, of the brain are responsible for different manners of thinking.

    Most individuals have a distinct preference for one of these styles of thinking. Some, however, are more whole-brained and equally adept at both modes. In general, schools tend to favor left-brain modes of thinking, while downplaying the right-brain ones. Left-brain scholastic subjects focus on logical thinking, analysis, and accuracy. Right-brained subjects, on the other hand, focus on aesthetics, feeling, and creativity.

    It is a blanket statement to say that ALL “…busy executives, quick comprehension outweighs a pretty picture every time.” Most intelligent people are equally left and right brain balanced and welcome a clear visual in contrast to a sea of words.

    All you left-brained people need to remember that if you are going to call yourselves Information Architects, you need to credit the fact that this profession originally stemmed from Information Graphics. And that includes the incredibly effective medium of 3-D visualization. Your not going to steal that away from us too.

  • damrat

    January 14, 2004 at 12:25 pm

    ji, while I agree with you whole-heartedly in regards to the importance of visual delivery, I think you were missing Alex’s point.

    Don’t take the line you quoted about the “pretty picture” out of context. Using graphics, design and illustration to connect the left-brain data to the right-brain asthetic is important. Alex obviously knows this, as illustrated by his reference to Robert L. Harris’ book.

    Alex’s comment pretty specifically refers to the 3-D options offerred with most charting software. I have lost count how many times I have brought to a data presenter’s attention how easily a well-intentioned and properly chosen chart can be rendered almost useless by mindlessly clicking the 3-D option. The chart has suddenly become a work of modern art, ala Paul Klee, with the click of a radio button. Clear, needed divisions between bar clusters or even the proper dimensional representation of a pie-slice become hard to distinguish or distorted. It is eye catching and visually ‘cool’ to be sure, but the accuracy or effectiveness of the delivery of the data is lost.

    I think your heart is in the right place, ji. I have been ranting in corporate circles for years about the importance of sound design principles in Information Architecture. It is a fight worth fighting. But don’t be so quick to jump on one of your fellow crusaders. Alex was merely exposing a common blunder that I have personally witnessed a thousand times over: The inherent evils of the 3-D option.

  • ji kim

    January 16, 2004 at 8:43 am

    Damrat,

    I think you meant to address “William”….but the UI in this thread is little confusing.

  • The Dashboard Spy

    May 23, 2006 at 1:06 pm

    In regards to the level of visualization and the risk of “chart junk”, I believe that it is more desirable to have a dashboard full of whiz-bang junk that is embraced by the user community than a “correct” dashboard that is never used. I’ve found that what users like translates to funding for further phases and that, within reason, we should give the users the thrills they seek. Look at the hundreds of enterprise dashboard screenshots here and you’ll see that the best designed dashboards run the risk of being a little overboard in the jazzy graphics department. It makes the users feel good. Let’s feed their habit?

  • The Dashboard Spy

    April 19, 2007 at 9:52 pm

    It’s been almost a year since my comment above urging the “make the end users happy” approach to executive dashboard design and I still hold that position after several interesting and politically-charged dashboard projects. The dashboard project sponsors want that “wow” factor – after all they paid for the dashboard and want the sizzle to make an impact. The collection of screenshots of actual enterprise dashboard implementations at http://www.enterprise-dashboard.com has grown now to over 850! There are a wide range of visual preferences exhibited there.

Sorry, comments are closed.