When one size does not fit all: a literature review on the modifications of the balanced scorecard
Published: Sept. 24, 2013
Latest article update: Dec. 8, 2022
Robert Kaplan and David Norton emphasize that the four perspectives of their standard balanced scorecard (BSC) need to be adapted to the organizational context. Yet, we lack a coherent body of knowledge on these adaptations. 20 years after the implementation of the BSC, a literature review is warranted to investigate if and how the original BSC has been modified in practice. The authors conduct a systematic literature review of leading academic journals from 1992 to 2012 to identify and analyze the extant empirical evidence on the BSC. The authors find 117 empirical studies on the BSC, of which 27 deal with BSC-modifications. First, the authors conclude that the BSC-perspectives have been modified to match different industries, organizational levels, or functions (e.g., the public sector, information systems, supply chain management, corporate social responsibility, or incentive systems). Second, the authors use an established BSC classification, and argue that the BSC has also been modified in terms of its sophistication. This paper can only identify few examples where the BSC has become an incentive-relevant management system as imagined by Kaplan and Norton; many organizations stop at the level of a measurement system. On the one hand, this article demonstrates the versatility of the BSC and its perspectives as claimed by Kaplan and Norton. On the other hand, the lack of sophisticated implementations shed a critical light on the relevance of the BSC in practice
Keywords
Environment, Corporate social responsibility, public sector, literature review, balanced scorecard, organizational design, performance measurement system, supply chain management, information systems, implementation, performance evaluation, incentives
Over the last 20 years, the balanced scorecard (BSC) has become one of the most popular management practices among both public and private organizations (Kaplan, 2012; Kaplan and Norton, 1992). It is a management system that aims at aligning an organization’s strategy with its planning and control systems. In order to achieve that, it derives its objectives, targets, key performance indicators (KPIs), and even action plans directly from an organization’s strategy map. The KPIs of the BSC differ from traditional performance measurement systems (PMSs) as they combine financial and non-financial, as well as leading and lagging KPIs. The original model of the BSC prescribed four perspectives (financial, customer, internal processes, learning and growth) for which appropriate KPIs had to be defined (Kaplan and Norton, 1992). Later, Kaplan & Norton (1996, p. 34) corrected this, stating that these perspectives should only be used as a template and needed to be adjusted to organizational context.
However, there is no consistent body of knowledge that could help to understand if and how these BSC- modifications have been achieved in practice. These insights would be of high relevance as the naive implementation of generic, decontextualized management practices is detrimental to organizational performance (Chenhall, 2003; Lueg and Nprreklit, 2013. 2012). To address this gap, we address the research question: How has the balanced scorecard been modified in organizational practice?
To answer this question, we conduct a systematic literature review of empirical evidence on the BSC, that has been published in leading academic and practitioner journals from the implementation of the BSC in 1992 to 2012. In total, we identify 117 empirical studies on the BSC, of which 27 deal with BSC-modifications.
The structure of the paper is as follows. Section 1 introduces our theoretical framework. Section 2 explains our methodology and literature search. Section 3 analyzes the relevant articles. We discuss the limitations and contributions of our findings in the final section.
We focus on BSC-modifications in two main areas: changes in BSC-perspectives and changes in BSC- sophisfieafion.
1.1. BSC perspective. In the beginning, Kaplan & Norton (1992) introduced the four BSC-perspectives as a general recommendation for implementation: the financial perspective covers how success is measured by shareholders. The customer perspective determines how the organization creates value for its customers. Internal business processes explains at which processes the organization must excel in order
to satisfy its customers and shareholders. The learning and growth perspective addresses the capabilities and information systems necessary to improve processes and customer relationships. Later, Kaplan & Norton (1996, p. 34) began emphasizing the need to adjust the BSC to organizational context:
“The four perspectives of the BSC have been found to be robust across a wide variety of companies and industries. But the four perspectives should be considered a template, not a strait jacket. No mathematical theorem exists that four perspectives are both necessary and sufficient. ”
Kaplan and Norton have then provided some anecdotal evidence how the BSC could be modified. First, they suggest adding or exchanging perspec-tives. Second, they suggest changing the importance of the perspectives, e.g., assigning less importance to the financial perspective in education or public services (Atkinson et al., 2011). Over the years, Kaplan and Norton (2001, 2004,2006,2008) have also made more suggestions of how the BSC can be better applied, e.g., for the corporate headquarter, or compensation purposes.
Despite its popularity, many critics have raised concerns against the BSC. Among the most prominent, Nprreklit (2000) challenges the mechanistic assumptions of the BSC, which assert that cause-and-effect relationships can be determined exante by top-down management. Later, she also shows that the BSC’s perspectives are outdated versions of the much older ‘Profit Impact of Market Strategy’ study (Lueg and Nprreklit, 2012). Moreover, Nprreklit (2003) deconstructs the rhetoric of the BSC’s authors, claiming that the popularity of the BSC is based in persuasive rhetoric rather than in solid academic argumentation. As a seminal empirical work, Inner & Larcker (2003) document a case where a by-the-book-implemented BSC is abandoned by an organization due to subjectivity of top management evaluators, and insensitivity for middle managers’ values. In a literature review, Zimmerman (2001, p. 424) similarly criticizes the BSC’s assumption that employees will alter their personal motivations only because of a new management control system:
“[...] the balanced scorecard [...] assume[s] that agents will enthusiastically adopt the new approach because it promises to maximize firm value. [...] This “Field of Dreams” (if you build it, they will come) approach ignores employee self-interest. ”
1.2. BSC types. Other researchers classify BSC- modifications not by (the weight of) BSC- perspectives, but by the sophistication of the BSC- implementation (e.g., Mahni, 2001). Speckbacher et al. (2003) conduct an empirical study and uncover that BSCs differ most distinctly in their scope. Based on their data from German-speaking countries, they suggest another classification of BSC-modifications:
According to Kaplan & Norton (1996, p. 34), only the BSC type 3 is a full BSC that affects organizational performance. Our literature review will also accommodate for this sort of BSC-modifications as a benchmark for the definition of section 1.1.
We conducted our literature review in four steps. First, we conducted our surveys in the databases ABI Inform, EBSCO, and ScienceDirect instead of limiting ourselves to a pre-selected set of journals. A search for ‘balance scorecard’ in the timeframe 1992 to 2012 resulted in 1,031 hits. Second, we kept only the 315 empirical articles to understand practices in the field. Third, we selected only those articles that were published in academic or practitioner journals of the highest quality, i.e., a minimum two star rating from the Association of Business Schools (Harvey et al., 2010). We also went through these articles’ bibliographies to uncover further relevant sources. This left us with 117 high qualify, empirical papers on the BSC. In a fourth step, we scanned abstracts, key-words, and titles of these articles, as we only aimed at the topic of BSC-modifications. We also included articles where the names of the perspectives were changed, even if we found out later that the content remained the same. This way, we did not omit any relevant literature. We ended up with a dataset of 27 articles, which we will review in the following section.
This review structures the literature for the reader by a framework. We followed established approaches in the management literature to draft such a framework (Katsikeas et al., 2000; Lueg, 2008; Lueg and Schäffer, 2010). We first studied the conceptual literature and established preliminary categories that should cover the most important fields of interest on BSC modifications. In a second step, we read all the sources we identified as relevant for this review. While reading the sources, we analyzed them for patterns that could help us to improve the preliminary framework of our analysis. Based on this, we adjusted our preliminary categories. We agreed on seven distinctive categories that should help the reader to get a good overview (ГГ, supply chain management, public sector, organizational levels, corporate social responsibility, performance eva-luation and other modifications). We provide a systematic overview of the articles’ characteristics at the end of this section.
3.1. Information technology. The difficulties of implementing information technologies (IT) and assessing their performance have been acknowledged by scholars (Lueg and Lu, 2012, 2013; Martinsons et al., 1999). Therefore, finding means to overcome these issues and to improve the management of IT systems has been a research focus. The BSC appears to be an effective tool to align and integrate ГГ and business strategies.
Huang and Hu (2007) show how to align IT capabilities and activities with business objectives and business requirements using the BSC. They illustrate measures to adjust the traditional perspctives.
Van Der Zee and De Jong (1999) demonstrate how the BSC helps managers and IT engineers to develop a common language. The authors even suggest that BSC can advance beyond a strategic management system and help to align organizational values and different cultures across departments.
Martinsons et al. (1999) follow the development of a BSC for information systems (IS) that measures and evaluates the following perspectives: business value, user orientation, internal process, and future readiness. Based on case study evidence, they suggest that the IS BSC could be used as a “[...] foundation for a strategic IS management system.”
Kim, Suh and Hwang (2003) provide an example of such an application by investigating an implementation of Customer Relationship Management (CRM). In that case, the BSC could be used to replace the traditional financial measuring systems as well as all traditional BSC-perspectives in an iterative process. The new system used the (mostly) non- financial perspectives of customer knowledge, customer interaction, customer value, and customer satisfaction. These were deemed more relevant than purely financial ones in the CRM setting.
Alternatively, IT tools can also optimize the components of the BSC in terms of precision or accessibility. Creamer and Freund (2010) showcase the adaptation of a BSC through machine learning methods. These helped defining the structure of a board-BSC for corporate governance purposes. One outcome was that the traditional customer perspective was replaced by the new perspective of stakeholders. According to Creamer and Freund (2010, p. 384), the improved BSC was:
“...able to forecast corporate performance, select the most important variables, establish relationships among these variables, define a target for each variable to optimize corporate performance, and build a board strategy map and a board BSC”.
This allowed managers to focus on the most important strategic issues and to delegate target setting to a semiautomated planning system.
Likewise, Akkermans and Van Oorschot (2004) show empirically that system dynamics (SD) modeling and simulation methods can effectively address problems with the quality of BSC-measures during the development process of the BSC.
Due to the limited scope of these IT-BSCs, we could not identify any BSC types 3.
3.2. Supply chain management The case study of Malina and Selto (2001) describes a BSC that focuses on the distribution channels of the US company. Managers merged the original 4 perspectives into 3 to suit the specific context in the following way: (1) competitive advantage related to customer value and internal processes; (2) profitability and growth depicted internal processes find financial success; (3) corporate citizenship was added and put together with investments in human capital, which both related to the learning and growth perspective. A completely new perspective was (4) distributor performance. While the authors found the BSC to be effective to align operations with strategy, they also noted tension between top and middle managers on the evaluation, control and communication mechanisms that came with the BSC. As to SCM-BSCs, this is the only BSC type 3 we could identify.
Bhagwat and Sharma (2007) follow the implementation of a BSC in an SME in India. While the BSC was focused on SCM and kept the original 4 perspectives, the value of the article lies in the elaborate suggestion of specific, SCM-related metrics for the BSC. This framework could be used as a strategic SCM evaluation tool to monitor and guide projects and general performance improvement efforts.
Zimmermann and Seuring (2009) conduct two case studies in the chemical and automotive industry where producers and retailers developed joint BSCs along their supply chains. Their article provides detailed insights into the strategy maps, perspectives, as well as a detailed account of the characteristics of used KPIs of these two BSCs. Their first case is also an example where the crucial learning and development perspective has been eliminated from the BSC, a step against which Kaplan and Norton (1996) generally warn. As it turned out, the companies dropped their plans to implement BSC types 2 due to the high maintenance costs.
Wu and Chang (2012) use survey data from 127 organizations to map the diffusion process of the BSC in SCM. Their study suggests that the four generic perspectives are widespread, but several organizations have modified the BSC’s measures and perspectives. Specifically, Wu and Chang (2012) propose that in SCM, the more externally focused perspective business process should replace internal processes in the SCM context.
3.3. Public sector. Kaplan (1999) acknowledges the difficulties to measure performance in the public sector. Due to the non-financial nature of many of its objectives, he suggests the BSC as a PMS. However, public organizations seem to struggle more than private ones in implementing the BSC.
Chang (2007) documents how the BSC was applied by the UK National Healthcare System to assess the performance of hospitals and to inform the public about this. The four original perspectives of the BSC were replaced by national targets related to waiting time, clinical output/outcome, patient satisfaction and capacity and capability. The main focus of the performance measures was on waiting time, and the importance of feedback from the patient was overlooked. As the choice of most BSC-measures was subject to political power, this led to a misleading rating system. Furthermore, the case demonstrated that the desire of politicians for shortterm and easily understandable measures might have hindered a more rigorous, long-term public sector reform.
Greatbanks and Tapp (2007) provide an example on how the BSC helped to improve service quality at the Customer Service Agency (CSA) in New Zealand. Each scorecard was built up from the strategic, financial, operational, customer and development measures with respect to each department and for each concerned employee. However, we alert that the BSC was only implemented at a sub-division level, which limits conclusions on the strategic alignment. Yet, the BSC was used to establish an incentive system for employees; for this reason, we classify this BSC as the only BSC type 3 in the public sector context.
McAdam and Walker (2003) investigate a BSC in local UK government. The authors provide a framework for implementing and managing strategy at all levels of public management and to link objectives, initiatives and measures to an organization’s strategy. In the case study, the perspective of employee satisfaction was added, and the importance of the customer perspective was prioritized. The overall results were mixed, but mainly positive in relation to the three main objectives of the public sector (Kaplan, 1999): create value, minimize costs and develop ongoing support and commitment from its funding authority.
3.4. Organizational levels: corporate and personal BSCs. In the beginnings of the BSC, Kaplan and Norton (1992; 1993a; 1993b) only related the BSC to the level of strategic business units (SBUs). They first mentioned the corporate BSC (CBSC) in 1996 (Kaplan and Norton, 1996), but did not develop its conceptual foundations until recently (Kaplan and Norton, 2008). Their main claim is that the CBSC orchestrates the SBUs and exploits their synergies.
Kraus and Lind (2010) investigate 8 of the largest Swedish organizations. They conclude that the CBSC had little impact on the effectiveness of corporate control since was mostly financially oriented.
Gumbus and Lyons (2002) explain how Philips Electronics overcame this limitation by implementing several SBU-BSCs connected by the corporate strategy. This BSC had three levels (strategy, operations, business unit), and the extension to a fourth level was planned (employee). Three traditional perspectives were kept. Only learning and growth was replaced by competence, as it also comprised the notion of leadership. Since this is the only BSC that links results to compensation, it is the only BSC type 3 in this field.
There are also two investigations of the BSC at the level of the actor. Wiersma (2009) finds the way 224 individual managers across 19 Dutch organizations use the BSC (decision-making/rationalizing, coordination, self-monitoring) depends on the context (evaluation style, competing controls, receptiveness to new information). This indicates that even if an organization has 1 BSC, its notion differs with every user. Rampersad (2008) develops a personal BSC to increase an actor’s efforts for the organization. It still incorporates the financial and learning perspectives. He adds an internal perspective (relating to the actors health and mental state) as well as an external perspective (relations to other actors).
3.5. Corporate social responsibility. When incorporating social and environmental performance measures, the BSC can address organizational sustainability (Lueg et al., 2013a; Songini and Pis- toni, 2012).
As an example, Dias-Sardinha and Reijnders (2005) document how large Portuguese organizations address social and environmental performance. 2 out of the 4 perspectives of the BSC were changed to adapt to serve this purpose: the financial perspective was replaced by eco efficiency (compliance and pollution management), and the customer perspective by stakeholders. The authors reported several problems with the BSC implantation, such as the dearth of relative performance measures, the eclectic nature of non-financial indicators, as well as the predominance of financials in industrial organizations.
Tsai, Chou and Hsu (2008) demonstrate how to use a sustainability BSC to evaluate socially responsible investments. For that, they suggest replacing the customer perspective with a broader stakeholder/ customer perspective.
Chahneta and Palomero (2010) investigate the use of the BSC for sustainability in 16 organizations. Besides adjusting the traditional 4 perspectives, they suggest adding 3 new perspectives: technologies, social/occupational, and environmental.
Hansen et al. (2010) follow the implementation of a community focused BSC by Merck in Thailand. They report that a fifth perspective was added to the 4 traditional ones (social contribution).
We criticize that none of the studies can explain how the organizations have linked their CSR- intentions to the results from the BSC, e.g., by using incentive systems. Therefore, we cannot classify any of these CSR-BSCs as a BSC type 3.
3.6. Performance evaluation. Kaplan and Norton (1996, p. 34) see the link from the BSC to incentive systems as the final step to a fully implemented BSC, which corresponds to the understanding of researchers that classify the BSC by sophistication (Lueg, 2010; Malmi, 2001; Speckbacher et al., 2003). Since all of the BSCs in this section consider performance evaluation, they are all BSC types 3.
Inner et al. (2003) investigate the use of a BSC for compensation in financial services. They find that the traditional perspectives of the BSC were not sufficient for this: only the perspectives financial and customer were kept, and the four new perspectives on strategy implementation, customer, control, people, and standards were added. The authors report that the BSC was finally discarded in favor of a revenuebased incentive system due to problems of the BSC with overreliance of lagging, financial measures, as well as dysfunctional subjectivity of superiors in evaluations.
Also Decoene and Bruggeman (2006) are critical. They document a BSC-modification of a Danish plastics manufacturer that keeps the customer perspective and adds the following perspectives: responsible care; manufacturing [includes costs and internal processes]; and people. They conclude that the top-down compensation plan lacked strategic alignment. Hence, it did motivate actors to increase organizational performance.
Griffith and Neely (2009) use a quasi-experiment to investigate incentives and branch performance in the UK. The included BSC perspectives are the traditional perspectives financial and customer, the newly added are internal measures, people and supplier. The authors conclude that the success of BSC- incentives varied across branches, mostly depending on the experience the middle managers had to respond to the new incentives.
3.7. Other modifications: collaborations, alliances, and SMEs. The BSC was further modified for diverse other purposes. Sandstrom and Toivanen (2002) demonstrate how the BSC replaces schedules and budgets for engineers in the product development and design of a manufacturer. The merit of the paper lies in showing different measures for the traditional 4 perspectives. Al-Ashaab et al. (2011) conduct two case studies and illustrate how the BSC can also be used in collaborative, inter-organizational settings. Only the internal business processes perspective was kept for that. The newly added perspectives included competitiveness, sustainable development, innovation, strategic partnerships, and human capital. Gumbus and Lussier (2006) use three case studies to illustrate how the BSC and its traditional four perspectives can be adjusted to small- and mediumsized organizations. Due to the limited scope of these IT-BSCs, we could not identify any BSC types 3. Table 1 summarizes our analysis.
4.1. Contributions. This article addresses the question how the Balanced Scorecard has been modified in organizational practice. We find that organizations modify the BSC in two main ways: (1) by adapting the perspectives and the pertinent objectives and KPIs to their specific needs (Kaplan and Norton, 1996), and (2) by choosing the BSC type (sophistication) that fits its purpose(Speckbacher et al., 2003). Our findings make several contributions to the extant literature.
First, we can somehow confirm the claim of Kaplan and Norton (1996) that the BSC is versatile and can be used across different industries, functions or hierarchies. The empirical evidence suggests that it is not always necessary to invent new perspectives - that might lead to information overload or lack of focus - to adjust a BSC to a new context. Rather, a contextbound selection of objectives and KPIs can already lead to an appropriate modification. Yet, we alert practitioners that the implementations in some fields were constantly subject to severe problems, e.g., in the public sector, or for incentive systems.
Second, we find that the empirical evidence across the many identified fields does not offer a clear pattern of modifications. Neither were all modifycations successful. Therefore, we cannot offer advice to practice on the ideal modifications. Nevertheless, this literature review offers a compre-hensive overview of the state of the art of BSC-modifications and can thereby help researchers and practitioners to quickly identify the most relevant studies.
Third, we follow Nprreklit et al. (2012) and challenge the notion of Kaplan (2012) that the BSC is highly relevant in practice: out of the 27 reviewed articles, only 6 (22%) report that the BSC has been fully implemented as a type 3 (Speckbacher et al., 2003). This is relatively low compared to the high rates of implementations of similar systems, such as Valuebased Management (Burkert and Lueg, 2013). If so many organizations have a BSC type 1 or 2 - that Kaplan and Norton (1996, p. 217) describe as nonperformance enhancing - then something else must drive organizational performance, and the BSC is only a placebo. Since its implementation is, however, time-consuming and expensive, managers should be very clear about its purpose before adopting and modifying it.
4.2. Limitations. A main limitation of this review is that we limited ourselves to high quality academic and practitioner journals. We may have possibly overlooked valuable studies from books or conference presentations. Another limitation of this article is that the analysis of the modifications was limited to the changes in the types and in the perspectives of the BSC. For instance, the review could have been structured by the different ways that actors use the same type of BSCs.
4.3. Future research. Future research topics could expand on our contributions. First, analytical and conceptual researchers could attempt to suggest a general pattern of BSC-modifications that empirical researchers could use as a benchmark. Second, future studies should generally incorporate success measures of the BSC-modifications that are comparable across studies in order to see how ‘relevant’ the popular BSC actually is for organizations in the field. Third, researchers could take a closer look at the often neglected learning and growth perspective, that accounts for intangible assets (cf. Lueg et al., 2013b).
To conclude, this article aimed at reviewing the empirical literature on BSC-modifications. We could show that the BSC is very versatile and has been applied across many industries, functions and hierarchies (IT, SCM, public sector, organizational levels, CSR, perfor-mance evaluations, alliances, or SMEs). Yet, the performance effects of these modifications remain open issues.