Ministry of Economic Development Home| Contact MED|


 
 
 

Links to this page were:

Section Subnavigation Links:

3. Innovation Results 2005


This Document is Archived


07/04: Just How Innovative are New Zealand Firms? Quantifying & Relating Organisational and Marketing Innovation to Traditional Science & Technology Indicators

Richard Fabling
[ Last Updated 28 August 2007 ]


Firstly, we compare and contrast different innovation measures (across both outcomes & practices) within the BOS 2005 cross-section. Since this paper is partly concerned with reporting the results of the expanded innovation collection format (ie, the introduction of two "new" innovation types), we segment firms that have successfully innovated into three distinct groups: product and/or operational process only (PP) innovators; organisational/managerial process and/or marketing only (OM) innovators; and innovators that have succeeded in producing a combination (COMBO) of PP & OM innovations.14 Given our prior discussion, we should note that the breakdown into innovation groups is inconsistent with our advocated holistic view of the firm. It is done purely for ease of exposition and not for conceptual reasons.

Table 1: Headline innovation rates & relationships between innovation outcomes 2005
Headline
innovation
rates (2yr):
Number Rate Of which: also outcome…
Products Operational processes Organis-
ational/
managerial
processes
Marketing methods
New
products
7852 22.9% 100.0% 44.2% 47.8% 48.4%
New
operational
processes
7066 20.6% 49.1% 100.0% 63.5% 52.6%
New
organi-
sational
/managerial
processes
9124 26.6% 41.2% 49.2% 100.0% 51.4%
New
marketing
methods
8147 23.8% 46.6% 45.6% 57.6% 100.0%

Headline
innovation
rates (2yr):
Number Rate Of which: also ongoing…
Products Operational processes Organi-
sational/
managerial
processes
Marketing methods
New
products
7852 22.9% 30.3% 25.1% 20.6% 23.1%
New
operational
processes
7066 20.6% 26.2% 31.2% 24.3% 21.3%
New
organi-
sational
/managerial
processes
9124 26.6% 25.6% 29.8% 28.9% 25.9%
New
marketing
methods
8147 23.8% 26.3% 24.5% 21.3% 27.5%

Innovation groups (2yr): Number RATE Of which: also ongoing…
PP OM COMBO NON
PP: Product AND/OR operational
process innovations ONLY
4799 14.0% 9.6% 4.0% 19.9% 66.5%
OM: Organisational/managerial process AND/OR marketing method innovations ONLY 3669 10.7% 4.6% 8.2% 18.5% 68.6%
COMBO: Combination of "technological" &
"non-technological" innovations
7782 22.7% 8.4% 7.0% 36.0% 48.6%
NON: No successful innovation over the
period
18011 52.6% 0.9% 2.3% 4.2% 92.7%
34261 100.0%

Chart 4: Headline innovation outcome comparison 2003-2005 (consistent population)

Chart 4: Headline innovation outcome comparison 2003-2005 (consistent population)

Headline rates for innovation outcomes & our innovation groups are presented in table 1. The top panel of the table shows overall rates for the four innovation outcomes and, to the right, rates of successful (and ongoing attempts at) innovation conditional on having innovated on another dimension.15 For example, of those firms that successfully introduced new (or significantly improved) operational processes, 63.5% also introduced new organisational/managerial processes. These results support the motivating hypothesis of the paper – technological progress does not operate independently of wider practices within the firm. Applying the innovation group definitions above emphasises this point. In the bottom panel of the table, we see that our COMBO group (i.e., firms with innovations spanning "technological" & "non-technological" dimensions) has by far the largest population (of the innovator groups). Chart 4 puts these results in the context of economy-wide innovation by comparing innovation in 2003 to 2005. Not too much attention should be paid to overall rates as both populations have had to be adjusted to achieve comparability, and because the innovation reference periods are different. The important point to draw from this graph is that the 2003 results miss the complexity of the innovation story for a significant proportion of product & operational process innovators.

The distinction between PP & OM innovator groups is itself murky, since over a fifth of each of these groups considers they are ongoing innovators on the other dimension (bottom right of table 1). This last data suggests a potential mislabelling of the innovation groups as "distinct". We choose to continue with the groups as defined on the grounds that: we prefer to specify our subsequent regressions with outcomes on the left-hand side and activities on the right-hand side (despite the obvious problem of whether causality can be asserted in this contemporaneous relationship); and we have already admitted our groupings violate the holistic approach advocated – firms crossing our artificially imposed boundaries does nothing but emphasise this point further.16

Chart 5: Innovation activities 2005 (BPS-consistent industry coverage)

Chart 5: Innovation activities 2005 (BPS-consistent industry coverage)

→ Full size version of Chart 5 [117 kB JPEG]

Chart 6: Sources of ideas/info for innovation 2005 (BPS-consistent industry coverage)

Chart 6: Sources of ideas/info for innovation 2005 (BPS-consistent industry coverage)

→ Full size version of Chart 6 [102 kB JPEG]

We now turn to measuring the underlying innovation activities in the population. Chart 5 shows overall participation rates in innovation activities measured in BOS, while chart 6 shows sources of innovation ideas. There is significant variation in the rates of business uptake of these practices with general training of staff being conducted by 85% of firms, while M&A activity affects less than 3% of the population. The question we wish to ask is: How are these activities related to innovation group outcomes (contemporaneously)? To answer this question we conduct a series of multinomial probit regressions of our innovation groups on firm characteristics and various combinations of innovation activities (Table 2).17 We draw two interpretations from the table coefficients. First, they indicate whether the characteristic, practice or source of information is more or less likely to be associated with the innovation group that heads the column the coefficient is in (relative to being in the NON group). A p-value under each coefficient indicates the statistical significance of this interpretation. Second, looking across a row (within a panel), coefficients can be compared to see whether an independent variable is more likely to be associated with some successful innovation groups over others. A supplementary test of the equivalence of the OM and PP coefficients tells us whether the characteristic, practice or source of information is significantly more likely to be related to one of these outcome (p-values for these tests are not reported in the tables, but significant differences – at the 5% level – of this type are denoted in the tables by bolded coefficients).

Table 2: Contemporaneous relationship between innovation activities & outcomes
OM PP COMBO OM PP COMBO
ln(RME) 0.213** 0.201** 0.238** 0.009 -0.017 -0.082
[0.000] [0.000] [0.000] [0.893] [0.817] [0.247]
ln(age) 0.011 0.003 -0.084 0.041 0.038 -0.066
[0.879] [0.962] [0.206] [0.597] [0.610] [0.446]
Export intensity 0.004* 0.009** 0.007** 0.003 0.006 0.003
[0.032] [0.001] [0.000] [0.242] [0.072] [0.323]
Inward direct investment (FDI) intensity 0.002 0.006** 0.004* 0.004 0.009** 0.007*
[0.487] [0.009] [0.039] [0.194] [0.001] [0.020]
Outward direct investment (ODI) indicator 0.516* 0.578** 1.277** 0.092 0.233 0.774
[0.031] [0.005] [0.000] [0.808] [0.532] [0.119]
Subsidiary firm -0.317* -0.383** -0.281* -0.610* -0.579* -0.588
[0.048] [0.007] [0.027] [0.037] [0.023] [0.063]
Entered new export market (1yr) 0.706* 0.310 1.017**
[0.014] [0.267] [0.000]
Invested in expansion (1yr) 0.018 0.061 0.209
[0.921] [0.691] [0.249]
R&D intensity (1yr) -0.043 -0.034* -0.045**
[0.053] [0.033] [0.003]
Share of in-house R&D (1yr) 0.004 0.012 0.011*
[0.363] [0.053] [0.016]
Part of a merger or acquisition (1yr) -0.023 -0.500 0.150
[0.946] [0.278] [0.723]
Trained employees (1yr) -0.494* -0.103 0.417
[0.014] [0.645] [0.067]
To innovate (2yr):
Machinery and equipment 0.600* 0.973** 0.711**
[0.011] [0.000] [0.002]
Computer hardware and software 0.970** 0.764** 1.178**
[0.000] [0.000] [0.000]
Acquired other knowledge -0.018 -0.064 0.216
[0.950] [0.836] [0.483]
Design 0.570* 0.834** 0.722**
[0.023] [0.001] [0.003]
Marketing new products 0.420 0.932** 1.195**
[0.091] [0.000] [0.000]
Trained employees 1.410** 1.423** 1.065**
[0.000] [0.000] [0.000]
Changed marketing strategy 0.484 -0.162 0.735*
[0.098] [0.605] [0.018]
Market research 0.331 0.451 0.338
[0.216] [0.131] [0.193]
New strategy/ management techniques 0.824** -0.089 0.812**
[0.000] [0.701] [0.000]
Organisational restructuring 0.708** -0.006 0.656**
[0.005] [0.980] [0.009]
Co-operative arrangements 0.970** 1.103** 1.419**
[0.008] [0.001] [0.000]
Sources of innovation ideas (2yr):
New staff
Existing staff
Business group
Customers
Suppliers
Competitors
Other industries
Professional advisors
Books/patents/Internet
Conferences/exhibitions
Industry/employer organisations
Universities/polytechnics
CRIs and other research institutes
Government agencies
NON 96.8% NON 94.0%
OM 0.0% OM 30.5%
PP 0.1% PP 32.7%
COMBO 13.6% COMBO 70.6%
54.0% 73.2%

OM PP COMBO OM PP COMBO
ln(RME) -0.017 0.055 0.005 -0.025 0.009 -0.079
[0.804] [0.409] [0.946] [0.727] [0.898] [0.272]
ln(age) 0.061 -0.009 -0.055 0.051 -0.006 -0.080
[0.450] [0.909] [0.562] [0.532] [0.936] [0.380]
Export intensity 0.004 0.007* 0.007** 0.004 0.005 0.004
[0.155] [0.036] [0.008] [0.221] [0.169] [0.215]
Inward direct investment (FDI) intensity 0.003 0.009** 0.006* 0.005 0.011** 0.008**
[0.233] [0.003] [0.026] [0.084] [0.000] [0.006]
Outward direct investment (ODI) indicator -0.149 -0.117 0.535 -0.089 -0.073 0.557
[0.646] [0.703] [0.139] [0.804] [0.842] [0.229]
Subsidiary firm -0.693* -0.801** -0.665* -0.691* -0.754** -0.629*
[0.010] [0.003] [0.014] [0.014] [0.004] [0.032]
Entered new export market (1yr) 0.561* 0.048 0.781**
[0.048] [0.860] [0.004]
Invested in expansion (1yr) 0.056 0.123 0.269
[0.740] [0.421] [0.126]
R&D intensity (1yr) -0.029 -0.025 -0.037**
[0.142] [0.063] [0.008]
Share of in-house R&D (1yr) 0.001 0.010* 0.009**
[0.679] [0.020] [0.005]
Part of a merger or acquisition (1yr) -0.209 -0.710 -0.017
[0.524] [0.051] [0.966]
Trained employees (1yr) -0.538* -0.150 0.367
[0.016] [0.505] [0.127]
To innovate (2yr):
Machinery and equipment 0.573* 0.922** 0.690**
[0.015] [0.000] [0.003]
Computer hardware and software 0.633** 0.363 0.845**
[0.003] [0.085] [0.000]
Acquired other knowledge 0.097 0.111 0.386
[0.752] [0.733] [0.232]
Design 0.467 0.725** 0.588*
[0.056] [0.002] [0.011]
Marketing new products 0.259 0.770** 1.066**
[0.245] [0.001] [0.000]
Trained employees 0.876** 0.893** 0.555**
[0.000] [0.000] [0.008]
Changed marketing strategy 0.464 -0.237 0.635*
[0.075] [0.405] [0.027]
Market research 0.016 0.080 0.008
[0.952] [0.771] [0.976]
New strategy/ management techniques 0.429* -0.479* 0.479*
[0.049] [0.035] [0.035]
Organisational restructuring 0.577* -0.027 0.568*
[0.024] [0.909] [0.017]
Co-operative arrangements 0.697 0.728* 1.089**
[0.055] [0.022] [0.002]
Sources of innovation ideas (2yr):
New staff 0.420 -0.546* 0.276 -0.013 -0.814** -0.207
[0.059] [0.012] [0.201] [0.954] [0.000] [0.334]
Existing staff 1.692** 2.097** 1.697** 1.222** 1.698** 1.085**
[0.000] [0.000] [0.000] [0.000] [0.000] [0.000]
Business group 1.008** 0.890* 0.936** 0.282 0.302 0.044
[0.005] [0.014] [0.005] [0.358] [0.306] [0.878]
Customers 0.425* 0.512* 0.767** 0.014 0.209 0.313
[0.044] [0.018] [0.000] [0.949] [0.404] [0.154]
Suppliers 0.249 0.167 0.234 0.002 -0.104 -0.140
[0.252] [0.447] [0.292] [0.994] [0.655] [0.526]
Competitors 0.405 0.505* 0.482* 0.290 0.289 0.293
[0.091] [0.030] [0.036] [0.235] [0.215] [0.212]
Other industries -0.253 -0.049 0.223 -0.598* -0.320 -0.203
[0.440] [0.883] [0.515] [0.049] [0.287] [0.509]
Professional advisors 0.789** 0.451* 0.608** 0.602** 0.396 0.505*
[0.000] [0.033] [0.007] [0.007] [0.076] [0.030]
Books/patents/Internet 0.390 0.305 0.346 0.133 0.224 0.048
[0.103] [0.146] [0.103] [0.586] [0.328] [0.833]
Conferences/exhibitions 0.670** 0.794** 0.853** 0.383 0.471* 0.477*
[0.004] [0.000] [0.000] [0.105] [0.039] [0.044]
Industry/employer organisations 0.491* 0.211 0.430 0.197 0.102 0.059
[0.040] [0.375] [0.103] [0.444] [0.681] [0.822]
Universities/polytechnics -0.034 0.389 0.344 -0.378 0.047 -0.074
[0.924] [0.232] [0.295] [0.241] [0.883] [0.813]
CRIs and other research institutes -0.307 0.403 -0.240 -0.497 0.307 -0.557
[0.429] [0.290] [0.522] [0.175] [0.412] [0.138]
Government agencies -0.235 -0.710 0.041 -0.176 -0.743 0.109
[0.501] [0.056] [0.902] [0.619] [0.053] [0.757]
NON 94.7% NON 94.5%
OM 19.2% OM 34.7%
PP 22.7% PP 39.3%
COMBO 65.5% COMBO 70.5%
69.8% 74.8%

Note: All panels are multinomial probits with innovation group as the dependent variable (NON is the base outcome). Regressions contain ANZSIC division dummies (coefficients not shown). Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients). Bold coefficients indicate significant (5% level) difference between PP & OM innovator coefficients (larger of the two highlighted). Proportions of each innovation group accurately predicted are shown below the table.

Firm size, export performance and ODI all have significantly positive coefficients in panel (1), but these results are not robust to the introduction of firm practices. FDI is related to innovation outcomes across all specifications and is more likely to be associated with PP innovation than OM innovation. Subsidiary firms are significantly less likely to be innovative, perhaps explained by a division of responsibilities within the business group (the panel (3) effect of the business group as a source of ideas would support this hypothesis). Firm age is not significant in any of our regressions. It may be that the simple model specified is not appropriate, or that other variables, particularly firm size, are picking up any life-cycle effect.18

At the bottom of each panel we report the proportions of accurately predicted innovation outcomes. Panel (1) is poor at identifying innovators of any type.19 Our model becomes better at discerning successful innovators once we introduce innovation activities and/or sources of information. Part of the increase in the overall prediction rate from the first panel (54%) to the last panel (75%) is likely to be due to the routing in the innovation module of the survey (see the Appendix for more on this). However, the way the model allocates innovators to innovation groups has also improved, suggesting that the practice-inclusive models are adding explanatory power over and above the routing effect.

Focussing on panel (4), most sources of innovation ideas are not individually significantly related to innovation outcomes, the strongest positive effect coming from existing staff (whereas, new staff are negatively related to PP innovation outcomes). In contrast, most innovation practices are significantly related to innovation outcomes (bearing in mind our caveat around these significance tests). We highlight just a few points: innovation-specific employee training dominates general employee training (general training being pervasive and, therefore, a commonly held characteristic of NON-innovators); the newly measured innovation activities of changed marketing strategy, new strategy/management techniques, and organisational restructuring have a significantly higher relationship with OM than PP innovation;20 marketing of new products is a PP innovation property (perhaps suggesting that existing marketing methods are more commonly used to introduce new products); higher shares of in-house R&D are important to PP innovators; and the contemporaneous relationship of R&D intensity to innovation outcomes is, if anything, negative. Given the existing literature on the effect of R&D, this last point should raise concerns about causality and the importance of considering lags between practices and outcomes.21 These concerns lead us to turn to the BPS-BOS panel.


14 Firms that have not successfully completed any innovation in the prior two years will act as our reference group (denoted NON). These firms are a diverse bunch constituting those that: were attempting to innovate but hadn’t completed an innovation; had attempted, but then abandoned, innovation; or had not attempted to innovate in the reference period.

15 Innovation rates are measured over a two year time frame to align with the BOS innovation collection frequency.

16 We test the robustness of this choice by constructing two alternative dependent variables for the model in panel (1) of table 2. First, we expand our innovation groups to include ongoing innovators; and, second, we count innovations and perform an ordered probit regression. Both specifications show similar bulk features (signs & significance of independent variables) to the preferred model.

17 By firm characteristics we mean: firm size (in logs); age (in logs); export intensity (% of total sales); FDI intensity (proportion of firm ownership overseas); ODI indicator (i.e., whether the firm has interests offshore); subsidiary indicator (i.e., whether the firm is in a business group, but not the group-top); and industry (division level ANZSIC dummies). Industry dummies are not reported in most tables (to keep the tables manageable) and are not discussed in the paper. These dummies are jointly significant in all specifications.

18 Although the correlation between ln(RME) & ln(age) is only 0.249.

19 A randomised allocator would, on average, score 25% on this measure. A model that does not predicts any innovators would score 53% (i.e., the rate of non-innovators).

20 While coefficient signs consistent with intuition support the idea that the model is appropriate, an alternative (or additional) interpretation might be that the questionnaire leads respondents to the "appropriate" innovation activity answers. In particular, it could be argued that the innovation activities significantly more important for OM innovators merely define what an OM innovation is. Looking at the direct relationship between quantitative firm performance & innovation activities, or the lagged effect of these activities on outcomes, may shed some light on this issue.

21 Another potential explanation would be that the choice of R&D question was wrong (see Appendix). We test this by introducing the innovation module R&D indicators into the panel (2) specification, with the following effects: R&D intensity remains significantly negative with almost identical coefficients; the p-values on the in-house R&D share coefficient become large and the in-house R&D indicator is significantly positive for PP & COMBO innovation (suggesting multicollinearity); external R&D indicator is negative but insignificantly different from zero.



Back to Top