Ministry of Economic Development Home| Contact MED|


 
 
 

Links to this page were:

Section Subnavigation Links:

4. Panel Results


This Document is Archived


07/04: Just How Innovative are New Zealand Firms? Quantifying & Relating Organisational and Marketing Innovation to Traditional Science & Technology Indicators

Richard Fabling
[ Last Updated 28 August 2007 ]


In this section we seek to relate general business practices in 2001 to innovation outcomes in 2005. To do this we construct a measure of general management practices from the subset of questions where a concordance can be confidently mapped across the BPS-BOS surveys (table 3 lists the subject areas covered).22 Specifically we regress self-reported "high" relative productivity (a binary) on population-weighted BPS practices and use the predicted probabilities generated by this model as our measure of management practices in both 2001 & 2005 (i.e., for the 2005 management practice index we use 2001 model coefficients with 2005 variable values).23

Table 3: Management practice questions used in the index
Description BPS BOS
Clear vision or mission Q2.3 C7
Promoted set of company values Q2.4 C8
Procedures for customer complaints Q3.1 C10
Non-sales staff in contact with customers Q3.2 C11
Measure customer satisfaction Q3.3 C12
Customer involvement in product development Q3.4 C13
Systems to measure supplier quality (binary) Q4.1 C14
Supplier involvement in process improvement Q4.2 C15
Delegation authority to handle supplier problems Q4.3 C17
Formal performance reviews (binary) Q5.2 C26
Performance pay schemes (binary) Q5.3 C27
General employee training (binary) Q5.5 C28
Health and safety management processes Q5.6 C31
Staff involvement in product/process problem identification Q6.1 C33
System for information storage & retrieval Q7.1 C18
Systematic benchmarking against other firms Q7.2 C21
Use of various measures to assess performance Q7.4 C20
Monitoring competitors' products Q7.5 C22
Closeness of core equipment to "frontier" Q9.7 A45

Note: For questions with multiple response categories, each category response is entered as a separate binary variable. Where applicable the "don't know" category of each question is dropped (to avoid perfect multicollinearity), failing that the "no" category is dropped.

Before discussing the properties of this index, we revisit the issue of panel bias. In table 4 we regress a binary of whether the firm is in the panel on the 2001 (population-weighted) characteristics of firms in the BPS dataset.24 Whether the firm has survived on the business frame is, naturally, a critical determinant of the panel composition. Since the survival variable captures the attrition effect, the importance of firm size should be interpreted as being related to sampling, specifically by: reducing the probability of dropping below the BOS firm size threshold; and increasing the probability the firm will be in a stratum with a higher sampling proportion. To some extent bias is also suggested by the 2001 practices & outcomes of firms in the panel. Testing across product & process innovation outcomes, innovation practices, and our management practice index, the panel has a significantly larger proportion of firms that were marketing the introduction of new products (p=0.020) & well-managed firms (p=0.000), as measured by our practices index. This latter effect is demonstrated in chart 7, where the distribution of the 2001 management practices of the panel is shown relative to the BPS population.

Table 4: Firm characteristics favouring selection in the panel
In panel
ln(FTE) 0.297**
[0.000]
ln(age) 0.157
[0.107]
Export indicator 0.110
[0.255]
Inward direct investment (FDI) indicator 0.012
[0.930]
Mining and quarrying (ANZSIC division B) 0.559*
[0.029]
Manufacturing (ANZSIC division C) -0.153
[0.294]
Construction (ANZSIC division E) 0.825**
[0.000]
Wholesale trade (ANZSIC division F) 0.744**
[0.000]
Retail trade (ANZSIC division G) 0.890**
[0.000]
Accommodation, cafes and restaurants (ANZSIC division H) -0.145
[0.531]
Transport and storage (ANZSIC division I) 0.599**
[0.003]
Communication services (ANZSIC division J) 0.391
[0.157]
Finance and insurance (ANZSIC division K) 0.460*
[0.022]
Property and business services (ANZSIC division L) 0.808**
[0.000]
Education (ANZSIC division N) 1.014**
[0.000]
Health and community services (ANZSIC division O) 0.677**
[0.002]
Cultural and recreational services (ANZSIC division P) 0.634*
[0.010]
Survived 1.913**
[0.000]
Constant -3.461**
[0.000]
R2: 0.281

Note: Probit regression with selection in the panel as the dependent variable. Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients).

Chart 7: Management practices of panel relative to BPS population in 2001

Chart 7: Management practices of panel relative to BPS population in 2001

→ Full size version of Chart 7 [99 kB JPEG]

Bearing this potential bias in mind, we perform two common-sense tests on our management practices index. First we look at the persistence of practices over time, noting that there has been a general increase in the index from 2001 to 2005 (chart 8).25 While practice changes are quite diverse, prior practices do play an important role in explaining current practices (panel (1) of table 5). Panel (2) of table 5 confirms that firms that reported organisational/managerial innovation over 2003-2005 also experienced changes in practices as measured by the change in our index over 2001-2005. Taken together, the regressions in table 5 suggest that our conservative approach to variable concordance is satisfactory, and that our management practice index is measuring something consistent with the respondent's sense of how the firm has changed. Panel (2) could also be considered a useful "reality check" on the respondent's interpretation of the organisational/managerial innovation question.

Table 5: Tests of the plausibility of the management index
Panel (1)
Management
practices (2005)
Panel (2)
Organisational/
Managerial innovation (2005)
ln(FTE) 0.021** 0.208**
[0.000] [0.000]
ln(age) 0.005 -0.041
[0.485] [0.447]
Export indicator -0.006 0.026
[0.588] [0.766]
Inward direct investment (FDI) indicator 0.001 0.149
[0.972] [0.178]
Management practices (2001) 0.232**
[0.000]
Change in management practices 0.537**
[0.002]
R2: 0.111 R2: 0.054

Note: Panel (1) is a linear regression with management practice (2005) index as dependent variable. Panel (2) is a probit with reported organisational/managerial innovation as the dependent variable. Both regressions contain ANZSIC division dummies (coefficients not shown). Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients).

Chart 8: Change in management practices 2001-2005

Chart 8: Change in management practices 2001-2005

We conclude this section by asking, what impact do 2001 business practices have on 2005 innovation outcomes? We test this in two stages (table 6). First we test the impact of innovation practices & sources of information on innovation groups. We then introduce our measure of how well managed the firm is in 2001 to see what impact this additional explanatory variable may have. Focussing on panel (1), very few innovation activities are found to be significantly linked to positive innovation outcomes four years on. Consistent with our concerns about the potential for returns to R&D being lagged, both conducting in-house R&D & engagement with universities/polytechnics are now positively associated with innovation, whereas contemporaneously they were not. Marketing new products stands out as being positively associated with innovation outcomes both contemporaneously & across time. Other innovation activities – machinery & equipment investment, design, innovation-related employee training, show no longer term relationship with innovation but all had strong positive contemporaneous relationships (table 2), perhaps suggesting that the intent of these activities is more to enable the production of current innovations rather than as investments in the future innovative capacity of the firm.26

Table 6: Lagged effect of practices on innovation outcomes
OM PP COMBO OM PP COMBO
ln(FTE) 0.132* 0.020 0.157** 0.130* 0.022 0.149**
[0.029] [0.748] [0.005] [0.031] [0.729] [0.009]
ln(age) 0.058 0.119 0.010 0.061 0.119 0.018
[0.509] [0.193] [0.902] [0.492] [0.194] [0.821]
Export indicator -0.124 0.034 0.160 -0.120 0.032 0.183
[0.419] [0.818] [0.235] [0.435] [0.829] [0.177]
Inward direct investment (FDI) indicator -0.041 -0.052 0.092 -0.046 -0.052 0.082
[0.842] [0.793] [0.606] [0.824] [0.793] [0.643]
To innovate (1yr):
In-house R&D -0.050 0.130 0.471** -0.054 0.134 0.453**
[0.742] [0.382] [0.000] [0.723] [0.370] [0.001]
External R&D 0.167 0.020 0.069 0.165 0.029 0.059
[0.336] [0.907] [0.662] [0.344] [0.868] [0.712]
Machinery and equipment 0.013 0.169 0.110 0.010 0.172 0.097
[0.924] [0.217] [0.394] [0.945] [0.211] [0.450]
Acquired other knowledge -0.176 0.055 0.303 -0.182 0.056 0.286
[0.368] [0.765] [0.063] [0.354] [0.761] [0.079]
Industrial design 0.006 0.282 0.018 0.003 0.301 -0.012
[0.983] [0.259] [0.941] [0.993] [0.230] [0.960]
Marketing new products 0.066 0.365* 0.397** 0.063 0.371** 0.380**
[0.661] [0.010] [0.002] [0.677] [0.009] [0.004]
Trained employees 0.240 0.062 0.191 0.231 0.063 0.168
[0.086] [0.658] [0.142] [0.097] [0.655] [0.199]
Sources of innovation ideas:
Competitors 0.322 -0.064 0.080 0.313 -0.062 0.063
[0.095] [0.725] [0.641] [0.105] [0.733] [0.714]
NZ owners & associated firms 0.064 0.048 0.018 0.057 0.053 -0.002
[0.642] [0.727] [0.884] [0.679] [0.702] [0.986]
Overseas owners
& associated firms
0.151 0.131 0.094 0.148 0.129 0.085
[0.286] [0.339] [0.466] [0.297] [0.349] [0.512]
Industry/employer organisations -0.087 -0.049 -0.225 -0.092 -0.050 -0.247
[0.533] [0.731] [0.082] [0.513] [0.725] [0.056]
Research institutes
& consultants
-0.144 -0.113 -0.096 -0.146 -0.113 -0.100
[0.329] [0.439] [0.477] [0.323] [0.441] [0.458]
Universities/
polytechnics
0.086 0.365* 0.197 0.084 0.370* 0.194
[0.607] [0.030] [0.197] [0.615] [0.029] [0.206]
Books/conferences
/exhibitions
-0.002 0.129 -0.016 -0.002 0.121 -0.006
[0.990] [0.434] [0.917] [0.990] [0.465] [0.968]
Professional advisors -0.147 -0.464** -0.095 -0.145 -0.465** -0.081
[0.308] [0.002] [0.475] [0.315] [0.002] [0.539]
Trade New Zealand 0.323 -0.046 0.158 0.320 -0.044 0.141
[0.157] [0.836] [0.415] [0.161] [0.844] [0.466]
Technology New Zealand -0.171 -0.190 -0.005 -0.169 -0.194 0.009
[0.543] [0.461] [0.981] [0.548] [0.449] [0.968]
Industry New Zealand -0.262 0.109 0.148 -0.266 0.110 0.126
[0.373] [0.684] [0.562] [0.365] [0.680] [0.622]
Government departments 0.197 0.227 -0.090 0.197 0.222 -0.089
[0.306] [0.222] [0.614] [0.306] [0.230] [0.622]
Management practices (2001) 0.239 -0.141 0.896*
[0.548] [0.725] [0.016]
NON 93.5% NON 91.8%
OM 0.6% OM 0.6%
PP 3.8% PP 4.2%
COMBO 35.5% COMBO 35.8%
54.5% 53.8%

Note: Both panels are multinomial probits with innovation group as the dependent variable (NON is the base outcome). Regressions contain ANZSIC division dummies (coefficients not shown). Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients). There are no significant (5% level) differences between PP & OM innovator coefficients in either panel. Proportions of each innovation group accurately predicted are shown below the table.

Finally, in panel (2), we introduce 2001 management practices. Our punch-line is twofold: the initial endowment of management practices is good for (COMBO) innovation outcomes in 2005; and the introduction of the management variable does not have substantial impact on the coefficients or significance of the importance of in-house R&D & marketing of new products. In other words, we find that good management practices appear to provide an additional effect on future innovation outcomes.


22 We deliberately exclude innovation practices from this list so that we can test their additional impact on innovation outcomes.

23 This model of "good" management practices ignores the fact that "good" may have an industry-specific interpretation.

24 Some control variables in 2001 are unavailable (ODI & subsidiary) and others (FDI & export) are now binaries (denoting non-zero values) instead of intensities. While some detail has been lost, there is a very strong relationship between 2001 & 2005 control variables, reflecting our expectation that these characteristics should display some persistence. Industry division is measured consistently and quite stable (4% of firms in the panel change division). Employment is strongly correlated despite the change in measurement from FTEs to RMEs.

25 The red line in chart 8 shows how the density of management practices has changed. There has been a net decline in the number of firms with scores between 0.2 & 0.5, with most of the net increase occurring at index values above 0.5.

26 Comparison over time of remaining sources of information questions are thwarted by changes in the classification scheme across surveys.



Back to Top