4. Panel Results
In this section we seek to relate general business practices in 2001 to innovation outcomes in 2005. To do this we construct a measure of general management practices from the subset of questions where a concordance can be confidently mapped across the BPS-BOS surveys (table 3 lists the subject areas covered).22 Specifically we regress self-reported "high" relative productivity (a binary) on population-weighted BPS practices and use the predicted probabilities generated by this model as our measure of management practices in both 2001 & 2005 (i.e., for the 2005 management practice index we use 2001 model coefficients with 2005 variable values).23
Table 3: Management practice questions used in the index
| Description |
BPS |
BOS |
| Clear vision or mission |
Q2.3 |
C7 |
| Promoted set of company values |
Q2.4 |
C8 |
| Procedures for customer complaints |
Q3.1 |
C10 |
| Non-sales staff in contact with customers |
Q3.2 |
C11 |
| Measure customer satisfaction |
Q3.3 |
C12 |
| Customer involvement in product development |
Q3.4 |
C13 |
| Systems to measure supplier quality (binary) |
Q4.1 |
C14 |
| Supplier involvement in process improvement |
Q4.2 |
C15 |
| Delegation authority to handle supplier problems |
Q4.3 |
C17 |
| Formal performance reviews (binary) |
Q5.2 |
C26 |
| Performance pay schemes (binary) |
Q5.3 |
C27 |
| General employee training (binary) |
Q5.5 |
C28 |
| Health and safety management processes |
Q5.6 |
C31 |
| Staff involvement in product/process problem identification |
Q6.1 |
C33 |
| System for information storage & retrieval |
Q7.1 |
C18 |
| Systematic benchmarking against other firms |
Q7.2 |
C21 |
| Use of various measures to assess performance |
Q7.4 |
C20 |
| Monitoring competitors' products |
Q7.5 |
C22 |
| Closeness of core equipment to "frontier" |
Q9.7 |
A45 |
Note: For questions with multiple response categories, each category response is entered as a separate binary variable. Where applicable the "don't know" category of each question is dropped (to avoid perfect multicollinearity), failing that the "no" category is dropped.
Before discussing the properties of this index, we revisit the issue of panel bias. In table 4 we regress a binary of whether the firm is in the panel on the 2001 (population-weighted) characteristics of firms in the BPS dataset.24 Whether the firm has survived on the business frame is, naturally, a critical determinant of the panel composition. Since the survival variable captures the attrition effect, the importance of firm size should be interpreted as being related to sampling, specifically by: reducing the probability of dropping below the BOS firm size threshold; and increasing the probability the firm will be in a stratum with a higher sampling proportion. To some extent bias is also suggested by the 2001 practices & outcomes of firms in the panel. Testing across product & process innovation outcomes, innovation practices, and our management practice index, the panel has a significantly larger proportion of firms that were marketing the introduction of new products (p=0.020) & well-managed firms (p=0.000), as measured by our practices index. This latter effect is demonstrated in chart 7, where the distribution of the 2001 management practices of the panel is shown relative to the BPS population.
Table 4: Firm characteristics favouring selection in the panel
|
In panel |
| ln(FTE) |
0.297** |
| [0.000] |
| ln(age) |
0.157 |
| [0.107] |
| Export indicator |
0.110 |
| [0.255] |
| Inward direct investment (FDI) indicator |
0.012 |
| [0.930] |
| Mining and quarrying (ANZSIC division B) |
0.559* |
| [0.029] |
| Manufacturing (ANZSIC division C) |
-0.153 |
| [0.294] |
| Construction (ANZSIC division E) |
0.825** |
| [0.000] |
| Wholesale trade (ANZSIC division F) |
0.744** |
| [0.000] |
| Retail trade (ANZSIC division G) |
0.890** |
| [0.000] |
| Accommodation, cafes and restaurants (ANZSIC division H) |
-0.145 |
| [0.531] |
| Transport and storage (ANZSIC division I) |
0.599** |
| [0.003] |
| Communication services (ANZSIC division J) |
0.391 |
| [0.157] |
| Finance and insurance (ANZSIC division K) |
0.460* |
| [0.022] |
| Property and business services (ANZSIC division L) |
0.808** |
| [0.000] |
| Education (ANZSIC division N) |
1.014** |
| [0.000] |
| Health and community services (ANZSIC division O) |
0.677** |
| [0.002] |
| Cultural and recreational services (ANZSIC division P) |
0.634* |
| [0.010] |
| Survived |
1.913** |
| [0.000] |
| Constant |
-3.461** |
| [0.000] |
|
R2: |
0.281 |
Note: Probit regression with selection in the panel as the dependent variable. Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients).
Chart 7: Management practices of panel relative to BPS population in 2001

→ Full size version of Chart 7 [99 kB JPEG]
Bearing this potential bias in mind, we perform two common-sense tests on our management practices index. First we look at the persistence of practices over time, noting that there has been a general increase in the index from 2001 to 2005 (chart 8).25 While practice changes are quite diverse, prior practices do play an important role in explaining current practices (panel (1) of table 5). Panel (2) of table 5 confirms that firms that reported organisational/managerial innovation over 2003-2005 also experienced changes in practices as measured by the change in our index over 2001-2005. Taken together, the regressions in table 5 suggest that our conservative approach to variable concordance is satisfactory, and that our management practice index is measuring something consistent with the respondent's sense of how the firm has changed. Panel (2) could also be considered a useful "reality check" on the respondent's interpretation of the organisational/managerial innovation question.
Table 5: Tests of the plausibility of the management index
|
Panel (1) Management practices (2005) |
Panel (2) Organisational/ Managerial innovation (2005) |
| ln(FTE) |
0.021** |
0.208** |
| [0.000] |
[0.000] |
| ln(age) |
0.005 |
-0.041 |
| [0.485] |
[0.447] |
| Export indicator |
-0.006 |
0.026 |
| [0.588] |
[0.766] |
| Inward direct investment (FDI) indicator |
0.001 |
0.149 |
| [0.972] |
[0.178] |
| Management practices (2001) |
0.232** |
|
| [0.000] |
|
| Change in management practices |
|
0.537** |
|
[0.002] |
|
R2: 0.111 |
R2: 0.054 |
Note: Panel (1) is a linear regression with management practice (2005) index as dependent variable. Panel (2) is a probit with reported organisational/managerial innovation as the dependent variable. Both regressions contain ANZSIC division dummies (coefficients not shown). Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients).
Chart 8: Change in management practices 2001-2005

We conclude this section by asking, what impact do 2001 business practices have on 2005 innovation outcomes? We test this in two stages (table 6). First we test the impact of innovation practices & sources of information on innovation groups. We then introduce our measure of how well managed the firm is in 2001 to see what impact this additional explanatory variable may have. Focussing on panel (1), very few innovation activities are found to be significantly linked to positive innovation outcomes four years on. Consistent with our concerns about the potential for returns to R&D being lagged, both conducting in-house R&D & engagement with universities/polytechnics are now positively associated with innovation, whereas contemporaneously they were not. Marketing new products stands out as being positively associated with innovation outcomes both contemporaneously & across time. Other innovation activities – machinery & equipment investment, design, innovation-related employee training, show no longer term relationship with innovation but all had strong positive contemporaneous relationships (table 2), perhaps suggesting that the intent of these activities is more to enable the production of current innovations rather than as investments in the future innovative capacity of the firm.26
Table 6: Lagged effect of practices on innovation outcomes
|
OM |
PP |
COMBO |
OM |
PP |
COMBO |
| ln(FTE) |
0.132* |
0.020 |
0.157** |
0.130* |
0.022 |
0.149** |
| [0.029] |
[0.748] |
[0.005] |
[0.031] |
[0.729] |
[0.009] |
| ln(age) |
0.058 |
0.119 |
0.010 |
0.061 |
0.119 |
0.018 |
| [0.509] |
[0.193] |
[0.902] |
[0.492] |
[0.194] |
[0.821] |
| Export indicator |
-0.124 |
0.034 |
0.160 |
-0.120 |
0.032 |
0.183 |
| [0.419] |
[0.818] |
[0.235] |
[0.435] |
[0.829] |
[0.177] |
| Inward direct investment (FDI) indicator |
-0.041 |
-0.052 |
0.092 |
-0.046 |
-0.052 |
0.082 |
| [0.842] |
[0.793] |
[0.606] |
[0.824] |
[0.793] |
[0.643] |
| To innovate (1yr): |
| In-house R&D |
-0.050 |
0.130 |
0.471** |
-0.054 |
0.134 |
0.453** |
| [0.742] |
[0.382] |
[0.000] |
[0.723] |
[0.370] |
[0.001] |
| External R&D |
0.167 |
0.020 |
0.069 |
0.165 |
0.029 |
0.059 |
| [0.336] |
[0.907] |
[0.662] |
[0.344] |
[0.868] |
[0.712] |
| Machinery and equipment |
0.013 |
0.169 |
0.110 |
0.010 |
0.172 |
0.097 |
| [0.924] |
[0.217] |
[0.394] |
[0.945] |
[0.211] |
[0.450] |
| Acquired other knowledge |
-0.176 |
0.055 |
0.303 |
-0.182 |
0.056 |
0.286 |
| [0.368] |
[0.765] |
[0.063] |
[0.354] |
[0.761] |
[0.079] |
| Industrial design |
0.006 |
0.282 |
0.018 |
0.003 |
0.301 |
-0.012 |
| [0.983] |
[0.259] |
[0.941] |
[0.993] |
[0.230] |
[0.960] |
| Marketing new products |
0.066 |
0.365* |
0.397** |
0.063 |
0.371** |
0.380** |
| [0.661] |
[0.010] |
[0.002] |
[0.677] |
[0.009] |
[0.004] |
| Trained employees |
0.240 |
0.062 |
0.191 |
0.231 |
0.063 |
0.168 |
| [0.086] |
[0.658] |
[0.142] |
[0.097] |
[0.655] |
[0.199] |
| Sources of innovation ideas: |
| Competitors |
0.322 |
-0.064 |
0.080 |
0.313 |
-0.062 |
0.063 |
| [0.095] |
[0.725] |
[0.641] |
[0.105] |
[0.733] |
[0.714] |
| NZ owners & associated firms |
0.064 |
0.048 |
0.018 |
0.057 |
0.053 |
-0.002 |
| [0.642] |
[0.727] |
[0.884] |
[0.679] |
[0.702] |
[0.986] |
Overseas owners & associated firms |
0.151 |
0.131 |
0.094 |
0.148 |
0.129 |
0.085 |
| [0.286] |
[0.339] |
[0.466] |
[0.297] |
[0.349] |
[0.512] |
| Industry/employer organisations |
-0.087 |
-0.049 |
-0.225 |
-0.092 |
-0.050 |
-0.247 |
| [0.533] |
[0.731] |
[0.082] |
[0.513] |
[0.725] |
[0.056] |
Research institutes & consultants |
-0.144 |
-0.113 |
-0.096 |
-0.146 |
-0.113 |
-0.100 |
| [0.329] |
[0.439] |
[0.477] |
[0.323] |
[0.441] |
[0.458] |
Universities/ polytechnics |
0.086 |
0.365* |
0.197 |
0.084 |
0.370* |
0.194 |
| [0.607] |
[0.030] |
[0.197] |
[0.615] |
[0.029] |
[0.206] |
Books/conferences /exhibitions |
-0.002 |
0.129 |
-0.016 |
-0.002 |
0.121 |
-0.006 |
| [0.990] |
[0.434] |
[0.917] |
[0.990] |
[0.465] |
[0.968] |
| Professional advisors |
-0.147 |
-0.464** |
-0.095 |
-0.145 |
-0.465** |
-0.081 |
| [0.308] |
[0.002] |
[0.475] |
[0.315] |
[0.002] |
[0.539] |
| Trade New Zealand |
0.323 |
-0.046 |
0.158 |
0.320 |
-0.044 |
0.141 |
| [0.157] |
[0.836] |
[0.415] |
[0.161] |
[0.844] |
[0.466] |
| Technology New Zealand |
-0.171 |
-0.190 |
-0.005 |
-0.169 |
-0.194 |
0.009 |
| [0.543] |
[0.461] |
[0.981] |
[0.548] |
[0.449] |
[0.968] |
| Industry New Zealand |
-0.262 |
0.109 |
0.148 |
-0.266 |
0.110 |
0.126 |
| [0.373] |
[0.684] |
[0.562] |
[0.365] |
[0.680] |
[0.622] |
| Government departments |
0.197 |
0.227 |
-0.090 |
0.197 |
0.222 |
-0.089 |
| [0.306] |
[0.222] |
[0.614] |
[0.306] |
[0.230] |
[0.622] |
| Management practices (2001) |
|
|
|
0.239 |
-0.141 |
0.896* |
|
|
|
[0.548] |
[0.725] |
[0.016] |
|
|
NON |
93.5% |
|
NON |
91.8% |
|
|
OM |
0.6% |
|
OM |
0.6% |
|
|
PP |
3.8% |
|
PP |
4.2% |
|
|
COMBO |
35.5% |
|
COMBO |
35.8% |
|
|
|
54.5% |
|
|
53.8% |
Note: Both panels are multinomial probits with innovation group as the dependent variable (NON is the base outcome). Regressions contain ANZSIC division dummies (coefficients not shown). Stars denote significance at 5% (*) & 1% (**) level (two-sided test – robust p-values in square brackets below coefficients). There are no significant (5% level) differences between PP & OM innovator coefficients in either panel. Proportions of each innovation group accurately predicted are shown below the table.
Finally, in panel (2), we introduce 2001 management practices. Our punch-line is twofold: the initial endowment of management practices is good for (COMBO) innovation outcomes in 2005; and the introduction of the management variable does not have substantial impact on the coefficients or significance of the importance of in-house R&D & marketing of new products. In other words, we find that good management practices appear to provide an additional effect on future innovation outcomes.
Back to Top