Ministry of Economic Development Home| Contact MED|


 
 
 

Links to this page were:

Section Subnavigation Links:

7.Recommendations


Evaluation of the Maori Tourism Facilitation Service

[ Last Updated 3 June 2008 ]


7.1 Evaluation

  1. If the MTFS programme is continued, it is recommended that a full impact evaluation of this programme be conducted by July 2008 to examine the following questions:
    • To what extent is the MTFS achieving the intended policy outcomes?
    • Would the outcomes have been achieved without the programme? How much value is the MTFS adding?
    • Is the MTFS well coordinated with related government and private business assistance services?
    • Is the MTFS filling an important need?
    • Is the delivery of the MTFS efficient compared over time and to similar programmes?
    • What are the opportunities for improvement?
    • Can the MTFS model or lessons from it be applied to other parts of the tourism sector or other business assistance programmes?

7.2 Policy improvements

7.2.1 Target group

  1. To continue to avoid duplication with other existing programmes and services, there needs to be increased clarity in communicating the policy intention that the MTFS programme is not designed for start-up businesses but only for Maori tourism businesses that are developing or established and focused on business growth, rather than more basic business capability issues.

7.2.2 Intended programme outcomes

  1. The specific outputs and outcomes intended from the MTFS were identified from within relevant policy documents, and where required, were clarified through consultation with the Ministry of Tourism and TPK. These are set out in Section 1.5 - Programme Logic Model. Based on the lessons learned from this evaluation, some refinements are proposed to this logic model to increase clarity in terms of intended key outputs, immediate, intermediate and ultimate outcomes. The revised logic model is presented at the end of this report.

7.2.3 Eligibility criteria

  1. Tighten the criteria regarding length of time in business from a six month minimum to a minimum requirement of 12 months in business.
  2. Clarify that to be eligible for the MTFS programme, all participants must meet the necessary criteria of being willing to participate fully in the programme by investing time and/or money into assessment and/or mentoring.
  3. Clarify that for a business that does not already incorporate Maori aspects (e.g. tikanga, te reo, cultural performances etc.) as part of its products and services, but is considered to have the potential to incorporate Maori aspects, this potential needs to be demonstrated as part of their Business Development Plan.
  4. Clarify the growth potential criteria with an objective definition would enable better application of this criteria. It is proposed that "growth potential" be defined as having a willingness and plan to develop the business to achieve annual growth exceeding a target rate. This target should be defined by TPK with assistance from the Ministry of Tourism and Ministry of Economic Development.
  5. Consider setting a limit (e.g. no greater than 10%) on the number of businesses granted exemptions from the discretionary eligibility criteria.

Table 4. Revised MTFS Programme intervention logic model

PROBLEMS OUTPUTS IMMEDIATE OUTCOMES INTERMEDIATE OUTCOMES ULTIMATE OUTCOMES
  • collectively, Maori tourism businesses are not performing as well as they could
  • need to build capability
  • Lack of engagement with existing government services
  • Non-engagement with provider of generic business assistance applicable to the sector
  • lack ability to access and use research and information
  • need assistance in marketing and promotion
  • number and quality of initial and full assessments completed
  • number of business development plans (BDP) created
  • BDP identifies key areas for business improvement
  • number and quality of mentors assigned
  • number and quality of referrals to other business assistance programmes
  • quality and accuracy of reporting by service providers
  • participants are satisfied with the overall programme
  • participants are satisfied that the BDP meets the needs of their business
  • participants are satisfied with the mentoring received
  • completion rate of actions set out in BDP
  • number of other business assistance programmes that are engaged, as recommended through BDPs or mentors
  • improved market knowledge and market development capability
  • improved strategic planning
  • improved business management and practices
  • improved product development capability
  • increased number of applicable businesses who have Qualmark license.
  • increased integration of business with the industry
  • business growth in revenue, profits, productivity,
  • improved quality of product and service received by customers
  • improved business sustainability
  • improved contribution of Maori tourism sector to the industry and economy

7.3 Operational improvements

7.3.1 Initial assessment

  1. Revise the Business Snapshot tool currently used for initial assessment of participants to ensure it identifies all of the critical issues for the business, i.e. the financial status (e.g. profitability, debt levels), ownership, governance, and growth potential of the business.
  2. Request participants to present the financial statements of their business for the past year or two (for older businesses) to enable accurate assessment of financial status.

7.3.2 Transition between Account Managers, Assessors, and Mentors

  1. Improve the transition to Mentors from Account Managers and Assessors and minimise the potential duplication between these roles through better briefing among the parties at key transition points.
  2. Once the mentoring phase has been completed by the current participants, TPK should review the roles of the Account Managers, Assessors, and Mentors to identify if there are opportunities to improve efficiency and effectiveness.

7.3.3 Referrals to other services or training

  1. To ensure that Account Managers and Assessors are able to make appropriate and timely referrals when necessary, it is important that there is a systematic process to keep them up to date with the list of mentors and programmes or services of other providers available to work with MTFS clients.

7.3.4 Mentoring

  1. Within the budget constraints of the programme, ensure that the timing, intensity, and nature of mentoring provided to participants is tailored to the client need.

7.3.5 Information sharing with key stakeholders

  1. In order to maximise the potential value of information collected by the MTFS programme in informing the development of policies and programmes for the Maori tourism sector, it is recommended that TPK explore opportunities to improve information exchange with key stakeholder organisations such as the New Zealand Maori Tourism Council.

7.3.6 Monitoring and evaluation of programme outcomes

  1. Continue to measure, record and monitor the programme outcomes in terms of business capability and performance of participants at the start of engagement, at regular intervals during engagement, and up to two years after completion of the programme.

Back to Top