The evaluation framework for the STELLAR Network of Excellence is based on the Logic Framework Approach (LFA) to programme evaluation. The LFA provides a very structured way to assess the effectiveness of certain intervention strategies and activities to achieve an intended change. Although coming mainly from developmental programme design and evaluation the LFA has been widely adopted and used for evaluating scientific programmes and technology deployment programmes, e.g. in the USA.
In the context of STELLARnet the LFA has been adapted to the specifics of our context. Via various means of getting input and collecting feedback the project objectives of STELLARnet have been slightly reformulated to express the indented change that STELLAR wants to achieve via its joint programme of activities. Apart from supporting the actors in STELLAR to perform according to the description of work as defined in the contract the evaluation framework also aligns the project performance to the overall project objectives and identifies indicators for their achievement.
In the future we will use the evaluation framework as a diagnostic instrument to continuously assess the status and the direction of the various activities within STELLARnet and their contribution to the overall project objectives.
For monitoring the development of the STELLAR network, the involved actors, topics and disciplines, two additional methods are applied, namely Social Network Analysis and Ego-centric Network Analysis. First results give a rather heterogeneous picture of the network regarding TEL-related disciplines and topics as well as a strong involvement of all partners in the activities of the network. The reporting and data collection process for the monitoring activities still needs to be improved and coupled more closely with the management reporting process in the future.
Click here to get to the deliverable.