From the ICT for Development web site
This 50-page paper sets forth a series of core communication indicators for assessing the impact of activities and projects using information and communication technologies (ICTs) for development. It is published by the Research and Extension Division, Natural Resources and Environment Department, of the Food and Agriculture Organization (FAO) of the United Nations.
Drawing from the practice and thinking already in circulation, author Warren Feek considers the end goal of ICT-based interventions, such as the possibility for increased participation of people in decision-making and policies which affects their lives brought about by ICT use - rather than the technology used. This is because there is nothing inherent in the new technologies that prompts positive development; they are just tools. It is insufficient to measure, for example, household or village access to the internet as a predictor of positive future social and economic progress. For, as Feek presses, what if the headman in the village or the senior male in the family monopolises use and information flow?
In this context, Feek lays the groundwork for his series of indicators, exploring two schools of thought: the communication for development thinking undertaken by the Communication for Social Change (CFSC) Consoritum, and the Participatory Rural Communication Appraisal (PRCA) approach developed by the Food and Agriculture Organization (FAO) of the United Nations. He provides 3 main reasons for choosing these models:
Feek then explores the fundamentals of each school of thought. In brief, the PRCA approach to research has the following characteristics:
The CFSC approach entails:
Feek's indicators emanate from these overall social change development strategies, which he states have proven impact. He stresses that they are informed (and reinforced) by the perspectives emerging from the ICT evaluation literature· They also provide short-term measurements that predict long-term change, are simple and practical, and are applicable across the full range of development contexts.
The 18 indicators can be collated as follows, grouped into their categories:
Holistic dialogue
1. The ICTs are increasingly used for dialogue and debate.
2. Policy and programme knowledge is increasingly communicated through the ICTs.
3. There are increased levels of access to the ICT processes.
Community and individual voice
4. The opinions and ideas expressed through ICT channels are increasingly those of the people most affected by development issues in any given context.
5. The people most affected by development issues in any given context increasingly dominate the physical use of the ICTs.
6. Technical experts on ICT for development increasingly respond to and implement the technical requirements voiced by those most affected.
Participatory decision-making
7. A minimum of 40% of the people involved in the management are directly affected by the development issues that the ICTs being mobilised are designed to address.
8. There are x (the number inserted here depends on the scale and nature of the programme being evaluated) examples in the last 12 months of the use of the ICTs for engaging people directly affected by development issues in overall programme management and/or policy development.
Building communication platforms
9. The ICTs are increasingly used to draw relationships between different development issues.
10. The ICTs are increasingly used as a communication platform to identify and negotiate the specific strategic and technical support that development organisations require.
11. The ICTs are increasingly used as the source for the core information needed to better inform individual development activities.
12. The ICTs are increasingly used as the gathering point for like-focused organisations and groups.
Change symbols
13. The ICTs are increasingly used to highlight emerging symbols and images related to action on the development issue(s) in question.
14. The ICTs are increasingly used to multiply strong symbols and/or images that are emerging from the struggle.
15. The ICTs are increasingly used to both convey meaning and deepen debate and dialogue through the symbols and images presented.
Working alliances
16. The ICTs are increasingly used to build working strategic and/or operational partnerships with other organisations that have similar vested interests.
17. The ICTs are increasingly used to participate in networks of like-focused organisations.
18. The ICTs are increasingly used to both provide support to others involved in compatible action and to receive support from such organisations.
Feek explains - and illustrates, through a diagram on page 26 - that little will be gained from a massive increase in one element of the process - for example, just focusing on getting as many people directly affected as possible involved in the management of the programme or initiative. Attention to that element of the process needs to be matched by corresponding improvements in action in the other 5 areas. That is, there must be a balanced and harmonious relationship between all the elements above.
Feek next uses the first four categories of indicators to highlight the possible ways in which evaluation methodologies can be used to collect the relevant information. He examines how such methods as content analysis, structured and unstructured interviews, surveys and questionnaires, and participant and non-participant observation would look in each case.
He concludes with two core observations. First, "[t]here is a chicken-and-egg quality to the perspective presented above. Which should come first when developing indicators to measure the impact of ICTs on development issues: the evidence from research or the assertions from experience and thinking? He explains that, though there is no compelling data at this time, the assertions are nonetheless important because they provide one framework through which the research can be funnelled. Also, Feek recognises that "[w]hen people and organizations know the criteria by which they will be assessed, they tend to work to strengthen those factors....If the dominant thinking assesses ICT developments according to these evaluation indicators, this will drive programming towards those elements."
5148 Polson Terrace