Disclaimer Monitoring and Evaluation: Relevant Projects A comprehensive listing of IBTCI's M&E experience is noted below. Iraq Monitoring and Evaluation Performance Program, Phase II (MEPP II) (USAID): IBTCI is providing long- and short-term technical and advisory services on performance monitoring and evaluation of USAID/Iraq programs as well as data quality analysis. The purpose of MEPP II is to provide regular performance monitoring and reporting, periodic reviews of specific projects, and an annual evaluation of the impact of the overall USAID/Iraq assistance program. USAID's portfolio includes activities in infrastructure, health, education, economic growth, banking/finance, private sector development, agriculture, democracy and governance, program policy, power and natural resources, environment and gender mainstreaming. To accomplish this, IBTCI has developed a unique nationwide monitoring capability utilizing local field monitors. The monitoring activities incorporate surveys were based on sophisticated sampling techniques; computer based statistical data analysis using the most advanced available social science techniques, and rigorous supervision and quality control. IBTCI has developed the scopes of work and successfully completed evaluations for several major programs as well as for a data quality assessment for the USAID/Iraq program. Details of the Team's activities include: Iraq Community Action Program (ICAP I and II). IBTCI completed the evaluation of the USAID/Iraq community action program being implemented by five cooperative agreement holders. IBTCI surveyed the community action groups established under the program, and performed field interviews in rural and urban communities with grantee staff and beneficiaries. The ICAP holders dispersed both cash and in-kind grants to CAGs in all of Iraq's 18 governorates. IBTCI was asked by the USAID CAP II CTO to validate methods and practices CAP II employed. The purpose of the ICAP II evaluation was to provide program decision makers with a means to verify and validate the information provided by the partners, answer specific programmatic questions, and provide guidance for CAP Phase III. Iraq Civil Society Program (ICSP). IBTCI carried out evaluation to provide guidance and recommendations for course corrections for the program, determined whether objectives were being achieved, and provided lessons learned. The evaluation was summative. It was carried out by a three person M&E project team and carried a heavy Democracy and Governance element. Capacity Building in the Provinces. IBTCI provided a three person evaluation team to conduct an assessment of ministries at the provincial level and provided recommendations for a design report to pave the way for a new procurement to address identified gaps. Local Governance. IBTCI evaluated the strengths and weaknesses of the budget execution support initiative, anti-corruption work, and support to improve financial management in the provinces, provincial development strategy, and initiatives to improve essential services. Public Sector Capacity Building. IBTCI evaluated the public sector capacity building projects at the center (Ministries of Electricity, Finance, Planning and Development and Labor and Social Affairs) and the local government level. Iraq Elections. IBTCI performed an evaluation of USAID capacity-building assistance to the critical nationwide Iraq elections of 2004 and 2005. IBTCI met a tight December 2005 deadline for the report, having recruited highly regarded experts as the core team for the evaluation. FMIS Review. IBTCI was contracted to provide an assessment of the current situation of the development of the Iraqi Financial Management Information System, the likelihood of achieving the stated objectives within the memorandum of understanding between the US and Iraqi governments, gauge the Ministry of Finance's ability to assume full responsibility for operating the FMIS and finally, to provide recommendations on moving forward with the system. Data Quality Assessment (DQA). IBTCI conducted a program-wide DQA using the USAID five standard quality criteria. These were applied across eight program strategic objectives and 38 indicators selected by the Mission. The IBTCI team used a combined retrospective and prospective approach using multiple techniques to gather and verify information including site visits, phone interviews, e-mail correspondence, document review and data review. Data Quality Assessment (DQA). For the Office of Foreign Disaster Assistance (OFDA). IBTCI conducted a desk review of data from the 5 partners funded by OFDA in Iraq using 15 indicators, including: complete description, plan for data acquisition, plan for data analysis, review and reporting, and baseline/target values. On-going Monitoring. IBTCI and its local field monitors regularly conduct monitoring of USAID-funded activities to determine whether progress is being made against established benchmarks. This monitoring has been critical to USAID's overall oversight of activities. Yemen: Yemen Monitoring and Evaluation Project (USAID): IBTCI is developing a comprehensive M&E system to provide continued, on-the-ground performance monitoring, verification and evaluation of the impact, output and outcome results and environmental compliance of a set of USAID projects and activities. The M&E Project will provide consistent performance monitoring and reporting, as well as reviews of specific activities, projects and the portfolio as a whole on at least an annual basis. Annual evaluations of project achievements against the overall stabilization goal and periodic assessments of particular geographic or sectoral impacts will also be provided, as agreed with USAID in the annual Work plan. The general goal of the M&E Project is to support USAID/Yemen in meeting day to day information needs in order to make informed program management decisions, as well as to provide substantive support to with qualitative, quantitative and analytical information to assist in assessing and evaluating the strategy's development hypothesis. Yemen: Performance Work Statement (PWS) for Monitoring, Evaluation, and Assessment Program for Media Information Support Team (MIST) (USG): The project is to monitor and evaluate the on-going projects to determine their effectiveness in the development of religious, tribal, and community leaders; women and family; and rural and youth populations. Georgia: Monitoring USG Assistance Program Results in Georgia (U.S. Dept of State): The primary purpose of this project is to monitor United States Government (USG) foreign assistance provided to Georgia to ensure the funds are directed toward the foreign policy and foreign assistance objectives for which they are intended. Monitoring data collected will be analyzed and reported to all USG implementers of Georgia assistance programs as well as Congress, Office of Management and Budget (OMB), and others. It will be used to make judgments as to the effectiveness of programs to meet USG assistance objectives and to determine what, if any changes need to be made to assistance priorities and activities going forward. Cambodia: Evaluation of the Counter-Trafficking in Persons Program (CTIP) implemented by the Asia Foundation in Cambodia (USAID): The project is to evaluate the CTIP program to determine if it is successful in improving coordination and collection of data between anti-trafficking actors; enhancing victim care through development and implementation of national standards; and improving access to justice for victims of trafficking, both directly and indirectly. Latin America/Caribbean: Evaluation of Latin America and the Caribbean Bureau Office of Regional Sustainable Development's (LAC/RSD) Regional Education Program (USAID): The IBTCI team is conducting an evaluation of the USAID Latin America and the Caribbean Bureau Office of Regional Sustainable Development's (LAC/RSD) Regional Education Programming. A strong, experienced team has been assembled fully capable of conducting a robust assessment of the impacts and comparative advantages of LAC/RSD's regional education programming and producing substantive, actionable recommendations to inform the design of new USAID/LAC regional education interventions. Bolivia: Mission Assessment for Program Planning (USAID): IBTCI is assessing USAID's program in Bolivia, and analyze whether the sectors in which the Mission currently works are most appropriate, given Bolivia's development needs, the Government of Bolivia's (GOB) priorities and National Development Plan, the U.S.-Bolivia bilateral relationship, the work of other donors in Bolivia, USAID's Mission Strategic Plan, current/anticipated resource levels, and USAID Mission staffing. IBTCI will determine how USAID can better integrate its existing programs and align them with the GOB's development priorities and with the work of other donors. Advise on possible Government-to-Government programs, including how other donors are implementing Government-to-Government programs and identify possible programmatic openings; and provide recommendations on sectors in which USAID should focus when it prepares its next Mission strategy. Senegal: Governance Assessment Studies (WB): IBTCI and a partner firm are commencing work on governance assessment studies for the World Bank in Senegal. The team will use the methodology and survey instruments designed by the WB technical team to collection and analysis data relevant to the governance of the transportation and public works sectors in Senegal. More precisely, the study will concentrate on the construction, maintenance and utilization of roads; freight and passenger transportation; and maritime transportation. Construction will be addressed only in regards to road transportation. Worldwide: Evaluation of the 2005 Global Development Marketplace Projects: Innovations for Livelihoods in Sustainable Environments (World Bank): The Development Marketplace (DM) is a competitive grants program of the World Bank that identifies and funds innovative, early-stage ideas that exhibit high potential for development impact. The 2005 Global Development Marketplace competition (DM2005) issued its call for proposals based on the theme, Innovations for Livelihoods in a Sustainable Environment, focusing on six sub-areas: (i) renewable energy and energy efficiency, (ii) application of clean technologies in small enterprises, (iii) biodiversity conservation, (iv) environmental education and awareness, (v) protecting environmental health, and (vi) sustainable use of natural resources. The DM tasked IBTCI, as an independent third party to undertake an external evaluation of the 31 projects implemented within the DM2005 cohort. The purpose of the evaluation is threefold: (i) to assess the performance and outcomes of the DM2005 portfolio through an individual assessment of the 31 projects on three main evaluation criteria's performance of the project, outcomes, and performance of the project team; (ii) identify core drivers of project success or failure including those that are particular to this sector; and (iii) assess the potential limitations or barriers for projects to scale up and/or replicate. The evaluation, conducted with quantitative and qualitative methods, will be structured in three parts to assess: (i) the DM2005 portfolio performance on the three main criteria: project performance, outcomes and performance of project team, and (ii) an analysis of the key drivers and/or constraints for project success or failure that are associated with the sector, and (iii) an assessment of the opportunities, barriers or limitations for project scale up or replication. Key questions for assessing the first component on the evaluation related to the main evaluation criteria stated above are project performance, outcomes, and performance of the project team. Iraq: Evaluation of the Community Stabilization Program (USAID): IBTCI has been contracted by USAID/Iraq's to qualitatively evaluate the impact and effectiveness of the USAID/Iraq Community Stabilization Program (CSP) as a non-lethal tool for counterinsurgency (COIN). The objective of this evaluation is to look at the impact of the USAID/Iraq Community Stabilization Program on the stabilization of Iraq. The effectiveness and complementarily of the CSP model as a non-lethal tool for counter-insurgency and for contributing toward stability in conflict situations will be evaluated. The team will derive lessons learned on project design and implementation to guide future USAID or U.S. Government COIN programming in conflict affected environments. The result of this evaluation will contribute to the USG's understanding of the non-lethal side of COIN and to the greater debate on creating stability. Nigeria: Call Down Framework for the Bureau of Private Enterprises (BPE) (DFID): IBTCI was contracted by the UK Government's Department for International Development (DFID) to carry out a three and a half-year Call Down Facility (CDF) Framework Contract for the benefit of the Bureau of Public Enterprises (BPE) in Nigeria. IBTCI provided the BPE with rapid-response access to sources of expertise (international and Nigerian) to provide technical assistance in non-transaction privatization issues. During this contract,, IBTCI carried out 51 tasks in 15 areas of assistance. Selected task descriptions related to monitoring and evaluation work include the following: Capacity Building on Knowledge Management and Documentation Support for Privatization Impact Assessment. This consultancy sought to provide institutional capacity building in knowledge management and documentation support that would have been required for an upcoming privatization Impact Assessment and for an effective post-privatization monitoring in the Nigerian Privatization Agency (BPE.) The task was expected to provide Agency's staff with the appropriate level of skills integrate to design and manage a knowledge management system and its procedures as well as documentation techniques and support (including methodology, survey plans and instruments, sampling plans, databases, and stakeholder awareness)to gather, analyze, evaluate and interpret the expected mass of data required for 1) assessing compliance by new owners of contractual terms and conditions, and other legally enforceable covenants, inherent in the privatization transaction, and 2) facilitating and assisting with the data collection, collation and analysis of privatization-related information as well as economic and social data to enable the implementation of an impact assessment of Nigeria's privatization program and associated government policies on the Nigerian economy and society. This task results demonstrated that the Agency urgently required the institutional strengthening of the Post-Privatization Monitoring Department to enable it to collect and analyze the massive amounts of information that would be needed, and that the information required to conduct an impact assessment was unavailable in the form and nature that would be required. Privatization Monitoring Advise for the Monitoring & Compliance Unit at BPE. Under this project, the consultant was responsible for the Design, Testing and Implementation of a Monitoring Framework for BPE. The objective of this assignment was to design a monitoring structure to effectively assess the progress of privatization transactions. The IBTCI consultant also provided on-the-job-training to the staff of the Planning & Monitoring (P&M) unit at BPE, as well as advised the Monitoring and Evaluation Unit for a more enabling institutional framework and more effective monitoring of progress of the privatization processes. The consultant also assessed the features and functionality of the available MIS architecture and pertinent computer software and evaluated how M&C could make better use of it. Concurrently, IBTCI proceeded to identify and define the information to input into the reports of the M&C Unit, including fields and sources of data, i.e., where and how data is to be acquired. Finally, the Consultant outlined a future strategy/plan for the M&C function regarding monitoring tools, and made recommendations regarding additional tasks to be performed in order to carryout the objectives under the TOR. Post-Privatization Monitoring. The purpose of assisting the Post-Privatization Monitoring Unit at BPE was to develop recommendations for an appropriate institutional arrangement and corresponding procedures for interfacing between BPE, other relevant government organizations and the privatized companies. These arrangements and procedures were expected to ensure that the objectives of privatization were and are being achieved. As follow-on to this assignment, the consultant was called to highlight the best international practices and relevant experiences of Post-Privatization Monitoring in other African countries. Consultancy for the Identification & Collection of Data & Documentation. IBTCI carried out the identification, collection, organization, analysis and validation of data and documentation relating to SOEs privatized and commercialized from 1988 until 1999 by the Technical Committee on Privatization and Commercialization (TCPC), the predecessor of the BPE. Albania, Malawi, Paraguay, Philippines, Tanzania, Zambia: Threshold Evaluation (MCC): Under this evaluation IBTCI was tasked to provide an assessment of MCC's support for anti-corruption reform and business registration efforts in the first six Millennium Challenge Corporations (MCC) Threshold programs. The scope of the evaluation was to: identify the extent to which the programs completed the intended program activities, analyze by sector and country the activity outcomes, and draw a link between the activities and the Eligibility Criteria. Sectors to be covered include: procurement/audit reform, law enforcement technical assistance, business registration streamlining, support to anti-corruption commissions, and support to civil society and media. The IBTCI team began by carrying out an extensive background document review before they left for a field visit in each of the six countries. While in each country the IBTCI team contacted and interviewed members of the USAID mission, the project's implementing partners and local officials who were directly involved with the implementation of the anti-corruption initiatives. The IBTCI team also conducted a focus group with members of the local media about the affects of this initiative. After field visits are completed, IBTCI will use information from the interviews and focus group as well as other written documents to formulate the evaluation design and data collection plan for future programs. Iraq: Strengthening Iraq's Forensic DNA (FDNA) Analysis Capabilities Project, Component: Monitoring and Evaluation Support of the Iraq Forensic DNA Project (U.S. Civilian Research & Development Foundation (CRDF) / United States Department of State): Over a three year period, IBTCI is serving as a subcontractor to the US Civilian Research & Development Foundation (CRDF) on its efforts to build capacity in Iraq for forensic DNA analysis to support the identification of human remains. The project includes teaching Iraqis proper techniques for the identification of human remains. IBTCI's role is as an independent professional evaluator to assure the effectiveness of CRDF's training by conducting periodic monitoring and evaluation. IBTCI's activities have and will include: developing a project performance plan; ground truthing reporting data by utilizing local field monitors and tracking actual performance against the project monitoring plan; developing and conducting training surveys; and conducting a mid-term and final evaluations. Pakistan: Monitoring and Evaluation Services IQC (USAID): The IQC is aimed to provide assistance and support to Mission personnel in the performance of their duties in the areas of monitoring and evaluation in the areas of Education, Health, Governance, Economic Growth in Sindh, NWFP, Balochistan and Punjab. When USAID/Pakistan identifies a specific need for services (i.e., a task), a separate work statement is prepared for that task. The selected contractor provides personnel with qualifications and expertise suitable for the task and ensures the work is satisfactorily completed. IBTCI may be tasked with providing support services in any of these areas: Monitoring and evaluating the recipient and the recipient's performance during the award in order to facilitate attainment of program objectives by (1) maintain contact including site visits and liaison with the recipient; (2) review and analyze all performance and financial reports as well as verifying timely delivery; (3) assure compliance with terms and conditions of the award; and (4) carry out substantial involvement terms of a cooperative agreement, including review and approval of work plans and monitoring and evaluation (M&E) plans. IBTCI will evaluate the recipient's program effectiveness at the end of the program and perform other duties as may be requested or as delegated by the Agreement Officer for ensuring prudent management over assistance funds. Monitoring and evaluation responsibilities include the same as for grants and cooperative agreements, plus the following; IBTCI may be tasked with providing support services in any of the areas of inspecting work; determining whether deliverables are complete and acceptable; administrative approval of payment vouchers; providing technical direction to the contractor; and completing contractor performance reports. Support for monitoring and evaluation may include soliciting feedback from project stakeholders other than USAID or its implementing organizations, such as: Government of Pakistan representatives, communities, beneficiaries, etc. Nigeria: Federal Government of Nigeria Support to the Government's Broad-Based Privatization Program (USAID): IBTCI's participation in the Program was funded by USAID under two SEGIR Privatization Task Orders. IBTCI's advisory work was provided directly to the Bureau for Public Enterprises (BPE). The range of Technical Assistance provided by IBTCI was comprehensive and was implemented under four broad components. Under these four components, the agreed scope of work directed IBTCI to implement 15 major tasks but also required that the firm be flexible to respond to additional or changing needs, as these would arise. Monitoring and Evaluation Activities: A critical part of IBTCI's scale of work was to closely monitor and report on the progress of privatization carried out by BPE in comparison to targets for privatization set up under Phases 1, 2 and 3. A computerized program was set up to undertake this monitoring. In addition, based on USAID direction, IBTCI conducted an impact evaluation of privatization on the Nigerian economy, labor force and public participation. Focus group meetings were held with the beneficiaries, labor unions and media in this regard. IBTCI's findings and recommendations were utilized to make mid course revisions in the Nigerian privatization plans. The main areas of technical assistance and training included: Institutional and Selected Policy Support, Support of Key Priority Sectors, Support for Privatization of Other Priority Public Enterprises, and Policy Support and Consensus Building. Bangladesh Export Diversification Project (World Bank): IBTCI assisted the Government of Bangladesh (GOB) and the World Bank to accelerate the pace of development and diversification of exports. The project's two broad components were Product and Market Development (PMDS), and Trade Management Capacity building (TMCB). IBTCI served as the Secretariat and Project Coordination and Development Unit (PCU), and monitored and evaluated the activities of three subcontractors. The 3 major components of the project were a Matching Grant Fund, Customs Modernization, and Institutional Strengthening of the Bangladesh Tariff Commission. Sub-components of the project were: strengthening the WTO Cell of the Ministry of Commerce; development and implementation of a strategy for the Ready-Made Garments export industry. Technical experts on this project include Trade and Export Specialists, Procurement and Evaluation Experts, and Financial Management professionals. In its role as the Project Coordination Unit (PCU), IBTCI continued to assist the Ministry of Commerce (MOC) in coordinating monitoring and evaluating all project activities including conduct of technical committee meetings, integration of sub-projects, and maintenance of a central reference point for project generated documents. The capability of the export sector as a whole was being greatly enhanced by the simultaneous development of the capacities of exporting enterprises and the supporting government institutions. The firm maintained a close liaising relationship with the Government's Audit Committee and was responsible for financial management and disbursements including ensuring transfers of tax and VAT payments. Results from IBTCI's financial management activities were institutionalized in manuals and reports which helped with knowledge transfer and technical competence. Monitoring and Evaluation achievements included the conduct of substantive revisions of existing documents, and updating of project performance indicators as well as the design of templates for baseline and impact surveys for public agencies to conduct project evaluations. Egypt: Privatization Program Monitoring and Evaluation (USAID): In the early 1990's, the Government of Egypt (GOE) initiated a large and ambitious program of privatization of its state-owned industrial enterprises. The project contained four major functions: Sales Support, Organizational Development, Public Relations, and Decision-Making Support. Over a period of five years, USAID retained IBTCI to monitor the entire program, evaluate the services of the implementation contractors and report on the effectiveness of USAID's assistance for the privatization of the selected enterprises. In addition, we monitored the progress, problems, and achievements of the GOE in the implementation of this program. In addition, IBTCI evaluated a Report on the effects of the privatization program on the national economy. IBTCI's reporting and insights were presented in regularly quarterly reviews, workshops, and through a set of special studies conducted to evaluate policy constraints and other policy requirements. IBTCI faced the task of gathering and analyzing a substantial amount of on-going project data from Egyptian government agencies, principal contractors on the program, as well as from the donor agency, USAID. Monitoring and evaluation was carried out at the levels of policy, transactions and organizational management. The IBTCI team carried out its duties through an integrated use of surveys, document review, observations, and interviews with key transactions and other project staff. The Team's method of evaluation was innovative in that it used a participatory approach to include input from all key stakeholders. Baseline measurements of project progress were closely analyzed against donor targets and goals. While performance was evaluated against quantitative targets, qualitative insights were also documented and used where measurable data was unobtainable or data could not be described numerically. For the purpose of evaluating and monitoring USAID's privatization portfolio, IBTCI monitored the program, evaluated the services of the implementation contractors and reported on the effectiveness of USAID's assistance for the privatization of these enterprises. As such, IBTCI conducted assessments and provided continuous analysis on the effectiveness and impact of activities on the implementation of the Egyptian privatization program and of complementary support activities. Specifically, IBTCI analyzed regulatory, political and legal impediments to privatization and provided strong qualitative and quantitative assessments of progress in divestiture/sales programs, financial sector development, promotion campaigns, organizational development and decision-making support. IBTCI also reported on the macro-economic and business environment in Egypt. Also, IBTCI published an IBTCI Quarterly Review which summarized IBTCI's findings and provided the most comprehensive analysis of the impact and progress of privatization in Egypt. The Review was distributed to more than 600 recipients and was intended for those within and beyond Egypt interested in investing or trading with Egypt.