How to Improve our Global Chinese Official Finance Data
How we Measure the “Health” of a Project Record
The purpose of AidData’s “Health of Record” methodology is to rate the completeness and verifiability of each project record. The methodology produces a source triangulation and a field completeness score. Our team uses these scores to prioritize project records that require further investigation and validation; they can also be used by external users to isolate and analyze project records with varying levels of data quality.
The public disclosure of these data quality scores is part of a larger effort at AidData to be as transparent as possible about the data it produces through the Tracking Under-reported Financial Flows (TUFF) methodology. For more information on how you can help improve the “health” of a particular project record, please see the section titled, "Improving the Data".
Source Triangulation Score: This score, which varies from 0 to 20 (with higher scores representing better-sourced project records) is designed to capture the diversity and quality of sources and source types used to construct individual project records. These sources not only include those codified in the TUFF methodology (e.g. media reports, government documents, and scholarly articles), but also sources gained via ground-truthing efforts.
Base Score: The base score is determined by the number of media reports used to source a project. It is informed by the actual distribution of sources in the database.
- Projects receive 1 point for each additional media report (2 and above)
- Points will be capped at 4 because of the diminishing value of additional media sources (due to repetition of information).
Value Added Score: This score awards extra points to project records that are sourced from other, more credible sources. Extra points are awarded for each source type that informs a project record. Project records do not receive additional points for more than one source within each category; rather, this score is used to assess the diversity of source types attached to a project record.
- Official Government Sources (Donor/Recipient): 3
- Other Official Sources (non-Donor/non-Recipient): 3
- Implementing Agency Source: 2
- Academic Journal Articles/Other Academic Sources: 2
- NGO/Civil Society/Advocacy: 1
- Social Media, including unofficial Blogs: 1
Bonus Points: Additional points are awarded for ground-truthed or sky-truthed projects. Evidence of such a procedure is found in multimedia content uploaded to the page of a project record.
- Successfully ground-truthed: 4 points
Field Completeness Score: This score assesses a project record’s level of completeness (i.e. having all of its fields populated). It varies from 0 to 9; higher values represent project records with more populated fields. We prioritize the presence of 7 ‘key’ fields (defined below); if any of these fields are missing information, a project record’s completeness score is reduced by 1 point. Additionally, a project record earns an extra point when any ‘high-value’ field (defined below) is populated. In order to ensure that the field completeness score only assumes positive values, all project records start base value of 8 before deductions begin. The theoretical max of this score is therefore 9.
High value fields:
- Transaction Amount: Projects with missing financial amounts will receive a 1 point deduction
- Commitment Year: Project without a commitment year or tagged “year uncertain” will receive a 1 point deduction
- Flow Class: “vague” records will receive 1 point deduction
- Flow Type: Vague-TBD/Unset records will receive a 1 point deduction
- Sector: Unallocated/Unspecific projects will receive a 1 point deduction
Status: To identify records that merit an additional round of searchers to see if new information is available, the completeness score will take status into account. It is reasonable to assume that completed or cancelled projects will not receive additional media coverage whereas pipeline, implementing, or suspended projects could receive additional coverage.
- Projects that are marked as completed or cancelled will receive 1 point since we can be confident that additional information will not be forthcoming.
- Projects that are marked pipeline or implementation’ receive 0 points.
- Implementing/Accountable Agency: Projects without an implementing or accountable agency also lose a point.
Improving The Data - Get Involved
While AidData’s Chinese Official Finance database was built by our own staff and researchers, it has since then benefited from the input of dozens of independent contributors.
We’d like you to help us improve the data by identifying errors and omissions, and by suggesting alternative sources of information.
This public resource was created in anticipation of the fact that others who are knowledgeable about specific Chinese official finance activities would help improve the accuracy, scope and depth of the database over time.
AidData staff follow a specific set of procedures to review and approve suggested content (see Appendix A of the TUFF 1.3 Methodology for more details). If your contribution is approved, you will receive an email notification from our team to let you know that your comment has been integrated into the online record.
Find a project record
1. Access our online database at china.aiddata.org.
2. If you have a specific project in mind, then use the search page and find the project based on the information you know about it. Alternatively, if you know the ID of the project record in our database, you can “Find by Project ID”.
Challenge or Confirm
Once you have entered an ID or clicked on a particular project record on the search page, you will be led to the project page for that individual record. On this page, you will be able to see the different attributes of that single project. If you can verify any of the information that is entered in a variable or project description, hover over that variable name and click “confirm.” Alternatively, if you believe there is an error (whether in the project description or for a specific variable), then hover over the variable name and click "challenge". Then, enter the desired revision for this data field. For verification purposes, we highly recommend linking to the source document in the “source” section; otherwise, your challenge will require corroborating evidence from another commenter or source. Once you enter this information, an AidData staff member or researcher will review your contribution and choose whether to accept it on the page. If accepted, your username and contribution will appear to other users on that project page.
Leave a comment
If you do not wish to "challenge" the existing data but simply have additional information for a project, then you can input this information in the comment box at the bottom of the project page.. See adjacent Screenshot for a visual.
Upload a file
You can also attach files to project records. To do so, navigate to a project page and upload files using the box in the top-right side of the page. By choosing one of the options, you can upload photos and PDFs, share videos and download files that other users have shared.
If you have any questions, you can email us at firstname.lastname@example.org.