Mission
The China Pathfinder Project is a collaboration between the Atlantic Council and Rhodium Group to track China’s convergence or divergence from open market economy norms. This project is nonpartisan and seeks to foster consensus about where China stands in relation to advanced market economies. With that goal in mind, our design balances accessibility for nontechnical readers with commitment to robust, transparent, data-grounded methods.
Research Framework
The China Pathfinder Project evaluates the economic system of China and ten open market economies in six categories: financial system development, modern innovation system, market competition, trade openness, direct investment openness, and portfolio investment openness. The first three clusters represent the “domestic” dimension, and the latter three clusters represent the “external” openness dimension.
We rely on annual indicators that are formed into a composite score each year. Each of the six categories outlined above possesses a set of annual indicators and a final composite index. In addition, we select nuanced supplemental indicators and conduct quarterly policy tracking to keep up with fast-moving economic and policy developments in China.
This year’s China Pathfinder measures the 2010 and 2021 performance of eleven countries using the same standardized metrics. The selected country list is as follows: Australia, Canada, China, France, Germany, Italy, Japan, South Korea, Spain, the United Kingdom, and the United States. Aside from China, all other countries are members of the OECD and are considered market economies. These specific countries were chosen according to being in the top-ten country list for highest gross domestic product (GDP).
Our inaugural China Pathfinder Scorecard incorporated China’s 2010 performance as a datapoint to benchmark China’s present-day progress since the last decade. This decision also provided data prior to the start of President Xi Jinping’s administration and offered an objective picture of how China’s economy has developed since. Starting with this report, we have expanded our data sample to compare the 2010 performance of all countries in our list, not only China. This allows us to analyze whether open-market economies have improved or regressed since 2010 according to our metrics for market openness.
Annual Indicators
Our criteria for selecting annual indicators have two main components: data timeliness and ability to make international comparisons. These criteria inherently limit each other, as timely data often do not have extensive country coverage. This created obstacles in our data collection process, and the path we chose with our annual indicators reflects the ideal solution to these data availability problems.
The annual China Pathfinder report has a foundation of quantitative methods and sources. It mixes source types for data analysis. We make use of existing credible databases and literature, such as the OECD, International Monetary Fund (IMF), and World Bank datasets and indices; platforms such as CEIC and Bloomberg for China-specific statistics and company financial data; and expert buy-in for our in-house production of proprietary datasets.
Along with compiling research from these data sources, China Pathfinder also incorporates indicators that were informed by study groups and expert interviews. Our team conducted review sessions with various outside experts on China and OECD economies, index creation, and construction of cross-country economic evaluations. We have implemented feedback and new ideas gathered from these conversations to improve our annual indicator selection.
Composite Scoring
A composite indicator employs a defined model for selecting a group of individual indicators and transforming them into a single index. Composite indicators are common tools in policy analysis, particularly for maintaining objectivity in comparing country performance. China Pathfinder takes guidance from the OECD Handbook on Constructing Composite Indicators: Methodology and User Guide, which compiles various statistically sound methodologies for economists and policymakers to build composite indicators.
To calculate composite scores, we use the Min-Max methodology. This is necessary to normalize countries’ scores from the individual indicators, which have different units and scales. The Min-Max normalization method was selected because it preserves country clustering and countries’ relative performance distance. Min-Max uses each dataset’s minimum and maximum datapoints to establish a “lower bound” and “upper bound.” Each country value X within a given indicator is taken in relation to these bounds. China Pathfinder subtracts the lower bound from the country value and then divides the outcome by the difference in the upper and lower bounds. This normalizes every indicator from zero to one. We use a scale of 0 to 10 for the composite scores, so the datapoints are multiplied by ten after completing the Min-Max process.
Some indicators have opposite implications for large values and small values. For our purposes, we set the following standard for all indicators and composite score readings: smaller values (i.e., those closer to zero) indicate “low” and larger values (i.e., those closer to ten) indicate “high” openness or development. Some indices that we adopt measure restrictiveness levels on foreign direct investment (FDI) or capital flows, and larger values represent greater restrictions on openness. For indicators that follow this pattern, we reversed the values before initiating the Min-Max method for the composite. Value reversal involved setting the maximum bound for these indicators and using it to subtract each country datapoint.
China Pathfinder’s composite indices blend de jure and de facto indicators. De jure indicators measure a country’s institutions or legal framework characteristics, while de facto indicators are outcome oriented and seek to measure the actual effects of said institutions. While there is an argument to be made for using one or the other, we chose to integrate both into a blended composite score for each cluster. Selecting only de jure indicators opens the possibility that policies or institutions in place do not necessarily evenly result in the same expected outcomes, or reflect the true situation for some countries. Using de facto indicators solely is particularly challenging with external factors, such as the COVID-19 pandemic, that greatly skew real outcomes temporarily. This approach also fails to afford credit to countries that have implemented institutional reforms when resulting progress has a lag.
We assign equal weighting to de jure and de facto indicators in the composite index calculation when the indicators have comparable importance to defining our cluster evaluation. Otherwise, each individual indicator receives the same weight regardless of de jure or de facto designation.
Supplemental Indicators
Chosen indicators within each area are intended to proxy for the broader picture, but do not encompass all aspects of an economy. Therefore, narrower factors that affect China’s performance evaluation are featured as “supplemental indicators.” Supplemental indicator data outcomes receive their own chart visualizations, but the data generally cannot be applied to all countries in our sample. For example, some poignant indicators lack data coverage for many countries in our sample, besides China. This complexifies our process for comparing China with the top open market economies on the same standards. For this reason, supplemental indicator data do not contribute to a country’s final composite score.
Numerous data compilation methods are used in building our supplemental indicators. Some indicators are reflections of standard metrics, and others are modified in-house to illuminate certain aspects of metrics that already exist. Finally, China Pathfinder applies a handful of existing proprietary indicators developed by Rhodium Group.
Policy Tracking
China Pathfinder supplements its yearly quantitative assessment with quarterly policy tracking. After compiling all relevant major policy developments in China during a specific quarter for each of our six clusters, we systematically evaluate each development. The evaluation process contains four possible signals for China’s policy momentum: movement toward, movement away, mixed movement, or no change in relation to open-economy standards. After aggregating all positive, negative, mixed, and stagnant developments in China’s policy atmosphere, China Pathfinder presents a heatmap within its quarterly report that shows the outcome.
In examining policy changes, our team specifically looks for policies that connect back to the benchmark signals that we outlined in our inaugural report’s Section 2 on “Looking Forward: Market-Oriented Policy and Data Signals.” This provides some continuity between our annual report’s quantitative-driven outcomes and the policy considerations elaborated upon in quarterly reports.
Applications and Caveats
While China Pathfinder is intended to be a quantitative resource for policymakers, economists, and business leaders to benchmark the Chinese economy and stay informed about China’s policy developments, it is not a comprehensive assessment of every aspect of China’s economy. Our research design is deliberately narrow, focusing on just enough to permit a clear picture of China’s compatibility with market economies without hindering reader accessibility.
The choice to track China’s system versus open market economies, rather than a broader set of emerging and developing economies, was a deliberate one. We fully acknowledge that China does not have any intention to become a democratic open market economy. However, we postulate that OECD policymakers can only maintain open and engaging economic policies with China if there is movement in a similar direction.
Our project concept opens the question of whether China should be expected to converge with advanced OECD nations, instead of the opposite. Aiming for fairness in the China Pathfinder evaluation, we compare China not on areas in which our sample of market economies are already structurally perfect, but on agreed-upon norms integral to an open economic system.
We choose to focus on economic policies and outcomes, where increased openness is perceived as a positive direction. However, China and the OECD countries we analyze may show signs of convergence in areas where the latter nations have adopted targeted industrial policies. While national security concerns may indirectly impact the outcomes of China Pathfinder, our data scope primarily focuses on economic policy and outcomes; the primary goal is to evaluate economic effects instead of political or strategic motivations.
Our research design and indicator selection are not perfect, but represent what we believe is the best available solution within existing constraints. Main caveats include the following:
- There are some areas of great importance to market economies that we do not cover. These include the presence of a robust social safety net, comprehensive labor protection laws, environmental protections, and policies to mitigate inequality. We acknowledge that these areas are critical aspects of any market economy, but believe that the indicators we have chosen serve to address the project’s core focus of how OECD nations should choose to view China’s system in the context of future engagement.
- Our selection of annual indicators faces structural limitations. In some areas, we have good coverage; in other areas comprehensive, comparable and timely data are not available and, therefore, we face major gaps in what we would have considered ideal coverage (for example, subsidies). The following summarizes the changes to our annual indicator list from 2020 to 2021 due to datasets being discontinued or too lagged to retain going forward:
- Banking Assets Controlled by Private Firms, a financial system indicator from the Bank Regulation and Supervision Survey (BRSS), has been replaced with State Ownership in the Top 10 Financial Institutions, collected in-house using Bloomberg data. Both indicators measure the role of the state in the financial system.
- Foreign Competition in the Banking Sector, a financial system indicator from the BRSS, will no longer be featured in the annual scorecard.
- Overall Market Concentration Across All Industries, a market competition indicator better known as the Herfindahl Hirschman Index (HHI) from the World Integrated Trade Solution (WITS), has been replaced with Proportion of Sector Market Capitalization Held by Top 5 Firms, collected in-house using Bloomberg data. Both indicators proxy for market concentration and aggregate results across all sectors of an economy.
- Scope of SOEs Index, a market competition indicator from the OECD Product Market Regulation series, has been replaced with Ownership of Top 10 Firms across 11 sectors. Both indicators capture the presence of the state in a range of industries.
- Direct Control over Enterprises Index, a market competition indicator from the OECD Product Market Regulation series, will no longer be featured in the annual scorecard.
- Openness to Foreign Innovation Collaboration, an innovation system indicator from the World Bank, will no longer be featured in the annual scorecard. Data reflecting foreign collaboration were too volatile to be meaningful due to COVID-19 pandemic impacts.
- Our data approach cannot fully account for the unlimited reach of the state and the role of the Communist Party in influencing prices, competition, and outcomes in the Chinese economy. While we assess measurable elements such as the proportion of top 10 financial institutions by market capitalization that are state-owned, these measures certainly understate the role of politics in the economy—as 2021’s extralegal changes to the role of private ownership in the education-services sector (one of many examples) demonstrate.
Research Dissemination and Data Visualization
The China Pathfinder Project provides visualizations for indicators in six areas that will be updated with new data annually. It preserves 2010 as a benchmark year for China’s performance, a data point that will live through future iterations of composite scoring and individual indicator analysis. Starting in 2022, the project added 2010 data to benchmark the performance for all countries in the sample. This data is featured on the website landing page and individual economic area pages, and will be updated in future iterations as well.
To add nuance and include higher frequency data on the Chinese economy, quarterly reports incorporate relevant supplemental indicator data and timely chartwork on the most critical developments of the quarter. In the face of unexpected large-scale developments or data availability issues, the supplemental indicator list will be modified to ensure maximum utility for the user.
Data visualizations are created by Seven Mile Media, Jerico Aragon, and Youyou Zhou, and range from interactive data features on the website and graphical representations throughout annual and quarterly reports.