Asia-Pacific economics research audit finds that the global field of China economic analysis has produced a remarkably stable record of confident predictions whose specific content varies inversely with the period they cover
China Commentary Study: 94 Percent of Trajectory Predictors Have Previously Predicted the Opposite Trajectory
SINGAPORE — The Asia-Pacific Economic Analysis Research Centre released a study Wednesday examining the career-spanning prediction records of 147 prominent analysts who had published significant forecasts about China’s economic trajectory, finding that 94 percent had at some point in their career published predictions whose direction contradicted predictions they had previously published with equal or greater confidence. The study, which analysed publicly accessible economic commentary, academic papers, and institutional reports across a 30-year period, found that 41 percent of analysts had at some point in their career argued with significant confidence that China’s economic growth was unsustainable, and that 72 percent had at some point argued with significant confidence that China’s economic development was extraordinary and would continue. The intersection of those two groups — analysts who had argued both positions at different points in their career — was 94 percent, producing the study’s headline finding. The study’s lead researcher, Dr. Kevin Okafor, described this as “a finding about the difficulty of economic forecasting in complex adaptive systems rather than a finding about analyst integrity, though I want to note the distinction is doing significant work in that sentence.”
“China’s economy has been, over 30 years, remarkable in ways that have repeatedly confounded expectations in both directions,” Dr. Okafor said at a Singapore briefing attended by China economists who confirmed the finding and who spent the networking session afterwards discussing which specific articles had contributed to their 94 percent membership. “Analysts who predicted a hard landing in 2014 were wrong. Analysts who predicted continued double-digit growth after 2015 were wrong. Analysts who predicted decoupling from Western trade networks by 2020 were wrong. Analysts who predicted full integration by 2020 were also wrong. The 94 percent figure reflects the specific challenge of forecasting an economy whose scale, policy environment, and strategic direction produce outcomes that neither conventional emerging market models nor conventional developed economy models accurately predict.”
The Prediction Record in Detail
The study tracked each of the 147 analysts’ China economic predictions across four categories: growth trajectory (accelerating, stable, decelerating, or collapse risk); financial system stability; geopolitical economic integration; and what the study labels “the structural transformation prediction” — assessments of whether China’s economy was successfully transitioning from export-led manufacturing toward consumption and services. Each analyst was assessed for directional consistency within categories across their published career. The 6 percent of analysts who had not published contradictory predictions within any single category were characterised by the study as “either those who had specialised very narrowly in a stable sub-area, those whose careers were short enough that the economic cycle had not produced a contradicting event, or those whose predictions were sufficiently qualified that no specific prediction could be identified as directionally inconsistent with a prior prediction, which is the epistemically correct approach but is underrepresented in the public commentary field.”
The growth trajectory category showed the highest contradiction rate, at 79 percent of analysts having published predictions in both the “sustained high growth” and “significant growth deceleration” directions over their careers. The financial system stability category was second, at 67 percent. Dr. Okafor said these two categories were “the ones where the evidence base shifts most dramatically with policy changes, commodity cycles, and external demand conditions, making contradictions between five-year-apart predictions not a sign of analytical inconsistency but of genuinely changing conditions.” He said “the difficulty is that the individual predictions are typically expressed without reference to the conditions that would make the prediction invalid, so the prediction appears to be about China’s trajectory in general rather than about China’s trajectory given current conditions, and the contradiction appears when the conditions change.”
The Most Quoted Analysts and Their Records
The study’s citation analysis identified the 20 analysts with the highest citation rates across the 30-year period — those whose China economic analysis had the most reach in the academic, policy, and media environments. The 20 most cited analysts had a contradiction rate of 97 percent, higher than the overall 94 percent, which the study attributed to two factors: the most cited analysts had the longest careers, providing more time for contradicting events to occur; and the most cited analysts had the broadest analytical coverage, addressing more categories in which contradictions could emerge. “The analysts who have influenced the field most significantly have also changed their views most significantly,” Dr. Okafor said. “This is not hypocrisy or inconsistency. It is the record of analysts who have engaged seriously with a complex economy across multiple decades and have updated their views as the evidence changed, which is what good analysts should do and which, when you aggregate it, produces the pattern the study documents.”
He confirmed that “the study could have been written as a finding about analyst quality, since updating views in response to evidence is a positive trait.” He said it was “not written that way because the finding the study documents is the difficulty of the prediction enterprise rather than the quality of the predictors, and because framing it as a quality finding would produce the defensiveness that makes this kind of research less useful.” He said “94 percent of prominent analysts having published contradictory China predictions is evidence that China’s economy is very hard to predict accurately over long horizons, which everyone in this room already knew but which having in quantitative form is useful for calibrating confidence in the next round of predictions.”
What the Analysts Said When Presented With Their Records
The study contacted 67 of the 147 analysts to share their individual prediction records and invite response. Forty-one provided responses. Twenty-three described their view updates as “appropriate responses to changing evidence,” which Dr. Okafor confirmed was “the correct characterisation in most cases.” Twelve described their view updates as “refinements of a consistent underlying framework,” which he described as “partially accurate and partially retrospective rationalisation in proportions that varied by individual.” Six described their prediction record as “more consistent than the study’s framing suggests,” which he confirmed was “their right to argue” and whose specific arguments he had reviewed and found “not compelling in four of the six cases and worth considering in two.” One analyst said they “had been wrong so often about China that they had stopped making specific predictions and now only described the range of outcomes they considered plausible with explicit probabilities,” a response Dr. Okafor described as “the most honest in the dataset and also the one that will generate the least media coverage, which is a commentary on the media environment rather than the analyst.”
