ISSN 2330-717X

China’s Scientific Research Evaluation System To Undergo Major Change Following Coronavirus Outbreak – Analysis

By

The act of several research scientists publishing scientific papers in China regarding the novel coronavirus epidemic during the early stages of the country’s outbreak has stirred quite the controversy and dissatistifaciton amongst the Chinese society, centering on the two following issues- One, if the researchers had known about the epidemic beforehand but kept mum about it for the sake of the paper’s publication and two, if the researchers placed their research interest ahead of the public’s welfare by prioritizing the publication of their papers in foreign journals over dealing with the epidemic.

Due to the lack of official information disclosed and a rather sloppy attempt by the government to quell the contagion during the early stages, this caused the exact sentiments of suspicion to surface amongst the public towards the government, triggering another huge uproar.

Logically speaking, if an unknown public health emergency ever breaks out, researches and epidemiological studies must be conducted in order to understand how the contagion functions. The intention of publishing papers within the international journals community is to share any findings that would give the international scientific and medical community a better chance at understanding the characteristics of the virus at hand and allow them to conduct joint research and prevention attempts.

True enough, the urgent publication of the papers helped various countries in their analysis of the epidemic tremendously, though it came at the expense of preventing (and controlling) the epidemic on a domestic level effective immediately. That, coupled with government’s sluggish response and lack of transparency towards the matter further drove the frustrated public redirecting their dissatisfaction on the scientific researchers for their eagerness to publish the papers. 

Faced with an overwhelming pressure from the public, this prompted the Ministry of Science and Technology to issue a memo stating – “Project undertakers and scientific researchers are to prioritize the interest of the country and its nation. Scientific papers are to be produced with intention to the benefit the country firsthand and all findings are expected to be incorporated into the prevention and control efforts of the outbreak. Until efforts to prevent and control the epidemic are successful, the publication of any scientific researchers’ papers must come later.”

The phrase “Scientific papers are to be produced with intention to the benefit the country firsthand” came from President Xi Jinping’s speech at the National Conference on Science and Technology Innovation, the Chinese Academy of Sciences and the Chinese Academy of Engineering on May 30, 2016. Xi added that the purpose of scientific researches isn’t solely to seek knowledge and truth, but to aid in the country’s economic and social development as well as to benefit its people. Thus, the vast majority of scientific researchers should bear that in mind that “scientific papers are to be produced with intention to the benefit the country firsthand” and apply any scientific and technological accomplishments to China’s goal of achieving modernization.

The phrase – “scientific papers are to be produced with intention to the benefit the country firsthand” is the government’s way of preaching an “applied and practice-driven approach” amongst the scientific researching community amidst the outbreak. As such, ANBOUND researchers believe that China’s scientific research evaluation systems will eventually undergo a major change after the outbreak, with applied and practical researching practices becoming an important and must-have requisite for China’s scientific research evaluation systems in the future.

For the longest time, China’s scientific research evaluation system has been defined by the standards of “papers published, title garned, education level, awards received”, meaning that scientists who have published countless papers, received many titles, possess great academic backgrounds and received numerous received would be in more favorable position. When it comes to the following aspects – (a) national science and technology programs, (b) national science and technology innovation bases, (c) central scientific research institutions, (d) national science and technology awards, and (e) innovative talent promotion programs, the quantity and contribution of papers are excessively emphasized, albeit in an unhealthy manner whilst the quality, contribution, and influence of landmark achievements are often downplayed.

The evaluation standard which overemphasizes the number of published papers caused a large number of researchers to participate in scientific research scene rather competitively i.e.: focusing on producing papers, with large resources having been invested in it. Ironically, the investment put forth in such scientific research does nothing to provide a substantial boost to China’s basic research and applied research. A large number of scientific research achievements have neither made valuable breakthroughs in the field of basic research nor made meaningful practical contributions in the field of application and practice. A case in point is that China’s only ever Nobel Prize in science was awarded to Tu Youyou, a researcher of “three no(s)” (i.e. no education, background, and capita), for her team’s discovery of artemisinin, which saved millions of lives around the world and whose work was immortalized in history.

The evaluation standard which excessively emphasized the number of published papers has caused a rat race amongst researchers. One of the reasons for that is that papers and impact factors are directly linked to many interests — professional titles, grades, bonuses, and research funds.

According to the public information published by top international journal “Science” in an article titled – “Cash bonuses for peer-reviewed papers go global” which systematically analyzed the average of global cash bonuses provided for scientific papers around the world on August 10, 2017, China came first on the list. This is because Chinese universities typically offers firstimer authors >US$ 43,000 for publishing a paper in “Science” or “Nature”, with the top reward for such papers a jaw-dropping amount of US$ 165,000, 8.3 times as much (approx. US$ 20,000) as Saudi Arabia which ranked second, and about 30 times more than developed countries such as the UK, the U.S., and Australia. It is worth noting that most of the countries included in the list are developing countries, indicating a common trait of developing countries is to stimulate research with cash bonuses.

Thus, in recent years, the Chinese government has been promoting the change of the evaluation system in scientific research. In early July 2018, the General Office of the CPC Central Committee and the General Office of the State Council issued a plan known as  “Ways to deepen the Reform of Project Evaluation, Talent Evaluation, and Institutional Evaluation”, and proposed to improve the evaluation method of scientific and technological talents, highlight the importance of moral ethics, professional ability and work performance as well as do away with the principles of “papers published” and “impact factors”.

In February 2020, the Ministry of Science and Technology and the Ministry of Finance jointly issued the plan – “Several Measures to Eliminate the Ill Habit of Prioritizing a “Papers Only” Approach in Science and Technology Evaluation (Trial)”. The relevant measures emphasized the practical value in project topic review, national science and technology innovation base, technology research and development institutions and relevant projects, and not to take the paper as the main evaluation basis and evaluation index. The implementation of this measure plan will be evaluated after a one-year trial period. It is clear that the outbreak of novel coronavirus has stimulated the reform in China’s scientific research evaluation system, and is expected to be fully implemented after the outbreak. China’s scientific community, which has long been dominated by papers and impact factors, is in for a major shakeup.

However, it should be noted that it is not easy to completely change an evaluation system, and it is even more difficult to establish a more reasonable evaluation system for scientific research. Therefore, it is imperative that China’s scientific research authorities remain vigilant against hypercorrection in the process of reforming.

From the perspective of public policies, ANBOUND researchers believe that there are several reasons for the large deviation in China’s scientific research evaluation system: (1) The lack of a reliable peer review mechanism, adequate environment and competent professionals in China’s scientific research community makes it hard for the country to have a solid peer review system founded on approvals from the academic community, which caused the research community to come up with a “simple and feasible” paper impact factors evaluation system. (2) Chinese researchers lack a comprehensive and diversified incentive system, and tend to orient towards extremely utilitarian evaluation indicators under the condition of low income, resulting in a malformed system of “papers only” and “impact factors only” approach. (3) China’s scientific research evaluation system is too short-term and utilitarian, and there is insufficient support for basic, theoretical and long-term research, which leads to China’s short-sightedness in basic and theoretical research. Such short-sightedness and utilitarian evaluation system requires special vigilance in the future reform of scientific research evaluation system. (4) The reform of the scientific research evaluation system should not only be diversified but competent too.

This isn’t to say that the country should go from the extreme of “papers only” to the other extreme completely ignoring papers and only focusing on utilitarian returns. In particular, it should be stressed that the adjustment of the scientific research evaluation system will be amplified by the policy under the role of the future reform policy orientation. If there is a hypercorrection, the scientific research evaluation system in China may be far too different compared to the systems employed in advanced countries, which can lead to the superficiality and overemphasis of practicability in scientific research evaluation.

Final analysis conclusion:

The novel coronavirus is a mirror that reflects the shortcomings of China’s scientific research evaluation system. Presently, the reform of the scientific research evaluation system has already begin at the time of this article’s writing. In the future, China’s scientific research evaluation system in expected to undergo a significant change that prioritizes practice and application in its country’s researches. However, the reform of the evaluation system should also be hypercorrection-proof, with the “paper only” approach shifting to a completely pragmatic one.


Thanks for reading Eurasia Review. For more of our reporting make sure to sign up for our free newsletter!

Anbound

Anbound

Anbound Consulting (Anbound) is an independent Think Tank with the headquarter based in Beijing. Established in 1993, Anbound specializes in public policy research, and enjoys a professional reputation in the areas of strategic forecasting, policy solutions and risk analysis. Anbound's research findings are widely recognized and create a deep interest within public media, academics and experts who are also providing consulting service to the State Council of China.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.