Modern Australian
The Times

Reliable science takes time. But the current system rewards speed

  • Written by Jason Chin, Senior Lecturer, College of Law, Australian National University
Reliable science takes time. But the current system rewards speed

Lately, there have been many headlines on scientific fraud and journal article retractions. If this trend continues, it represents a serious threat to public trust in science.

One way to tackle this problem – and ensure public trust in science remains high – may be to slow it down. We sometimes refer to this philosophy as “slow science”. Akin to the slow food movement, slow science prioritises quality over speed and seeks to buck incentive structures that promote mass production.

Slow science may not represent an obvious way to improve science because we often equate science with progress, and slowing down progress does not sound very appealing. However, progress is not just about speed, but about basing important societal decisions on strong scientific foundations. And this takes time.

Unfortunately, the pressures and incentives modern scientists face are almost universally against slow science. Secure, permanent university jobs are scarce, and with budget cuts, this appears to be getting worse.

As a result, the pressure to publish has never been higher. Indeed, in my yearly performance meetings, I am asked how many articles I’ve published and what is the status of the journals I published in. I am not asked how robust my methods are and how discerning my peer reviewers were.

The problems with fast science

Our current “fast science” approach has produced a host of problems.

Much as with fast food, scientists are incentivised to produce as much science as possible in as little time as possible. This can mean cutting corners. We know, for instance, that larger samples lead to more trustworthy results because they are more likely to be representative of the relevant population. However, collecting large samples takes time and resources.

Fast science is also associated with gaming the system. As a hypothetical example, an educational scientist might collect data to find evidence for their theory that a new teaching style promotes better learning. Then, they look at the data and realise the intervention did not quite improve learning. But if you squint at it, there might be a trend if you drop a couple of pesky outliers that didn’t see a benefit. So, they do just that.

This an example of what’s known as a “questionable research practice”, because it’s not considered outright fraud by conventional standards. Surveys in many fields suggest these practices are widespread, with about 50% of scientists saying they have engaged in them at least once.

Fast science is also associated with more obviously unethical practices.

Reports of fabricated data are likely due, in part, to scientists trying to publish as quickly as possible. An industry has even sprung up around scientific fraud – what are known as “paper mills”. These organisations produce articles around fabricated data and then sell authorship to those papers.

Scientist in a dark lab preparing a vaccine.
Surveys have shown about 50% of scientists have engaged in questionable research practices such as slightly tweaking research data. National Cancer Institute/Unsplash

Why trustworthy science takes time

So, what does slow science look like and how can it help?

The late English statistician Douglas Altman provided one of the most famous descriptions of the slow science mantra: “We need less research, better research, and research done for the right reasons”.

In many ways, it is the opposite of fast science: large samples and careful, well-documented, transparent practices.

Recall the hypothetical example of the scientists testing a new education practice. Rather than immediately jumping into data collection, the slow practice would be to first write a “registered report”. In other words, scientists would write out their theory and how they propose to test that theory, and send that out for peer review prior to collecting data.

The journal would then follow the normal process of soliciting peer reviews and allowing the scientists to revise their report in response to those reviews. Then, the authors would collect data, with publication in the journal being assured as long as they follow the agreed upon methods.

There are two major benefits to registered reports: it allows for peer feedback while it is still possible to improve the study and it removes an incentive to engage in questionable or fraudulent practices. Using the registered report format can take longer. But it is associated with more credible findings.

Two other slow practices worth mentioning are conducting research in a way that is reproducible and correcting errors in the existing body of research.

In theory, all science should be reproducible. That is, scientists should share their methods and data such that other scientists can both verify that work and build on it (developing new recipes, to continue the analogy to slow food).

Similarly, cleaning up the scientific record is incredibly important. For the same reasons that chef Gordon Ramsay likes to a clean a kitchen out before improving it, science needs to get a handle on what existing findings are reliable before we can build on them.

This means carefully going through existing publications to find studies that show indications of being fabricated or otherwise unreliable. This sleuthing is rare among university scientists because it does not typically result in publications. But it is highly important.

Scientist with white and grey hair peering into a microscope.
Slow science is the opposite of fast science: large samples and careful, well-documented, transparent practices. National Cancer Institute/Unsplash

Slow science is slowly gaining steam

Currently, it requires bravery to engage in slow science.

Universities are keen to move up the university rankings lists. Those rankings are driven by publishing. So, universities hire, promote and retain their scientists based on their publications. This makes it risky to slow down.

There are, however, some reasons to hope. Movements are afoot to redefine research quality to take into account more aspects of slow science.

The Declaration on Research Assessment is a worldwide initiative to move away from ranking systems that ignore the principles of slow science.

Grassroots organisations are also creating platforms for more open and exacting peer review.

And advocates for more careful research practices have recently been appointed to important positions, such as with research funders and academic journals.

These developments are worth following and building upon because society does not need heaps of low-quality science. It needs science that deserves trust.

Authors: Jason Chin, Senior Lecturer, College of Law, Australian National University

Read more https://theconversation.com/reliable-science-takes-time-but-the-current-system-rewards-speed-249497

Make Dad a Guest in His Own Home This Father’s Day

Father’s Day can accidentally turn Dad into the unpaid event manager of his own celebration. He lights the barbecue, finds extra chairs, checks wh...

Where to Enjoy Your Off-Road Caravan on the Gold Coast

With a caravan, you can travel anywhere and everywhere without battling the rush of the peak holiday season or last-minute reservations. While the r...

How Osteopathy Supports Recovery from Sciatica and Nerve Pain

Sciatica isn't just annoying. It's genuinely painful. It sits deep in your glute and shoots straight down the back of your leg. It turns something as...

The Winter Jewellery Edit: Five Pieces You'll Wear All Season

As wardrobes shift to cosy knits, tailored coats and rich seasonal textures, jewellery becomes the finishing touch that pulls every winter outfit to...

7 Signs It's Time to Upgrade Your Piston Air Compressor

If you run a workshop, panel shop, or fabrication business anywhere around Perth, you already know what heat and dust do to equipment over a few sum...

How Long Do Bathroom Renovations Melbourne Take? Step-by-Step Process Explained

Planning a bathroom renovation is exciting, but one of the biggest questions homeowners ask is, "How long will it take?" While every project is uniq...

Why Your Skin Breaks Out: The Science of Acne Explained

Acne is the most common skin condition in the world. An estimated 85% of people experience it at some point between the ages of 12 and 24, and a gro...

10 Swimwear Trends Australian Women Are Wearing This Summer

Every Australian summer brings a fresh wave of swimwear trends, but some styles have much greater staying power than others. While fashion constantly ...

Why Regular Skills Updates Are Essential for Licensed Security Officers

A guard at a Brisbane shopping centre gets a call about a shoplifter who's turned aggressive.  They’ve done the job for six years. But their de-...

10 Benefits of Choosing Professional Tutoring Penrith Services

Every student has unique learning strengths, challenges, and academic goals. While classroom teaching provides essential knowledge and structure, so...

Sunshine Coast Baby Classes Prove Big Hit Among First-Time Mums

There's a movement gaining traction on the Sunshine Coast, providing a village of support, socialisation and relief for first-time mothers and babie...

Father's Day Gift Ideas for Men Who Are Hard to Buy For

Some dads are easy to buy for. Others do not want anything, already have everything, or give you the classic "don't worry about me" answer every yea...

Top 5 Mistakes That Wear Out Your Brakes Faster

Brakes don't need frequent replacements like oil changes do.   But a lot of the wear happens quietly, over months, because of habits most drivers...

Plantation Shutters vs Curtains: Which Is Better for Your New Home?

Moving into a new home is an exciting opportunity to personalise your space and make it your own. While many homeowners focus on furniture, flooring...

Celebration of Life vs Traditional Funeral: What's the Difference?

When saying goodbye to someone you love, there is no single way to honour their life. Every family has different traditions, beliefs, and preference...

Building Approval for Roofing Projects: What Homeowners Need to Know

Roofing projects are an important part of maintaining and protecting your home. Whether you're repairing storm damage, replacing an ageing roof, or ...

Chatswood Tutoring And Its Role In Academic Achievement

Academic success often requires more than classroom attendance alone. Students face increasing expectations as they progress through school, particu...

Why Laser Hair Removal Treatments Continue Growing In Popularity

Managing unwanted hair can become time-consuming and frustrating for many people, especially when shaving, waxing, and other temporary methods requi...