Predictive algorithms are no better at telling the future than a crystal ball

  • Written by Uri Gal, Associate Professor in Business Information Systems, University of Sydney
Predictive algorithms are no better at telling the future than a crystal ball

An increasing number of businesses invest in advanced technologies that can help them forecast the future of their workforce and gain a competitive advantage.

Many analysts and professional practitioners believe that, with enough data, algorithms embedded in People Analytics (PA) applications can predict all aspects of employee behavior: from productivity, to engagement, to interactions and emotional states.

Read more: Digital public: looking at what algorithms actually do

Predictive analytics powered by algorithms are designed to help managers make decisions that favourably impact the bottom line. The global market for this technology is expected to grow from US$3.9 billion in 2016 to US$14.9 billion by 2023.

Despite the promise, predictive algorithms are as mythical as the crystal ball of ancient times.

Predictive models are based on flawed reasoning

One of the fundamental flaws of predictive algorithms is their reliance on “inductive reasoning”. This is when we draw conclusions based on our knowledge of a small sample, and assume that those conclusions apply across the board.

For example, a manager might observe that all of her employees with an MBA are highly motivated. She therefore concludes that all workers with an MBA are highly motivated.

This conclusion is flawed because it assumes that past patterns will remain consistent. This assumption itself can only be true because of our experience to date, which confirms this consistency. In other words, inductive reasoning can only be inductively justified: it works because it has worked before. Therefore, there is no logical reason to assume that the next person our company hires who has an MBA degree will be highly motivated.

Read more: How marketers use algorithms to (try to) read your mind

Assumptions like these can be coded into hiring algorithms, which, in this case, would assign a weighting to all job applicants with an MBA degree. But when inductive reasoning is baked into the code of hiring applications, it can lead to unfounded decisions, adversely impact on the bottom-line, and even discriminate against certain groups of people.

For example, a tool used in some parts of the United States to assess whether a person arrested for a crime would re-offend was found to unfairly discriminate against African Americans.

They lead to self-fulfilling prophecies

Another flaw in the predictions thrown up by algorithmic analysis is their propensity to create self-fulfilling prophecies. Acting on algorithmic predictions, managers can create the conditions that ultimately realise those very predictions.

For example, a company may use an algorithm to predict the performance of its recently-hired salespeople. Such an algorithm might draw on data from standardised tests completed during their onboarding process, reviews from previous employers, and demographics. This analysis can then be used to rank new salespeople and justify the allocation of more training resources to those believed to have greater performance potential.

This is likely to produce the very results that the initial analysis predicted. The higher-ranked recruits will perform better than those ranked lower on the list because they have been given superior training opportunities.

Read more: What businesses can learn from sports about using algorithms

Calculating probabilities of future events is meaningless

Some practitioners recognise the flaws in the predictive capability of algorithmic systems, but they still see value in generating models that indicate probability.

Rather than predicting the occurrence of future events or states, probabilistic models can indicate the degree of certainty that events or situations might occur in the future.

However, here too it pays to be a little sceptical. When a model calculates that an event is likely to happen it does so as a percentage of 100% certainty. Any probabilistic prediction is only possible in relation to the possibility of complete certainty. But since complete certainty is impossible to predict, probabilistic models are of no real significance either.

Algorithms don’t ‘predict’, they ‘extrapolate’

So if they cannot predict organisational events with complete or even probable certainty, what can predictive algorithms do?

To answer this, we must understand how they work. Once developed and inscribed with their base code, predictive algorithms need to be “trained” to hone their predictive power. This is done by feeding them with past organisational data. They then search for trends in the data and extrapolate rules that can be applied to future data.

For example, workforce planning algorithms can identify employees who are likely to resign. They do this by analysing the personality and behavioural patterns of employees who have resigned in the past and cross-referencing the results with the profiles of existing employees to identify those with the highest matching scores. With each round of application, the algorithm is continually adjusted to correct ever-decreasing prediction errors.

Read more: Why marking essays by algorithm risks rewarding the writing of 'bullshit'

However, the term “prediction error” is misleading because these algorithms do not predict, but rather extrapolate. All that predictive algorithms can ever do is guess at what is going to happen based on what has already happened. The leap required to make actual predictions is not a matter of computing power, but rather of bending the laws of physics.

Predictive models can’t anticipate change

Because they are extrapolative, predictive models are rather good at identifying regularities, continuity and routine. However, the human brain is also designed to identify stable patterns. Competent managers should be well aware of their organisation’s operations, and capable of envisioning steady patterns over time.

What managers find difficult to predict is change. Unfortunately, predictive models are also poor predictors of change. The more radical change is – different from existing patterns – the more poorly predicted it will be.

To manage effectively and develop their knowledge of current and likely organisational events, managers need to learn to build and trust their instinctual awareness of emerging processes rather than rely on algorithmic promises that cannot be realised. The key to effective decision-making is not algorithmic calculations but intuition.

Authors: Uri Gal, Associate Professor in Business Information Systems, University of Sydney

Read more http://theconversation.com/predictive-algorithms-are-no-better-at-telling-the-future-than-a-crystal-ball-91329

Australia Today

What sea creature can attack and win over a blue whale?

Wally Franklin, Researcher and co-director of the The Oceania Project, Southern Cross University

Blue whales are the largest creatures to have ever lived on Earth.ShutterstockThis is an article from Curious Kids, a series for children. The Conversation is asking kids to send in questions they’d like an expert to answer. All questions are welcome – serious, weird or wacky! You might ...

Read more

how leadership instability and revenge became woven into our political fabric

Frank Bongiorno, Professor of History, ANU College of Arts and Social Sciences, Australian National University

Wes Mountain/The Conversation, CC BY-NDBack in 2012, a major study on the selection and removal of party leaders in Anglo parliamentary democracies was published. The book contained a section with the inviting title of “Machiavellian tactics”. Most of the authors’ examples came fro...

Read more

How to move energy policy models beyond bias and vested interests

Shirin Malekpour, Research Leader in Strategic Planning and Futures Studies, Monash Sustainable Development Institute, Monash University

Modelling should be a chance to test your assumptions, not just confirm them.ShutterstockThe Turnbull government’s flagship energy plan, the National Energy Guarantee, was intended to end a decade-long stalemate on energy and climate policy in Australia. Ironically, since its unveiling in Octo...

Read more

University staff and students are at high risk of ill health. Here's how to make sure they can cope

Brad Wright, Sessional Academic (Health & Physical Education), Charles Sturt University

Students and staff at universities have many of the same health risk factors, including poor mental health and alcohol consumption.www.shutterstock.comUniversity students are an at-risk population for many health issues. These include mental health, alcohol and substance use, sexual assault and hara...

Read more

What do your earliest childhood memories say about you?

Penny Van Bergen, Senior Lecturer in Educational Psychology, Macquarie University

The experience "this happened to me" is stronger than "this happened" in memory formation. epicharmus/flickr , CC BY-SAWe experience thousands of events across childhood, and yet as adults we recall only a handful. Some might be “firsts” (our first ice cream, our first day at school), or...

Read more

what is loss aversion and is it real?

Brendan Markey-Towler, Researcher, The University of Queensland

You may still feel losing a wallet more than finding it.ShutterstockA recent study claims a core idea in behavioural economics – loss aversion – is a fallacy. Loss aversion is the theory that the pain of losing something is greater than the pleasure we feel by gaining something equivalen...

Read more

Holidays & Travel

Guide to Travel Necessities for 2018

Sure, it sounds like quite an adventure to hit an open road with nothing but a one-way ticket and an open mind, but the harsh reality is – you won’t...

Top Sightseeing Spots in New Zealand

New Zealand is one of the most fascinating locations for anyone to visit in the world. After all, it’s a place with a variety of unique landscapes, but it isn’t...

Must-Pack Items for a Travel Blogging Boss

As a travel blogger, you get to see and explore so many wonderful destinations and meet various interesting people, but before you embark on a new adventure you need to...

Luxury Camping Adventures Around the World

Perhaps in direct response to the dominance of technology in the modern world, many travelers are feeling a strong draw towards nature. While some are able to fully embrace their...

Dredging works underway Plantation Island

Tourists and workers travelling to popular tourist destination Plantation Island, Fiji, are set to benefit from safer access when marine channel dredging is completed at the end of June 2018...

Top 5 Tips for Traveling With Dogs

Travelling with your dog can be thrilling, but sometimes it can turn into a real nuisance. Unless you know how to properly restrain the pooch, whether it’ll be able to...

Top Island Destinations for 2018

When we picture island destinations in our minds, we often imagine a tropical beach of white sand, a sun lounger laid out in the shade of a line of palm...

Why Car Rental Excess Insurance is a Smart Choice

Some car rental agencies include basic damage cover in the standard rental fee, with the option to add on liability reduction, or excess insurance. The addition of excess insurance normally...

More Than a Third of Australians Feel 'Too Busy' With Work to Take a Holiday

New research from InterContinental Hotel & Resorts has unveiled a large number of Australians (32 percent) are simply too busy with work to take some much-needed rest and relaxation. Almost...

Fashion & Beauty

Groom To Do List

Sorry Aussie Men, you no longer just pay for the alcohol, flowers and marriage license. Times have certainly changed. Wedding Expert shares what Australian Grooms are now expected to do before...

Simple Secrets To A More Confident Smile

We all know just how important first impressions are. After a handshake, what’s one of the first things people will notice about you? It’s your smile. A friendly smile is...

Improve Your Body Confidence and Feel Great

No matter how good you feel about yourself, sometimes you just can’t help but see a few little flaws that seem gigantic to you and make you feel self-conscious. Whether...

First-Timer Tips For Your First Lip Filler Appointment

Getting injectable lip fillers can be a quick and effective way to plump up your smile with minimal drama. They’re a cost-effective and safe way to boost the natural shape...

The Most Common Skin Conditions and How to Deal with Them

We often underestimate the importance of our skin, but as the largest organ in our body, and our primary layer of defense, it is constantly affected by many environmental factors...

Beach Babe Basics: Everything You Need to Look Stylish at the Beach

Summer is right around the corner, and this year, we all should make the best of it. Right now, it is not just about looking stylish on the streets, it...

HEALTH

National Action Plan For Endometriosis Is A Game-Changer For Australian Women

Heba Shaheed, The Pelvic Expert, shares her personal story and expert tips for living with endo... First National Action Plan For Endometriosis Is A Game-Changer For Australian Women   The announcement of the first...

Pre - summer pampering: Australian women are detoxifying themselves in the most “kind-Ly” fashion!

In today’s society we are completely exposed to materials, products and chemicals which we unfortunately have no clue if it’s origins, meaning and purpose. Getting back to basics...

Eye Health Dos and Don'ts

Most people take their eyes for granted and spend little to no time thinking about their eye health until they notice something wrong. This leads to plenty of common and...

Non-invasive Cosmetic Treatments

In a world where everyone is chasing perfection, plastic surgeries have become more and more common to the point where it’s odd if you don’t get one during your life...

My Health Yoga

Carrie-Anne Fields of My Health Yoga has taken her Gold Coast yoga teacher training worldwide. She started her health business 20 years ago aged 22 and has grown into a...

Fit Body 101 - Increase Your Fitness Effectiveness

You have to find some space for physical exercise in your weekly schedule in order to live a good life. Embracing this way of life is very beneficial because it...

LIFE STYLE

Add a little colour to your move - and life!

How a little ‘colour’ and planning can take your Move, and make it a more enjoyable one Colour plays a huge role in our lives, it can take us up, or...

6 Simple Rules for Redesigning Your Kitchen

How do you feel about your kitchen? Well, if you feel like your home needs a bit of lifting up, one of the best and most effective places to start...

Dog Flea Allergy

Severe itchy skin disease in dogs causes Flea bite hypersensitivity. The itch is as a result of an allergic reaction to the saliva of the flea which is injected into...

5 Ways to Turn Your Bedroom into a True Zen Retreat

The bedroom should be our little sanctuary where we come to relax after a long day of work. However, in order to be able to unwind all the accumulated stress...

Things to Consider when Deciding on your Wedding Flowers for the Big Day

Choosing the wedding flowers is a complicated process where you have to take into account many elements, from the wedding dress to the wedding theme. You can discover in this...

Renovating tips for your house

There are very few property owners who move into a house where they don’t want to make any changes. Alterations are almost inevitable every time you move-house, but alterations can...

FOOD & DINING

Morning greens: the breakfast skincare regime

It’s safe to assume that most Aussies fail to eat enough greens. Although this was momentarily resolved with the rise and popularity of the green juice movement, the lack of...

Best Hidden Gem Hong Kong Restaurants

You finally find yourself enjoying the endless beauties of China and this fascinating city. In a place with so much variety, all your senses will be wide awake, and your...

JOHNNY DI FRANCESCO NAMED OFFICIAL AMBASSADOR OF EAT STREET MELBOURNE

Johnny Di Francesco, world champion pizzaiolo and owner of Melbourne’s Gradi Group of restaurants, is excited to announce he has been named official ambassador for Eat Street Melbourne 2018. As Ambassador...

The best Mother's Day gift EVER!

Whether it’s to celebrate a special occasion, or just wind down at the end of a long day, there’s nothing much better than pouring yourself a glass (or two…) of...

Sing for Your Supper at Chargrill Charlie’s

To celebrate the final curtain call of the Barden Bellas, Chargrill Charlie’s is giving you the chance to Sing for your Supper! Show off your best acapella vocals to win...

MAKE IT WINE TIME, ANY TIME

Whether it’s to celebrate a special occasion, or just wind down at the end of a long day, there’s nothing much better than pouring yourself a glass (or two…) of...