Survivorship Bias: Don’t ignore the losers

Vincent Frisina Profile Image

VINCENT FRISINA

Director, Customer Marketing & Programs

I bet you don’t know just how helpful failures can be. It’s pretty typical for humans to learn about the world through failures. Touching a hot stove, falling out of an unsafe tree, or walking through a burr-patch with bare feet all present clear opportunities to learn from failure in a painful way. The human brain is programmed to learn from the pain, and avoid the situations in the future. But what about times when the pain is less pronounced? Are there groups of failures we should be revisiting, but aren’t?

We’re exploring the Psychology of Telecom Expense Management with a look at Survivorship Bias. Our brains are pre-programmed with these biases whether we like them or not. Through understanding, however, we can avoid certain categories of mistakes and potentially deliver better products and services to our users, while also benefiting our bottom line.

Survivorship Bias depends on our tendency to use evidence of success as the primary measure for planning for future successes. You may recognize it as a kind of sample bias, or how some data points get ignored because they don’t prove the theory. Laszlo Bock, head of People Operations at Google, discusses how survivorship bias impacted Google’s hiring practices on an episode of You Are Not So Smart. After years of tricky hiring practices and insane interview questions, the human resources teams at Google decided to use some statistical analysis to see just what a great job they’d done.

“When failure becomes invisible, the difference between failure and success may also become invisible.”

Here’s the problem. Although the interview process predicted the candidate’s failure, Google never hired the person to find out if they actually failed. All measures of success were based on performance of employees who made it through the interview process successfully. Google went back and hired some of the washed out candidates. The interview washouts performed as well as the successful interviewees. Google discovered that while its hiring process was newsworthy, it did not actually predict success and that by eliminating failure data from its sample set, it made the difference between failure and success harder to see.

One place “survivorship bias” rears its ugly head in our world is in zero usage device management. Unused and active device counts certainly drive unnecessary business expenses each month. Telecom Expense Management (TEM) and Wireless Expense Management (WEM) firms focus on keeping this key performance indicator (KPI) down. We consider the zero total usage metric our success pool; if the number is very low, we have a high success rate in keeping zero total usage devices down. What about the lines with only 10 minutes of usage in a billing period? How about those with just a few kilobytes of data usage? These lines have survived the culling of unused lines, but the logic used to select the sample is biased.

With Visage Mobile’s MobilityCentral product (shameless plug), you don’t have to choose between analyzing your successes or the failures — MobilityCentral will do both for you! Zero usage metrics on the Spend dashboard deliver instant access to candidates for disconnection, and canned reports easily surface lines with minimal usage in various categories. MobilityCentral also keeps track of contract and termination fee information for every line, so you can see if it’s cost-effective to cancel any active line of service.

It’s always important to review the criteria used to determine your successes. When you know what your failures can tell you, you can better see success!

Increase Savings Realization by Sending Email

Visage Mobile has a lot of data about what works, and what doesn’t, when managing wireless programs. One thing that data shows us, over and over again, is the powerful impact email communication has on end-user behavior as it pertains to wireless spending and usage.

How confirmation bias alters wireless analysis

Chances are, you’re doing a pretty good job of keeping wireless costs optimized for your customers.  That’s why they continue to pay you.  That’s good, very good, but our business environment demands that successful vendors provide consistently increasing returns to their customers, or they will be replaced by competitors or alternative approaches. An important aspect of this process, which you may not have considered, is how basic human cognitive biases might be affecting how you conduct your business.

International Savings

International roaming expense come in a variety of flavors. Similarly, international savings opportunities abound when you know what to look for.

3 of the Most Overlooked Audits

This week, Lisa helps us with overlooked wireless audits based on real data she sees every month in MobilityCentral.

MobilityCentral Release 5.7

MobilityCentral Release 5.7 is here. Take a look at the newest features!

Why Mobility Managers Should Care About “Orange is the New Black”

What’s the number one reason why you should care about the new season of “Orange is the New Black?” Because your USERS care.

Why Wireless Expense Management Outsourcing May Work For You

We’ll look at a few terms and concepts surrounding Visage-based service providers to help put your mind at ease with the idea of outsourcing a small part of your wireless expense management workload, or an entire branch.

Employee data management using the user import template

MobilityCentral is most frequently used for generating cost center reports (also known as ‘charge-back reports.’) These reports rely on tying employee wireless expense data to other systems such as HR and accounting.

Are your users giving away corporate data?

In her article “Report: Holiday Upgrades Ripe for BYOD Privacy Risks,” Diana Goovaerts at WirelessWeek.com runs down a research study by Blanco Technology Group (BTG).

Did you budget for…?

Studies have shown that managing to a budget keeps costs down. But we all know that even with the best budget, the unexpected happens.