Site icon Sophos News

That Black Mirror episode with the social ratings? It’s happening IRL

What do you get when you cross the worst aspects of social media, people’s actual lives and giant, centralized databases?
The outcomes are already playing out. Certain cities in China have been piloting the country’s social credit score system – a system that’s due to be fully up and running by 2020, according to a plan posted on the Beijing municipal government’s website on Monday (the plan is dated 18 July).
One of the many repercussions of such a system is that people get blacklisted for not paying off their debts when a court thinks they’re capable of doing so, regardless of what the debtor says.
The ID photos, names and numbers of blacklisted people are displayed on billboards throughout the city, and they’re then barred from booking flights or high-speed trains (considered “luxury” travel) and blocked from staying in hotels. By the end of May, people with bad credit in China had been blocked from booking more than 11 million flights and 4 million high-speed train trips, according to the National Development and Reform Commission.

A permanent stigma?

The Indicator podcast on National Public Radio’s Planet Money has been covering China’s unfolding social credit system for the past few months. Last month, the podcast covered the story of Lao Duan, a 42-year-old coal broker, who told NPR that people’s attitude toward the blacklisted is one of suspicion. He can’t relax when socializing with anybody who isn’t also on the blacklist – which is the case with many of his former coal-dealing colleagues:

(Through a translator) The widespread attitude towards us is very resistant. People were saying, why are you cured being happy? Why do you still have time to be happy? Why do you not go out and make money to pay back your loan?

Unfortunately, as NPR reports, the stigma appears to be permanent. While in countries like the US, we can declare bankruptcy and then hopefully rebuild our credit, in China, the label of socially/financially unacceptable appears to be irreversible. Though it’s technically possible to get off the blacklist, it seems that nobody ever does.
A financial scarlet letter is only one aspect of China’s increasingly pervasive social credit system, which, according to Bloomberg, is designed to make it impossible for the “untrustworthy” to “move even a single step.”

Rewards and penalties

The pilot city of Rongcheng foreshadows how comprehensively China plans to judge each of its 1.3 billion people with its lifelong points program, which assigns each resident their own, personalized rating. The system is similar to the credit score system of the US, but it will also include ratings for behavior, including whether you squabble with your neighbors, clean up after your dog, or obey the traffic laws.
Xu Ranjan, a 32-year-old IT engineer, told NPR that it’s gotten a lot more peaceful in Rongcheng since it implemented the multifaceted penalties. It used to be that pedestrians risked their lives crossing the street. Now? The cars wait for you. If they don’t, their drivers will lose points. And that can be bad.
There’s a letter/grade system behind the points. Everybody starts at 1,000, though you can earn more by, say, giving to charity or donating blood. If you score between 960 to 1,000 or more points, you’re an “A.” Between 850 to 959 points, you’re a “B.” You’re a “C” if you’re between 849 and 600. That’s considered a “warning” level. Below that, you’re a “D,” and you’re labelled untrustworthy.
Driving while intoxicated? Automatic downgrade to a B. You’re also docked 50 points for spreading rumors online.
A high score gets you discounts at local businesses, a lower heating bill, free cable channels (such as a kung fu channel and a soap opera channel), and special invitations to community events.
A low score not only costs you those goodies; it also means you might not be able to get a promotion at work, regardless of your great performance and productivity.
NPR reports that the government is keeping track of all of this with the help of designated “watchers.”

These are people who keep track of goings-on in their neighborhoods. And they keep track of neighbors’ behavior and update people’s scores.

‘Nosedive’

If you haven’t already watched the “Nosedive” episode of the TV show Black Mirror,” perhaps you should, because it’s no longer fiction, at least in China. Somebody in the nation’s government must have interpreted it as a blueprint.
The system has some benefits. Xu Ranjan, who has a score of 1,000 and is living in Rongcheng’s pilot system now, says that it doesn’t feel creepy. He likes it. People are behaving, and they’re putting the needs of the community above their own selfishness, Ranjan said: a positive step in the evolution of society and people living together:

I feel people have become more friendly. I think in the history of human being developing towards, like, communities, if everybody can follow the rule, I’m sure it’s very good for, you know, every individual living in the city.

According to Beijing’s published plan, the capital city is on track to pool data from multiple databases and, by the end of 2020, will be rating some 22 million citizens based on their actions and reputations. To do so, they’ll rely on a range of services, with data flowing from agencies that deal with tourism, business regulators and transit authorities.
They’ve already got much of this already in place: just a few examples include an enthusiastic embrace of facial recognition, such as when Chinese police got facial recognition glasses to find suspects in the massive human migration that is China’s annual Lunar New Year. Chinese authorities love facial recognition technology so much that they use it in at least one public park to thwart toilet paper thieves.
As Bloomberg points out, the move to online banking has also made tracking individuals via financial data easier:

Apps such as Tencent’s WeChat and Ant Financial’s Alipay [have become] a central node for making payments, getting loans and organizing transport. Accounts are generally linked to mobile phone numbers, which in turn require government IDs.

With pieces of such a vast system of surveillance already in place, it’s hard to imagine anybody can escape, and that means that the state can punish anybody it wants, with ease.
Political dissidents? Ethnic minorities? Jaywalkers? Toilet paper hoarders?
Check, check and check: vast databases, linked together, enable states to find them, name them, shame them, fine them, or to persecute them. That’s why it’s called Big Data: the oceans of data being linked together are wide and all-inclusive. The repercussions can be deep.

Exit mobile version