Will Democracy Survive Big Data and Artificial Intelligence? - Scientific American

every Chinese ... ”Citizen Score” will determine under what conditions they may get loans, jobs, or travel visa to other countries. ... individual monitoring would include people’s Internet surfing and the behavior of their social contacts... algorithms know pretty well what we do, what we think and how we feel—possibly even better than our friends and family or even ourselves....
using sophisticated manipulation technologies, these platforms will be able to steer us through entire courses of action... from programming computers to programming people... "big nudging", which is the combination of big data with nudging... whoever controls this technology can win elections—by nudging themselves to power...
a state that attempts to determine the happiness of its citizens is a despot. ... right of individual self-development can only be exercised by those who have ... informational self-determination... experiments with manipulative technologies, such as nudging, are performed with millions of people, without informing them, without transparency and without ethical constraints.... Ultimately, a centralized system of technocratic behavioral and social control using a super-intelligent information system would result in a new form of dictatorship... In the worst case, a centralized artificial intelligence would control what we know, what we think and how we act... we urge to adhere to the following fundamental principles... a kind of Hippocratic Oath for IT professionals...
completely new educational concepts are needed... focused on critical thinking, creativity, inventiveness and entrepreneurship... the framework needed to efficiently collate knowledge and ideas from lots of people in order to create collective intelligence is still missing