Posted by Thomas Scarborough |
The real danger is an explosion - of Big Data |
We
lived once with the dream of a better world: more comfortable, more secure, and more advanced. Political commentator Dinesh D’Souza called it ‘the notion that things are getting better, and will continue to get better in the future’. We call it progress. Yet while our world has in many ways advanced and improved, we seem unsure today whether the payoff matches the investment. In fact, we all feel sure that something has gone peculiarly wrong—but what? Why has the climate turned on us? Why is the world still unsafe? Why do we still suffer vast injustices and inequalities? Why do we still struggle, if not materially, then with our sense of well-being and quality of life? Is there anything in our travails which is common to all, and lies at the root of them all?
It will be helpful to consider what it is that has brought us progress—which in itself may lead us to the problem. There have been various proposals: that progress is of the inexorable kind; that it is illusory and rooted in the hubristic belief that earlier civilisations were always backward; or it is seen as a result of our escape from blind authority and appeal to tradition. Yet above all, progress is associated with the liberating power of
knowledge, which now expands at an exhilarating pace on all fronts. ‘The idea of progress,’ wrote the philosopher Charles Frankel, ‘is peculiarly a response to ... organized scientific inquiry’.
Further, science, within our own generation, has quietly entered a major new phase, which began around the start of the 21st Century. We now have
big data, which is extremely large data sets which may be analysed computationally.
Now when we
graph the explosion of big data, we interestingly find that this (roughly) coincides on two axes with various global trends—among them increased greenhouse gas emissions, sea level rise, economic growth, resource use, air travel—even increased substance abuse, and increased terrorism. There is something, too, which seems more felt than it is demonstrable. A great many people sense that modern society
burdens us—more so than it did in former times.
Why should an explosion of big data roughly coincide—even correlate—with an explosion of global travails?
On the one hand, big data has proved beyond doubt that it has many benefits. Through the analysis of extremely large data sets, we have found new correlations to spot business trends, prevent diseases, and combat crime—among other things. At the same time, big data presents us with a raft of
problems: privacy concerns, interoperability challenges, the problem of imperfect algorithms, and the law of diminishing returns. A major difficulty lies in the
interpretation of big data. Researchers Danah Boyd and Kate Crawford observe, ‘Working with Big Data is still subjective, and what it quantifies does not necessarily have a closer claim on objective truth.’ Not least, big data depends on social sorting and segmentation—mostly invisible—which may have various unfair effects.
Yet apart from the familiar problems, we find a bigger one. The goal of big data, to put it very simply, is to make things
fit. Production must fit consumption; foodstuffs must fit our dietary requirements and tastes; goods and services must fit our wants and inclinations; and so on. As the demands for a better fit increase, so the demand for greater detail increases. Advertisements are now tailored to our smallest, most fleeting interests, popping up at every turn. The print on our foodstuffs has multiplied, even to become unreadable. Farming now includes the elaborate testing and evaluation of seeds, pesticides, nutrients, and so much more. There is no end to this tendency towards a better fit.
The more big data we have, the more we can tailor any number of things to our need: insurances, medicines, regulations, news feeds, transport, and so on. However, there is a problem. As we increase the detail, so we require great energy to do it. There are increased demands on our faculties, and on our world—not merely on us as individuals, but on all that surrounds us. To find a can of baked beans on a shop shelf is one thing. To have a can of French navy beans delivered to my door in quick time is quite another. This is crucial. The goal of a better fit involves enormous activity, and stresses our society and environment. Media academic Lloyd Spencer writes, ‘Reason itself appears insane as the world acquires systematic totality.’ Big data is a form of totalitarianism, in that it requires complete obedience to the need for a better fit.
Therefore the crisis of our world is not
primarily that of production or consumption, of emissions, pollution, or even, in the final analysis, over-population. It goes deeper than this. It is a problem of
knowledge—which now includes big data. This in turn rests on another, fundamental problem of science: it progresses by screening things out. Science must minimise unwanted influences on independent variables to succeed—and the biggest of these variables is the world itself.
Typically, we view the problems of big data from the inside, as it were—the familiar issues of privacy, the limits of big data, its interpretation, and so on. Yet all these represent an
enclosed view. When we consider big data in the context of the open system which is the world, its danger becomes clear. We have screened out its effects on the world—on a grand scale. Through big data, we have over-stressed the system which is planet Earth. The crisis which besets us is not what we think. It is big data.