MA final project research
0 The Research Book

Many thanks go to Alekz Keck for the programming, Phillipp and Florian Koller for the soundtrack and moreover to Anne Katharina Schäfer, Peter Werner, Melanie Seyer, Hannes Mandel, Andreas Schepers at ESA, the mates at Digital Media, the DAAD, the German Academic Exchange Service and to my tutors Sadhna Jain and Rob Rae. The whole work is licensed under Creative Commons (BY, NC, SA).
1 Research
1.1 This life is not a movie, or maybe

In conclusion of my research, moving images break down into four categories: fiction, faction, simulation and operational images. The term Operational Images relates to the German filmmaker Harun Farocki who himself references to Jean-Luc Goddard. Operational Images are images without any mythologic charge. Farocki correlated the term with the quest of French philosopher Roland Barthes for something similar in language. Figurative examples of operative images are the guidance cameras on the tip of autonomous bombs capturing highly engineered images whose only purpose is technological. Men are inspecting these images merely to check the mode of operation of its parent machine. In this manner these images hold an intense functional aesthetic.
Screen Realities is a very blurry term by intention. The hypothesis is that the boundaries between the categories of moving images mentioned above are tumbling down and the different realities are increasingly merging. The main cause is the Internet. Its anarchic hierarchies and the overall democratic structure also means an equality of the different images. These forms of image taking are emancipating from their primary purpose into a universal language where all the various forms become part of our common memory.
The place where all those Screen Realities are collected is the control room – the modern editing room. These rooms are everywhere nowadays. They are like massive routers. I examined one of those huge control facilities on a trip to the ESA (European Space Agency) and their ESOC (European Space Operations Centre). On-site I was briefed about the functionality of the main and the other, smaller, control rooms that monitor the several satellites in space. Consequential the form of my final project will be an abstract recreation of a control room. The aesthetic will make use of collage techniques as a reference to pop art which always took parts of reality and reassembled them to emphasize and criticize. The work itself will examine the importance of the crash for shifts in the mass media, referencing Paul Virillio (“There is no technical invention without accidents. Each time a technology is invented, a technology of transport, of transmission, or of information, a specific accident is born.”) and Guy Debord (“In the spectacle, one part of the world represents itself to the world and is superior to it.“).
The crash is both, the witness of technological and social progress, and the culmination of the spectacle and as such the evolutionary moment, the mutation, of mass media. The same mass media that tend to over-aestheticise the crash by converging the four Screen Realities.

Constructivism, Post-Modernism and later Pop Art became quite important recyclers of reality. Artists of these movements took parts of the reality and magnified, removed and reconstructed them. They sampled reality and duplicated the banality of everyday life in order to recontextualize its meaning. Roland Barthes wrote in his essay »The Death of the Author« in the spirit of Post-Moderism that originality is created through the rearrangement of banal, already known elements. Several years earlier the artist Max Ernst stated about the collage, the predominant technique of the later era of Post-Modernism and Pop Art especially, that it is the systematic exploitation of the accidentally or artificially provoked encounter of two or more foreign realities on a seemingly incongruous level.

The difference between the Screen Realities and other more comprehensive reality models such as the conceptions of realities by system theorist Niklas Luhmann is that Screen Realities are limited through technical restrictions. Lenses, image sensors, bandwith, screen resolutions – Screen Realities are a priori a restricted and limited reality. On top of these technical limitations there is the selectivity and contingency of the human operator. He‘s choosing the perspective, white balance, colour mode, depth of field, focus and in the end the edit and or the cut. (Some might call managing these settings art already.)
With the increasing amount of moving image data in these modern days, with CCTV cameras (a perverted variation of Operational Images) all over the cities e.g., the human influence on the moving image decreases. Into the shoes of the human operator steps a modern technical facility. Not only a device, but an arrangement, an architecture of devices: The control room. It‘s a necessity to manage the flood of moving images that‘s growing proportionally. 24/7 streaming replaces tapes and harddrives. And the control room replaces the editing room. Control rooms are being erected almost everywhere. The New York Stock Exchange (NYSE) for example is nothing else than a vast control room. The only purpose of the control room is the impossible: The control of reality. A wish that comes from the fear of losing public order and power at last.
In order to research modern digital control rooms I went on a field trip to the European Space Agency (ESA) in Darmstadt, Germany. Their European Space Operations Centre (ESOC) has one of the largest control rooms of Europe if not the world. My interest was not only in the process of controlling but also in the screens and the related technologies. A key questions involved the several ways users are interacting with multiple screens and what architectural and design concepts are appropriate to visualize vast amounts of abstract data.
The trip to the European Space Agency was somewhat disenchanting. I learned that they hardly ever work with moving images, but with software generated representations of reality only. The enormous ammount of columns of figures and numbers representiong positions and speed was impressing but disappointing for my research. (Consequently you could think about extending the Screen Realities with another reality: The Software Reality, which would be close to the Operational Images and simulation.) On my desperate quest for moving images one of the technicians told me the story of the new docking system on board of the new ATV module, a space transport vehicle. It docks completely automatically with laser technology. No video technology was meant to be used until the Russians intervened and insisted on an extra camera plus crosslines on the ISS. They simply wanted to see the whole docking process. Nobody at ESA had thought of that before.
Also my timing was rather bad. The day before I arrived in Darmstadt they had an unscheduled start mission control test. The day after I left two space vehicles, an Iridium-US-satellite and an abandoned russian vessel crashed some thousand miles above the Pacific – teaching me quite tangibly the contingency and incalculability of crashes. (More pictures on Flickr.)
Caution is especially advised for the terminology. Way too often terms are being caved, manipulated and misused. A recent example is the terror term that is being hyped throughout worldwide media and whose alarming association is being misused politically to avoid discussions and replace arguments. It crops up that terms and their exact usage is necessary for a certain credibility. A credibility that also includes the phenomenon (or project) it is naming. Crash is a versatile term. It is not only being used in context with the unintentional cold deformation of different materials such as metal or conrete, it also finds its use in failing software programming, natural events such as an impact of an asteroid, and last but not least the holistic failure of the financial sector. This ambiguous ability is to a high extent suiting for a project that‘s reproducing or simulating a certain reality with the objective to emphasize and reveal a higher truth.



The 1980s are generally seen as the decade of the rise of stock exchange and the financial wealth of its actors. Until today the image of a stock trader and successfull banker is shaped by fictional motion pictures of that time. »Wall Street« of director Oliver Stone, released one year after the London Big Bang, with Charlie Sheen as Bud Fox, a young Wall Street stockbroker in early 1980‘s New York with a strong desire to get to the top, being the most iconographic of all of them.
This decade startet a mimetic phenomenon of absurd wealth, of English shoes, Italian suits, private jets (as ironically described in Tom Wolfe‘s short story for the new Evening Standart called »The rich have feelings too…«) and German cars. The car by the way becomes a ambiguous metaphor for the crash these days. The obvious is it‘s accident and secondly with being dumped in all the oversea harbours all around the world the car became a symbol for the financial crash that is turning into a economic crisis. The automotive industry and the aerospace industry are both of this old, 1980s styled, capitalism (and in many cases both are producing their goods for both the military and the civil sector).
If the stock exchange as mentioned before is nothing but a control room and the desk of an individual banker or trader nothing else but a smaller modell of this huge architecture the question remains how they still can claim that no one saw the crash coming. It seems that there must be a certain disfunction between the way their control rooms display reality.






The »Kill All Hippies« music video for the schottish electro noise band Primal Scream by Intro is almost 10 years old by now and it‘s still ingenious regarding the usage of found footage but also the prudential combination of 3D-space and graphical elements. It‘s a great example of leaving things out.
»Anomaly« by Noah Harris of Precursor speaks graphically a similar language as the Primal Scream video. It extends this language with an elaborate and convincing information design. The extruded video footage is an interesting attempt with the deconstruction of video material. Despite their age both videos, »Kill All Hippies« and »Anomaly«, don‘t seem old, but rather timeless, which evidences their quality.
What impresses me the most about the opening sequence for the motion picture »The Kingdom« is the skilful combination of historic recordings and 2D-3D information design. Thereby Stephan Burle, the designer, uses accurately the free space (here a metaphor for the desert) in his composition to emphasize single elements such as the drill rigs. It’s a strong piece of work where charts turn into political messages.
The original purpose of Daniel Rothaug‘s pictures is, as the name »Digital Acoustic Cartography« indicates, of acoustic nature. Beyond that he uses the software Processing not only for informational processing but also for a remarkable way of deconstructing the (video) image.
»Iron Man«‘s end sequence by Prologue Films hasn‘t much to do with the prior examples, but for me it‘s one of the most compelling motion design pieces of the last two years. In the beginning it is graphically reduced to completely monochromatic outlines. These lines are a homage to comics and computerized blueprints at the same time. And additionally Prologue added advanced information graphics towards the end, similar to those in the movie, also produced by the very same company.
2 Work Process
2.1 Early Tests




The second test was about the border area between the different Screen Realities. We know that the mass media tend to over-aestheticise even documentary images. With it they blur the edges between faction and fiction. This experiment was meant as a critical comment on this practice. I used documentary footage to modify little things in the picture, manipulating the message of the images. The modifications were supposed to be so slightly that the viewer doesn‘t recognise them in the first place but still feels somewhat uncomfortable and irritated watching it. To achieve such effekt, I enlarged the eyes of refugees by the amount of 50 percent for example.
For the third experiment I was concentrating on narrative structures. I set up a small media history of the crash, wish means I concentrated on the correlation between the disaster and the news coverage about it. The theory behind that was that the crash was something like the evolutionary trigger for the emerging of new media and formats. The example for my tentative short film was the ditching of a Boeing into the Hudson River in February 2009. Only three minutes after the crash the first picture was spread all over the world by a user of the micro-blogging service Twitter.
After that I dealt with the possibility of transfer data directly onto video footage. Therefore I took stock exchange data, normalized it with a mathematical formula that is also used for data processing with the Processing software, translated it into a graphical system and used that system as displacement map for the video footage.

Having developed the terminology graphs I couldn‘t stop thinking of the ambiguity of the mechanical and the financial crash. With the increasing feeling of powerlessness (see also the interview in the appendix) towards the ongoing process of bailing out multi-billion-dollar companies along with the credit borrowers and home owners being somewhat blamed for the whole crisis. I decided to focus the content of my work on the financial crash. The one that was caused by a pervert system of a greedy minority and that‘s going to have economic impact on almost every family all around the globe.
Considering all this I developed the final concept of the stock trader‘s desk. A spatial installation that is an interactive and a motion graphic piece at the same time. The construction is to look like this: On a desk, that somehow is also a kind of control console, are two monitors and a operating element (a keyboard) installed. All together sculptures a working place of a stock trader. Thus the left screen displays a simulation of a trading software. With the keyboard the user/viewer checks 18 pre-selected stock quotes of some of the most wealthy worldwide operating companies. The right screen then shows elements of the real world. These elements, houses, cars, trains and planes for example are dynamically linked to the stock quotes on the left screen. If the quotes decrease the video track of the particular element plays forward towards its crash. Corresponding precisely with the stock quotes of the last 12 months, the video elements crash.
2.3 Visual Representation of the Stock Exchange Data
To this purpose I collected the stock quotes of one year, from early March 2008 to early March 2009 (52 weeks in total) and processed them into XML-files that can be read by the software. In the beginning I had analysed 20 different stock quotes of some of the worldwide wealthiest companies. Due to performance reasons I had to reduce them to 18 however. Pretty soon the design and the arrangement of 18 quotes at the same time became a problem. Similar real applications usually present no more than three quotes at the same time. I started experimenting with different designs, used line and area, monochromatic and coloured charts. Besides I worked with different transparencies and blending modes, sorted the quotes regarding their values in different groups and aranged them again. It seemed to be impossible to create a well ordered overview. Then I switched back from experimenting with area charts to line charts, whose amplitude looks like a seismograph, and I realised that I was on the wrong quest. I realised I had to look not for order, but for chaos. Uncontrollability – would be a better fit. That‘s why I chose monochromatic line charts eventually.








2.4 Graphic User Interface (GUI)
In the beginning I wanted the software to look like its real examples, as a Windows98 application. After finishing several versions I realized that it would be more helpful to actually develop an interface that reminds the user of software he used before but still makes him feel to use something he couldn‘t use every day. The new look was meant to be more coolish and technical.











