Augmenting Realities

Lit 80, Fall 2013

The Rise of Technology and Fall of Humanity


According to Moore’s law the computing power of technology doubles every two years. Considering this, we are quickly approaching the time when the computational ability will be equivalent to human intelligence. With this time approaching, some questions arise. Will this increased ability increase human dependence on technology? If so, will there be a point when our dependence is our downfall? According to works of science fiction, the answer is yes. If this is the case, then we must determine at what point this is predicted to occur. To determine this I looked at science fiction novels and movies and see how the societies of fictional worlds became too dependent and what steps led up humanity’s downfall. Then I considered today’s technology, and how compared it to what is described in science fiction. Finally, I researched what today’s experts on singularity and related schools of thought feel about improvements in technology and how they’ll effect humanity. Taking all of this information, I determine an estimate for when our dependence on technology will betray us. To complement the written work, I have created physical timelines to help visualize what has occurred in science fiction novels. Additionally, I designed a program that provides the reader with a hypothetical situation and then asks the reader to determine what will happen as a result.

Final Project Abstract

Bob Kane’s Batman comic series is incredibly expansive; however, a steady, well-known constant in the universe is the relationship between Batman and his main nemesis, the Joker. The two characters go far beyond a clash between”good” and “evil;” the most important story arcs in the Batman universe explain these two characters from more of a yin-yang perspective, in that one’s existence justifies the other.  Certain story arcs on this topic are better received than others, and I believe that it in most cases this is due to that particular arc’s adherence to the original Batman canon. While each may slightly differ plot-wise, the majority of Batman and Joker story arcs begins and ends in quite similar places: two unwavering characters, with rigid moral codes that appear to be ideologically opposite, end up justifying the existence of each other, with no real long term resolution (no triumph of good over evil, etc).

My project aims to look at the various visual representations of their relationship across several media and observe the similarities and differences between them. This transmedia study will include analyses of the film, video games, and graphic novels. The works that will be studied are The Dark Knight film by Christopher Nolan (2008), the graphic novels The Killing Joke by Alan Moore (1988) and The Man Who Laughs by Ed Brubaker and Doug Mahnke (2005), and the Warner Bros/Rocksteady video game Arkham Origins (2013). For a media element, I will attempt to analyze the major plot lines and story progression of each work by means of a visual map of the major stages of Freytag’s Pyramid, which will include examples from each of the works listed. By mapping out all these different story lines, I hope to emphasize the nature of the relationship between Batman and Joker, and note the importance of this aspect of the original narrative canon.


Humanity of AI [ABSTRACT]

Artificial intelligence is a field of computer science that has fascinated science fiction writers and researchers for decades. Alan Turing devised of a test in the 1950’s for a machine’s intelligence. Simply put, a machine passes the Turing test if a human is unable to distinguish it from another human. Over the past few decades, artificial intelligence has jumped from a theory to a developed art.

The aim of this paper is to analyze the history and development of artificial intelligence. Analysis will include implementations of AI in the real world and in fiction.

The media element will be a simple chat bot I’ll make using the above techniques. The element will demonstrate the technology behind making a Turing complete (maybe…) machine and the advantages/disadvantages of certain techniques.

Augmenting Scientific Literature: An Alternative View of Cancer Research

There is more to cancer research than just raw data. My project is a tumblr compilation of visual representations of scientific literature that depict what would be considered concrete data in an artistic manner—establishing a connection between the research processes, the results, the components of the disease, and the impact it has on people’s lives. Research is not one-dimensional; there is a beauty behind analyzing the building blocks of life—even when they’ve gone wrong—and that can be extracted through manipulation of the text, diagrams, and data of the official paper.

The goal of this project will be to investigate how augmenting the text of figures of scientific literature can alter the reader’s perception and interpretation of both the literature and the data. Interpreting the data in this manner sheds a different light on the subject and makes a connection between the concrete and abstract ideas associated with the disease and subsequently forms a bridge between the molecules, the scientists, and the patients. There will be multiple elements in my project that will collectively augment the scientific literature. The tumblr will have images generated by text analysis tools, manipulations of the data using visualization tools, mapping of certain processes, and other interactive elements that together establish a way of looking at science through an artistic lenses. The literature that I will be using will be a collection of scientific articles found online that all relate to cancer research.

Through the media elements, I will aim to compare and relate different concepts and features from the various articles, augmenting them in a way that will form connections and go beyond the factual data to demonstrate that there is more to scientific research than just charts, numbers, and molecules. Some examples of ways that this will be achieved are through text analysis, such as words clouds, that analyze major concepts in research based on the words used in the discussion of the findings and through manipulating discovered sequences of important molecular components to create an artistic image of what makes up a disease. I think it is important to look deeper into research literature and having a visual and artistic depiction of the components of a disease can expand the range of understanding that can be obtained from the work.

[ABSTRACT] Videogames: Purely Entertaining Or Perception Altering


The gaming market has been continuously spiking as computer and digital devices emerged around our lives from the 1980s till now. The exponential increase in video game companies has led to a boom in players as well. Video games, compared to its first emergence, seem to play a much bigger role in our lives now, and still little do we know about how such a potential medium could influence our thoughts.

This project aims to investigate the different genres of videos-games, such as action-adventure, role-playing (RPG), strategy games etc. and seeks to compare and contrast how these games, set in virtual (digital) worlds,  subconsciously alter our perceptions and decision-making process in the real (physical) world. The project will first attempt to boldly recontextualize the setting, plot and characters in various games to illustrate the societal impact if people acted exactly like video game characters. Subsequently, to comprehensively and specifically discuss the impact of games in our lives,  numerous attributes of games, such as linearity versus non-linearity, sandbox versus just narrative, will be scrutinized. Game samples that are representative of each attribute will also be taken into account. By making these concrete analysis, the project attempts to ask the reader: How do different game genres and game styles change our perspectives in our real world?

Last but not least, the project seeks to research how subconscious perceptions of the physical world is different for a person who is playing a game (controlling the protagonist and making the decisions) and for a bystander who is watching a game. To minimize error, the same part of a game (genre and attribute to be determined) will be presented to the player to play and remediated as a video for the “watcher” to watch.  This interesting comparison will give us a glimpse about how interactivity/interpassivity of video games encompasses potential societal implications.


Final Project Abstract: See more than texts

See more than texts

With the development of computational ability, more and more literature pieces are “born-digital” or have been digitized. To have a multidimensional  view of the literature, we have to develop tools to see something behind texts. In this project, I will cover the tools and projects about how to see more than texts when reading literature. Interesting topics like text visualization, data-mining will be covered. Tools and projects like Ngram Viewer, Wordle and Textarc will be introduced. And some experiments with those tools and projects will be presented. Finally, there will be some analysis about how these tools and projects change the way of literature research, how they change our attitudes toward literature and how they make us think about digital humanity. I hope that with this final project I can have a new view towards the literature in digital age.

Delving into a Seizure through Music

Seizures effect millions of people around the world and can be very harmful to normal bodily function and can in some cases even cause death. The aim of this project is to visualize the occurrence of seizures using Electroencephalograph (EEG) data. By visualizing this data through music, one can vividly see the effect a seizure has on a patients brain and how large of an impact it has on normal brain function. In order to do this, raw EEG data will be taken and converted into a WAV file, which can then be analyzed by music editing programs. There will then be two different elements to this media project. First, the raw WAV file will be analyzed by WIDI Pro, which will analyze the peaks and troughs of the WAV file and convert any peaks it recognizes into piano notes. Along with this visualization, I will also mirror an actual piano piece and match the tone, tempo, and volume to the EEG data. In order to do that, I will analyze the changes in distance between each peak on the WAV file and use that measure to change the tempo of the piano track. I will also measure the heights of the peaks and troughs of the WAV file and subsequently change the volume of the piano track. Therefore, the seizure data can be visualized with actual tonal music, and the listener can enjoyable see the effect of a seizure on the brain. I believe this visualization is important in showing listeners what actually occurs in the brain of someone suffering from seizures and the severity of the issue. This could also further be used to educate people who are at risk for developing seizures and elucidate how it effects their brains and body’s.

Electronic Literature Response: “Losing the Lottery” and “Living Will”

In her book Electronic Literature: New Horizons for the Literary, Katherine Hayles defines “electronic literature” as “work with an important literary aspect that takes advantage of the capabilities and contexts provided by the stand-alone or networked computer” (3). In the classic sense, literature refers to the written medium exclusively. Thus, “e-lit” has many distinct characteristics that validate its existence as a separate medium. It is afforded certain functions that augment the reading experience in a unique way; when comparing it to popular media such as film, video games, or print, e-lit bridges the gap between text and multimedia most effectively. In other words, the balance between writing and audiovisual content is the most even. In addition, e-lit is able to utilize a wider variety of tools that enable authors to create a very specific experience for their audience (more so than static illustrations alone). These artistic media elements can be merely supplementary or integral  components of the work, both of which can be seen in Eric Lemay’s “Losing the Lottery” and Mark Marino’s “Living Will.”

Lemay’s “Losing the Lottery” features a very interesting media element to supplement its writing. The work first brings you to a lottery mini-game: the screen shows rapidly moving random lottery balls with numbers, six of which the reader must choose to continue. The reader is then shown a two-column layout that displays a lottery simulator algorithm on the right side and a collection of 49 pages on the right side. Each of the 49 pages has a short paragraph, quote, or absurd statistic that has something related to the unlikelihood of winning the lottery, interspersed with personal anecdotes and thoughts from the author. The lottery simulator uses the six numbers chosen by the reader and cycles through randomly generated lottery sequences, with headers that show the number of times you have won, the degree to which your numbers match, and the time and money spent/earned playing the lottery.

elit lottery

“Losing the Lottery,” Eric Lemay

            This media element is supplemental to the text, but definitely enhances the simple message being portrayed. The combination of short excerpts and the miniscule winnings shown by the simulator shows the reader on a deeper level just how futile it is to play the lottery. The simulator serves as a personalized firsthand experience, and quietly runs alongside the text as you read. It allows the reader to glance over to the right and view his or her “progress,” while simultaneously taking in information about how difficult it is to win the lottery. Although the message in this piece is pretty simple, it is a very clear demonstration of how such a media element can simultaneously reinforce the ideas of a text effectively. This interactive simulator is a much more interesting method of visualizing an idea than merely showing data aggregates in a graph or table. While the simulation might not be essential, the work would be far less interesting without it.

Media elements can also play an integral role in the consumption of an e-lit work; Mark Marino’s “Living Will” is a great example. This piece functions as a highly interactive click-and-scroll story that allows the reader to choose what happens on a whim. As the reader scrolls through and reads the will, different parts of the text become clickable. Depending on what the reader selects, the document will alter itself instantly. The left hand side of the page has a box that explains who the reader is and what he or she is reading, and the right side of the screen features a simulator (just like Lemay’s piece) that runs simultaneously as the reader goes through the document, tallying up the inheritance (bequests, fees, taxes, etc.). In addition, the simulator features multiple points-of-view that let the reader see how much money the different characters of the work have earned as a result of the reader’s browsing through the document. This media element is very immersive and provides a rich storytelling experience. In a way, this feels like a role-playing video game (RPG), in that the decisions that the reader makes alters the course of the story. However, each of the various permutations of the path follows a parent storyline, implying that all arcs will eventually lead to the same conclusion.

living will

“Living Will,” Mark Marino

This type of e-lit piece shows the powerful applications the medium can have when it comes to fictional storytelling. It is hard to compare this to film or video because it is mostly comprised of words as opposed to moving images; however, it is a dynamic experience that could be more aptly described as a video game of sorts (maybe not the most entertaining or colorful, but certainly interactive).

One of the few flaws that e-lit pieces are unable to rectify currently is the issue of accessibility. While they can serve as very interesting and immersive methods of consuming literature, one must have a computational device (a smartphone, computer, tablet) to experience it, which restricts access to many different people. Also, depending on which device is used,  the full experience can vary. Personally, I would not enjoy navigating through “Living Will” on a small smartphone screen as opposed to a regular laptop screen. These are all considerations the author must put into account when producing a work. Furthermore, while this is not necessarily a limitation to the medium, it is difficult to reproduce such a work and present it in other media, as the author has purposefully designed the work with a specific representation in mind. Having a knowledge of coding flash/java/html scripts would be quite useful in attempting to do so.

While “Losing the Lottery” and “Living Will” are quite in depth, they do not showcase the entire range that the e-lit medium possesses. Some other e-lit works such as Robert Kendall’s “Candles for a Street Corner” or Campbell and Jhave’s “Zone” feature much more audiovisual content than text. In this way, they are more similar to other visual-heavy media such as graphic novels or film. There is an emphasis on what is seen in order to communicate certain emotions and feelings more effectively than text alone. However, one cannot exist without the other in e-lit pieces; without the writing to justify the media element, it is enormously difficult (and often unsatisfying) to navigate these elements without direction or apparent purpose. This is one of the reasons why the e-lit medium has such great potential as an effective means of telling a story or communicating information – the tools it has in its arsenal to relay a multidimensional experience far outnumber those which books can employ, which help the reader understand works on a significantly more personal and profound level.


Works Cited

Campbell, Andy, and Jhave. “Dreaming Methods : Zone.” Dreaming Methods : Zone. Dreaming Methods, 2013. Web. Nov.-Dec. 2013. <>.

Hayles, Katherine. Electronic Literature: New Horizons for the Literary. Notre Dame, IN: University of Notre Dame, 2008. Print.

Kendall, Robert, and Michele D’Auria Studio. “Candles for a Street Corner.” Candles for a Street Corner. Michele D’Auria Studio, July 2004. Web. Nov. 2013. <>.

Lemay, Eric. “DIAGRAM :: Eric LeMay.” DIAGRAM :: Eric LeMay. N.p., n.d. Web. 04 Dec. 2013. <>.

Marino, Mark. “Living Will.” Living Will., 2010. Web. Nov. 2013. <>.

Electronic literature critique: “Strings”

According to Katherine Hayles, an electronic literature piece is “a first-generation digital object created on a computer and (usually) meant to be read on a computer” [1]. Due to the dynamic presentation forms provided by computers, electronic literature is able to provide more dimensions of interaction with viewers. In class we explored several different projects that presented text and audio and responded to user interaction. Electronic literature pieces intend to augment the user’s experience in a way that is not possible by traditional print literature. As a result, there exists much potential for the form as an artistic and meaningful medium. This paper explores Dan Waber’s “Strings” project and analyzes its merits as an electronic literature piece [2].

“Strings” is composed of several individual demonstrations of a simple idea. A string is shown in a small window that morphs into words and shapes. For example, the string could curl up on one side of the screen to form a “yes.” While more than one string may be present, none ever break or join. They may change shape freely.

The "yes" side of the "argument" piece.

The “yes” side of the “argument” piece.

Waber’s first piece, titled “argument,” shows a single string stretching the window oscillating from left to right. When the string reaches the left, the string forms a “yes”. When it reaches the right, the word “no” is formed. Interestingly, I think that this piece would be just as understandable sans the title. It is apparent from the motion of the string that there is stress in the exchange – the “yes” is pulled to the right until the string is flat while a “no” is formed on the right hand side, and then the “no” is pulled flat as a “yes” appears in the left hand side. In my head, when I first saw the piece my mind automatically applied a voice to the two words as they were dragged across the screen. A “yes” and “no” would sound in my head at each oscillation. The animation was able to easily reproduce the dynamics of an argument in my head. In text or image, the same situation would be very difficult to convey so simply and quickly. This several second animation with two words was able to convey the situation, tone, and apply some character to the words.

Another piece – “youandme” – shows the word “you” slowly moving across the screen while the word “me” buzzes around. The animation seems to give a personality to the words. In my mind, I imagined an old man walking across a room while his grandson/daughter runs about in excitement. The “you” has a slow and deliberate character to it, while the “me” appears to be playful and energetic.  I felt like a story was being told with the words. I was able to construct characters with unique traits and even produce a plausible scenario behind the interaction. The idea  – an old man walking as his grandson zips about – even put a smile on my face. It was pretty cool to see such a simple animation produce so much in me and even evoke some emotion.

Waber’s final piece, titled “poidog” shows a string morphing into the sentence “words are like strings that I pull out of my mouth” [2]. This piece reveals a little of Waber’s thoughts about the project. It’s an interesting premise, as his entire project is based around string morphing into words. When I imagine speaking and just pulling a morphing string out of my mouth, my mind attributes physical properties to the string. Gravity pulls the string down, and when changes are made at the beginning of the string, the end morphs slightly. It makes me think about how sentences are very interconnected structures and how altering a single word can change the whole structure’s meaning and presence.

I believe “Strings” is an attempt to show that a very simple structure – a “string” – can be embodied with both meaning and emotion. On paper or canvas it’s incredibly difficult to produce a story with just a few words that can convey a situation as well as Waber’s animations. His use of timing and stress in the string provides character and allows viewers to connect and project onto the words. With each piece, I understood very quickly what he was trying to show and I enjoyed watching the animations. As for where the piece fits in to the electronic literature scene, I believe it definitely makes its mark. I wonder however whether it would be as effective at scale. The format seems most effective at its current size – showing a small scenario. I think though that the idea can be expanded to a larger animation with more complex story and deliver an equally interesting experience.

To show that Waber’s piece fits into the contemporary literature scene, consider the following questions proposed by Hayles.

“Is electronic literature really literature at all?” [1] I argue that it is. Literature can be defined as “Imaginative or creative writing, especially of recognized artistic value” [3]. What Waber produced is definitely creating writing. He transforms words using animations produced on a computer to reveal a story. I believe literature in the creative sense should tell some kind of story. Other electronic literature pieces fail in this regard. Take for example, “Sea and Spar Between” [4]. The piece shows stanzas of Dickinson’s poems and “Moby Dick” presented meaninglessly on the screen on an immense grid. I couldn’t pull any meaning from it or decipher any kind of story. Really it just seemed like a lot of text was thrown on the page to make a point I didn’t understand. “Strings” does not fail in this regard – it’s immediately obvious what can be drawn from the animations available.

“Is literary quality possible in digital media, or is electronic literature demonstrably inferior to the print canon?” [1] Literary quality is absolutely possible in digital media. In “Strings,” Waber is able to tell a small story with the use of only a few words. I believe it would take a few sentences at least to produce the same level of story as the piece “argument” for example. The electronic aspect of the piece was able to convey meaning that would be hard to bring across in text so easily. Well made electronic literature can certainly show where the print form can benefit from the flexibility provided by code.

For the above reasons, I believe “Strings” is an excellent example of electronic literature. Waber was able to use computer animations to bring a string to life in engaging and interesting scenarios. Neither the animation nor the words are overbearing, and the piece is able to effectively communicate what it’s trying to accomplish. I hope in the future that Waber expands his concept with different, longer scenarios. Perhaps he would be able to allow users to animate words or their choice on a string and allow any chosen word to morph into another. Overall there is certainly merit to the piece, and I can imagine a lot of ways it could expand in the future.







E-Lit Critique: The Knotted Line

ELit-Zhan 01

Electronic Literature

The end of the 20th century saw a huge advancement of digital technologies. Hand-written letters, hand-held books, etc., though not totally eliminated from use, were slowly becoming obsolete. The digital and virtual era was approaching as mankind strove in technological evolvements such as computers, cell phones, and the construction of a widely shared virtual network: the World Wide Web. With this tremendous impetus in the time of seemingly incessant new inventions and breakthroughs, the academic disciplines had to majorly adjust, redefine and even reform many of their expressive ways and methods. The digital humanities were created, which relied on computational technology to virtually “copy” the many words written on books to operation system file formats such as doc., pdf., html, and the list goes on, while simultaneously adding elements that were never possible before: videos, augmented pictures and plots etc. As the 21st century beckoned, people become increasingly inventive and constructed a new form of expressionistic art form: electronic literature, or E-Lit. E-Lit was only able to be construed because the transformation of the millennium generated even more “high-tech” computational technology. Software as well as hardware became more and more sophisticated and more intricate software programming software gave rise to complex games, rendering utilities and so on, which E-Lit readily utilized as one of its manifold forms of expressions.

One element that sets E-Lit apart from the digital humanities and other written pieces is that E-Lit itself does not necessarily need verbal expressions. In layman’s terms, E-Lit might have no words in it, but still be a piece of literature. This is a very important aspect to realize before analyzing any electronic literature pieces. Admittedly, most people would think about a written book or anything in alphabetic words or characters when asked to define literature. Our propensity to connect the word literature with written elements actually constraints us from constituting a more comprehensive picture of this sort of art. N. Katherine Hayles, in her book Electronic Literature: What Is It?, specified E-Lit as “digitally born…[and] digital object created on a computer and (usually) meant to be read on a computer”. (Hayles 3) She also indicated that electronic literature pieces might have “no recognizable words, [but might have] important visual components [and] sonic effects…”. (Hayles 4) In class we have extensively discussed the basic elements and inner meanings that are representative of typical E-Literature pieces. Additionally, we have scrutinized many examples of E-Lit pieces on the internet such as MUPS (digital augmentation system), SKIN, City Stories, and the Xenotext Experiment, which “takes programming language and practices into account” (Hayles 28).

The Xenotext Experiment aims to use computational software to code/decode written words into DNA sequences.

The Xenotext Experiment aims to use computational software to code/decode written words into DNA sequences.

One E-Lit piece that I appreciate most was The Knotted Line, which utilizes actual miniature painting created in the 17th-19th century along with a digital timeline to explore the historical relationships between freedom and confinement and the question about how freedom is measured. The general E-Lit was extremely well-constructed. If the program launches successfully, the user will be brought to an all-black colored timeline which shows the “beginning” of American history, or the many confirmed accounts for that matter. The user can then use the mini-map of the timeline, a unique “navigation scheme” (Hayles 7), at the top right corner of the browser to get to the desired time period. The user interface was fraught with game elements. In order to know more about the happenings of a specific famous historical moment, one must move the mouse several times on the black lines of the timeline to virtually “cut open” the timeline, which will subsequently reveal the miniature paintings as well as a very short (usually 10~30) word description of the specific historical time period in America.

Navigation Mini-Map of the Knotted Line.

Navigation Mini-Map of the Knotted Line.

Black Lines

Black Lines

Miniature paintings and description one line is "cut open" with the mouse.

Miniature painting and description once line is “cut open” with the mouse.

In light of Hayles’s interpretation of E-Lit pieces, The Knotted Line fits perfectly into the definition of electronic literature. That is, the piece comprises of as little words as possible, while making up the lack of written elements through stunning visual displays, interesting and explorable game elements, and backdrop sounds to create the ambiance needed to truly appreciate this great workpiece. Through its impressive visual and sound interface, we can clearly see that The Knotted Line uses them dexterously in setting the mood and tone for the things it wants to show. The whole piece, in terms of literary elements, also incorporates numerous themes such as American Slavery history and the fear and isolation of the American society from foreigners and the differently-cultured in the 19th and 20th century (i.e. 1882 Chinese Exclusion Act/ internment camps for Japanese Americans during WWII). Though not extensively clear, the Knotted Line also implies its question of freedom/confinement by telling a historical narrative of the subject matter.

In many aspects, The Knotted Line can be considered as a piece of interactive fiction, though most of its accounts are historically accurate. Hayles claims that “interactive fiction  (IF) differs from [other] works…in having stronger game elements….The demarcation between computer games and electronic literature is far from clear…, many works of electronic literature have game elements.” (Hayles 8) The form of expression, that is, using a timeline to document a narrative of freedom and confinement of American history, plus adding game facets such as mouse dragging to it, makes the piece a work of E-Lit that can immensely augment the American history reading experience by giving a graphical and tonal view of slavery and isolationism, thus helping the reader to understand history more thoroughly.

Little game near the end of the timeline. Year 2009.

Little game near the end of the timeline. Year 2009.

In conclusion, the Knotted Line utilizes various visual and sonic elements, which are highly representative of typical electronic literature pieces, to create a website that is both entertaining, composing of many small yet delightful game elements, and educational, researching and scrutinizing the relations between freedom and confinement while asking questions to make the “reader” think deeper into the subject. As Hayles would have it: Electronic literature “make much fuller use of the multimodal capabilities of the Web”. (Hayles 6)



[1] Hayles Katherine N., Electronic Literature: What Is It? Accessed Nov. 3, 2013.

[2] The Knotted Line, Electronic Literature piece, Accessed Nov. 3, 2013.

Page 4 of 14

Powered by WordPress & Theme by Anders Norén