Showing posts with label ai. Show all posts

Sunday, 11 December 2016

Can A.I. write a Hollywood film?

Can A.I. write a Hollywood film?

A.I. filmmaking poses some fundamental questions about when and how a machine could develop independent and... 

 

Over recent years, we've seen artificial intelligence systems designed to write software, compose music, paint works of art, and even pen news articles, but the machines have been notably quiet in the medium of fiction storytelling. Designing an A.I. system that can write the screenplay for a movie, or compose a great novel, has posed a big challenge for researchers. So just how close are we to having machines pen our blockbuster films?

Opening credits

In June, a bizarre short film entitled Sunspring premiered. The film starred Thomas Middleditch (Silicon Valley) and chronicled the cryptic love triangle between three people inhabiting a strange futuristic office. Filled with incoherent non-sequiturs and inexplicably surreal tangents, the film could be considered either a compelling dream-like fugue or an amateurish mess.
In actuality, this odd film is something much more interesting. Sunspring is the first completely A.I. penned short film, developed in a collaboration between filmmaker Oscar Sharp and A.I. researcher Ross Goodwin. Appropriating a general text-recognition A.I. algorithm, Goodwin fed his system scores of science fiction screenplays from the 1980s and 1990s. Using films like Ghostbusters, Bladerunner and every episode of TV's The X-Files as its inspiration, the machine learned how to communicate in screenplay format and composed Sunspring.
The resulting film turned out to be stiflingly incoherent with literally no clear structure, but it revealed several fascinating recurring cinematic tropes that the A.I. seemingly recognized across numerous screenplays. Characters are constantly exclaiming confusion, with "I don't know what you're talking about," becoming a chorus-like refrain, while Thomas Middleditch's character shouts "it's not a dream" recalling countless reality-bending sci-fi stories.
The clear takeaway from Sunspring is that we're a long way from making a decent, or even coherent, A.I. penned movie. While A.I. systems have been developed to generate impressive musical pieces or works of visual art, it seems that fiction storytelling is a much more complicated beast. With its delicately complex combination of narrative, character, dialogue and structure, it seems like one of the critical barriers in developing a true form of artificial intelligence. A.I. pioneer Danny Hillis summed it up when he said, "The key thing that will make [artificial intelligence] work and make it acceptable to society is story telling."
A website called CuratedAI recently launched with the intention of acting as a repository for A.I. generated poetry and prose. Site founder Karmel Allison, a San Francisco-based software engineer, created a neural network algorithm designed to compose original machine-written pieces of poetry. Named Deep Gimble I, the algorithm has been loaded with a vocabulary of 190,000 words and its work is currently featured on the website. The poetry and prose the A.I. generates is definitely verbally discordant, but it does compellingly mimic the cadence and rhythm of classic work in its medium.
Earlier in 2016, a novel written almost entirely by an A.I. system passed the first selection round in a Japanese National Literary competition. Titled The Day A Computer Writes A Novel, this meta-tale had its human overseers direct the plot and characters while the A.I. generated the actual sentences. One judge described how the novel's ultimate shortcoming lay with its character descriptions, but the overall result suggested that a degree of human oversight or participation could make this kind of A.I. written fiction actually work.

The full feature

Impossible Things is the first attempt at an A.I. generated work of feature film storytelling and embraces the idea that having an human hand working with the machine is necessary. Mathematician Jack Zhang spent five years creating an A.I. that analyzed thousands of horror film plot summaries alongside their corresponding box office results. The idea is that the system can create a series of plot points that reflect popular audience tastes by crunching a serious amount of data. Understanding the limitations of the technology, a human writer was recruited to take the A.I. generated premise and plot, and add structure, dialogue and character.
The subsequent screenplay, Impossible Things, is now waiting on Kickstarter funding to move into production, but Zhang and his team have released a short summary of the A.I. co-written film and it predictably reads like an epic conglomeration of every horror movie cliche imaginable. The teaser trailer created to support the Kickstarter campaign, which was also written by the A.I. suggesting key things that would appeal to the film's ideal audience demographic, gives an appropriate indication of how unoriginal the results this kind of data-mined A.I. system can be.

Every single idea, shot, and audio trick can be traced back to prior successful films in the genre. Creepy kid singing a nursery rhyme? Check! Sound of a door creaking? Check! Ghost-like figure walking with a bloody knife? Check! It plays close to a parody of horror film tropes and in no way displays the whip-smart reflexivity that filmmakers like Quentin Tarantino deploy when they experiment with similar classic genre tactics.

Original sins

The unsettling idea raised by this form of A.I. generated filmmaking is that the technology can only ultimately feed back ideas we have enjoyed in the past rather than creating fresh, novel and meaningful new juxtapositions. Judging by the content of most modern big-budget Hollywood cinema, this method of generating content, by replicating past success, is already a path many movies already tread – Star Wars: The Force Awakens, I'm looking at you!
Netflix is the power-player with this form of data-driven content generation, and while it doesn't have A.I. systems literally creating its product, it does tailor all of its in-house productions to identified audience habits. Netflix has a treasure trove of data at its fingertips and is able to understand the viewing habits of its audience in ways no media producer ever has before. Netflix not only knows how quickly you binge through a series, but it can track the minute you stop watching an episode, if or when you come back to that show, and how you navigate through content in its library. This data allows it to mould its own productions to their audience's preferences.
Back in 2012, before the debut season of its first original series aired, executives were transparent about how they were using mined data to conceive original content. Steve Swasey, VP of Corporate Communications said to GigaOm at the time, "We can look at consumer data and see what the appeal is for the director, for the stars and for similar dramas".
This strategy has obviously been successful. Regardless of the creative or critical success in Netflix's productions, the audience demographics of each project has been incredibly clear. Its most recent series, Stranger Things, is a prime example. One can so visibly see how an algorithm could suggest that a show with those parameters would be successful. Do you like 80s movies and have a nostalgic connection to them? Are you a fan of Winona Ryder or Stephen King novels? The series, while creatively only mildly successful, is a supremely well-executed mash-up of current hipster nostalgic obsessions from Steven Spielberg's Amblin films (E.T, The Goonies, Close Encounters of the Third Kind), to its synth-heavy score reminiscent of John Carpenter horror films (which are referenced frequently) and its retro typeface credits that could be ripped from the cover of a Stephen King novel.
 
Not in 4,500 years?
 
So where does that leave us in the world of A.I. generated storytelling, particularly in the realm of film and television?
Film and television are still such complex creative mediums with long gestation periods from pre to post production and a large assemblage of persons involved across that production process. As we saw with a fully computer-generated screenplay in Sunspring, A.I. currently has little to no understanding of the nuances in character development and lacks the ability to build a coherent, meaningful narrative structure. At the other end of the spectrum, with productions such as Impossible Things, we simply seem to get A.I. assisted, data-mined compendiums of cliches blindly mashing up ideas that worked in prior financially successful films. Netflix also surfs that line of data driven content production, and while it has had its own volume of creative hits and misses, we still can't shake the feeling that this mode of production is frustratingly uncreative.
In eccentric filmmaker Werner Herzog's latest documentary Lo and Behold: Reveries of the Connected World, Stanford A.I. researcher Sebastian Thrun mentions to Herzog the inevitability of a machine at some point being able to make a film as good, if not better, than Herzog. The 73 year-old, self-professed technology luddite, bristles at the statement, replying, "Absolutely not!" In interviews Herzog has reiterated stoically that not in 4,500 years could a machine make a film better than he. The statement is steeped in classic Herzogian arrogance, but it does allude to something fundamentally human present in the process of creating meaningful fiction.
A.I. may be currently able to offer reasonably interesting simulacrums of original content in other artistic mediums from music to poetry, but it seems that fiction storytelling is a tougher mountain to climb for machine mimicry. It's one thing to use data mining as a way to generate a fictional narrative, but in longer, more immersive forms of media such as film and television, it becomes stiflingly apparent if a work is either mindlessly incoherent or discouragingly derivative.
A great film speaks to its audience and offers a perspective on the human condition in ways that are often abstract or allegorical. We can be given a unique insight into the world through someone else's experience and this results in a narrative generating its meaning and impact in ways that often cannot be quantified.
No matter how much data a machine can crunch, will it ever be able to offer us a meaningful and effecting perspective on humanity? Can it generate insights into our experiences in this world that are new or profound and then communicate those ideas through a fictional narrative?
These are the hurdles A.I. developers currently face, and while it probably won't take 4,500 years to overcome these barriers, they certainly pose some fundamental questions about when and how a machine could develop independent and creative thought. In the meantime, we can just console ourselves with the latest Hollywood reboot, remake or sequel, and realize that machines are already pretty well represented in Hollywood.

Deleting fears from the brain means you might never need to face them

Deleting fears from the brain means you might never need to face them

A new approach may make removing fears from the brain a more pain-free affair 

 

Conventional wisdom suggest that facing your fears is a good way to overcome them, indeed various forms of therapy for fear-related conditions are based on this premise. But by using a combination of artificial intelligence (AI) and neuroscience, an international team of researchers have come up with a way to eliminate specific fears from the brain without the subject actually needing to confront them, an approach that could offer more comfortable ways of treating phobias and post-traumatic stress disorders
.
According to the National Institute of Mental Health, 18 percent of US adults are diagnosed with a fear or anxiety disorder each year. A typical approach to treating such fear-related conditions is what is known as exposure therapy, where subjects are made to face their fears in a safe environment, conditioning the brain to embrace the low level or entire absence of any real danger. So somebody with a fear of flying may be shown photo after photo of airplanes, or somebody with arachnophobia may be shown images of spiders. The idea is that through repetition, the anxious response to these cues is gradually erased from the brain.

But the approach does have its flaws. By nature, this type of therapy is not exactly pleasant, and its effects are not permanent so some patients will experience relapses down the road. This has lead scientists to explore different ways to enhance the effectiveness of treatment, or take different approaches altogether.
The new technique developed by neuroscientists at the University of Cambridge, in collaboration with US and Japanese researchers, falls into the latter category. They claim that their approach enables fear memories to be removed from the brain without them ever needing to be triggered in the patient. Here's how it works.

It revolves around a new method of identifying fear memories in the brain that the team has dubbed "Decoded Neurofeedback." The technique uses image-recognition methods powered by artificial intelligence to monitor and recognize complex brain patterns representing particular fear memories. This was put to the test with 17 healthy volunteers, who were shown computer images and given short electric shocks at the same time in order to form fear memories in their brains.
"When we induced a mild fear memory in the brain, we were able to develop a fast and accurate method of reading it by using AI algorithms," explains Dr Ben Seymour from the University of Cambridge. "The challenge then was to find a way to reduce or remove the fear memory, without ever consciously evoking it."

Armed with their new, fast-acting pattern recognition software, the team noticed that even when the subjects were resting, traces of the shock-induced fear memory patterns would still make fleeting appearances. And because the subjects weren't even consciously aware of them, these flashes represented the perfect opportunity to undermine what they meant.
So each time a pattern was detected, the patients were handed small sums of cash. They were told that the amount of money they were earning was linked to their brain activity, but they weren't told exactly how, and this process was repeated over three days. By the end, it seemed that the brains had been reconfigured to associate those fear memories with something much more positive. The team reinforced this by then showing the subjects the computer images originally linked to the shocks.
"Remarkably, we could no longer see the typical fear skin-sweating response," says Dr Ai Koizumi, from the Advanced Telecommunicatons Research Institute International, Kyoto. "Nor could we identify enhanced activity in the amygdala – the brain's fear centre. This meant that we'd been able to reduce the fear memory without the volunteers ever consciously experiencing the fear memory in the process."

The researchers note that 17 is a pretty small sample size, but the promising results of the initial study have them hopeful that with further development, the technique could evolve into a clinical treatment for fear-related disorders.
"To apply this to patients, we need to build a library of the brain information codes for the various things that people might have a pathological fear of, say, spiders," says Seymour. "Then, in principle, patients could have regular sessions of Decoded Neurofeedback to gradually remove the fear response these memories trigger."

The team's research was published in the journal Nature Human Behaviour.

 

Facebook is now using AI to describe photos to the blind

Facebook is now using AI to describe photos to the blind

 How do you know what's in a photo if you can't see it? Facebook has the... 

Browse through your Facebook News Feed and you'll see photos play a prominent part, meaning visually impaired users are missing out on a lot of updates from their friends. Now Facebook's engineers have harnessed the power of an artificial intelligence network to describe these pictures to blind or partially blind users.

Facebook is calling the system "automatic alternative text" and it's based on a neural network primed with billions of parameters and millions of examples. Such neural networks – vast, complex databases designed to mimic the human brain as closely as possible – are playing an increasingly important role in modern computing.
The AI software doesn't actually "see" the picture, but it can compare the objects in it with its vast internal database of similar photos and make an educated guess about what's being shown. Part of the challenge, Facebook says, is in getting computers to recognize what's most important in an image, whether that's the people, the background or the "action."
For each image, the AI system returns a confidence score indicating how sure it is that it can identify what's in the picture. If this is above 80 percent, an automatically-generated caption appears. According to the engineers behind the system, that target is already being hit for half of all the pictures on the social network, and the underlying technology is getting better all the time (another key characteristic of neural networks).
Facebook's alternative captions are now live in the iOS app for some users 
When objects and people have been identified, Facebook's software constructs a sentence to describe the picture, usually ordered by how confident the AI is about the presence of each element. If there's some ambiguity about the picture then the sentence starts with "image may contain" to express that uncertainty.
The feature is live now in the Facebook iOS app, as long as your language is set to English and you're in the US, UK, Canada, Australia or New Zealand. Facebook says it hopes to roll out the service to more platforms, languages and markets in the near future. It actually works with any screen reader software – on iOS you can enable it via the VoiceOver tool in the Accessibility section of Settings (under General), for example.
Coincidentally, Twitter has also started experimenting with a similar feature, though in this instance captions are added manually. Users on iOS and Android are being encouraged to add their own alt text captions for the benefit of the visually impaired. Letting humans do the work means more accuracy in the description, but it does depend on people putting in the time and effort to explain what they're posting.