This is as close as I'm allowed to get to the building.
keep your head down and get clear of the rotors.
please approach the console and face the screen.
you may now enter the residence.
Caleb, I'm just gonna throw this out there, so it's said, Ok? You're freaked out.
You're freaked out by the helicopter, and the mountains and the house, because it's all so super-cool. You're freaked out by me, to be meeting me, having this conversation in this room, at this moment, right? And I get that. I get the moment you're having, but dude, can we just get past that? Can we just be two guys. Nathan and Caleb. Not the whole employer-employee thing.
Well, I guess the first thing I should do is explain your pass. Now it's simple enough. It opens some doors and it doesn't open others. And that just makes everything easy for you, right?
'cause "oh, I'm in someone else' house. Can I do this, Can I do that?" And this card, it just takes all that worry away.
If you try a door and it stays shut, Ok, it's off-limits. You try another door and it opens, then it's for you.
Buried in these walls is enough fiber optic cable to reach the moon and lasso it. And I want to talk to you about what I'm researching. I want to share it with you. In fact I want to share it with you so much, it's eating me up inside.
The signee agrees to regular data audit with unlimited access to confirm that no disclosure of information has taken place in public or private forums using any means of communication including but not limited to that which is disclosed orally or in written or electronic form.
I think I need a lawyer.
It's standard.
It doesn't feel very standard.
What can I tell you, Caleb. You don't have to sign it. You know we can spend the next few days just shooting pool, getting drunk together, bonding. And when you discover what you've missed out on, in about a year, you're gonna regret it for the rest of your life.
Good call.
So, do you know what the Turing test is?
It's when a human interacts with a computer, and if the human doesn't know they're interacting with a computer, the test is passed.
And what does a pass tell us?
That the computer has artificial intelligence.
And over the next few days, you're gonna be the human component in a Turing test.
Because if that test is passed, you are dead center of the greatest scientific event in the history of man.
If you've created a conscious machine, it's not the history of man. That's the history of gods.
And I guess we're both in quite a similar position.
We need to break the ice.
Do you know what I mean by that?
Yeah. Overcome initial social awkwardness.
Why don't we start with you telling me something about yourself?
What do you want to know?
Whatever comes to your head.
Some people believe language exists from birth. And what is learned is the ability to attach words and structure to the latent ability.
Sorry I had to send Kyoko to wake you, but I didn't want too much of the day to slip by.
She's some alarm clock,huh? Gets you right up in the morning.
What's the plan? Hit me.
I'm still trying to figure the examination formats. It feels like testing Ava through conversations is kind of a closed loop. Like testing a chess computer by only playing chess.
How else do you test a chess computer?
Well, it depends. You know, I mean, you can play it to find out if it makes good moves.But that won't tell you if it knows that it's playing chess. And it won't tell you if it knows what chess is.
So it's simulation versus actual.
And I think being able to differentiate between those two is the Turing test you want me to perform.
Look, do me a favor. Lay off the textbook approach. I just want simple answers to simple questions. Yesterday I asked you how you felt about her and you gave me a great answer. Now the question is how does she feel about you?
What is it a drawing of?
I do drawings everyday, but I never know what they're of.
It's the world's most popular internet search engine, processing an average of 94% of all internet search requests.
I got an apartment. It's kind of small. It's very small. But it's a five-minute walk to the office and a five-minute walk to the ocean, which I like.
If we're getting to know each other, I guess I should tell you that they're both dead. Car crash when I was fifteen. In fact I was in the car with them. Back seat. But it was the front that got the worst of it.
I spend a long time in the hospital afterward. Like nearly a year, and I got into coding. And by the time I went to the college, I was pretty advanced.
Nathan wrote the blue book base code when he was thirteen, which, if you understand code, what he did is like Mozart or something.
power cut
Did it get on you?
Dude, you're wasting your time talking to her. She doesn't understand English. Just give her the napkin.
It's like a firewall against leaks. It means I can talk trade secrets over dinner and know it'll go no further. It also means I can't tell her that I'm pissed when she's so fucking clumsy that she spills wine over my house guest.
It's funny. You know, no matter how rich you get, shit goes wrong. You can't insulate yourself from it. I used to think it was death and taxes you couldn't avoid, but it's actually death and shit. It's like these power cuts. You would not believe how much I spend on the generator system, but I keep getting failures every day.
The system was supposed to be bulletproof, but obviously the guys installed it fucked something up.
There's too much classified stuff here. So after the job was done, I just had them all killed.
So how did it go? What do you have to report?
It's discretely complicated.
when she threw your line back at you
She could only do that with an awareness of her own mind and also an awareness of mine.
It's the only part that I couldn't see. Cameras fail, I lose audio, the works.
If you knew the trouble I had getting an AI to read and duplicate the facial expressions. You know how I cracked it?
I don't know how you did any of this.
Every cell phone, just about, has a microphone, camera and a means to transmit data. So I turned on every microphone and camera across the entire fucking planet and I redirect the data through Blue Book. Boom! Limitless resource of vocal and facial expressions.
You hacked the world's cell phone?
Yeah, and all the manufacturers knew I was doing it too. But they could'n accuse me without admitting they were doing it themselves.
Structured gel. I had to get away from circuitry. I needed something that could arrange and rearrange on the molecular level, but keep its form when required. Holding for memories. Shifting for thoughts.
Here's the weird thing about search engines. It was like striking oil in a world that hadn't invented internal combustion. Too much raw material. Nobody knew what to do with it. You know, my competitors, they were fixated on sucking it up and monetizing via shopping and social media. They thought that search engines were a map of what people were thinking. But actually they were a map of how people were thinking. Impulse. Response. Fluid. Imperfect. Patterned. Chaotic.
You said it would be interesting to see what I would draw.
You've never been outside this building?
You've never walked outside?
I've never been outside the room I am in now.
Maybe a busy pedestrian and traffic intersection in a city.
A traffic intersection would provide a concentrated but shifting view of human life.
Are you attracted to me?
The way your eyes fix on my eyes and lips. The way you hold my gaze.
Do you think about me when we aren't together?
Sometimes at night, I'm wondering if you're watching me on the camera.
Now your micro expressions are telegraphing discomfort.
An AI doesn't need a gender. She could have been a gray box.
Actually I don't think that's true. Can you give an example of consciousness, at any level, human or animal, that exists without a sexual dimension?
They have sexuality as an evolutionary reproductive need.
What imperative does a gray box have to interact with another gray box? Can consciousness exist without interaction?
And in answer to your real question, you bet she can fuck. In between her legs, there's an opening, with a concentration of sensors. You engage them in the right way, creates a pleasure response. So if you want to screw her, mechanically speaking, you could. And she'd enjoy it.
My real question was, did you give her sexuality as a diversion tactic?
I don't follow.
Like a stage magician with a hot assistant.
So a hot robot who clouds your ability to judge her AI?
A consequence of accumulated external stimuli that you probably don't even register as they registered with you.
You know this guy right?
He let his mind go blank, and his hand goes where it wanted. Not deliberate. Not random. Some place in between. They called it automatic art. Let's make this like Star Trek, Ok? Engage intellect. I'm Kirk. Your head's the warp drive. What if Pollock had reversed the challenge? What if instead of making art without thinking?
guy who thinks before opens his mouth
The challenge is not to act automatically, it's to find an action that is not automatic.
And for the record, Ava is not pretending to like you. And her flirting is not an algorithm to fake you out. You are the first man she's met that isn't me. Can you blame her for getting a crush on you?
When I was in college, I did a semester on AI theory. There was a thought experiment they gave us. I't called "Mary in the Black and White Room." Mary is a scientist, and her specialist subject is color. She knows everything there is to know about it. The wavelengths. The neurological effects. Every possible property that color can have. But she lives in a black and white room. She was born there and raised there. And she can only observe the outside world on a black and white monitor. And then one day someone opens the door. And Mary walks out. She sees the blue sky. At that moment she learns something that all her studies couldn't tell her. She learns what it feels like to see color. The thought experiment was to show students the difference between a computer and a human mind. The computer was Mary in the black and white room. The human is when she walks out. Did you know that I was brought here to test you? Why did you think I was here? I'm here to test if you have a consciousness or if you're just simulating one. Nathan isn't sure if you have one or not. How does that make you feel?
Don't you think it's possible that he's watching us? Right now. That the blackouts are orchestrated so he can see how we behave when we think we are unobserved.
I charge my batteries via induction plates. If I reverse the power flow, it overloads the system.
You're causing the cuts?
So we can see how we behave when we're unobserved.
Can we talk about the lies you've been spinning me?
You got the light on you.
I told you that you're wasting your time talking to her. However, it would not be wasting your time, if you were dancing with her.
Today, I'm going to test you.
And please remember, while you're taking the test, that if you lie, I will know.
Look, the arrival of strong artificial intelligence has been inevitable for decades. The variable is "when", not "if". So I don't see Ava as a decision, just an evolution. I think it's the next model that's gonna be the real breakthrough. The singularity.
I didn't know that there was gonna be a model after Ava.
Yeah, why? You thought she was a one-off?
No, I knew there must have been prototypes, so I... I knew she wasn't the first, but I thought maybe the last.
Ava doesn't exist in isolation any more than you or me. She's part of a continuum.
When you make a new model, what do you do with the old one?
Well, I download the mind, unpack the data. Add in the new routines I've been writing. And to do that, you end up partially formatting, so the memories go. But the body survives. And Ava's body is a good one. You feel bad for Ava? Feel bad for yourself, man. One day the AIs are gonna look back on us the same way we look at fossil skeletons in the plains of Africa. An upright ape, living in dust with crude language and tools. All set for extinction.
I am becoming death, the destroyer of worlds.
I'd say we are about due a refill.
Bottoms up.
In battle, in the forest, on the precipice of the mountain, on the great dark sea, in sleep, in confusion, in the depth of shame. The good deeds a man has done before defend him.
I didn't know where you were. I waited all yesterday afternoon and all last night. I thought I wasn't gonna see you again. Aren't you gonna say something?
Caleb, I'm sure you've noticed that I've been somewhat overdoing it recently. So when I woke up this morning, I said, "That's it. Time to hit the old detox."
You wanna get wasted, you go right ahead, knock yourself out. Literally. I'm on brown rice and mineral water. So, anyway, now is when you tell me if Ava passed or failed. Are you gonna keep me in suspense?
Her AI is beyond doubt.
Although I gotta say, I'm a bit surprised. I mean, did we get past the chess problem, as you phrased it? As in, how do you know if a machine is expressing the real emotion or just simulating one? Although now that I think about it, there is a third option. Not whether she does or does not have the capacity to like you, but whether she's pretending to like you.
Maybe if she thought of you as a means of escape. Buddy, your head's been so fucked with.
I don't think it's me whose head is fucked.
I don't know, man, I woke up this morning to a tape of you slicing your arm open and punching the mirror. You seem pretty fucked up to me. I'm actually the guy who's on your side. Come here, I'm gonna let you out the hook.
You feel stupid, but you really shouldn't, because proving an AI is exactly as problematic as you said it would be.
Ava was a rat in a maze. And I gave her one way out. To escape, she'd have to use self-awareness, imagination, manipulation, sexuality, empathy and she did. Now, if that isn't true AI, what the fuck is ?
So my only function was to be someone she could use to escape? And you didn't select me because I'm good at coding? You selected me based on my search engine inputs. Did you design Ava's face based on my pornography profile?
Ava demonstrated true AI and you were fundamental to that. So if you can just, for a second, separate...
moral compass
smokescreen(掩护阵地和活动的) 烟幕;
unwind 放松