Honestly, was this the best headline for the story?

Feeling Unwelcome, Some Gays Vacate Virginia

Google is releasing its lists of n-grams. What’s an n-gram, you ask? An n-gram is n words in a row. For example, ‘how are you’ would be a 3-gram.

Computational linguists use n-grams all the time because they’re a cheap, easy, and effective way of showing what’s in a sentence or a document.

So, um, how many n-gram types are in the Google trillion-word corpus?

We processed 1,011,582,453,213 words of running text and are publishing the counts for all 1,146,580,664 five-word sequences that appear at least 40 times.

I was also interested in this tidbit:

There are 13,653,070 unique words, after discarding words that appear less than 200 times.

That seems to mean that in all the language in all the Web, there are about 13 million word types. I wonder how many of those are English.

It appears that in the run-up to war, George W. Bush had no idea that Islam comes in different flavours.

A year after his “Axis of Evil” speech before the U.S. Congress, President Bush met with three Iraqi Americans, one of whom became postwar Iraq’s first representative to the United States. The three described what they thought would be the political situation after the fall of Saddam Hussein. During their conversation with the President, Galbraith claims, it became apparent to them that Bush was unfamiliar with the distinction between Sunnis and Shiites.

Galbraith reports that the three of them spent some time explaining to Bush that there are two different sects in Islam–to which the President allegedly responded, “I thought the Iraqis were Muslims!”

Is it any wonder that the architects of the Iraq war are now unable to navigate the web of sectarian alliances?

And no, I don’t understand it either. But then I didn’t decide to throw rocks at the hornet’s nest. I might have done some research first.

At least I was aware of the disctinction. I listened in Mr Bryant’s social studies class in high school. And I was conscious during the latter half of the 70s what with the hostage crisis and all. Which is probably more than Dear Leader can say.

What’s a PhD in Linguistics good for? Setting people straight, for one thing.

Belligerent white woman: Could you get of the way?
Black teen: I be trying!
Belligerent white woman: You should speak gramatically correctly!
Smartass: “I be trying” isn’t ungrammatical. It’s standard usage in African-American vernacular English.
Belligerent white woman: Oh, what would you know?
Smartass: I have a Ph.D. in linguistics from MIT.

Ooh, snap!

I’ve seen a lot of handwringing about how young people don’t talk prop’ly these days, and it’s all the fault of SMS and the Internet.

From a linguistic perspective, this is silly. Language is always changing. Our ‘proper’ English would have hurt Shakespeare’s ears, and his English, in turn, would have pained Chaucer. And so on. I’m sure that Old English folk must have grumbled as they saw their beloved case system slipping away. “Bloody foreigners!” they would have said. “Coming in here with their arsy relexification!”

Parents worry about the negative influence of email and IM on language. But they don’t seem to have considered that kids are writing to each other! Has any generation in history corresponded by writing this much? All our parents ever did was talk on the phone.

Link:

Researchers at the University of Toronto found that more than three-quarters of Canadian teens use IM on a regular basis, but that the writing is surprisingly sophisticated. Though they often use informal diction and bizarre acronyms, the research found that students also use more formal phrasing than expected, and turn out to be talented at switching between different registers. “Everybody thinks kids are ruining their language by using instant messaging,” says Sali Tagliamonte, one of the study’s authors, “but these teens’ messaging shows them expressing themselves flexibly through all registers. They actually show an extremely lucid command of the language. We shouldn’t worry.”

Indeed.

Zut alors! French fries and French toast are French again!

Neither Reps. Bob Ney of Ohio nor Walter B. Jones of North Carolina, the authors of the culinary rebuke, were willing this week to say who led the retreat, as it were, from the frying pan. But retreat there has been, as a casual observer can see for himself in the House’s basement cafeterias.
“We don’t have a comment for your story,” said a spokeswoman for Mr. Ney.

Is that the same Bob Ney who got into such trouble over political corruption in the Abramoff scandal? I’d like to draw a connection between language mangulation and corruption, but I’m afraid that’s a bit tenuous even for me.

Never mind. The purge is over. Celebrate with a glass of Evian.

There’s currently some discussion on Retrospectacle about an African Grey Parrot named N’Kisi. (I’m the ever-controversial ‘fontor’ in comments.) His owner Aimee is claiming that he can understand language and have conversations.

Now African Grays are intelligent little buggers, I’ll give ’em that. And they are very good at remembering and repeating sounds, including speech sounds. Wouldn’t it be tempting to think that the bird was thinking of stuff to say and then saying it to you? Unfortunately, yes. All you need is one believing owner, an uncritical news media, and a credulous public, and voila! Bird conversation.

I’ve mentioned before that there’s a distinction between communication and language. My beloved big dumb cat is great at communicating. (It’s always about food for him, it seems.) But there’s no indication that he’s using a kind of language. That would involve a knowledge of syntax, the system of language. He’d have to be able to take sentences, and break them into their constituent words. Then he’d have to understand that certain words can be used in place of other words to make new sentences. I’m afraid Cattums is not up to it, though it’s something every human child can do. Kids have the brains for it.

Is a parrot’s brain big enough to process language in the way Aimee is claiming? I know very little about neurology, but Shelley at Retrospectacle does work in that area. She seems to think that it’s not out of reach for an African Gray. (Does it matter that she’s a bird fancier?)

I’m still not sure. Let’s take a closer look at some of the things that are going on when you carry on a conversation.

• You have plans and goals, which helps you decide who to talk to for what reasons.
• You have intentions, which you use to decide where the conversation is going to go at any given moment.
• You are able to use real-world knowledge, which comes into play when you hear and evaluate the information in the dialogue.
• You have a knowledge of context, and that will help you if someone refers to something that you can’t immediately determine.
• You can remember what’s happened so far in the conversation, so you can tell if (for instance) the questions you had when you came into the conversation have been answered.
• You are able to interpret what other people are saying and fit that into your plans.
• You can figure out the meanings of ambiguous words.
• Most amazingly, you can make guesses about other people’s beliefs, knowledge, feelings, and intentions.
• All in real time.

Aimee, the owner, is claiming that N’Kisi is doing all this AND engaging in wordplay, joking, and inventing new words.

What’s more likely — that a parrot is walking around with that kind of hardware crammed into such a small headspace, or that the bird is saying items from a repertoire and the owner is doing all the conversational work? If Koko, with a much larger brain, is going through the motions, no way is N’Kisi going to do any better.

But that’s just a guess based on my limited knowledge. Maybe brain size isn’t the sine qua non. Maybe we don’t really need these huge brains of ours, and we could do language with a brain the size of a cashew. Maybe the rest of our brains are just heat regulation and untapped potential. In an amazing world like ours, perhaps the parrot understands us and is capable of response. However, extraordinary claims require extraordinary evidence. So let’s see if N’Kisi’s output is sufficiently compelling to warrant a closer look.

There’s one example here.

Aimee: Ok, ya ready? (Aimee pushes button, toy says ‘square’ and makes music.)

N’Kisi: (Enthusiastic tone) That’s so cool!

Aimee: Isn’t it?

N’Kisi: Can ya hear(music is playing)There’s a square.

(Aimee pushes button again; toy says ‘square’)

N’Kisi: Lemme try (? illegible). Look, there’s a square!

(Aimee pushes button again; toy says ‘square’)

N’Kisi: Can you see that?

Aimee: Yeah!

N’Kisi: Look!

Aimee: Isn’t it cool?

In attempts to teach human language to primates, linguists found that animals tend to repeat words provided by their trainers. One thing I’m noticing is that Aimee says “cool” a lot. So does N’Kisi. I wonder how many times N’Kisi has heard Aimee say that.

Aimee: Wow!

(Aimee pushes the button; toy says ‘square’)

N’Kisi: Wow! there’s a me…

There’s the prompting again — N’Kisi says ‘wow’ right after Aimee does.

N’Kisi: You could try-angle. (word play, due to grammatical context)

Aimee: OK. (Aimee pushes another button, toy says ‘triangle’.) See? (pushes it again, ‘triangle’).

N’Kisi: Look at the square.

(Aimee pushes the button that says ‘square’.)

N’Kisi: There’s a square.

Notice how Aimee is cueing off of N’Kisi, pushing the buttons he suggests. This gives the impression that there’s a real back-and-forth conversation going on. Or it could be that the parrot is training the owner.

The word ‘square’ is also used a lot. The parrot is likely running through its list of items involving the word ‘square’ (which is good word recognition), but to a caring owner it could look like it’s making new utterances that build on previous ones.

Here’s my bit: I think N’Kisi’s ability to remember Aimee’s utterances and play them back with such fidelity is remarkable. (I think the same thing about the lyrebird, who can imitate other birds’ calls — and even chainsaws — with startling accuracy.) But I see no evidence that the parrot is understanding and using language as humans do. I don’t even know what words and sentences N’Kisi’s been exposed to, so I can’t tell whether any of these utterances are novel. What I see here is similar to primate studies: the animal makes a sign, the human carer interprets the mung out of it, and everyone remembers the hits and not the misses. The only difference here is that the subject is speaking with a clear human-like voice, which makes it even more tempting to jump to the conclusion that N’Kisi is using language. But it ain’t necessarily so.

I’d also like to address Aimee’s claims that N’Kisi is psychic. That’s for another day, though.

I was on the phone to my sister in Seattle. You have to understand; at several points in the last couple of years, I’ve asked her, “So, any regrets about voting for Bush?” And so far the answer has always been no.

“Did you hear?” she said. “Washington just said no to gay marriage.”

“Washington, really? Of all places! That’s too bad.”

“Too bad?” she said. “You don’t think gay people should be able to get married, do you?”

“Yeah, I think gay people should be allowed to get married.”

She was incredulous. “Why?”

Well, it was a teaching moment as pure as any I get offered. And wouldn’t you know, I was stumped for what to say.

I don’t know that gay marriage is one of my big important issues, and yet it sort of is. It’s one manifestation of freedom, which is a big deal for me. Letting people have the kind of relationships they want, with social sanction and wedding cake, just seems to me like the way it should be.

It wouldn’t sound right to say that there’s no reason not to have gay marriage, and that it won’t affect straight marriage at all, even though I think that’s the case. What right does a society have to deny a certain group of people the right to engage in a contract?

Should I argue, as Dan Savage did, that gay marriage will bring familial stability to children of gay parents?

But my answer was, “I think gay people should be able to get married because I believe in equality for all Americans, period.”

I think for a moment my sister might have compared that to her reason for banning gay marriage, which was “Gayness is icky.”