Wednesday, June 28, 2006

A standardized essay test?

A couple of weeks ago, lifestyle reporter Barbara Brotman of The Chicago Tribune had a first-person Sunday story on her experience taking the new SAT essay test. She made some interesting points along the way about standardized testing ... she actually seemed to enjoy filling in the bubbles! ... and her experience points up something I think journalism teachers and journalism students ought to be more aware of.

In a nutshell: The kind of writing we do for the public is not the kind of writing that is privileged in the academy. Certainly, as Brotman found out, it isn't the kind of writing that gets top scores on the SAT.

Which leads me to wonder whether a one-size-fits-all standardized test like the SAT discriminates against kids who want to be professional writers.

I've been reading Brotman's stuff in The Trib for 10 years now. Among other things, she writes engagingly about the experience of raising kids in the city of Chicago. And in one especially memorable column when Mayor Daley and then-Gov. Jim Edgar were squabbling about a third airport (to supplement O'Hare and Midway), she interviewed day-care service providers about how they might go about helping the politicians debate the airport issue with more civility and maturity. Several, as I recall, suggested putting both the mayor and the governor in the "time-out corner." So when Brotman took the SAT, along with a college-bound daughter, and wrote up the experience in the June 11 Perspective section, I settled in for some enjoyable reading. She didn't disappoint:
Inside [the testing site], I stood in a stairwell, waiting to check in. In front of me, high school students yawned, downing breakfast bars and trying not to stare at the mom in their midst. The staffer checking IDs gave mine the hairy eyeball, but my name was on the list. I was in.

I took a seat in the back of the classroom and put on my reading glasses. At 8:15 a.m., we began.

Say what?

The essay was first. The question:

"Does the success of a community--whether it is a class, a team, a family, a nation, or any other group--depend upon people's willingness to limit their personal interests? Plan and write an essay in which you develop your point of view on this issue."

And I thought--nothing.

Maybe there was something, a combination of emptiness and panic that swirled into a single thought: "Huh?"

Suddenly I realized that I, too, had stakes riding on the test. No one expected me to do well on the math. But how humiliating would it be if I blew the essay?

I got cracking. It wasn't anything to write Harvard about--how strange it felt to write by hand--but I used the words "relinquish," "communal" and "dovetailing." Take that, holistic scorers!

And then it was on to the next section. And the next, in a rhythm of test segments and brief breaks that was to continue for 4 1/2 hours.
The verbal (or "critical reading," as the SAT now calls it) sections Brotman enjoyed, "like doing needlework," and math, well, she survived it. In fact, she knocked the top off the reading test and did better than she'd expected in math. But her essay fell below expectations, into a range that "exhibits adequate but inconsistent facility in the use of language" and "has some errors in grammar, usage, and mechanics." If you write for a major metro daily, this isn't exactly how most people judge your work.

So Brotman did what comes naturally for any reporter for a major metro newspaper (or a county seat weekly, for that matter). She worked the phone, got ahold of a spokesman for the firm that administers the SAT and started asking questions. Her problem, according to Edward Hardin, content specialist in English language arts at the College Board, was "sound bites." Here's how Brotman tells the story:
My nose was somewhat out of joint. Edward Hardin, content specialist in English language arts at the College Board, graciously put it back.

Reached while he was meeting with six veteran SAT consultants to choose future essay subjects, he gave them my essay to read and grade again. Three gave it a 4; three gave it a 5 [out of 6 possible]. When he told them the author was a journalist, he said, they were not surprised.

My essay read like "sound bite writing," he said. "You have a lot of really interesting points and examples, but they tend to be one or two sentences, kind of scattershot. It jumps around a little bit, giving little chunks of information rather than sustained examples. There was some question as to whether it was building toward something or jumping around with random thoughts about the topic."
Brotman summed up her reaction in one word: "Ouch." I would give it a little more than that.

You see, the underlying structure of most good journalistic writing isn't sustained exemplification (to lapse into academic jargon for a minute) but narrative. When we cover an election or a three-alarm fire, we don't rush back to the newsroom and write an election essay or support a fire argument. We write a story. Our stories can be kind of scattershot, I'll admit, and sometimes they jump around a bit, because we're writing about people, and people's lives are like that. That's just the way of the world. But it all works out, because our readers need that narrative drive behind the story. If they don't get that sense of story from what we write as we cover the news, they move on to the sports page, the funnies or the school lunch menus.

"Story is the mother of all forms of of writing," says Donald Murray, a Pulitzer Prize-winning newspaper columnist who made the transition to academia as a professor at the University of New Hampshire, and has also written fiction and poetry. "Despite some intellectuals' lack of respect for traditional narrative, it is the principal way we all, intellectuals included, explore, understand, and explain our world to each other. We live and believe the narratives we have woven from our past and our experience. More than we realize, we see the world through story" (152).

But story, of course, isn't what they're looking for on the SAT.

It's not that there isn't a legitimate place for the kind of writing that gets kids a 6 out of 6 on the SAT essay. When I teach freshman English composition, I'm basically teaching argumentation, and it can be a struggle to get my students used to thinking in terms of supporting an argument with sustained evidence. But teach it I must ... even though I have to turn around and un-teach some of the more sustained academic windbaggery that goes along with it when I get the same kids as sophomores in basic newswriting. I don't pretend to be a rocket scientist, but somehow I manage to accomodate more than one style of writing in my students. I would recommend that attitude to the standardized testing industry.

It's as simple as this: Something is going badly wrong in the academy when a professional writer at one of the top 10 newspapers in the country scores in the "adequate but inconsistent" range on what is supposed to be a valid, reliable measurement of writing ability.

I've tried both academic and professional newspaper writing, and I would submit that good journalistic writing requires more craft and discipline than a lot of what passes for academic discourse (including my own). It's also been my experience that kids who are attracted to journalism have a pretty well developed flair for narrative writing by the time they get to college. Why? They like to read the papers, and they like to write the same kind of copy they like to read. So I am troubled by a one-size-fits-all standardized test that valorizes one style of writing above all others and penalizes the very students who are most likely to flourish as professional writers.

Works Cited

Brotman, Barbara. "Taking the SAT -- It's Not Just for Teenagers." Chicago Tribune 11 June 2006. Online ed. 28 June 2006. http://www.chicagotribune.com/news/opinion/chi-0606110190jun11,1,7867589.story

Murray, Donald. Writing to Deadline: The Journalist at Work. Portsmouth, NH: Heineman, 2000.

Friday, June 23, 2006

Quote from St. Angela Merici

Found while cleaning my office, an inpirational quote from St. Angela Merici, founder of the Ursuline order:

Do something,
get moving,
be confident,
risk new things,
stick with it,
then be ready for
BIG SURPRISES!

(as translated by Sr. Terry Eppridge, OSU)
I found it in a three-fold brochure promoting the Ursuline Companions in Mission, Central Region, Crystal City, Mo. I'm posting it to the teaching blog so I won't lose it again as the office-cleaning progresses.

Friday, June 09, 2006

Public policy T-shirt

On sale at this week's Central/Southern Illinois Lutheran Synod meeting was a black-on-yellow T-shirt promoting the www.lutheranadvocacy.org website. On the back it displays the following:
A Six-Point Plan for Effective Public Policy:
  1. When I was hungry, you gave me something to eat;
  2. When I was thirsty, you gave me something to drink;
  3. When I was a stranger, you welcomed me;
  4. When I was naked, you clothed me;
  5. When I was sick, you comforted me;
  6. When I was in prison, you visited me.
Truly I tell you, just as you do this for the least of my brothers and sisters, you do this for me.
-- Matthew 25
LutheranAdvocacy.org is a joint ministry of Lutheran Social Services of Illinois (LSSI), the three regional synods of the Evangelical Lutheran Church in America (ELCA) in the State of Illinois and the ELCA's Division for Church in Society. It is the ELCA state public policy office for the state of Illinois.

Flag pledge -- in Dena'ina language

Here's an interesting angle on the move for "English only" laws that accompany the current round of hysteria over immigration. It comes from an anthropologist's recollection of leading the Pledge of Allegiance with a Dena'ina Athabascan elder named Peter Kalifornsky at a school on Alaska's Kenai Peninsula.

I'll let the anthropologist, Alan Boraas of Kenai Peninsula College, tell the story as he wrote it up for The Anchorage Daily News several years later:
Two hundred grade schoolers make a lot of noise even when being shushed by their teachers, and I was a little ambivalent when we stepped to the microphone. I cleared my throat, Peter cleared his, and we began:

"Dek'nesh'uh bet'uhdi_t'ayich"' Peter read. "I pledge allegiance" I repeated. "Naq'ach' k'iniyich'," "to the flag," "ts'e_q'i k'i_anich'ina," "of the United States of America."

As we read, the children became curiously silent. Johnny stopped pulling Sally's pigtails, Betty and Amy stopped giggling, and Ricky, off in his own space, suddenly was captivated. As one, they stared intently at the frail old man speaking a strange language they didn't understand. They were not confused, but awed. Even the school district administrators paid attention.

The children seemed to sense that this was the language of their place. An ancient language with ancient roots. Though they came from many backgrounds, subconsciously they seemed to want to connect to those roots. After the program was over I stood to the side talking with some acquaintances, and I happened to look over toward Peter. Forty or so kids had gathered around him. They were quiet and respectful with a look not so much of admiration, but of wonder. It was as though there was something missing in their lives that this mysterious old man and his ancient language could satisfy. They would draw near and reach out their hand, and he would reach out his and touch them. Then they would drift away and others would press to the front for a chance to touch the hand of a man who held the secret to their connection to their place.
Now here's the kicker. Again, I'll quote Boraas:
In one of the supreme ironies of our time, reading the Pledge of Allegiance in a Native language could be be illegal today. With the passage of Alaska's English-only law, English is the only language that can be used in government functions.
There's another level of irony here, too. Kalifornsky was descended from a Dena'ina Athabascan man who converted to Christianity in the mid-1800s when he worked at a Russian outpost in California. (Hence the name.) When Alaska was a Russian colony, the Russian Orthodox Church promoted the use of Native languages and it was not uncommon for people to be bilingual, even trilingual. After the U.S. took over, the new territorial government brought in Protestant missionaries and English-only schools like those in the "lower 48." Now, a hundred years later, the Native languages are dying out. Kalifornsky, who died in 1993, devoted his last years to developing a written Dena'ina language and writing down many of the old Athabascan stories in their Native language.