Software That Can Sort Facts From Opinions

|

File this in the category of too good to be true: "A new research program by a Cornell computer scientist, in collaboration with colleagues at the University of Pittsburgh and University of Utah, aims to teach computers to scan through text and sort opinion from fact."

That will revolutionize the pundit business. I'm thinking lots of people will be surprised to discover just how much they read is opinion, not fact. And not just on op ed pages, either. But I'm not hopeful that the tack the researchers are taking will be able to measure anything beside how well a writer disguises his opinion as fact:

The new research will use machine-learning algorithms to give computers examples of text expressing both fact and opinion and teach them to tell the difference. A simplified example might be to look for phrases like "according to" or "it is believed." Ironically, Cardie said, one of the phrases most likely to indicate opinion is "It is a fact that ..."

The work also will seek to determine the sources of information cited by a writer. "We're making sure that any information is tagged with a confidence. If it's low confidence, it's not useful information," Cardie added.

So it's not like they are actually going to check the writing against facts; they are just going to look at how the information is presented, which means that ironically if you present opinion as fact the programs will take your word for it and flag it as fact. If you are careful and present your opinions as such, then the program will pick up on that and flag it as opinion.

In other words, the researchers are writing a program that uses the writer's opinion to sort opinion from fact in the writers work. Won't that be a great help. No word on a computerized sarcasm detector.

About this Entry

This page contains a single entry by Kevin Murphy published on September 25, 2006 11:44 AM.

Deeply Disturbing was the previous entry in this blog.

Read This Blog Or Else! is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

LINKS


St. Louis Blogs:

J Bowen
Christopher Johnson
Charles Austin
Archpundit
Random Observations
Brian J Noggle
Shelley Powers
Gateway Pundit
Listless Lawyer
Jim Durbin
Timothy Birdnow
Diane Meyer
Marijean Jaggers
Scott Ginsberg
Steve Boriss
St. Louis Bloggers
St. Louis Blogs . Org
Randall Sherman
Urban Review STL

Missouri Blogs:

John Combest
Blue Girl, Red State
Another Rovian Conspiracy
The News Buckit
The Source
Fired Up! Missouri
Susan "Farmgirl"

Favorite Blogs:

James Lileks
Glenn Reynolds
Rich Galen
Megan McCardle
Scrapple Face
In The Agora
The Brothers Judd
Geitner Simmons
Cronaca
Science Blog
Winds of Change
Da Goddess
Justin Katz
Fran Mason
Phil Carter
Greg Costikyan
Tom McMahon
Kevin Aylward
Rand Simberg
Michael Totten
Belmont Club
News Busters
Mark Ciocco
David Weinberger
Tom Maguire
Jon Henke & McQ (plus Dale!)
Kevin Murphy The Other
Craig Henry
Brian Tiemann
Crooked Timber
Charles Johnson
Powerline
Busy Mom
Jason Van Steenwyk
Jenne
INDC Journal
Eamonn Fitzgerald
John Little
King of Fools
Perish the Thought
Patterico
Jeff Harrell
Michael Yon
Ed Driscoll
George Roper
Jeff Goldstein
Mark A. R. Kleiman
David Opderbeck
Libertas
Bob Somerby
Ben Witherington
Creative Bits
Mark Daniels
Michael Spencer
Think Sink
The Brussels Journal
A J Strata
S K Murphy
Joe Carter
John Hawkins
Bridget
Back Talk
Joe Sherlock
Mark Perry
Daniel Dilger

Pundits

Charles Le Kraut Martel
Victor Davis Hanson
Mark Steyn
Thomas Sowell
Malcolm Gladwell
Robert Cringely
John Carroll
Paul Graham
David Nicklaus

My Interests

The Paralyzed Veterans of America
The American Anti-Slavery Group
Wayside Gardens
The Alliance for the Separation of
School and State

MacSurfer Daily News
Urban Legends
Diablo II Net (Unofficial)
The Word Detective
HotAIR
UN Documentation Center
Cub Scout Pack 787
Baloo's Bugle (Cub Scouts)
Wounded Warrior Project
Operation Iraqi Freedom
Defense Industry Daily