With Aggregation Becoming Big Business, Some Publishers Are Playing Along…For Now

May 13, 2013 by
Flipboard has become hugely popular by focusing on a smart, simple reading experience, letting the users decide what content to fill it with. (Credit: Shardayyy/Flickr/Creative Commons License)

Flipboard has become hugely popular by focusing on a smart, simple reading experience, letting the users decide what content to fill it with. (Credit: Shardayyy/Flickr/Creative Commons License)

Tech startups big and small are fighting for dominance in a new market offering personalized, curated or DIY magazines that aggregate what can be an overwhelming roar of online news content into something more manageable and meaningful. Judging from the popularity of apps like Flipboard, they have a captive audience. [Read more…]

Filed Under: Business Model, Mobile Tagged With: , , , , , , , ,

Where does news come from?

October 20, 2009 by

Time after time again, people who want to save newspapers claim that newspapers are the primary source of news. But is their claim actually founded on anything other than self-importance?

I love newspapers. I want them to survive, in some form, but it’s important to investigate where the truth in one of the linchpins of the “newspapers need to survive argument” comes from.

Tom Rosenstiel explained this before the Joint Economic Committee hearing on “The Future of Newspapers: The Impact on the Economy and Democracy,” on September 24, 2009:

In every community in America I have studied in 26 years as a press critic, the newspaper in town has more boots on the ground–more reporters and editors–than anyone else–usually than all others combined. A good deal of what is carried on radio, television, cable and wire services comes from newspaper newsrooms. These media then disseminate it to broader audiences.

When we imagine the news ecosystem in the 21st century, the newspaper is still the largest originating, gathering source.

Rosenstiel’s not the only one to make the claim. It’s a common one. John Carroll used to say that 80 percent of news came from newspapers. Len Downie and Robert Kaiser similarly claimed that newspapers were the originators of most content for most broadcast and cable news. And many studies of online blogs show that much of the linking originates from mainstream media, often newspapers.

But are newspapers where it all begins? In an online world, that’s only sort of true.

A study coming out of USC Annenberg of 250 news websites looks at where these sites are bringing information from – whether they are citing the AP or citing their own journalists. Though the analysis isn’t complete yet, initial results seem to suggest that wire services are providing the bulk of news online.

The study, as explained by Annenberg doctoral candidate and researcher Matthew Weber, takes a systems approach. This means that the researchers were taking a look at who was providing information for the network of news organizations, who was doing the filtering for the news organizations, who was collecting the information and from where – and how it was being passed on.

“If you take a systems approach to the news industry, the people who are providing the raw material are predominantly wire services,” he said.

Weber did find that newspapers still are where consumers make their first stop. And while they add their own content, newspapers are also acting as filters – were also bringing in articles from the AP, Reuters, AFP and the like.

“The ‘system’ start with the wires, and ends with the aggregators. Newspapers are jammed in the middle, competing for air,” Weber explained via e-mail.

But when it comes down to who is creating the content for news sites, the organizations providing information were “almost exclusively wire services,” according to Weber.

So wires, in this case, seem to be increasing importance in the news architecture of the online world – and newspapers aren’t the first stop that they used to be, though they do help sort information.

But in some sense, wires have always played an important role that has often been ignored by those who like to say that newspapers have set the news agenda and uncovered the most important stories.

When I was an intern covering cops at the Chicago Tribune in 2003, often my assignment came not from the scanners but from the now-defunct City News Service, a wire service owned by Tribune Co. that sold breaking news to the highest bidder in the local market. The City News Service in Los Angeles, not owned by Tribune, still serves a similar purpose.

Even if we disregard these pre-Internet wires that only operated in a handful of cities, it’s still unfair to say that newspapers set the agenda for the rest of the media in a city. Certainly newspapers often did the rigorous work of providing a detailed account which was then recycled on local news, but television news has never aspired to be anything but a recycling of newspaper headlines even in its golden era.

Cronkite saw his viewers still reading a paper, and today, local news also doesn’t kid itself about being entertainment. The two mediums work more complementary than as leader and follower than we might hope to suggest in our case for news survival.

But there’s a whole other element to where news comes from that has also been ignored in an online context – the world of blogs and online communities – and how this then sets an agenda for newspapers to follow.

Chris W. Anderson, a Nieman blogger and assistant professor at the College of Staten Island – CUNY, has research that suggests that it’s important to look not just at newspapers but at the whole news ecosystem- which includes everything from news to activist communities.

Anderson doesn’t question the macro-level assumption that journalists report and bloggers comment. But he notes that it’s a little more complicated when you look more closely at specific news instances.

Calling them news “blips,” Anderson said, “You’ll have an early period that most journalists wouldn’t call reporting where information will be released in niche spheres of the blogosphere.”

One example he gave was of reports of activists arrests. But it wasn’t that reporters were reading these activist blogs that this news happened to make it into the mainstream newspaper or news media. Instead, journalists got their tips from “being good reporters,” taking cues in the traditional way, perhaps from police or press releases or shoe-leather reporting.

From his observations at the Philadelphia Inquirer and the Philadelphia Daily News, Anderson said, “It’s a misnomer to think journalists are just sitting around reading blogs.”

But once journalists did report on these news blips, these blips were then circulated into the larger blogosphere. But the blips required a certain level of bubbling up to the surface from the niche level of social media, something that happened in traditional ways.

Twitter might make a good case of how newspapers aren’t the first and only source of news, especially on a hyperlocal level. Newspapers may be hoping to compete on the hyperlocal, but this strategy may be questionable especially in cities with actively wired bloggers and tweeters who may have the first claim on news.

My old neighborhood in LA is a Twitter neighborhood. Local stores and restaurants were on Twitter, as are many residents and more active bloggers. We all routinely kept the neighborhood hashtag #DTLA in our posts when commenting about our home. Sure, the bars marketed drink specials to us, but the #DTLA hashtag was the first source of news when the 2009 Lakers celebration got out of hand, then followed by TV and the LA Times. Twitter users provided great on-sight reportage of the Michael Jackson funeral at the Staples Center, often going beyond what mainstream media had to offer.

Did these events wind up back in the newspapers? Sure. But the most active concentration of rumors and new bits of information were coming from a niche community – in this case, the #DTLA one, and in Anderson’s case, the activist community.

Perhaps, instead of staking the claim for newspaper survival on the fact that newspapers provide the first stop of news and set our agenda for what it is we care to talk about, those making the case might start to make a more nuanced argument.

Maybe it’s not as compelling to say that newspapers are the great facilitators of democratic dialogue and discourse instead of the source of all that is news, but it seems to reflect the burgeoning reality of our digital era.

Filed Under: Frontpage Tagged With: ,

Holovaty's EveryBlock unlocks neighborhood news data

February 6, 2008 by

Noted journalist/programmer/Web guru Adrian Holovaty just launched his latest project, the Knight News Challenge-funded EveryBlock. As the site’s name implies, it strives to provide information about every block of the three cities it covers: New York, Chicago and San Francisco. Included data might include crime reports, civic inspections and filings, even geotagged Flickr photos.

Too many news professionals get bogged down by traditional notions of “journalism,” that what newsrooms publish must be multi-sourced narrative “stories,” from five to 500 inches long, following J-school-approved norms for reporting and narrative structure.

Feh. When I worked a small daily, many of us on staff suspected that the most popular features in the paper were the obits, police blotter and log of ambulance runs. And you know what? When I moved up, to bigger cities and bigger dailies, I missed not being able to check the paper to see where that police cruiser or ambulance I heard yesterday was going.

Readers love information. Whether that’s a police blotter, local bulletin board, school lunch schedule or gripping story in the local paper — they don’t care about the format. Readers just want it to be accurate, relevant and complete. Without anything misleading or extraneous, either.

That’s why I love watching people like Holovaty, whom I’ve interviewed before on OJR. The public has voted with its mouse clicks that it wants more information from the rest of the world that they are finding from the same, stale stories in their shrinking local papers. Holovaty’s creations offer the promise of a reinvigorated news industry, driven by journalists who can wield code, statistics and data every bit as effectively as words and grammar. I e-mailed Holovaty, and asked him about EveryBlock.

OJR: What’s EveryBlock providing that the average Web reader could not get before?

Holovaty: First, fundamentally, we offer a way to browse news at the block level, with a news page for every block — hence the name EveryBlock. We’ve done a fair amount of due diligence and are pretty confident this hasn’t been done before — and in three of the densest cities in America, at that.

Second, we’re providing some information that didn’t previously exist online. Two examples are film locations in Chicago and restaurant inspections in San Francisco. The former is provided to us by the Chicago Film Office, and the latter is provided to us by the San Francisco Department of Public Health, which has its own website but doesn’t include some of the data we publish.

Third, we make it easy to browse information that already existed online but was buried in deep government sites, either in “deep Web” search forms or non-Web-friendly formats such as PDFs. Two examples are landmark building permits in New York City and crime reports in New York City, but there are many other examples across our three city sites. This has been an interest of mine for a number of years, and it’s a dream come true to have the opportunity to do it at this scale.

Fourth, we’re detecting geography in narratives — “blobs,” so to speak — and making it easy for people to find relevant news articles and government documents that refer to specific places near them. Some examples are New York City news articles, San Francisco zoning agenda items and Chicago city press releases. Another (geeky) way to phrase this is that we’re harvesting geographic metadata from unstructured text.

Fifth, we’re providing some light trending and aggregate reports for *each* type of information on our site. For example, see the Chicago crime data.

OJR: Describe the work that went into creating EveryBlock.

Holovaty: The work that has gone into creating EveryBlock has been quite diverse, which makes the job interesting and exciting. On the “human” side of things, we’ve established many relationships with government officials and other partners who are responsible for local data. On the user-interface side, we’ve worked to design a gorgeous, easy to use site and an architecture that accommodates a wide variety of disparate types of information. On the map side, we’ve made our own maps, deciding against Google’s or Yahoo’s map offerings for a number of reasons; that took a sophisticated combination of design, coding and data chops. At the technical level, we’ve developed an array of technology just to get all of this data into an elegant, unified system. It’s beautiful. And we’ve even done a fair amount of manual labor, from hand-drawing neighborhood boundaries to hand-tagging newspaper articles to train our geoparsing algorithms.

OJR: I suspect that when many people, inside and out of the news industry, hear the word “journalism,” they think of a specific, narrative format for providing information. But sites such as EveryBlock provide information outside the traditional newspaper narrative form. Do you think that people in the news industry need to modify or expand their conception of “journalism” in order to account for the new and different ways that people can access and present information online?

Holovaty: People can define “journalism” however they’d like. At EveryBlock, what we’re interested in exploring is what sort of frequently updated information consumers want at the block level, and how they’d like to receive it. Whether this is called “journalism” or not is strictly academic. (I think it’s hard to argue against calling it “news,” though.)

I think people in the news industry should indeed modify their conception of what information they publish, and how they publish it. But should they modify their conception of “journalism”? Leave that to the people who have the time and inclination to debate semantics.

OJR: What has kept, or is still keeping, newspapers from having functionality like EveryBlock’s on their websites?

Holovaty: Unfortunately, there’s a lot. In the general case (and “general” means this excludes the newspapers out there who are doing great things online) —

* A lack of technical competence
* A culture so obsessed with daily deadlines that little thought/resources are put into paradigm changes
* A culture that disdains technology and science, particularly math, and, worse, actually takes pride in that
* Red tape
* Legacy systems
* Legacy attitudes
* People who ask “Is this journalism?” 😉

OJR: How long can you keep the site running on your Knight funding? What happens after that runs out?

Holovaty: That remains to be seen! Knight has awarded a two-year grant, and we’re just over six months into it, so… ask again in about 18 months. 🙂

OJR: Who are you trying to reach with EveryBlock? How are your promoting the site?

Holovaty: We’re trying to reach residents of the EveryBlock cities. If you live in Chicago, New York or San Francisco, we hope to make your block’s page on EveryBlock into something that you’d find useful time and time again.

Something tells me you won’t be seeing EveryBlock billboards on the expressway, or EveryBlock ads on subway cars. That’s just not our style. We’ve e-mailed friends and family, and the rest has sort of happened through word of mouth, blogs and media coverage. This approach worked well for chicagocrime.org, which has (anecdotally) gained pretty good awareness over the past two and a half years here in Chicago, with zero traditional marketing on my part.

OJR: What’s the timeframe, and procedure, for expanding to other cities?

Holovaty: This is an interesting challenge that we knew going into the project: to some extent, the technology is scalable (i.e., replicable in a way that makes subsequent cities easier to launch), but at the same time, every city’s data is different. We still don’t know how that breaks down, resource-wise, but it’ll be fun to find out.

OJR: If a local publisher wants EveryBlock technology on his/her website, what should they do? Are you working with partners? Should they try to build this themselves?

Holovaty: We’re obligated under the terms of our Knight grant to release the site’s code under an open-source license at the end of the grant period. The idea there is to experiment and do some good for the news industry — that’s one of the core missions of the Knight News Challenge program (www.newschallenge.org), which is the contest I entered to receive this grant.

In the meantime, though, we’re very interested in working with partners — media companies, governments, bloggers and any other local-news publishers — in our EveryBlock cities. (Folks can contact us at feedback at everyblock.com.)

Personally, I wouldn’t recommend that news organizations attempt to build this themselves, but it’s obvious that I’m biased — both by having implemented EveryBlock and having worked at a number of news organizations.

OJR: What information, related to EveryBlock or not, do you really wish you could get in front of Web readers, but that you haven’t figured out either how to get your hands on or how to present effectively? (In other words, what’s the next challenge?) What’s it going to take to get that information out there?

Holovaty: That’s another good question. Regarding data on the current EveryBlock cities, I’d say we’re only at 10 percent of where we could be. We’re almost ready to add a couple of data sets that didn’t make it in time for launch, and we’re continually adding news sources and blogs to crawl.

One type of information that we purposefully haven’t included on EveryBlock is “static” information — the location of the nearest subway station, or the census demographics for your block. There’s been a small amount of user interest in this, but there’s a core difference in that type of information, namely that it’s not time-sensitive, and it would take some thinking to figure out how that fits in with our current “news feed for your block” paradigm. We’ll see what happens. It’s one of the many interesting problems we look forward to tackling.

Filed Under: Uncategorized Tagged With: , ,
Next Page»