The Data Journalism Handbook at a glance, used under Creative Commons License.

As the Columbia Journalism Review reports, it behooves journalists to become literate in data coding, because that’s where jobs are opening up. It’s still a very small set of people who can combine the speed, ethics, understanding and fairness required of a journalist with the coding skills of a developer, says John Keefe, editor of data news at WNYC.

“[A]nybody who put any effort into being good at that and having those qualities is going to have a job probably before they can graduate,” Keefe told CJR.

Apparently, news sources as small as the Lansing State Journal and Vermont Public Radio are making space for data and design teams on their staffs. Publications can utilize coding-literate teams to produce graphics and surveys of demographics — census maps, for instance, in the case of WNYC’s coverage of Hurricane Irene, which brought them a record-setting amount of traffic.

Free tutorials like ones on Flowing Data and .net magazine teach journalists basic data coding skills that can help them become more employable, as outlets learn that the web offers them even more shots at being inventive and innovative and therefore more interesting to viewers.

The newsroom at The Daily Telegraph. | Credit: victoriapeckham/Flickr

The person who spoke this line was Matt Berger, the director of digital media at Marketplace. What he meant was there is no business model that will support an organization with 100 reporters writing 100 stories (or, as we used to refer to the newsroom, 100 monkeys at 100 typewriters).

When you are going up against a World Wide Web that has so much real-time content, it’s almost impossible to gain enough traction to adequately monetize the work of a single soul banging away at a single keyboard. This old model was only possible when information was scarce. And information was scarce because it was delivered on newsprint. (And yes, there are still a few places that can achieve the necessary scale in the digital realm, and we all know who they are.)

Of course, there is nothing earth-shattering about this concept. It’s blatantly obvious. And yet, when you stop to consider it, you wonder how anyone who cares about the future of the industry could be thinking about anything else. Or why so many news sites are still swimming upstream by trying to sell ads against work churned out by individual journalists.

The implications of this challenge are unsettling. The single “article” — journalism’s basic unit of commerce — will only rarely generate enough value to cover its cost of production. (Gulp.) But as I began to consider what scalable journalism meant, I also realized how many conversations I had had recently that were really about addressing this very problem.

I recently sat down with Steve Rosenbaum, author of “Curation Nation” and founder of Magnify.net. His startup seeks to address this issue by helping news sites appropriately harness content that’s out there already, rather than attempt to produce it themselves. Plenty of people might want to visit the homepage of Field & Stream to watch a video about boat trailers or fishing lures. But it’s not realistic to think that magazine’s staffers can churn out enough quality video to satisfy the demand of either the audience or advertisers. Again, it’s a question of scale.

Yet the Internet is brimming with videos about these topics already. So Magnify reels in an array of relevant videos that editors can choose from. Field & Stream provides the context (you’re watching this in the confines of their site’s video page) and the curation (they choose the content that they feel is most valuable). The best part: The magazine can sell pre-roll ads or ads on the site even though the content (the actual video) was created elsewhere. Depending on the arrangement, the magazine either pockets the revenue or shares it with whoever made the video. This last point marks an evolution of the concept of curation. Not long ago, showing someone else’s video on your site was considered “theft” by some. Now, many just call it “distribution.”

The issue of scale is also lurking in the background throughout the recent report from Columbia’s Tow Center for Digital Journalism on Post-Industrial Journalism (though it weighs in at an industrial-length 122 pages). Much of the report discusses the need for a new workflow that is more open and responds to the ways in which information is currently assembled and consumed. (For a smarter, Cliff Notes version of this concept, read the post from my friend and former editor Reg Chua.)

Obviously, the layers of editors that were once charged with policing copy have no place in the modern, distributed newsroom. But editing — the process of vetting, sharpening and enriching content — still holds tremendous value. I spoke recently with Roman Heindorff, one of the founders of Camayak.com, a browser-based product that helps organize a newsroom’s workflow. The founders were trying to address an increasingly common problem: how to bring sense to the news organization of the future, which will be made up principally of part-time contributors working on myriad projects, sometimes across vast geographies. Camayak has begun to gain traction with campus papers, which often have hundreds of occasional contributors who need a seamless way to collaborate with each other. The overall goal is to make the most efficient use of available human resources to produce greater amounts of content. The founders also believe there is a virtuous circle involved: The more people are able to use the platform to collaborate successfully, the better the content.

Marketplace’s Berger approaches the problem from the perspective of structured journalism. Achieving appropriate scale requires putting lots of up-front effort into building a digital product that doesn’t wilt with the day’s news. This means creating a database of content that the audience can dip back into multiple times and still draw new conclusions. The database can be regularly refreshed with new content to extend its life.

His Exhibit A is a Marketplace feature called Future Jobs-O-Matic, an interactive tool that lets you browse hundreds of professions to see how many people are employed as welders or what the average salary of a machinist might be (Answer: $39,000). The database is updated every two years, but people keep coming back to it, sharing it, using it in the classroom, etc. Buried in the data, of course, are also nuggets that traditional “article-producing” journalists can use as building blocks for stories.

The implications of what this all means from where I sit are far reaching. Much of what I do involves teaching students the rudiments of how to produce an article — which has an ever-shrinking economic value. Clearly, this needs to be rethought. And those of us who inhabit journalism schools need to create an environment that pushes students to produce journalistic artifacts that have a shelf life, that draw content from the crowd and that still provide a platform for storytelling and for meeting the information needs of the public. Should be a snap.

Equally important, social media and the virtual communities that websites are capable of forming can help to overcome a major barrier to the public’s understanding of risk perception: The tendency of citizens to conform their own beliefs about societal risks from climate change to those that predominate among their peers. This derails rational deliberation, and the herd instinct creates an opening for persuasion — if not deliberate disinformation — by the fossil fuel industry. Online communities can provide a counter-voice to corporations. They are populated by diverse and credible thought leaders who can influence peers to not just accept ideas but to seek out confirming evidence and then take action. Because social networks enable the rapid discovery, highlighting and sharing of information, they can generate instant grassroots activist movements and crowd-sourced demonstrations.

Studies show that a major cause of public skepticism over climate stems from ignorance of the reliability of climate models. Beyond their susceptibility to garbage in, garbage out, algorithms on which models are based have long lacked the transparency needed to promote public trust in computer decisions systems. The complexity and politicization of climate science models have made it difficult for the public and decision makers to put faith in them. But studies also show that the media plays a big role in why the public tends to be skeptical of models. An article in the September issue of Nature Climate Change written by Karen Akerlof et al slammed the media for failing to address the science of models and their relevance to political debate:

Little information on climate models has appeared in US newspapers over more than a decade. Indeed, we show it is declining relative to climate change. When models do appear, it is often within sceptic discourses. Using a media index from 2007, we find that model projections were frequently portrayed as likely to be inaccurate. Political opinion outlets provided more explanation than many news sources.

In other words, blogs and science websites have done a better job of explaining climate science than traditional media, as visitors to RealClimate.org, SkepticalScience.org and other science blogs can attest. But the reach of these sites and their impact on the broader public are debatable. Websites such as the U.S. Department of Energy’s Office of Science have a trove of information on climate modeling but, with the exception of NASA’s laboratories, most government sites on science make little effective use of data visualization. This void offers mainstream journalists an opportunity to be powerful agents in the climate learning process, to tell dramatic multimedia stories about how weather forecasts can literally save our lives and, by extension, why climate forecasts can be trusted.

Two recent events can be thought of as whetting the public’s appetite for stories about computer-generated versions of reality. The prediction that Hurricane Sandy would eventually turn hard left out in the Atlantic and pound the northeastern shore of the United States was made almost a week in advance by weather forecasters.

This technology-driven prediction no doubt saved countless lives. In addition, some media coverage of Hurricane Sandy did much to enable non-scientists to understand why it is tricky to attribute specific storms to climate change but still gave the public the big picture of how warmer ocean waters provide storms with more moisture and therefore make them bigger and more damaging.

Simultaneously, in a different domain but using the same tools of analysis and prediction, Nate Silver’s FiveThirtyEight computer model, results of which were published in his blog at The New York Times, out-performed traditional political experts by nailing the November national election outcomes. How did he pull that off? A story about his statistical methods, complete with graphics, could reveal how risk analysts create spaces between the real world and theory to calculate probabilities. This would help the public to become familiar with models as a source of knowledge.

Some reporters have produced text stories on climate models that are examples of clarity. Andrew Revkin, while as an environment writer for The New York Times and now as the author of his Dot Earth blog at nytimes.com’s opinion section, has for many years covered how climate models relate to a large body of science, including a posting on Oct. 30 that placed Hurricane Sandy in the context of superstorms of the past.

David A. Fahrenthold at The Washington Post wrote how “Scientists’ use of computer models to predict climate change is under attack,” which opens with a baseball statistics analogy and keeps the reader going. Holger Dambeck at SpiegelOnline did a thorough assessment of climate model accuracy in non-science language, “Modeling the Future: The Difficulties of Predicting Climate Change.” But these stories are rare and often one-dimensional.

Effort is now being spent on making scientists into better communicators, but more might be accomplished if mainstream journalists, including those who publish on news websites with heavy traffic, made themselves better acquainted with satellite technology and its impact on science. Information specialist Paul Edwards explains in his book, “A Vast Machine: Computer Models, Climate Data and the Politics of Global Warming,” how climate modeling, far from being purely theoretical, is a method that combines theory with data to meet “practical here-and-now needs.” Computer models operate within a logical framework that uses many approximations from data that — unlike weather models — can be “conspicuously sparse” but still constituting sound science, much as a reliable statistical sample can be drawn from a large population. How statistics guide risk analysis requires better explanation for a public that must make judgments but is seldom provided context by news stories. The debate over cap-and-trade policy might be Exhibit A.

Depicting model-data symbiosis in such diverse fields as baseball performance, hurricane forecasts and long-range warming predictions would be ideally suited to web technology. Not only can climate models be reproduced on PCs and laptops, showing atmospheric changes over the past and into the future, but also the models’ variables can be made accessible to the web user, who could then take control of the model and game the display by practicing “what ifs” — how many degrees of heat by year 2100 could be avoided by a selected energy policy, how many people would be forced into migrations if this amount of food supplies were lost, how big would a tidal barrier need to be to protect New York City from another Sandy disaster? (If this sounds a bit like SimCity, the new version of the game due in 2013 includes climate change as part of the simulated experience.)

This narrative approach to news, including personal diaries and anecdotes of everyday lived experience, is what Richard Sambrook, former director of BBC Global News and now a journalism professor at Cardiff University, has termed “360 degree storytelling.” Mike Hulme, a professor of climate change at East Anglia University, provides this description of the new public stance toward science in his book, “Why We Disagree About Climate Change”:

Citizens, far from being passive receivers of expert science, now have the capability through media communication “to actively challenge and reshape science, or even to constitute the very process of scientific communication through mass participation in simulation experiments such as ‘climateprediction.net’. New media developments are fragmenting audiences and diluting the authority of the traditional institutions of science and politics, creating many new spaces in the twenty-first century ‘agora’ … where disputation and disagreement are aired.”

Today’s media is about participation and argumentation. A new rhetoric of visualization is making science more comprehensible in our daily lives. What goes around, comes around. One of the pioneer online journalism experiments in making the public aware of how technology, risk assessment and human fallibility can cross over was a project by MSNBC.com known as the “baggage screening game.” Players could look into a simulated radar screen and control the speed of a conveyor line of airline passenger baggage — some of which harbored lethal weapons. Assuming you were at the controls, the program would monitor your speed and accuracy in detection and keep score, later making you painfully aware of missed knives and bombs. Adding to your misery was a soundtrack of passengers standing in line and complaining about your excessive scrutinizing, with calls of “Come on! Get this thing moving! We’re late!” It was hard to be impatient with the TSA scanners after that.

Convention City: For the next two weeks, we’ll be barraged with reportage from the Republican and Democratic national conventions. As MediaShift points out, a lot of attention among media observers will be paid to how a variety of digital tools are deployed, much like it was during the Summer Olympics. The media industry blog has already put together a helpful list of resources for following the conventions. Meanwhile, the Washington Post has launched a new feature it’s calling The Grid, which is an interesting way to scan through all their various social media and reporting channels and get the latest on the RNC (and next week the DNC).

Instagraphic: In case you missed it (which seems impossible), Instagram moved to the center of a century-old debate this weekend following the shootings at the Empire State Building. When user @ryanstryin posted a graphic photo showing one of the victims lying in the street, it prompted a lot of reflection from both the mainstream media and the public over whether it’s appropriate to publish or share such images. We’ve had these arguments since the advent of photography – in times of war, in times of peace – on whether to publish photos of the dead and wounded or withhold them out of respect for the victims and their families. But this was a special kind of wake-up call. The media no longer makes these decisions, now that witnesses have a publishing platform in their pocket. New media commentator and J-school prof Jeff Jarvis got a little hot under the collar defending his own decision to share the photo on his Twitter stream and offers a compelling argument on the side of keeping the news unfiltered. The point is, if you click this hyperlink showing a victim with blood streaming down the sidewalk (republished here by Slate), you’ve already been forewarned by the linked words. Since mainstream media still have the broadest reach, they will continue to find themselves at the center of this debate, but the audience is going to find it increasingly difficult to avoid such material. The decision will be not one for the “broadcaster” on whether to share, but a personal one on whether to click.

Streaming the world 60 seconds at a time. The Wall Street Journal is now asking its reporters to file microvideo reports using the social media video platform Tout. They’re calling it WorldStream. From Tampa to Syria, you can see snippets of life, the news, and everything else a reporter can capture with a mobile phone camera. A first dive leaves me with the impression that much, much work has yet to be done before WSJ’s WorldStream can be called a mature product. Rebels relaxing in a mosque in Syria might have been portrayed better with a photo, for instance. Thirty seconds watching a pan of the empty delegate center in Tampa would have been better spent reading an actual story about the convention. And I can’t help but wonder what you can expect to get out of a 60-second interview with a pol – the format seems more suited to TMZ celeb shots and gotcha journalism. It will be interesting to see how the service evolves. For now, my main impression is that we’re looking at the news equivalent of Romantic fragment poems – Coleridge’s “Kubla Kahn” or Keats’ “Hyperion.” They may work artistically, but are story fragments really the best approach for an industry devoted to informing and enlightening its audience?

Social media is bull$#!t. Or so says B.J. Mendelson in the title of his new book. The former social media marketer and contributor to Mashable boosts his own contrarian view after serving the industry for years. Among some of the more common precepts of online journalism Mendelson disputes: the all-importance of pageviews, that Facebook really has 800 million users, and that we’ve learned much new about Internet marketing since Dale Carnegie’s “How to Win Friends and Influence People.” He tells journalist Ernie Smith that the biggest BS thing about social media is “the concept that what’s happening on these very different platforms, with their comparatively small and different audiences, has resonance with what’s happening with the rest of us. This false hope we’re giving people, which not coincidentally popped up around the same time the economy cratered. People needed something to believe in, and selfish and greedy marketers were ready to give that to them in the package of the myth of social media.” Incidentally, the interview is a nice display of what you can do with Jux, yet another platform for quick blogging.

The problem with open data. Is there one? Some interesting conversations on the topic this week. One started when the White House announced the selection of its “Innovation Fellows,” members of the private and nonprofit sectors and academia whose job it will be to help develop five government programs, including one on open data. That announcement sparked some backlash from conservative commentators, including Michelle Malkin, who wondered whether this isn’t really just a waste of taxpayer money. Open government reporter Alex Howard captured some of that debate, which unfolded in the social media sphere. Meanwhile, techPresident’s David Eaves reported on how a government spending scandal uncovered in the U.K. with the help of an open data project raises as many questions about how government collects and reports its data as it does about the suspect spending. So, what do you do if the government’s databases are poorly coded or managed – how do we get the government to change? And even if you discover these remarkable stories with the aid of open data sources, does it make it any easier to act? More questions like these are sure to present themselves as data journalism flowers into a discipline in its own right.

Another decade of the Internet. I leave you with a fun look back at how much the Internet has changed in the past 10 years, courtesy of this Mashable infographic. Enjoy.