Journalism students use sports to learn how to manage reader comments online

Kristian Strøbech is an Associate Professor at the Danish School of Journalism and the instructor of “Online Journalism & Multimedia Storytelling.”

25,000 user visits in just seven days,
400 reader comments
…these were some of the results when 22 Danish online journalism students set up a website dedicated to covering the home town soccer team.

The class spend a week preparing for the project and setting up the site, http://www.agfokus.dk (Danish language). Technology costs were kept at 75 dollars, and for this modest investment of time and money they created and instant succes with fans – and a very worthwhile educational experience, both as an online journalism exercise and an experiment with dialogue-based journalism.

First some background on who we are:

The Danish School of Journalism is one of the larger journalism faculties in Europe with approximately 1100 full time journalism and photojournalism students enrolled and a staff of 110. DSJ is exchanging students with more than 40 educational partners in all parts of the world.

The course “Online Journalism & Multimedia Storytelling” has existed since 1999, and is one of five advanced practical media studies that journalism and photojournalism students at DSJ can choose during their final year. The course takes up a good part of a full semester. Focus is both hands-on and theoretical, with emphasis on acquiring the relevant skills in digital technology (photo, audio, video, Flash, basic HTML and CMS). Over the years students from the course have won national and international awards in multimedia journalism with their graduating projects. Projects are online at http://afdelinger.djh.dk/semesterprojekter.

We usually have one or more “live” online projects, always of shorter duration, during the course, and over the years we have tried many variations. Last fall I wanted to focus extensively (for the first time), on dialogue-based journalism, and for that I needed to be sure of a fairly big attentative online audience, which of course is not easy to ensure for a student project. I was guessing that some kind of spots focus could deliver an audience to an online project, but I was reluctant to go in that direction, because I feared that a large part of my students would have motivational problems with a sports-related subject.

But then I spotted an interesting “dramatic” situation: Our campus is situated in Aarhus, a city of 300.000, where the local soccer club, AGF (one of the main Danish clubs), had sensationally dropped out of the main league the previous season. As the fall season drew to an end last November, it became apparent that the team was not going to have an easy time making it back to the top league. In the last week of the fall season the team faced three “make or break” games during six days, and that November week fitted perfectly into my course programme in terms of carrying out a live online project.

So soccer it was, and predictably, at least a third of the class couldn’t believe their bad luck when I revealed the subject for the exercise. We were to focus exclusively and extensively on the team with every skill the class had acquired: Round-the-clock online coverage, still photos, audio, video, multimedia interactives — and every story element would be open for comments/dialogue.

Preparations / Information Architecture

Out of initial story idea-developing sessions came suggestions like: “Doesn’t it hurt when a player falls over during a match?” and “To date a soccer player.” It was obviously going to need some heavy-handed editing from my side to produce content that the club’s fans would actually read.

Luckily the problem of focusing on the right kind of stories solved itself, when the students as part of the preparations were asked to put together a profile of the four most likely audience “archetypes.” The students conducted interviews with fans in all layers of society, started threads in online fan communities presenting their project, and one group even spent an evening at home with a family whose entire lives seemed to evolve around the club. That particular experience revealed that the father, a blue-collar worker of about 50, literally spent hours daily scouring sports sites and online communities for any club-related piece of information and apparently his friends did the same. A surprise for most of us, who in our minds had stereotyped his age group and educational background into not being part of the online crowd.

Thus, a couple of days into the project it became self-evident for the students, that story ideas like “Doesn’t it hurt to fall over during a ball game?” had to be shelved. We were dealing with an audience of hard-core fans who would follow any URL to news and information about their team, and it was a starved audience; after the league relegation, their team was for the first time performing under the radar of national sports news and television coverage.

This led to a very clear and focused understanding among the students: We were about to engage a critical audience, experts really, who knew much more than we did about the subject at hand. Not an unusual situation for any journalist, but the process of analyzing the situation and getting to know the potential site-audience became a very meaningful educational experience transcending the sports-subject. As an added bonus, everyone became engaged in the challenge lying ahead.

Also surprisingly (for us at least), the fan base turned out to be more diverse in terms of age, geography and social status than we initially assumed, and we were able to accommodate this information into the formation of the site. An early idea that became very popular with readers was an invitation to “exiled” fans to send us their story and a photo of themselves in team colors. This led to really nice (and popular) stories from all over the globe.

For information architecture tools, I used John Shiple’s dated but still excellent basic tutorial and some additional Danish texts.

The audience is commenting

One of my big doubts and unknowns was whether we would be able to enter into a professionally and educationally meaningful dialogue with soccer fans, or if comments and debate on the site would be confined to esoteric fan discussions and banter. But I need not have worried. As it turned out, comments were for the most part positive, helpful and educating.

A few words about the set up: The site was built as a WordPress blog with every story open for comments. Commenting was not moderated, except that a user’s first comment on the site required active approvement from an editor. This worked really well, and allowed us to stop one or two comments not relating to either site or subject.

Out of 400 comments delivered on the site during the course of the week, only one thread needed a few cooling remarks from the editor. This was after the second game of the week (which the local team lost), where fans of the visiting team left some gloating remarks on the site, which in turn provoked AGF fans. Other than that, the overwhelming number of comments were positive in nature. The comments largely divide into a few groups:

  • Quick comments on editorial content, no reply needed. Often just a positive exclamation or side remark.
  • Comments on articles supplying additional information.
  • Comments pointing out reporting errors.
  • Suggestions, tips, requests.
  • Participation in discussions developing around certain articles or comments.

    It is hard to exaggerate the impact these lively and engaging reader comments had on us. Everyone in class became hooked and the effort put into the project was unlike anything I have seen before.

    Story development by dialogue

    Surely, it is nothing new in any newsroom to tap into ideas and suggestions from the audience, but it was a valuable exercise to use the site-based dialogue as an integrated part of the daily editorial process. To encourage our readers, my students came up with the idea to create a roaming video team that would take on a daily mission, chosen from incoming user requests. It quickly became one of the most popular features on the site, and the resulting stories were were both lightweight and more serious in nature. One user wanted us check a rumor that the team always had beef for lunch the day after a victory, but were served something more ordinary after lost games. Another user asked to hear what a former top player thought of the team’s present predicament. We tracked him down and met him in the kitchen of the restaurant where he now works as an accomplished chef – a nice feature story, one that we certainly wouldn’t have found otherwise.

    After the first couple of days we started getting a handful remarks a day from users thanking us for our effort and pleading with us to keep the site active longer than our planned week-long run.

    Video, above all

    Visitor tracking confirmed without a doubt that video was what our particular online audience really wanted. Every video we put on the site consistantly scored high in views (for statistics we used Google Analytics, which is free, useful and very easy to set up with a WordPress site).

    During games we had several cameras rolling and a runner who would pick up tapes and bring them to the press room, where we could edit clips (with iMovie) and upload them to YouTube during the game. It doesn’t beat a live TV transmission, but the highlight game clips were very popular with our audience, and it all was formidable training for the mostly print-trained students.

    On the technical side we opted for embedding YouTube videos in our site, since the workflow is easy and simple. The average waiting time was 20 minutes from upload till we had a working embedded video in our WordPress-site. We created a project account and used tagging to sort all the project videos. This allowed the really eager user to subscribe to our channel at YouTube, as well as following the site.

    Live blogging killed the site

    Live blogging during games was very popular and drew a large number of comments. It is also in itself an exellent training excercise for anyone who tries it for the first time. The popularity had a drawback though, because the constant browser refreshing among users caused our site to crash momentarily during all three games that week. One of the tech-savvy students came up with an interesting backup solution when this happened: We opened a Google document for our live-blogging team (all Google documents also have URLs) and before the game we prepared a simple white html page, ready to substitute our site. This stripped down webpage had contained just a headline and a link to the live-blogging Google document, and links to our YouTube and Flickr accounts. Basically this allowed our audience to stay tuned even though our site had crashed.

    Struggling photographers

    All our photos during the project week were uploaded to a pro account at Flickr. I had four photojournalism students in the class as well, and as always they provided the project with photography of a quality that all the “snap shooting” journalists never came near achieving. But an interesting learning experience was the clash between the Web’s demand for instant publishing and the professional print photographers’ dependence on the slow process of sorting and choosing and cropping and Photoshopping. This drove the student-site editors mad, because during the first two games of the week we had to wait a full 30-40 minutes for the first still photos to be uploaded from the photographers during the match. The live-bloggers were of course live and online from kick off, and it was hard for them to grasp why a few still photos could not be uploaded more or less instantly, never mind the quality but just to show our users that the game was on and we were covering it.

    I am not in any way blaming the photojournalists, as this is really just a predictable clash between two publishing traditions. The solution is of course dialogue and planning, and for the last game of the week the photographers had organized themselves with extra memory cards and a wireless laptop for uploading directly from the pitch.

    Multimedia elements

    Learning basic Flash is an integrated part of our course and it is usually technically challenging for most of the students. Even more challenging perhaps, is the successful integration of bandwidth heavy multimedia elements within the fast paced online storytelling environment. Again, this project turned out to be the near perfect publishing vehicle for relevant, userfriendly (and very popular) multimedia elements. A couple of examples:

  • Training ground interactive
  • Game high light interactive
  • Young players interactive
  • Frontpage fixed “eight picture-gallery”

    Our next project

    All in all, I think this project revealed how a live audience dialogue can be a great motivator in a training excercise as well as a useful source of inspiration and knowledge. The dialogue aspect is not something to be left just to the textbooks. Also, the educational value of the combined efforts needed to set up a dedicated website to a target audience cannot be overstated. There are hard lessons in this for any journalist, and I don’t mean of the technical sort. Regarding the technical challenge, it is amazing how tools such as WordPress, iMovie, YouTube, Flickr, Google Analytics and so on, keep getting easier to set up and use. In an educational context this is a great relief (I say this after countless hours of trying to teach HTML, CSS and their like to journalism students), whereas in a publishing context, it is almost scary to see how easy it is technically to create a moderate Web success with 25,000 user visits and 200,000 page views in just five days. I cannot help feeling sorry for our local newspaper here in Aarhus, caught in the steepest of declines and struggling so hard to find an audience for their scaled-down, text-based, subscriber-only website.

    In our next project, we will take the same tools and travel to Iceland this coming October where we will try to turn an interesting conference (Play The Game 2007, Reykjavik) into an opportunity for five days of global Web dialogue on subjects such as corruption in sports, doping, and Olympic copyright.

    Comments and questions are of course very welcome.

  • Trade association proposed to represent ratings websites

    When a Washington D.C. homeowner became disgruntled with a contractor who turned a remodel into a costly nightmare, she posted a complaint on a review site called Angie’s List. As Washington Post Metro columnist John Kelly chronicles in a recent post, it wasn’t long before the contractor caught wind of his negative review. The retaliation? A $6 million lawsuit against the homeowner.

    Kelly’s column notes that the contractor wanted to sue Angie’s List, but that his lawyer told him it was protected. The statute most likely being referenced is Section 230 of the Communications Decency Act, which essentially protects Web publishers from comments posted by users on their sites.

    But the negative impact for review sites as a result of this sort of incident is exactly what concerns Bob Nicholson, vice president of marketing and business development for Ratingz.net, a company whose umbrella of review and ratings sites includes RateMyProfessors.com, RateMDs.com and RealEstateRatingz.com.

    Nicholson says the company’s sites continually receive threatening phone calls and letters in reaction to the negative reviews garnered by its members.

    Armed with marketing budget and media contacts, Nicholson says professionals can take an aggressive stance against review and ratings sites. That’s why he’s spearheading an effort to organize these sites by forming a trade association for ratings and reviews websites.

    OJR spoke to Nicholson about the legal issues and cases brought against the publishers of these sites, the need for codes of conduct and why ratings sites deserve a positive spin in the press.

    Online Journalism Review: Comments and ratings posted on review sites are usually anonymous. Is that crucial to a successful review site?

    Bob Nicholson: People are hesitant to share their opinions precisely because of retributions, so I think it’s important for people to share their opinions with some confidence that they’re not going to be sued for what they say.

    OJR: To play devil’s advocate, if people are saying that something that’s true, then why be afraid to put a name behind it?

    Nicholson: In our system of justice, you can be accused of anything. Even if your defense in court is the truth, being sued can still cost thousands of dollars in legal defense, even if you ultimately win the case. Many people don’t want to deal with that.

    So we’d see a real chilling effect if people are afraid to post their opinions. If RateMyProfessor.com hadn’t allowed anonymous postings, students certainly wouldn’t have shared opinions about professors because of fear of retribution.

    OJR: Have any lawsuits been filed against your company?

    Nicholson: None of the [sites] has actually been sued. We regularly get threatening letters and phone calls. But we have quite strong legal protection in the form of Section 230 of the Communications Decency Act, which basically says that we are immune from the liability for content posted by third parties on our website.

    If someone wants to sue the person who posted the content, they have to go through a two-step process. First, they have to get information from our company about who posted the content, and really all we can give them is an IP address and time of posting because that’s all we have. And they need to get a court order in order to have us divulge that information, which we have done on a couple of occasions. Then they need to get another court order to go to the Internet service provider and find out who was using that IP address at that time.

    Sometimes a person who posts a negative review will post enough information in the review that it’s kind of self-identifying, and there’s a reasonable cause of action. In that case, the party who objects to the review can bypass all of these steps and file a John Doe lawsuit claiming that they believe this person is responsible for these postings.

    OJR: How should reviews be monitored?

    Nicholson: We tend to air on the side of letting posts go through. We do remove posts that have derogatory racial or sexual comments. We also remove posts that include personal identifying information about the poster or third party.

    If a post includes specific allegations of illegal actions, we delete that too. Our position there is if you have knowledge of specific legal actions, a ratings and review site is not the place to post that information.

    For example, if someone posts something that says, ‘this auto mechanic says that he fixed my carburetor and he didn’t fix it at all. He didn’t do what he said he was going to do,’ that’s a complaint about service. On the other hand, if he posts something that says, ‘this auto mechanic gave me a written quote and then before he would give me my car, he gave me a bill for another item which does not match the quote,’ that’s an illegal action.

    OJR: But as a reader of review sites, boy, would I want to know about that mechanic before I took my car there. So do you allow some of those posts or how does it work?

    Nicholson: We do and it’s subjective and difficult because we have moderators and we provide guidelines for them, but sometimes the moderator may interpret the rule differently in a particular case than I would interpret the rule. So we have guidelines that we try to apply on the sites that we manage, and it’s by no means universal and other sites have different guidelines or standards.

    OJR: How would a trade organization unite ratings sites?

    Nicholson: One of the things that we want to do is provide a source of information the press can turn to for the other side of the story, which is that individuals really need a voice. They need a place to share their opinion, and where they can hear about what other people have experienced. They need to have something that balances the marketing power of professional associations by giving individual consumers the ability to express themselves and learn from other consumers.

    OJR:What would a professional code of conduct for ratings sites include?

    Nicholson: That’s really premature to talk about. I think one of the things we need to do is as we build the organization is to get the various companies involved in deciding that.

    OJR: How do you draw guidelines for posts?

    Nicholson: Well that comes down to the individual company and site philosophy, and I do think that it’s important that sites be open and public about what their standards are so you can understand how posts are being filtered.

    In our case we’re very careful about deleting things because we don’t want to bias the ratings with our feelings. People express themselves differently. We see a very different review and type of language on our nightclub site than on our camp ratings site. If we try to apply our biases, I might filter out a lot of the ratings on our nightclub ratings site because of the language, but for that audience it’s valid discourse–

    OJR: So you don’t want to disrupt the culture of whatever the product or the service is–

    Nicholson: Yes. We also put a lot of faith in people as readers. When you’re reading reviews that people have posted, their language will influence you and you’ll interpret what they’re saying partly based on how they’re saying it. Do they seem like they’re crazy and vindictive or do they seem reasonable and are giving a balanced review?

    We don’t prefilter the content because you can form your opinions just as well as a moderator will make any decision as to what to let you say.

    OJR: How does a user trust that reviews are legit?

    Nicholson: Through a combination of software filters and instructions to our human moderators, we do try to filter out that type of abuse. We give our moderators instructions to look for patterns that computer software would have a difficult time seeing. For example, do I see the same phrases being used? Do I see the same language used over and over again? Do I see reviews submitted for five different Realtors within the same geographical region that uses very similar language to say this Realtor’s terrible? Then the suspicion is that maybe a realtor in that area is systematically slamming his competitors.

    We also have faith in the site visitor to look at the reviews and say, you know all these reviews are just too glowing, or they’re all just too awful and I don’t really believe them. We also emphasize this is just one source of information and if it’s an important decision, it certainly shouldn’t be your only source of information.

    To contact Bob Nicholson about his proposed trade association, e-mail bob [at] ratingz.net.

    Are you killing your comments?

    OJR reader Anna Haynes wrote in with a complaint, noting a mistake that too many online writers make:

    “I see the same mistake made over and over again, by online-newbie media types who think that publishing their missives onto a blog is enough, that ’2-way communication’ just means letting their readers talk (to each other, or to the wall) in the comments section; they don’t see dialogue between [non-troll] reader and blogger as part of the deal….

    “[S]o I read the post, I ask a question in the comments, I get no answer. I *feel* like it’s rude, by my blogging etiquette; perhaps theirs is different?”

    She’s right. Opening your stories and blog entries to comments represents just the first step in a long process of building an interactive relationship with your readers. I’ve written about the lost opportunities when news publishers do not solicit comments from their readers. Today, I’d like to write about the next steps – and identify three top mistakes that news publishers make to undercut their efforts at attracting smart reader comments.

    Don’t read or respond to your readers’ comments

    If you learn one thing from this column, let it be that “reader interactivity” is not a technical feature. Flipping a switch to turn commenting on does not make your site any more interactive than one that does not accept online comments.

    Interactivity is a relationship, built not with computer code but with words exchanged by real, living people on both sides of the Web server. Yes, you need good computer code to help enable and manage these relationships. But the code alone won’t make them happen.

    Nor can you expect readers to “talk amongst themselves.” They can do that anywhere else. If you want readers to talk on your website, you need to offer them the one unique feature that no other blog or discussion board can – the opportunity to talk to you (or your writers).

    So schedule time to read the comments on your stories, and to respond to questions or allegations made by your readers. Again, smart software can make this job easier, by identifying URLs with new comments or even sending your e-mails when readers post to your articles.

    Robin Miller’s advice on discussion boards applies here, too. Shutting down comments after a reasonable time can help ensure that you are not debating the same articles forever. Freeing yourself from the fear of having to respond to every article you’ve ever written should help your resolve to stay on top of the discussion over your recent pieces.

    Looking for some positive examples? Haynes provided a few, along with some smart analysis, when I asked her who is doing this right:

    “Of the more well read blogs, Jay Rosen at PressThink is excellent about responding to my and others’ comments – likewise Lex Alexander and John Robinson of the Greensboro News & Record, and of course, Dan Gillmor. With them, it *is* a dialog.

    “In general, it seems like the smaller the blog’s readership, the greater should be the obligation to respond to the readers, but typically the initially-small-readership blogs from offline-culture organizations are the least responsive (which is behavior that will tend to *keep* their readership small).”

    Respond too quickly, and too often, to readers’ comments

    Yep, I’m throwing you a curve here. But as an apathetic writer can kill a conversation, so can an over-eager one.

    Yes, if a reader asks a question directed at you, you should respond. But don’t rush to post the next comment after every question or observation. Allow your readers some time to respond to each other.

    When you do respond to a question, do so in a way that invites other readers to provide answers as well. Don’t think of yourself as one party in a two-person conversation. Instead, think of yourself as a talk show host (or dinner party host, if you are allergic to talk radio), charged with the responsibility to keep the converation moving, and to get as many people involved in that conversation as possible. In my experience, the most thoughtful readers are not always the ones most eager to comment. You must coax those readers into your conversation. Then let them have the floor once they engage.

    You can’t do that, of course, if you always demand the latest word.

    Don’t give readers a place of their own place to talk

    Smart, conversational comments sections will help attract more loyal readers to your website. But if you want to build your readership to an even larger level, you will need to give those readers a place to initiate their own conversations.

    People don’t like to react all the time, sometimes, they need to initiate. (Sports analogy: No one wants to spend the whole game on defense. Now and then, you need to get your hands on the ball.) Even if an individual reader never starts a conversation on your website, trust me, they will feel more empowered by seeing other readers doing it.

    So let them. Once you’ve established a tradition of responding to comments on your site, take the next step and open a space for readers to start their own conversations. Launch a discussion board, or enable readers to publish their own blogs on your site. [Like we just did here on OJR.] But do not forget that your, or your staff’s, participation is still needed.

    Your writers’ participation in these discussions, or your writers’ comments on or links to readers’ blogs, helps cement the relationship between your website and your readers. Reader blogs and discussions can become a rich source for news leads, too. Just be sure to credit the original discussion or conversation.

    The good news is that our readers do care about us, or at least about what we write. Let’s return that wonderful favor, and resolve to make better use of our websites to show that we care about our readers’ thoughts as well.