Category Archives: ideas

Timeline: how the Guardian did what I wanted to do

I once defended timelines as a great way to tell a story and to provide context to the facts. I also defended that news companies should be aware of their archives, and the value they have. Well, the Guardian used both to document two years of Blitz, on the 60th birthday of the beginning of the German bombings.

Guardian's timeline with archive referrals

Basically, this is a slideshow with a timeline navigation, with some info on the side, and some links for the original articles about that specific event. It’s a simple and very effective way to tell a story that unfolded for quite some time. Count the words of the side notes, and how they’re written: concise and clear. The link to the archives will give you the information about what happened through the voice of the journalist who witnessed it, lived it, more thoroughly. How many other stories could rehash these bits of History? Could journalists be a bit more like historians, also looking into a more distant past instead of focusing on the now?

This is just another new journalistic narrative, and one that could only work online. More, one that grabs all the potential of the medium. How do you feel about this type of narratives?

Portuguese data scraping experiment: parliament activities and YQL

It looks simple and effective, and something like this should have been made before by a newspaper or other news outlet. But, once again, it’s the geek community that steps forward and does a useful tool using public data (although I heard recently that a political editor working in an important media institution said that the deputies attendance was a “state secret”. Yeah, right…).  And why ? Just for the fun of it!

List of deputies by electoral circles

The mind behind this is experiment is Luis Confraria, that works as a front end developer at Outbox Ativism, a company that specializes in digital and web products for companies and institutions. So he’s not a journalist, but he decided to experiment with some tools to create what can be considered as a journalistic product. I asked him why: “Well my main motivation was.. fun! Also ,I liked the idea of building upon some  government website that indeed contained all the data but not in the most useful way. Besides, I really wanted to learn and test some stuff i used in it.

The project is based on the Portuguese Parliament website, and shows all the current deputies by party or electoral circle, and the profile and participation of each one of them. The original information is not organized in a easy to use way, so Luis resorted to some data scraping techniques. “At first I started scraping the data with a little python script but then I went with yql. Made a few open tables, and pushed them to github. On the client side i just used simple html / css / javascript with jquery, sammy.js.

There aren’t many open-data or data scraping projects in Portugal, and most of the ones I know are created by non-journalists, and he shared the example of Is there a lack of programmers in Portuguese journalism? I think so, but Luis goes even further: “There is probably a lack of programmers in society at large 🙂 not just in journalism.” Maybe journalists are  just not having fun with their work.

I’m optimistic about this. We will see more and more of these projects because there are better and faster tools each day and because people do really care.” To which he adds: “The most important is to have public data in the simplest format possible. The rest will come naturally.

I’m not as optimistic as he is, but I agree: there is a need, and things will find its own course. But it was hard to find space for videographers in the newsrooms, so I’m not confident about the future of programmers in the new newsrooms. At least in most of them. Now that he did this, what comes next?

Probably i will tweak and fix it some more. (It still looks like crap on ie). I hope someone builds something else with the yql tables. I have some ideas popping now and then but nothing mature enough.”

We’ll be looking out for them.

Luis shared the YQL tables, so have fun:

and here is the code for the tables:
Detailed information for each deputy: attendance, participation and profile

I’m a smartass

Don’t you hate people that  keep saying “I saw that one coming” or “I told you so”? I hate even more when I see people saying stuff i said before, and better than I did. But it’s comforting to know that sometimes a crazy idea is not that crazy at all.


In one of Google Reader items I saw the presentation of a new video tool:

Interactive video transcription and captioning service 3Play Media has an answer with a video clipping feature it announced today that “allows users to quickly create and share specific portions of a video simply by highlighting the spoken words in the transcript.”

Rather than introducing a video by asking your friends to use somewhat inaccurate controls to skip ahead, the service helps take them directly to the part of the video you intend, right down to the specific word. The service creates a link that includes start- and stop-time information. When you click on the link, you’re taken to a page that shows not only the video, but a word for word transcription alongside it.

This reminded me of one of those crazy ideas I sometimes have. In January this year I wrote:

I hate to transcribe every single word from an audio recording, and I’m also really slow taking notes. So, what about some voice recognition magic, that would  get every little word out to text format, while recording the audio, and the timeline for editing that audio would be words themselves. Not getting  it? You’d edit the statements like a Word doc, but if you chose a paragraph you’d have the audio associated to that specific bit ready to export. And send it immediately for publishing.

Not exactly the same idea, but pretty much the same principle. If 3Play Media tweaked the code a bit I think they could do what I proposed.

Dear Journalists, this is journalism too

If you want a picture of what the job of journalism also includes these days, just take a look at this post where the NYTimes explains their live coverage of the World Cup.  Journalism will not turn exclusively into this but it will also have a lot of programming. Are you willing to accept the change? You know it’s not up to you to decide, but to the users (people formerly known as the audience). I can see the job ads now: “required good writing skills, especially in XML and PHP.” The geek shall inherit the Earth indeed.

Changes in the Paradigm: from Citizen Journalism to Social Journalism

Citizen Journalism has always caused some stir: it’s hard to define, some academics and professionals do not consider it to be “real” journalism, yet it has been the source for breaking stories and mainstream media companies have been leeching on it. But Citizen Journalism – if there was ever one -has changed to something more complex and even harder to tackle: Social Journalism.

First of all, I have to make a distinction between the production of content and it’s distribution. Journalism is production, and now its distribution is made through new channels, mainly social networks. The issue here is that users add content while they distribute it, and that contribution can or can not be journalistic. For example, when I covered the Madeira floods, I used content I thought it had journalistic value, like videos and information about missing people, closed roads, isolated villages and overall damage. All the content was being created and shared online by common citizens on their social networks, like Twitter, Facebook and YouTube. And this is where the unstable paradigm of Citizen Journalism breaks to give way to Social Journalism.

In my former blog I jotted down a set of characteristics for Citizen Journalism:

  • It’s casual, whoever practices the journalistic act can do it only once in a lifetime.
  • It is mainly spontaneous, not dependant of an incumbency or professional obligation. It can be provoked by opportunity, personal need or social responsibility.
  • It is disorganized/not sistematic – this can happen in more or less degree, specializing in a job implies the learning of a method, that the citizen journalist may or may not master.
  • It is related to the surrounding reality of the citizen journalist, whether it is in a geographical level, emotional, cultural, therefore there is a certain amount of partiality (but like we’ve seen before, impartiality doesn’t not objectively exist in traditional journalism).
  • It doesn’t follow the mainstream news agenda. Apart from calamities, terrorist attacks, or other high profile events, Citizen Journalism tends to reflect realities, subjects, or perspectives absent from the mainstream media coverage.
  • It can be done by people who have a greater specific knowledge about a given subject than a journalist (which happens frequently, one can’t just know about everything).
  • The purpose is not any sort of remuneration but simply the act of information. (this can change)

But today I was reading this very interesting post by Joanna McNurlen that gave me a new perspective and raises some interesting questions:

Certain amateur new media users walk a similar path. They take photos and videos that instantly upload to the Internet, they use GPS software to track and broadcast their locations, and they tweet about everything they experience. The new media call these tech-savvy people “journalists,” but without the old connotation of the term. These so-called journalists do not investigate stories but merely broadcast experiences. They work as transmitters, publicizing their experiences with neither critique nor analysis. In doing so, they invite critique and analysis from other sources, which poses a problem.

“Experience broadcasting”. Now there’s a spot on concept. If you read the whole post, you’ll see she starts with the uploading of content to social networks, and then takes a turn to Baudrillard’s concept of simulacra, which in simple terms means we work with flawed representations of reality, and build new representations of it every time we relay our own view on it. This has always happened, and photography as one of the noble arts of journalism has always faced that problem: it captures in frame a slice of reality to show the core of that reality. Of course, many times it overlooked what was outside the frame for dramatic effect.

I remember thinking when I was a doing my first newsroom internship – in the last years of the last century – how little the audience gets from the actual reality of the news. A journalist has a backstage pass to reality, but it does not interfere (ideally) with the show, but neither gets the audience’s perspective. We see the actors before the makeup, the ropes and strings holding the set specifically built to maximize the visual effect for the audience, the marks on the floor and all. We do not report on that because that’s not the news. The show itself is, but we use that privileged position to account on it, and that was the power of the journalist: access.

But things changed and now reality and it’s slices and representations are in the middle of a virtual social arena, and the audience is part of it, surrounds it, builds and rebuilds that reality. When Haiti was hit by an earthquake six months ago most of the information was “broadcast” by people who lived it. They shared pictures, video, others outside the country managed to create maps with the information available, Google changed their own maps to show the degree of devastation. Google is not a news company, but knows the value and the need  users had for that information. Google thought in “Social” terms, like the ones who kept tweeting and posting content on Facebook, and sharing those snippets of journalism-unmediated reality online.

So the change goes like this: with Citizen Journalism, users created content (in different levels of complexity and depth), shared it; in Social Journalism users broadcast experiences or echo other people’s experiences by adding their own content to them and re-distributing it, and in some cases, that can be classified as journalism. Corporate media is already tapping social networks for stories and they have to do so or they’ll miss out on a huge amount of stories. And if you think broadcasting experiences is not journalism, well, take a look at this:

Hindenburg Disaster

We always had experiences broadcast by media, now many experiences are broadcast by users. The middle man (the journalist) is off the circuit between event and audience, but it’s not out of the loop. A huge part of journalist’s work these days is to validate the information, repurpose it  for an audience that is willing to build on it, and create context. But context is for another post.

Though media companies still ask their audience to become “citizen journalists” and profit from user generated content (UGC), I believe that things are changing to something more interesting: UGC turns into Social Generated Content as users post their experiences in social networks and think only about their connected peers, and not the local newspaper or radio station. This new “ParaMedia” phenomenon includes Meta and Hyper Media, but most important of all, it defines what social media is all about: sharing.

And you can share your thoughts with the rest of us. You probably saw this on Twitter, Facebook, Delicious, FriendFeed, your RSS reader of choice, so what do you make of it? Can personal snippets on reality be considered as journalism? Was journalism a corporate aggregator of reality slices? Where does journalism must evolve to deal with Social Generated Content?