Miley Cyrus News

Sunday, September 7, 2008

Many of Twitter Search's Trending Topics Really Aren't: They're Just Twitter Echo

Here's the scenario. You go to your favorite Twitter search engine to see what's going on in Twitterdom. Assuming you've gone to, you look down at the Trending Topics to see what's on the minds of Twitteropians. You see the following phrase "Skateboarder Wanted." You're intrigued. You're wondering "what could a skateboarder have done that has him or her wanted by the police?" So you click on the link and get taken to the Twitter search results page. You see a number of postings describing a story from Germany in which a skateboarder is wanted for doing 62 mph in a 50 mph zone.

Okay, interesting enough, but Trending Topic? Hardly! At the time of this writing, there were only twenty postings that matched on a query of 'skateboarder wanted.' So how does a topic with so little interest become a Trending Topic?

To answer this question, let's start by taking a closer look at the results. Of the twenty matching posts, four of them were tweeted by a human, and the other sixteen were tweeted automatically from a feed service such as TwitterFeed is a terrific free service that Twitalytics uses to automatically submit our blog posts to Twitter. The way that it works is you set up an account with TwitterFeed and provide your Twitter account name and password. You set up a new feed by providing the address of the RSS feed you want to post from. You then set the frequency that you want TwitterFeed to check for new posts. Set it and forget it. It really is a very useful service.

But, as with many things, it is pretty easy to abuse this service. You see, even though the spirit of TwitterFeed is to enable you to tweet *your blog* -- you actually can tweet any blog or RSS feed. So let's return to our wanted skateboarder. That story was posted to Digg where it got enough interest to make it into the RSS feed for popular Digg stories. Now imagine a Twitter account whose only purpose in life is to re-tweet stories as they get published via RSS feeds from major sites such as Digg, TechCrunch, NY Times, CNN and so on.

Here is an example of four such accounts. @headlinenews, @headline_news, @top_news and @breaking_news. There are many others but I chose these as really good examples. What each of these has in common is the intention of tweeting news headlines from major news sources. The aggregation of the disparate sources combined to make a somewhat useful Twitter account. You can imagine that if you followed any one of these, you'd be getting a good cross-section of news stories as they occur.

The problem occurs when many people act on this idea and set up Twitter accounts for automated re-tweets of the same news sources. In the case of the skateboarder story, once the headline made it into the Digg feed, fifteen accounts (in addition to diggupdates who also tweeted the headline) re-tweeted the same exact headline. This barage of tweets dealing with the same subject in a narrow slice of time caused the phrase "Skateboarder Wanted" to achieve the status of a Trending Topic (though that didn't last very long). It really wasn't a hot topic nor did it ever become one (at least not on Twitter).

This phenomenon, which we're referring to as "Twitter Echo," occurs for most of the major news sources. The articles get published in their RSS feeds and then re-tweet accounts automatically multiply the post causing the terms in the headline to immediately spike as a Trending Topic. [Note: the phrase "Twitter Echo" has been used before but hasn't taken hold, so the terminology seems to remain up for grabs.]

Is Twitter Echo bad? Well, it creates additional noise in the system that for the most part isn't resonating with the Twitter audience. The four Twitter accounts mentioned above have a combined following of 516. That's not much. Twitter makes it very easy for a user to sign up for tweets from the news sources of interest that the user cares about. Is there really much added value from someone doing the work of news source aggregation? It's hard to imagine that there is.

Saturday, September 6, 2008

Trending Topics and Hot Searches -- How Twitalytics is Different

A recent blog post on Twitter's blog Twitter Trends & a Tip talks about the Trending Topics feature of Twitter Search. There's no question about the value of this feature. Twitter Search along with the Trending Topics feature provides a real-time snapshot into what people care about at this very moment in time. This provides a level of insight into current events that was not available anywhere else on the Internet until Twitter came along. That's a very bold statement to make, but it's true.

Another exceptionally powerful tool is Twitscoop. This description is lifted from their about page: "Through an automated algorithm, twitscoop crawls hundreds of tweets every minute and extracts the words which are mentioned more often than usual. The result is displayed in a Tag Cloud, using the following rule: the hotter, the bigger (no joke here)."

Twitalytics could not do what it does without Twitscoop. And using Twitscoop inside TweetDeck is a very handy combination of functionality. One more tool that deserves mention is Twitstat which also offers a tag cloud of hot topics. To be sure, there are other Tweeters out there who are also using the tools described here to report back on the hottest topics such as @twitgeistr (uses Twitstat) and @trendingtopics but @Twitalytics aims to do something much more than just report the hot topics.

Regardless if you're looking at Twitter Search's Trending Topics, or Twitscoop or Twitstat, you're never getting the back story. If the word "earthquake" happens to be hot right now, do you know why? A hot word or phrase is actually of no value to you unless you know what is causing so much interest in that topic.

What all of these other services have in common is that they are powered by automation. Sophisticated algorithms comb through the Twitter stream culling out words and phrases that are occurring at an unusually high rate relative to all other words. Whether this gets reported back as a tag cloud or a simple list, the best that these algorithms can offer are the spiking words, not the understanding to explain the reasons for the spikes.

Twitalytics provides a service whereby a human rapidly performs enough research to quickly determine whether there's any importance to a spiking topic or is it just a statistical anomaly that's of no consequence. Then, upon determining that a hot topic merits the attention of our audience, we put an editorial voice to what is happening and explain why anyone should care.

Our Tweets are written as if our followers are getting these as SMS text messages on mobile devices. The goal of each Tweet is to provide enough information with the allotted 140 characters that we alleviate the need for the reader to have to visit a Web page to become informed. This is very different than how news services operate. They Tweet a news headline that usually provides a teaser but not enough information to offer understanding. This forces the user to visit the accompanying URL to get the complete picture. Twitalytics aims to deliver understanding, not teasers.

Friday, September 5, 2008

Tweetlog for September 4 through September 5

  • What we're not tweeting enough about: Haiti has been ravaged by three storms. People there need a lot of aid. And now Ike is coming at them
  • TaTweeting Up: tatango began offering its free group texting service to the public today
  • (espn) White Sox lose Carlos Quentin due to wrist surgery possibly for remainder of season
  • (CBS/Hilzoy) Factchecking Sarah Palin's remarks during her acceptance speech:
  • (MarketWatch) McCain's acceptance speech drew more viewers than Obama's. Total viewing audience 38.9M to 38.3M across all covering networks
  • Think you know the issues? Play this game at ABC to see who you really agree with.
  • Twitterland anxiously awaiting official launch of Spore (sim game by SimCity creator) on Sept 7
  • (npr/John Ridley) A pocket guide to speaking "Palinguage"
  • (AP/Mercury News) US Coast Guard helicopter crashes off Hawaii coast. 3 crew members dead, one missing.
  • Tweeting up: Adobe unveils Genesis at Office 2.0 conference -- a collaborative mashup client based on Adobe AIR for enterprise workers
  • (AP/Yahoo) A brewing cat fight? Obama campaign to employ more high-profile women in effort to blunt Palin's appeal
  • (CNNMoney) US jobless rate hits 6.1% -- highest in five years
  • (MSNBC) Condoleeza Rice makes historic first visit to Libya -- highest ranking US official to visit in 50+ years
  • Ike is now a category 3 hurricane expected to hit populated areas of the Carribean by Sunday and is on a path to hit South Florida next week
  • Time magazine (Joe Klein) response to Palin/Giuliani mockery of Obama's community service
  • Michael Moore: on Larry King Fri @ 9pm ET/6pm PT. Release of "Slacker Uprising" - Mike's Election Guide #3 NYT's best
  • East coast states from Georgia to New Jersey bracing for Hannah. "State of Emergency" issued in North Carolina and Virginia.
  • On behalf of Tweeters everywhere, TGIF!
  • Chants of USA USA USA means another protestor has been spotted and removed
  • Nice line by McCain: "we are all Americans and that 's an association that means more to me than any other"
  • Protestor in the RNC08 hall getting great coverage
  • John McCain now taking the stage at #RNC08
  • While we're waiting for John McCain to start, here's a priceless video from Jon Stewart: Sarah Palin Gender Card
  • Twitterland reactions to Cindy McCain's speech: put the video back on!!
  • Twitterland reactions to Cindy McCain video: we could all use a tissue right now
  • Tom Ridge has taken the stage at #RNC08
  • Video about Sarah Palin now playing at #RNC08. Theme: mother, maverick, moosehunter, maverick, mayor, maverick
  • Twitterland reactions to Senator Graham: wondering if speech was really written in anticipation of Joe Lieberman getting the VP nod
  • Senator Lindsay Graham speaking now at #RNC08
  • Tweeting up: Barack Obama being interviewed by Bill O'Reilly
  • Twitterland reactions to Senator Brownback: fell flat. Also, feeling he ripped off Hillary's "yes we will" line
  • Twitterland reactions to the new Bill Gates/Jerry Seinfeld TV commercial aired during the football game: not good
  • Now tweeting: Governor Tim Pawlenty just finished his speech at #RNC08 -- Twitterland reactions: boring
  • What we're watching: NFL season opener - Redskins vs Giants - Giants up 10-0 with 11 mins left in first half
  • Tweeting up: Sarah Palin's new theme song playing at #RNC08: "Barracuda" by sisters Ann and Nancy Wilson of Heart
  • TO check the truthfulness of remarks made by the candidates, follow @politifact or visit:
  • Mass retweet: Good quote from my friend Jody: "Jesus was a community organizer. Pontius Pilate was a governor." Original:
  • Kevin Keegan has resigned as Newcastle United's manager
  • Cheney, speaking in Azerbaijan about Russia's invasion of Georgia "this act has been condemned by the international community." Ironic, no?
  • Latest predictions have Hannah making landfall in North Carolina early Saturday morning, then scooting up the east coast to Maine by Sunday
  • More Tweet buzz from last night at the RNC: "hick-hop" star Cowboy Troy's reading of the pledge - no one appears happy with that one
  • Now Tweeting: David Allen delivering keynote address at Office 2.0 conference -
  • Twitterville undecided: is it "pit bull" or "pitbull"??? According to Wikipedia, the AKC and rest of Web, it's two words -- "pit bull"
  • Tweeting from Thailand: PM Samak refusing to step down
  • Now Tweeting: tonight's NFL season opener kickoff time moved up to 7pm to avoid conflict with McCain's speech
  • Now Tweeting: tonight's NFL season opener kickoff time moved up to 7pm to avoid conflict with McCain's speech
  • Ike holding steady as a category 4 hurricane over central Atlantic ocean and moving west
  • Georgia issued a tropical storm watch for coastal areas in advance of Hannah
  • A moving van is in front of the Detroit Mayor's mansion. 'nuff said
  • C'mon America ... it's time to vote! Not for president silly, it's time to vote for your favorite tweets and tweeters
  • Ike has become an extremely dangerous category 4 hurricane but is still out in the middle of the Atlantic away from any land masses.
  • Hanna downgraded from hurricane to tropical storm. Lingering over Bahamas and Turks & Caicos. It'll play as a dog-leg right when it hits SC
  • Twitterdom reactions to Sarah Palin: she brought her "A" game and delivered. Most were very impressed with her.
  • Twitterdom reactions to Rudy Giuliani: besides the Drill Baby, Drill chants, it was a good speech but fierce and full of attack
  • (Guardian) If elected, Obama/Biden may press criminal charges against the Bush administration
  • Breaking News: Plane crashes in Cassville, WI. Two U. of Dubuque students on board now in the hospital.
  • What Twitterdom had to say about Mitt Romney: he wants to throw big government liberals out of Washington. Twitterdom's reaction: HUH??
  • What Twitterdom had to say about Carly Fiorina: she knows John McCain, that's about it
  • What Twitterdom had to say about Meg Whitman: awful speaker