LeftyBlogs.com: News & Announcements

« "But I don't know if I have an RSS feed!" | Main | Liberal Blogosphere for Hurricane Relief »

New feature: local and not-local tabs

That's right - we've made it a bit easier to read just the local stuff from your favorite local blogs. Those nifty tabs across the top of each state page separate each blog's headlines into local stuff and not-local stuff. (And a combined feed if you want to see it all.)

Of course, the whole local/not-local thing is an automated system based on keyword-matching technology. It's pretty darn good - but not perfect. Soon, we'll be adding a feature that allows you to report a particular post as being on the wrong side. That'll help our system get better and better at spotting the differences.

Stay tuned - we're still tweaking. Feel free to suggest more feature improvements here too.

Posted by Kari Chisholm on August 27, 2005 10:20 PM

Comments

One suggestion, one bug report.

Let people put invisible tags in their posts to mark them as local.

<local state="NH" /> would work, but maybe it'd be safer to simply do something like <span id="nh" /> although, maybe <span state="nh" /> is even cleaner. Maybe you could check for any of the above.

--

Bug report:

If you check NH, you'll see a post near the top from "One Voice From NH". It is obviously from last year, though, but the date of the year is correctly placed.

--

I can help if you have a SQL or database question. Movable Type is a php thing, so that's not tough for me either. Tons of experience. ;) Check my blog for a link to my resume.

Posted by Josh Narins on August 29, 2005 06:01 PM

Josh-- Interesting idea. That said, I'm not sure I want to require people to use invalid HTML - even if it is for a good cause.

On the NH bug report - yeah, every once in a while a date goes askew. Seems to be less than 0.1% of the time.

Thanks for the offer of help. We're squared away for now, but I've got your resume on file now. :)

Posted by Kari Chisholm on August 29, 2005 07:17 PM

Hi, This post which is strictly local, ended up being listed as non-local Massachusetts.

Three Winners in MA State Senate Special Election Primary
Frederick Clarkson - Tue 8:08 p.m. - 5 clicks

Posted by Frederick Clarkson on August 31, 2005 08:00 AM

Not being to be a downer, but what is the point of this local vs non-local business? Do I have to type "Ohio" in every post to get it listed properly? My blog has "Ohio" in it's title; why isn't this enough to be listed as local?

Posted by The Ticked Off Ohioan on September 1, 2005 10:10 AM

TickedOff...

Because that's the WHOLE point this website. There are many, many, many other aggregators and indexes out there.

People are having trouble finding local CONTENT about local issues.

We're trying to separate the I-Hate-Karl-Rove stuff from the Impeach-Bob-Taft stuff. There's precious little local content out there, but a real hunger for it.

My initial instinct was to ignore all the non-local posts completely, but because the system isn't perfect, we're running it all - just categorized.

Soon, when I'm done organizing this, then I'll be working on a Bayesian filter to automagically 'learn' over time what's local and non-local.

Remember, we're beta. And it's been less than three weeks. Hang in there.

Posted by Kari Chisholm on September 1, 2005 11:31 AM

<span id="NH" /> is 100% valid XHTML Strict 1.0

The only trick with ID tags is that they should be unique within a document.

<span class="NH" /> works great, unless the person had previously defined a CSS class named NH, in which case they could use "New Hampshire" or "____NH" with any random number of _'s.

The other suggestion wasn't valid XHTML or HTML, but it wouldn't have broken any browser anywhere :)

Posted by Josh Narins on September 4, 2005 05:15 PM

Maybe not the right place to post, but there are about 10 posts in the Ohio not local category that are listed as being from my site Ohio Watch. This problem is that they aren't from Ohio Watch they are from http://www.soapblox.net/myleftwing which is a national blog. Just a heads up.

Posted by The Ticked Off Ohioan on September 6, 2005 11:00 AM

Kari,

I guess I should ask what exactly it is you consider to be local, if you don't think calling for the impeachment of the governor of a state is local news. Are you planning on drilling down to the county level for all fifty states?

People are having trouble finding local content because blogs focusing on local activities don't exists at least in Ohio. I suggest that all those having trouble either read the newspaper or start their own local blogs.

Posted by The Ticked Off Ohioan on September 6, 2005 11:17 AM

Let me recap just one more time. The local/not-local thing is an AUTOMATED SYSTEM. I don't personally review all the thousands of posts a day.

If you use the name of the Governor in the headline or the RSS excerpt of your post, it'll wind up in the local feed. Sometimes, people use nicknames or abbreviations which the system doesn't know.

As I've said before, we've only been live a few weeks. We're working on a better system, that will allow the readers to flag posts as local or not-local.

Hang in there.

Posted by Kari Chisholm on September 6, 2005 11:45 AM

I've worked with Bayesian classifiers. My suggestion is to think of something else.

And I'd settle for aggregating local *blogs* vs local *content*, even if they do say they hate Rove every once and a while.

The present system certainly needs some help.

Posted by nevada scandalmonger on September 8, 2005 03:59 PM

Well, now, hang on a minute. If you do indeed want to see all posts from all local blogs, then just click on the "combined" tab. That's what it's there for.

Most other people I've talked to want to find local content - so that's what that tab is for.

We're creating options here - not cutting them off.

Posted by Kari Chisholm on September 8, 2005 05:06 PM

p.s. Bayesian systems work great if they're trained right. It is, of course, possible to write a bad Bayesian classifier - which ones have you worked with, and how were they bad?

Posted by Kari Chisholm on September 8, 2005 05:07 PM

How terrible would it be to allow visitors to reclassify entries on the fly? That way if someone saw a post that was misclassified, they could click a button to get it switched. After a certain number of 'votes' from unique IPs, then the item would switch its classification.

That might even help you train your classification algorithm faster.

Posted by sco on September 14, 2005 09:39 AM

SCO -- that's precissely what we're working on. Great minds think alike!

Posted by Kari Chisholm on September 14, 2005 11:38 AM

Viz the classifier: Yes, good training data is key. If you use the "pages" I assume your archiving from each blog, make sure you have some way to manually classify/review the training data. What you don't want to do is to use the current categories of local vs. non-local since they have too many mistakes.

(Having some means for readers to reclassify as suggested above could be used for marking training data, but if noone chooses to do it for a given state, then you just have the current set-up. Perhaps you should explicitly reach out to local bloggers to see if they will help you do that.)

And this won't be a one time process, since you'll have to retrain since new terms will crop up as time passes which will be high probability indicators for the "local" category. For example, in the Nevada section, the current system mis-categorized a post about Richard Perkins, the speaker of the Nevada State Assembly (and about as local as you're going to get) because (I guess) Perkins isn't one of your "nevada local" keywords. But as time goes on, Perkins may not be important to Nevada politics anymore, but some new guy will be.

So one thing you might do is to make sure you get and update at least a list of all the state level officials and give those names extra weight in your scheme.

For the short-term, I would suggest making the "combined" button the default "view" of the state blogs. Otherwise, many truly local posts are mistakenly hidden. Those who want to risk the "local" button view could select that if they want .

Posted by nevada scandalmonger on September 17, 2005 11:10 AM

Another computer geek's chiming in: read this thread and I think I see and agree with where you're going -- bayes plus user-supplied adjustments, right?

If so, an intermediate step might be to allow users to submit words that are local/nonlocal differentiators. A step easier than bayes, and the code framework could be done in a way that lets you just extend things to add bayesian filters as phase two.

Then again, the story I'm staring at is a nasty test case. A columnist that writes an even split of local/non-local editorials is caught in a political controversy for criticizing a local candidate for the inappropriate politicization of the race and for the candidate's utter lack of experience and their capitalizing on their celebrity in an unrelated national issue campaign.
The story's definitely local, but using either one's name to indicate local (what a user would do) will backfire when either name resurfaces on a national issue.

Anyway, you've made a great site. I just found it and will be hanging out here regularly, I imagine.

Posted by d2 at 43rdstateblues on October 30, 2005 09:01 AM

Post a comment




Remember Me?

(you may use HTML tags for style)

Trackback Pings

TrackBack URL for this entry:
http://www.mandatemedia4.com/mt/mt-tb.cgi/12

Listed below are links to weblogs that reference New feature: local and not-local tabs:

» Mark this point. from biil
I think this article was interest for you. [Read More]

Tracked on September 10, 2006 11:56 AM

» nudism teen from nudism teen
[Read More]

Tracked on September 10, 2006 11:06 PM

» refurbished ibm laptops from refurbished ibm laptops
[Read More]

Tracked on September 13, 2006 10:16 AM

» buy cheap phetermine from buy cheap phetermine
[Read More]

Tracked on September 13, 2006 10:51 AM

» golf swing analyzer software free download from golf swing analyzer software free download
[Read More]

Tracked on September 13, 2006 06:39 PM

» car rental discounts from car rental discounts
[Read More]

Tracked on September 14, 2006 12:20 AM

» phentermine order from phentermine order
[Read More]

Tracked on September 14, 2006 08:56 AM

» toyota echo hatchback from toyota echo hatchback
[Read More]

Tracked on September 15, 2006 01:39 AM

» 1992 bmw 325is performance parts from 1992 bmw 325is performance parts
[Read More]

Tracked on September 15, 2006 12:41 PM

» pocket digital cameras from pocket digital cameras
[Read More]

Tracked on September 15, 2006 07:33 PM

» free nextel mp3 ringtones from free nextel mp3 ringtones
[Read More]

Tracked on September 16, 2006 02:15 AM

» cheap airline ticket to las vegas from cheap airline ticket to las vegas
[Read More]

Tracked on September 16, 2006 12:18 PM

» refinance fees from refinance fees
[Read More]

Tracked on September 17, 2006 08:43 AM

» free downloadable sanyo ringtones from free downloadable sanyo ringtones
[Read More]

Tracked on September 17, 2006 10:51 AM

» cluster feeding from cluster feeding
[Read More]

Tracked on September 17, 2006 10:34 PM

» tramadol and acetaminophen from tramadol and acetaminophen
[Read More]

Tracked on September 19, 2006 10:24 AM

» board of registered nursing california from board of registered nursing california
[Read More]

Tracked on September 19, 2006 09:06 PM

» free downloads for ipod from free downloads for ipod
[Read More]

Tracked on September 19, 2006 11:34 PM

» remove spyware and virus trojans free from remove spyware and virus trojans free
[Read More]

Tracked on September 20, 2006 04:15 PM

» cialis sample from cialis sample
[Read More]

Tracked on September 20, 2006 09:47 PM

» life insurance corporation of india from life insurance corporation of india
[Read More]

Tracked on September 20, 2006 10:37 PM

» casino golden online palace from casino golden online palace
[Read More]

Tracked on September 21, 2006 03:06 PM

» buy online.broadphase.com site soma from buy online.broadphase.com site soma
[Read More]

Tracked on September 21, 2006 09:29 PM

» aura color soma soul sourcebook therapy from aura color soma soul sourcebook therapy
[Read More]

Tracked on September 21, 2006 09:38 PM

» propecia danger from propecia danger
[Read More]

Tracked on September 22, 2006 07:07 AM

» effects xenical from effects xenical
[Read More]

Tracked on September 22, 2006 10:30 AM

» affect side xenical from affect side xenical
[Read More]

Tracked on September 22, 2006 10:33 AM

» medication ultram from medication ultram
[Read More]

Tracked on September 22, 2006 11:13 AM

» california income tax law from california income tax law
[Read More]

Tracked on September 22, 2006 09:43 PM

» play baccarat from play baccarat
[Read More]

Tracked on September 22, 2006 11:55 PM

» cialis generic levitra viagra from cialis generic levitra viagra
[Read More]

Tracked on September 23, 2006 10:27 AM

» car insurance for mexico from car insurance for mexico
[Read More]

Tracked on September 24, 2006 04:05 AM

» refinance mortgage colorado from refinance mortgage colorado
[Read More]

Tracked on September 24, 2006 08:22 AM

» bet jackie news reid from bet jackie news reid
[Read More]

Tracked on September 24, 2006 08:08 PM

» buy fioricet leave reply from buy fioricet leave reply
[Read More]

Tracked on September 24, 2006 09:22 PM

» Efavirenz from Efavirenz
[Read More]

Tracked on September 25, 2006 12:43 AM

» st laurent shopping center from st laurent shopping center
[Read More]

Tracked on September 25, 2006 03:21 PM

» dental group insurance from dental group insurance
[Read More]

Tracked on September 25, 2006 11:41 PM

» zyban quit smoking from zyban quit smoking
[Read More]

Tracked on September 26, 2006 01:45 PM

» online betting from online betting
[Read More]

Tracked on September 26, 2006 02:01 PM

» car cheap insurance lady from car cheap insurance lady
[Read More]

Tracked on September 26, 2006 11:55 PM

» 21st century insurance from 21st century insurance
[Read More]

Tracked on September 27, 2006 12:13 AM

» auto insurance company from auto insurance company
[Read More]

Tracked on September 27, 2006 12:16 AM

» russian dating from russian dating
[Read More]

Tracked on September 27, 2006 08:34 AM

» buy cheap viagra from buy cheap viagra
[Read More]

Tracked on September 27, 2006 09:04 AM

» buy paxil from buy paxil
[Read More]

Tracked on September 27, 2006 01:30 PM

» abuse fioricet from abuse fioricet
[Read More]

Tracked on September 27, 2006 02:07 PM

» Forex Trading Software from Forex Trading Software
[Read More]

Tracked on September 27, 2006 02:08 PM

» domain name registration from domain name registration
[Read More]

Tracked on September 27, 2006 09:26 PM

» pre qualified mlm lead from pre qualified mlm lead
[Read More]

Tracked on September 27, 2006 09:40 PM

» why cialis from why cialis
[Read More]

Tracked on September 30, 2006 12:15 PM

» buy cialis generic online from buy cialis generic online
[Read More]

Tracked on September 30, 2006 01:31 PM

» online car insurance from online car insurance
[Read More]

Tracked on October 1, 2006 02:10 PM

» a list of car insurance company from a list of car insurance company
[Read More]

Tracked on October 1, 2006 02:41 PM

» home owner insurance quote from home owner insurance quote
[Read More]

Tracked on October 1, 2006 09:53 PM

» home owner insurance quote from home owner insurance quote
[Read More]

Tracked on October 1, 2006 10:28 PM

» xanax from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 2, 2006 08:08 AM

» carolina credit equity home line north from carolina credit equity home line north
[Read More]

Tracked on October 2, 2006 10:08 AM

» xanax online from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 2, 2006 12:00 PM

» sxbbuuyc from sxbbuuyc
sxbbuuyc [Read More]

Tracked on October 2, 2006 03:02 PM

» пидорасы from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 2, 2006 04:01 PM

» buy xanax from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 2, 2006 08:03 PM

» tramadol medicine from tramadol medicine
[Read More]

Tracked on October 2, 2006 09:43 PM

» ebony porn from ebony porn
[Read More]

Tracked on October 2, 2006 09:51 PM

» dad and daughter incest from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 2, 2006 11:58 PM

» incest gallery from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 3, 2006 08:06 AM

» airfare cheap class first flight from airfare cheap class first flight
[Read More]

Tracked on October 3, 2006 10:04 AM

» buy xanax from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 3, 2006 11:57 AM

» xanax online from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 3, 2006 03:57 PM

» buy xanax online from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 3, 2006 07:58 PM

» ccr concert ticket from ccr concert ticket
[Read More]

Tracked on October 3, 2006 10:29 PM

» arizona home equity loan from arizona home equity loan
[Read More]

Tracked on October 3, 2006 10:31 PM

» cheap zyban from cheap zyban
[Read More]

Tracked on October 3, 2006 10:31 PM

» where can i buy fda approved phentermine cod from where can i buy fda approved phentermine cod
[Read More]

Tracked on October 3, 2006 10:57 PM

» rape comics from Maugli Blog
Maugli Excerpt [Read More]

Tracked on October 3, 2006 11:59 PM