Improving the Neatorama Upcoming Queue

Hello, everyone! Yesterday, Neatorama user rellimz submitted a post to the Upcoming Queue, which subsequently got promoted to Neatorama's front page, about how the Queue is wreaking havoc on the blog. Overnight, the post got over 100 comments from other readers voicing the same concern.

First of all, please let me thank rellimz for the interesting post, and all of you who posted a comment for giving us your feedback. I'm going to tell you what we're going to do about the Queue, but first, please let me give a background on why we have the Upcoming Queue feature in the first place.

Why Do We Have the Upcoming Queue in the First Place?

As much as I enjoy writing for Neatorama, blogging is kind of a "closed" enterprise. Traditionally, blog authors write and blog readers read (and comment, if they like). For something that is supposed to improve interactivity on the Web, it's pretty much a top-down approach or a one-way street.

For a long while, I've been thinking of ways to improve user participations - and thanks to the good folks of VideoSift and VaroCMS, I think we've found the answer. The Upcoming Queue is a place where people can write their own Neatorama posts and have their submissions be reviewed by the community (through voting) and Neatorama editors.

Submissions that get enough votes (and therefore deemed "good" by the community) are promoted to the front page. Conversely, those that are spammy or of dubious quality get voted down and actually purged from the Queue. That's the theory, anyhow.

In practice, community votes may not be enough: good posts that are written up poorly don't get votes. Bad posts may get promoted because of coordinated gaming of the system. Moreover, unless you're a hardcore Neatorama reader, you may not have noticed that the submitted post had already been covered on the blog before. Because of its size, a small number of users can dominate the Queue.

Like any new project, there will be bugs and kinks that need to be worked out - and the Queue is no different. A couple of days ago, we had a massive influx of promoted submissions of dubious quality. We had since tighten up Queuebot's algo, and the problem seems to have largely been solved.

It has been a learning experience, and I'm not ready to get rid of Queuebot nor will we completely discount the community votes (if we were going to do that, why have the voting in place in the first place?). I think the Upcoming Queue has a place on Neatorama. We're not going to change the blog into a web 2.0 or user-generated content. Instead, we will use the Upcoming Queue as a supplementary source of posts.

What We'll Do to Improve the Upcoming Queue

Here are a few things we'll do to make Queuebot better:

  • Tighten up the promotion algorithm
    It's now harder for a post to be automatically promoted to the front page. While this will have a negative effect of throttling down the number of posts that make it, it will also rid the front page of lower quality posts.

  • Greater editorial control
    Neatorama admins can now flag submissions that have been featured on the blog before as "dupes." This stops the voting, but lets the submission be visible for the alloted 24 hours in the Queue.

    We haven't been as aggressive in marking things as "spam" in the Upcoming Queue before, but we will start doing so soon. We will also edit the descriptions to make them more "Neatorama-worthy" whenever applicable. (Give us a couple of days on this one!)

  • Fishing from the discard pile
    On the other hand, stricter rules will undoubtedly mean that "worthy" submissions end up being discarded rather than promoted. We will continue to fish these out of the discards and promote them manually. This also guards against hateful downvotes, where a user downvotes a worthy post simply because he or she doesn't like the submitter.

Queuebot-Less RSS Feed

One big reason that I stopped using an RSS feed reader is the ever-increasing number of unread post displayed. It's disheartening to open your reader in the morning and find that you have 500 unread posts.

While I think that the fixes above should greatly improve the quality of front page posts on Neatorama, if you hate Queuebot that much, here's an RSS feed that will display every front page post except those promoted from the Upcoming Queue:

http://www.neatorama.com/feed/?author=-5587

Simply copy and paste that into your feed reader and voilà! No more Queuebot posts.

Again, thank you everyone for your input - we take your feedback seriously and will work hard to make Neatorama a blog you can enjoy daily!


Whew....for a minute it looked like Neatorama was heading down the Digg.com path (remember when Digg was actually a good read for TECH news - now look at it, a cesspool of teenage humour and other crap - all gamed by a few members with no real life)
Abusive comment hidden. (Show it anyway.)
Great, thanks for the fast action! This was clearly something important to a lot of people, and I think your response has been well decided. My only real criticism is pretty mild: the title of the new RSS feed is "Neatorama » Queuebot" which suggests that it contains only queuebot posts, not excludes them. It was a bit confusing to me.
Abusive comment hidden. (Show it anyway.)
Way to go, Alex! This plan is a win-win and sure to alleviate the surge while also allowing user submitted content to find a niche here. Now, where's my YouTube bookmark? I've got some submitting to do! (i keed, i keed.) :P
Abusive comment hidden. (Show it anyway.)
Thanks Alex! Its good to hear the commotion about the queue was not going unanswered. I certainly hope it improves things, as I would hate to see it go entirely.

Keep up the good work!
Abusive comment hidden. (Show it anyway.)
I volunteer as the lone naysayer. I love the "closed" system of blogging where a single or group of bloggers act as gatekeeper. When we readers find a gatekeeper we like, we become faithful readers of that blog. It is why we are here.

A community-voting platform changes the voice of Neatorama and thus runs the risk of shedding Neatorama's established readership as the community steers the blog in a new direction.

The perceived problem the Queue fixes will be replaced with a new one -- maintaining Neatorama's identity.
Abusive comment hidden. (Show it anyway.)
Sounds good. I'm not going away just yet. I love Neatorama... and since I commented on the post mentioned above, just thought I'd stop and smile here :)
Abusive comment hidden. (Show it anyway.)
I'm tremendously glad this discussion worked, with all viewpoints being heard equally, and such a fair conclusion. I had my doubts when I first posted that it would make it past the death ray of the Queue-bot. I agree with Johnny Cat, this is win-win. Yay Alex for a great compromise. Thank you.

Dan~rellimz, Neatorama fanboy.
Abusive comment hidden. (Show it anyway.)
Good plan, though I think Alex and company were already in some ways implementing the above plan before.

Again I think a lot of the posts are pretty cool and neat but just need some "finesse" from the pros in terms of quality writing/descriptions.
Abusive comment hidden. (Show it anyway.)
@Sidd

I'd love that too! I may not use an RSS reader but Im still sick of sifting through all the posts on here! Though we'll have to wait and see if there's a problem now with these new changes implemented....
Abusive comment hidden. (Show it anyway.)
thank you! as one of the voters for a separate feed on the previous thread, i love the new option. i breathed a sigh of relief that i can keep neato in my queue :-)
Abusive comment hidden. (Show it anyway.)
is it possible to only use the algorithm to send posts to editors so they can review it before it gets posted to the front page?

I keep thinking that it is the automation that is bringing down the quality that folks are used to on this blog. I just don't know how an automated program could ever determine whether something is actually "neat."
Abusive comment hidden. (Show it anyway.)
It's great that you're continuing to work on the Queuebot functionality, but I would like to third Sidd and Cuimhne's sentiments about wanting a direct site-link that filtered out Queuebot posts. I do appreciate the desire to boost the number of posts the site offers per day, but personally I spend too much time here just reading the posts from official Neatorama posters as it is ... save me from having to filter through still -more- posts, please!
Abusive comment hidden. (Show it anyway.)
Wow, that was more controversial than one of Adam's posts ;) Improving steps have already been taken : keep up the good job!

@Johnny cat : keep them Youtube videos coming! ;p
Abusive comment hidden. (Show it anyway.)
@VonSkippy - I think the change in digg is directed or explicitly allowed by its admins. That website certainly has an enviable growth during the past couple of years, though it remains to be seen if digg can be profitable.

@AJ - it's a delicate balance to maintain friendliness of the blog as Neatorama grew over the years. Our "troll be gone" background picture in the comment box seems to help somewhat, but its effectiveness is wearing down ...

I'm a firm believer that more openness is a good thing. I still think the Upcoming Queue will be good for the blog.

@twit - automated promotion has been de-emphasized, though it will remain a factor in the Upcoming Queue.

@Front page sans Queuebot posts - this is more difficult to achieve. I'm not convinced that quality and Queuebot are mutually exclusive - so please give it some time. I think we saw an irregular spike in dubious post quality that has been fixed. We can implement a "secondary front page" for those who dislike the UQ if warranted in the future. Maybe (I don't know technically how to do that yet)
Abusive comment hidden. (Show it anyway.)
Is there any merit to the idea of leaving your identity along with your yea or nay vote? I've seen plenty of promotion-worthy items voted down with no stated reason and no clue as to who the critic is. It's sure discouraged me from contributing further.
Abusive comment hidden. (Show it anyway.)
I've noticed that there has been a rash of downvoting submissions regardless of their quality.

While we don't yet have the ability to match identity to votes, please be assured that an editor will look through each and every one of the submissions and may promote your post even if it got downvoted out of the Queue.
Abusive comment hidden. (Show it anyway.)
I'm with AJ:

"I love the “closed” system of blogging where a single or group of bloggers act as gatekeeper. When we readers find a gatekeeper we like, we become faithful readers of that blog. It is why we are here."

I read Neatorama and Boing Boing for the quirky choices of specific personalities. Blogs have a "feel" or sensibility of sorts that is a result of the individual bloggers.

blogs have an open community of readers not writers.
Abusive comment hidden. (Show it anyway.)
Front page sans Queuebot posts:
that would still be what i'd want for all the reasons mentioned before

could this be at least an option to keep everyone happy?
Abusive comment hidden. (Show it anyway.)
"I’m not convinced that quality and Queuebot are mutually exclusive - so please give it some time."

That's certainly reasonable, and I wouldn't argue that Queuebot posts are necessarily of lower quality as a rule; it's just that with a limited amount of time to spend reading through blogs for fun I would prefer to at least have the -option- to only read the postings of 'official' bloggers. I just like having some means of divvying up my blog-reading time based on knowing whose blog posts I generally like or dislike. True, scrolling through Queuebot posts isn't a -hugely- onerous task, but it is one more thing I'd rather -not- take on if possible.

As you say, though, if offering a secondary, Queuebot-free page is technically out of reach at the moment that's understandable; I do hope that it can be placed high on the list of "Nice to Haves," though <=)
Abusive comment hidden. (Show it anyway.)
While I am certain that the Queuebot will increase Neatorama's raw numbers, I am equally certain that it will cost the blog its unique character. I guess if Alex (and the other eds.) are willing to strike that bargain, that's all that matters. It is, after all, their blog.

It will be interesting to come back in a year or so, and compare the content then to the archived content from before the change (to the bot), and see what the spawn of the Queuebot actually grows into.

IMHO noting good ever comes from anything with "bot" in its name.

I'm just sayin'
Abusive comment hidden. (Show it anyway.)
I love the Upcoming Queue! I understand, and am sympathetic that it is a new undertaking and so, is a work in progress. I think it is a wonderful, fun and interesting idea, that can better serve the blog.

Of course, a lot of that depends on constructive interaction from the entire community.

I'm not much of a commenter (maybe a handful of times in the years I've been coming to Neatorama), but I have been thinking of posting to the Queue because it intrigues me. And, I think, that's what the Queue is all about. Getting all the Neatos out there to participate on the blog, not just by reading the blog.

My 2 cents :)
Abusive comment hidden. (Show it anyway.)
Awesome I was waiting for this. Thank you! I can go back to paying attention to Neatorama (it took me a while to find this post as I had stopped reading).
Abusive comment hidden. (Show it anyway.)
Login to comment.
Click here to access all of this post's 29 comments




Email This Post to a Friend
"Improving the Neatorama Upcoming Queue"

Separate multiple emails with a comma. Limit 5.

 

Success! Your email has been sent!

close window
X

This website uses cookies.

This website uses cookies to improve user experience. By using this website you consent to all cookies in accordance with our Privacy Policy.

I agree
 
Learn More