[theme-reviewers] An idea to improve the theme review process.

[Chip Bennett]

I don't think this idea (which I'll call "review karma") would work, for
several reasons. I'll be happy to elaborate later, but to summarize quickly:

1) Your idea must also assume that Theme Authors who have Themes in the
review queue would actually perform quality reviews, rather than performing
expedient reviews in order to improve the queue position of their own Themes
(or to increase their own "review karma" in an attempt to improve the queue
position of their own Theme).

2) Your idea is infeasible to implement and to manage, with our current
infrastructure and workflows

3) Your idea is really not necessary. The state of the review queue is such
that currently, Themes are open for less than 5 days on average. All we
really need is for everyone's review activity to increase marginally. We've
been averaging just under 8 active reviewers per week since the beginning of
September. If every active reviewer closed 2 tickets per day, we would
completely eliminate the review queue within one week. If every active
reviewer closed 1 ticket per day, we would more than keep up with the pace
of incoming tickets.

Chip

On Wed, Nov 3, 2010 at 7:50 AM, Satish Gandham <satish.iitg at gmail.com>wrote:

> Before I start, here are my assumptions
>
>    - *All the theme developers are capable of reviewing a WordPress theme.
>    *
>    - *Every developer wants to get his theme reviewed as early as
>    possible.*
>
> *My idea:*
> How about giving higher priority to who review other themes? More the
> themes they review, higher their theme moves in the review queue.
>
> *Possible problems:*
>
> A developer reviewing a theme just to get a position for his theme in the
> repository may not review it with care.
>
> *Solution 1:* We can give negative reputation to such reviewers.
>
> Problem with this solution..
> It's hard to decide whether a reviewer reviewed the theme with care or not.
>
> *Solution 2:* Have the review reviewed.
> You may say we are already having less man power, and a review of review
> will slow down things further.
>
> That's not true, If my assumptions are correct, we will be getting lot of
> help.
>
> *Note: *Tickets must be assigned randomly, they shouldn't be allowed to
> choose tickets. Because, it's possible for developers to join hand's and
> pass their themes through the review process.
>
>
> Satish Gandham
>
>
>
>
> _______________________________________________
> theme-reviewers mailing list
> theme-reviewers at lists.wordpress.org
> http://lists.wordpress.org/mailman/listinfo/theme-reviewers
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wordpress.org/pipermail/theme-reviewers/attachments/20101103/89a39bf6/attachment.htm>