[theme-reviewers] Payment Option for Theme Reviews

[Stephen Cui]

Pay-to-play is definitely not an option. But how can we improve the
process? I was an active reviewer before the incentive starts and started
again after the incentive ends. I stopped again as I feel that my
contribution is not valued. If my review cannot be trusted, why am I even
reviewing any themes?

I believe I am quiet experienced on theme review. I know there are
reviewers that are new and some reviews are low-quality. The problem is we
need to wait 3-4 weeks for an admin to point out the problem. This adds
frustration for everyone.

Something has to be done. Many of us are tried to make suggestions. Two
days ago, I suggested Experience Review option. I also suggested if WP
Foundation can hire a full-time Admin. If the option is not possible, let
us find other option. I wish we can have more open discussion about the
solution.

Regards

Stephen


On Thu, Jul 31, 2014 at 3:05 PM, Otto <otto at ottodestruct.com> wrote:

> On Thu, Jul 31, 2014 at 1:49 PM, Srikanth Koneru <tskk79 at gmail.com> wrote:
>
> But the bottle neck is admin time availability.
>>
>
> I grant you that admin time is a problem, but additionally, the fact that
> admins have to second guess and redo most reviews is also kind of a problem.
>
> I just went and looked at four "approved" themes in the admin queue. Two
> of them had issues that I noticed immediately as being problems.
> Big-code-issues that prevent me from going live with them; not just look
> and feel type things. The other two I marked live. Now, small sample, I
> grant you, but if this holds true throughout this queue, then that's about
> 40 themes I'll have to return-to-sender instead of marking live.
>
> I can see why the current admins would find this a bit frustrating.
>
> What can help make it such that reviewers are actually doing the entire
> review before approving themes? Or is there a focus problem? In the cases
> I've seen, it's been functionality issues that are the stoppers at this
> stage, not necessarily look-and-feel issues. Most reviews I've been reading
> over the last 10 minutes pointed out menu problems, CSS problems, things
> like the front-page functionality not working properly, but missed (to me)
> big obvious ones like saving defaults to the database or requiring the use
> of a plugin. This is the sort of things the admins find and I grant you
> that you have to look at the code for them, but I don't think the admins
> should need to be second-reviewing everybody's reviews here, but that is
> what is happening and why it takes so long.
>
> Should we be assigning reviewers in pairs? Two reviewers per ticket? I
> dunno.
>
> -Otto
>
>
>
> _______________________________________________
> theme-reviewers mailing list
> theme-reviewers at lists.wordpress.org
> http://lists.wordpress.org/mailman/listinfo/theme-reviewers
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wordpress.org/pipermail/theme-reviewers/attachments/20140731/b7ebdae5/attachment-0001.html>