[theme-reviewers] Goals and Process

[Chris Everson]

It sounds like everyone is interested in some sort of actual checklist. I plan on doing my review sometime this weekend. At that time I'm definitely willing to put together a checklist of sorts based on the TDC and other points of evaluation used by the folks that have already gotten to their review. 

Any objections? What format would be ideal for this? I was thinking either web-based, interactive PDF, or at very least, a PDF that would make an easy-to-follow guideline that doesn't involve any physical interaction.

Questions? Comments? Concerns?

CHRISEVERSON
WEB DESIGNER & DEVELOPER

cell: 360.286.0353

the man: chriseverson.net
the machine: startwithgrey.com
twitter: @chriseverson
linkedin: linkedin.com/pub/chriseverson
facebook: facebook.com/chriseverson.net

On Jun 11, 2010, at 7:43 AM, chip at chipbennett.net wrote:

> I concur.
> 
> I'm thinking that Joseph (Joe?) is getting several people started on an
> initial theme review, in order to give us some better context for coming
> up with the more formalized process.
> 
> That's what I'm doing with my first review, anyway: just going through the
> TDC and evaluating the theme against each of the checklist points.
> 
> I think, once we've got some context by reviewing an initial theme, we'll
> better be able to evaluate what criteria are critical/required (GO/NO-GO),
> and which ones are more subjective (1-5 rating, or whatever) - as well as
> how each subjective criterion (or category) should be weighted.
> 
> Of course, my first theme assignment is taking a bit (sorry, Joseph - the
> one you gave me threw about five errors right off the bat!), so it may not
> be until the evening or tomorrow morning until I can report back on it. In
> the meantime, I'm appreciating the opportunity to read everyone else's
> initial take on the review process.
> 
> (As for getting the feedback to the theme authors themselves: I assume
> Joseph is handling that?)
> 
> Chip
> 
>> Hi David,
>> 
>> I agree with your points. I was thinking something like a scorecard too.
>> 
>> What I understood so far, is that we will go to check the theme against
>> the listed points from Theme_Development_Checklist, right? Is this our
>> only job?
>> 
>> I would appreciate a clarify from Joseph too.
>> 
>> Regards,
>> Daniel
>> 
>> 
>>> Hi Joseph (and everyone else),
>>> 
>>> First, is it Joseph or Joe?
>>> 
>>> Second, can you clarify what exactly the goals are of a theme review?
>>> What are we trying to accomplish? I realize we are trying to improve the
>>> quality and reliability of themes, but how is that going to work?
>>> You've assigned some theme reviews to participants here, but they are
>>> reporting "problems" back to us, not to the author to fix.  Is there a
>>> process I am not seeing?
>>> 
>>> It seems to me, and I apologize if I am speaking out of turn, is that
>>> all of the information on
>>> http://codex.wordpress.org/Theme_Development_Checklist#Theme_Unit_Test
>>> could be turned into a scorecard.  It's already broken up into sections.
>>> Give each bullet list a line item with a 1-5 rating or a y/n and set a
>>> comment section for free form comments at the end of each sub  section.
>>> Then a theme submission could come in, be assigned to 3-5 of us, and we
>>> each complete a scorecard.  (heck portions of it could be automated.)
>>> Then send these scorecards back to the theme author where they can
>>> digest what they have done right, and what needs improvement.  Without
>>> being too rigid, this process is crying for some formality of method.
>>> This also gives the theme author feedback, but not at the whim of one
>>> reviewer since some of the points (aesthetics in particular) are very
>>> subjective.
>>> 
>>> Just a thought...
>>> 
>>> -David _______________________________________________
>>> theme-reviewers mailing list
>>> theme-reviewers at lists.wordpress.org
>>> http://lists.wordpress.org/mailman/listinfo/theme-reviewers
>> 
>> --
>> Daniel Zilli _ Production Executive _ Jilliz Ltd.
>> 
>> Phone: +66 (0) 85 334 1224 | Website: http://www.jilliz.com
>> 288/43 BaanMai Puttabucha 36, Bangmod, Thungkru Bangkok 10140.
>> 
>> _______________________________________________
>> theme-reviewers mailing list
>> theme-reviewers at lists.wordpress.org
>> http://lists.wordpress.org/mailman/listinfo/theme-reviewers
>> 
> 
> 
> _______________________________________________
> theme-reviewers mailing list
> theme-reviewers at lists.wordpress.org
> http://lists.wordpress.org/mailman/listinfo/theme-reviewers

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wordpress.org/mailman/private/theme-reviewers/attachments/20100611/552ef98a/attachment.htm>