[wp-meta] [Making WordPress.org] #2330: Leverage the WordPress Cron / Cavalcade to run the plugin imports

[Making WordPress.org]

#2330: Leverage the WordPress Cron / Cavalcade to run the plugin imports
------------------------------+-----------------------------------
 Reporter:  dd32              |      Owner:
     Type:  defect            |     Status:  new
 Priority:  normal            |  Milestone:  Plugin Directory v3.0
Component:  Plugin Directory  |   Keywords:
------------------------------+-----------------------------------
 Currently the plugin directory is using a stand alone script which runs in
 a loop to process changes.

 Historically this has caused problems during high-frequency-commits, so
 instead, lets switch the importer to run as a WordPress Cron Job, this
 will have the advantage that we can run many imports in parallel, it also
 brings complexity as a plugin shouldn't be imported twice at the same
 time.

 On WordPress.org we're using Cavalcade to offload cron tasks from
 WordPress which has given jobs the ability to scale, it also means we can
 be sure that no two individual jobs are running in more than 1 location.

--
Ticket URL: <https://meta.trac.wordpress.org/ticket/2330>
Making WordPress.org <https://meta.trac.wordpress.org/>
Making WordPress.org