[wp-hackers] Load Balancing | Media Uploads to Multiple Servers

[Simon Wheatley]

Considering the average use case though:

Click New Post
Faff with some text
Upload an image
Faff with some more text
Publish

In the second lot of faffing there's surely enough time for this
syncing to occur? I believe ours takes about 60 seconds and the setup
is provided by Positive Internet otherwise I'd be providing more
details on how it works... sorry.

S


On Wed, Jul 29, 2009 at 3:56 PM, Steve Pellham<spellham at gmail.com> wrote:
> Thanks for the responses.  RSYNC is the solution that we were looking into,
> but my concern is the update frequency.   It would be overly simple to sync
> the directories once per day, but if the sync is not immediate, the concern
> is that a post would render without its associated images.    I'm looking
> for a real-time upload sync solution where the files are pushed out to 1 or
> more remote servers as the file is uploaded.
>
> Therefore the question about a plugin that triggers the file push as content
> is uploaded, I'm envisioning something like this.
>
> 1. create new post
> 2. upload image - this should trigger a server process (rsync, ssh, scp,
> rsh, rcp) that pushes the file to additional servers real-time.
> 3. view post on any available servers (with full content, images, etc..) in
> the LB pool.
>
> I understand that a nightly sync may work in cases where backup servers were
> used strictly for failover, but not in a real-time load balancing scenario
> where all servers should have updated content at the time (or very shortly
> after) it was uploaded.
>
> We will have to build a solution for this both inside and external of WP
> anyway since the site is custom and WP only runs our blog.
>
>
>
>
> On Wed, Jul 29, 2009 at 9:20 AM, Tim Schoffelman <tim at silentgap.com> wrote:
>
>> We have a current system that does this very thing. Basically, the servers
>> we run are using a *nix type OS and we just RSYNC the wp-content/uploads
>> directory w/ our backups. This solution has worked really well for us.
>> We've
>> messed around with a few other plugin ideas, but found that this one suited
>> our needs the best. I'm interested in seeing other solutions though.
>> ~tim
>>
>>
>> On Wed, Jul 29, 2009 at 9:02 AM, Simon Wheatley
>> <simon at sweetinteraction.com>wrote:
>>
>> > The load balanced solution I'm deploying to as I type has file syncing
>> > in the OS File System. Perhaps worth looking at as well as a WP
>> > solution?
>> >
>> > S
>> >
>> >
>> > On Wed, Jul 29, 2009 at 3:00 PM, Steve Pellham<spellham at gmail.com>
>> wrote:
>> > > Is anyone aware of an existing plugin for the post editor pages and/or
>> > media
>> > > gallery that would push uploaded media (images, video, etc....) to
>> > multiple
>> > > servers in cases where a WP installation is load balanced?
>> > >
>> > > DB changes are handled via local and wan replication, but I'm looking
>> for
>> > a
>> > > solution for keeping other media in sync as new images/videos are added
>> > to
>> > > the gallery, inside posts, etc...  I can think of ways to accomplish
>> this
>> > > (ftp, rsync...), but I haven't yet found an existing plugin for this.
>> >  Don't
>> > > want to reinvent the wheel unless absolutely necessary.
>> > >
>> > > Thanks, Steve
>> > > _______________________________________________
>> > > wp-hackers mailing list
>> > > wp-hackers at lists.automattic.com
>> > > http://lists.automattic.com/mailman/listinfo/wp-hackers
>> > >
>> >
>> >
>> >
>> > --
>> > Simon Wheatley
>> > Sweet Interaction Ltd
>> > Web Interaction Design & Development
>> > Tel: 07971 687295
>> >
>> > Consulting for Stephen Fry: http://stephenfry.com/
>> > Blog functionality for DfID - http://blogs.dfid.gov.uk/
>> > House of Illustration site - http://houseofillustration.org.uk/
>> > Blog for the Royal Navy - http://jackspeak.royalnavy.mod.uk/
>> >
>> > ---
>> > Sweet Interaction Ltd is Registered in England/Wales, no. 6610741
>> > Registered office: 7 Malton Av, Manchester, M21 8AT
>> > _______________________________________________
>> > wp-hackers mailing list
>> > wp-hackers at lists.automattic.com
>> > http://lists.automattic.com/mailman/listinfo/wp-hackers
>> >
>> _______________________________________________
>> wp-hackers mailing list
>> wp-hackers at lists.automattic.com
>> http://lists.automattic.com/mailman/listinfo/wp-hackers
>>
> _______________________________________________
> wp-hackers mailing list
> wp-hackers at lists.automattic.com
> http://lists.automattic.com/mailman/listinfo/wp-hackers
>



-- 
Simon Wheatley
Sweet Interaction Ltd
Web Interaction Design & Development
Tel: 07971 687295

Consulting for Stephen Fry: http://stephenfry.com/
Blog functionality for DfID - http://blogs.dfid.gov.uk/
House of Illustration site - http://houseofillustration.org.uk/
Blog for the Royal Navy - http://jackspeak.royalnavy.mod.uk/

---
Sweet Interaction Ltd is Registered in England/Wales, no. 6610741
Registered office: 7 Malton Av, Manchester, M21 8AT