[wp-trac] Re: [WordPress Trac] #8999: Completely New LiveJournal Importer

[WordPress Trac]

#8999: Completely New LiveJournal Importer
-------------------------------------+--------------------------------------
 Reporter:  beaulebens               |        Owner:        
     Type:  enhancement              |       Status:  closed
 Priority:  normal                   |    Milestone:  2.8   
Component:  Import                   |      Version:  2.7   
 Severity:  normal                   |   Resolution:  fixed 
 Keywords:  needs-testing has-patch  |  
-------------------------------------+--------------------------------------
Comment (by beaulebens):

 A couple points:

  1. Most of the importers write to the filesystem in some way or another
 (upload files etc)
  2. I'm open to another way of doing it, but there's no way to handle big
 imports from the LJ API that I could come up with other than files since
 the data is very likely to exceed memory limits (especially when you have
 to juggle multiple copies of things to re-thread comments, which aren't
 threaded when you receive them)
  3. I agree the var_export thing is kinda scary, but it performed
 significantly better than serialize/unserialize (and assuming that it's
 necessary to store things between steps, something needs to be used to
 maintain array structure)
  4. I'm aware of the Snoopy issue, and am working on adding cookie support
 to the HTTP API right now.

 I'm totally open to other ideas on how this can work, but that's all I
 could come up with after a ''lot'' of messing around with other options.
 Big blogs (lots of comments in particular) are just massively problematic
 if you try to do anything much in memory here.

-- 
Ticket URL: <http://trac.wordpress.org/ticket/8999#comment:18>
WordPress Trac <http://trac.wordpress.org/>
WordPress blogging software