Home
Arjen's Journal - Brian's stab at "the death of replication"
Open Query: MySQL, Open Source & other ponderings

Arjen Lentz
Date: 2008-04-07 09:41
Subject: Brian's stab at "the death of replication"
Security: Public

I think Brian is right with his The Death of Replication story.... replication is very useful for many cases, but RDBMS (commercial and FLOSS) have done a fairly dismal job at getting multiple writers to scale decently economically. And modern companies just don't have piles of cash to throw at this, nor does that really scale on the web scene (speed of deployment, etc).

In this context, I'm not sure the new memory based MySQL storage engines coming out are so relevant, they might be fixing the wrong thing in the wrong place. They'll have their place for now, but it's not moving us forward really.

What needs to be fixed is distributed writes. And economically!

Post A Comment | 4 Comments | Add to Memories | Tell a Friend | Link



User: [info]iholsman
Date: 2008-04-07 10:47 (UTC)
Subject: (no subject)

what would also be nice is if you could integrate the binary log replication into other systems, like what facebook is doing with memcached, and I would do with SOLR.

Reply | Thread | Link



Brian "Krow" Aker
User: [info]krow
Date: 2008-04-08 15:41 (UTC)
Subject: (no subject)

So you want the mysql replication system to be able to replicate arbitrary commands?

Reply | Parent | Thread | Link



User: [info]iholsman
Date: 2008-04-08 20:58 (UTC)
Subject: (no subject)


I'm not sure it's a general need, but for us we need to keep multiple data sources synchronized (solr, memcached, and other mysql schemas ), and are using tools like mule and talend to do this, and then using other replication tools to push it out to their slaves.

having other things being able to read the binlog would mean we could update those systems in a simpler fashion and speed our time to market, as well as remove 1/2 different systems from the architecture.

Regards
Ian

Reply | Parent | Thread | Link



Brian "Krow" Aker
User: [info]krow
Date: 2008-04-08 22:37 (UTC)
Subject: (no subject)

I have a library I wrote that has simple reading of the binary log (its public, though far from finished). The problem is writing to the binlog... at this point only an engine can do that.

I've seen someone hack up blackhole to pass executing messages. That is not that hard to do... for that matter we could simplify this through the new gearman stuff I am about to announce next week.

Reply | Parent | Thread | Link



browse
my journal
links
May 2008
High Performance MySQL (2nd ed.)
summary