Comments on: Magic Multi-Connections: A “facility in Rails to talk to more than one database at a time” http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/ Ruby makes Rails, Javascript makes Ajax, Dr Nic makes Magic Sun, 20 Jul 2008 08:50:27 +0000 http://wordpress.org/?v=2.5.1 By: James N. Sears http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-95622 James N. Sears Tue, 10 Jun 2008 06:08:25 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-95622 <strong>Multiple Database Connections in Ruby on Rails...</strong> I've been doing a lot of work in Ruby on Rails lately and absolutely love it. In the past few days I've needed to port an existing database over to a new schema for comparisons and benchmarking. It took a...... Multiple Database Connections in Ruby on Rails…

I’ve been doing a lot of work in Ruby on Rails lately and absolutely love it. In the past few days I’ve needed to port an existing database over to a new schema for comparisons and benchmarking. It took a……

]]> By: Closer To The Ideal » Blog Archive » Why do people sometimes feel attacked, even though no one is attacking them? http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-93507 Closer To The Ideal » Blog Archive » Why do people sometimes feel attacked, even though no one is attacking them? Mon, 02 Jun 2008 01:29:17 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-93507 [...] rough territory, but someone goes and does something nice (Woo hoo!). Dr Nic writes a plugin to use multiple databases with Rails. Way cool. Really way cool. Awesome job Nic. This is the part of open source that I love, when [...] [...] rough territory, but someone goes and does something nice (Woo hoo!). Dr Nic writes a plugin to use multiple databases with Rails. Way cool. Really way cool. Awesome job Nic. This is the part of open source that I love, when [...]

]]> By: GW http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-92809 GW Fri, 30 May 2008 00:51:43 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-92809 I too am looking for a solution to allow multiple users per database. In order to apply principle of least privilege to database actions, I prefer to set up a few database users, each with specific duties relative to read/write/delete and table access rights. I'll have a look at the plugin code and see if I can decipher a way to use it / extend it, but I think this is also one of those "obvious" lackings in the Rails connection interface. I too am looking for a solution to allow multiple users per database. In order to apply principle of least privilege to database actions, I prefer to set up a few database users, each with specific duties relative to read/write/delete and table access rights.

I’ll have a look at the plugin code and see if I can decipher a way to use it / extend it, but I think this is also one of those “obvious” lackings in the Rails connection interface.

]]> By: eduludi http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-75073 eduludi Tue, 19 Feb 2008 13:24:09 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-75073 Is there a way to use this technique to connect multiple database users/roles to the same database? what about performance? Could I simulate a multi-thread connection? Is there a way to use this technique to connect multiple database users/roles to the same database? what about performance? Could I simulate a multi-thread connection?

]]> By: Kyle http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-52888 Kyle Thu, 01 Nov 2007 19:52:50 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-52888 Has anyone used this in a real production environment. I used a similar gem http://rubyfurnace.com/gems/mysql_replication_adapter (Mysql_replication_adapter), but found it to make our write database hang for a long time for queries. I'll blame it on myself for not knowing the inner workings of the gem prior to rolling it out on the test clusters, but I'm wondering if there are any other options to accomplish this. Perhaps using a load balanced pool of connections to the slave with 3rd party hardware / software could be the most fool proof solution here. Where it intercepts which are read and writes. Although I like having control over which connection a query gets sent to, and this really can help you solve performance problems right in the butt. I'd love to hear about any experience though in a real world high load production environment (1mil + connections a day) and rails internals doing the slave db-load balancing for you. Also the more connections you have open for a server deamon such as mysqld the slower it will run. Has anyone used this in a real production environment. I used a similar gem http://rubyfurnace.com/gems/mysql_replication_adapter (Mysql_replication_adapter), but found it to make our write database hang for a long time for queries. I’ll blame it on myself for not knowing the inner workings of the gem prior to rolling it out on the test clusters, but I’m wondering if there are any other options to accomplish this.

Perhaps using a load balanced pool of connections to the slave with 3rd party hardware / software could be the most fool proof solution here. Where it intercepts which are read and writes. Although I like having control over which connection a query gets sent to, and this really can help you solve performance problems right in the butt.

I’d love to hear about any experience though in a real world high load production environment (1mil + connections a day) and rails internals doing the slave db-load balancing for you.

Also the more connections you have open for a server deamon such as mysqld the slower it will run.

]]> By: GSIY … Ruby-Rails Portal http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-46516 GSIY … Ruby-Rails Portal Sat, 22 Sep 2007 21:38:21 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-46516 [...] Remember that point about Rails lacking an easy-to-use way of dealing with multiple read/write databases? Strike that. Nic Williams has released Magic Multi-Connections. It makes it dead easy to use a cluster of databases to scale read and write speeds higher than a single connection would ever allow. [...] [...] Remember that point about Rails lacking an easy-to-use way of dealing with multiple read/write databases? Strike that. Nic Williams has released Magic Multi-Connections. It makes it dead easy to use a cluster of databases to scale read and write speeds higher than a single connection would ever allow. [...]

]]> By: Twitter on Rails | tactical web development http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-45228 Twitter on Rails | tactical web development Mon, 10 Sep 2007 16:04:06 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-45228 [...] Gespannt verfolgte damals die Blog-Gemeinde die Anfeindungen zwischen signal37.com und Twitter; und jeder wußte es nun besser. Jeder fragte sich, warum die Twitter-Entwickler so blauäugig auf Ruby on Rails gesetzt hatten, warum man bestimmte Probleme nicht so, sondern so gelöst hätte und überhaupt (möglicherweise war das hier der entscheidende Hinweis?) [...] [...] Gespannt verfolgte damals die Blog-Gemeinde die Anfeindungen zwischen signal37.com und Twitter; und jeder wußte es nun besser. Jeder fragte sich, warum die Twitter-Entwickler so blauäugig auf Ruby on Rails gesetzt hatten, warum man bestimmte Probleme nicht so, sondern so gelöst hätte und überhaupt (möglicherweise war das hier der entscheidende Hinweis?) [...]

]]> By: Alex Peuchert http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32866 Alex Peuchert Fri, 15 Jun 2007 14:31:31 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32866 Hi DrNic! me again... I had some thoughts about this multiple-database-thing and came up with an idea about it. Why not change the database connection inside the controller action? Maybe you think this could be interesting and want to read more about it at: http://scriptserver.blogspot.com/2007/06/uploaded-dynamicdatabasechanger-plugin.html -alex Hi DrNic! me again… I had some thoughts about this multiple-database-thing and came up with an idea about it. Why not change the database connection inside the controller action? Maybe you think this could be interesting and want to read more about it at:

http://scriptserver.blogspot.com/2007/06/uploaded-dynamicdatabasechanger-plugin.html

-alex

]]> By: links, ideas and geek stuff » Blog Archive » links for 2007-06-12 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32516 links, ideas and geek stuff » Blog Archive » links for 2007-06-12 Tue, 12 Jun 2007 16:20:11 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32516 [...] Dr Nic » Magic Multi-Connections: A “facility in Rails to talk to more than one database at a time” [...] [...] Dr Nic » Magic Multi-Connections: A “facility in Rails to talk to more than one database at a time” [...]

]]> By: Dr Nic http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32304 Dr Nic Sun, 10 Jun 2007 16:37:40 +0000 http://drnicwilliams.com/2007/04/12/magic-multi-connections-a-facility-in-rails-to-talk-to-more-than-one-database-at-a-time/#comment-32304 @alex - I think #2+#3 would be implemented by your #conn method implementation. In the example above it was a pure random selection of original connections. You could do health checking there, etc. But more importantly, this code is just an idea/proof of concept to show how you could modify an ActiveRecord (or any class) via a Module. @alex - I think #2+#3 would be implemented by your #conn method implementation. In the example above it was a pure random selection of original connections. You could do health checking there, etc.

But more importantly, this code is just an idea/proof of concept to show how you could modify an ActiveRecord (or any class) via a Module.

]]>