Should You Consolidate Your Database?

I recently did one of those things that analysts are supposed to do, which is to test the accepted wisdom about a concept that’s been kicking around so long no one seems to even question its veracity. The concept is database consolidation, and the accepted wisdom is that database consolidation lowers IT budgets and raises business effectiveness and efficiency while providing a high degree of ROI and value.

Unfortunately, that statement is only half true. Database consolidation can have a huge impact on IT budgets by lowering hardware and database license costs, and in doing so database consolidation can even help on the business side as well. But it turns out that most database consolidation projects miss an enormous opportunity to have a dramatic effect on the business side, and in fact often leave business users out on a limb when it comes to regulatory compliance, business continuity, and plain old business success.

Once again the accepted wisdom proves to be more accepted than is merited and a lot less wise than expected.

Here’s the problem. Database consolidation is easy if you leave out one important element: the maintenance of an accurate, usable, and extensive history of past transactions and results that spans the different data types, formats, and standards that have been used in your different source databases over time.

In other words, as long as you don’t try to maintain anything but the most cursory history of your chart of accounts, your customer records, your product offerings and prices, your manufacturing records, and everything else you’ve store in databases lo these many years, consolidation is easy. And cost-effective, and relatively useful, and a key component in IT simplification.

But if you want to maintain some historical perspective on your business, and be able to access the data that you need to meet regulatory requirements, analyze historical trends, maintain customer and business continuity, and otherwise run a successful business following a merger, divestiture, or other major consolidating event, it turns out that database consolidation only gets you so far. And it’s usually not far enough.

Far enough means being able to meet your business obligations, like providing the FDA with an historical record of the clinical trials for a new drug that isn’t working right or the processing records for a food product that is suspected of poisoning consumers. Far enough means being able to accurately balance your books and, if necessary, restate your earnings without worrying whether you’re about to break the law. Far enough means being able to truly optimize your cross-sell and up-sell opportunities by maintaining a single version of the “truth” about your customers and prospects. Far enough means making sure your business is up and running on day one post merger or divestiture, absent that chaos and uncertainty that an incomplete data environment would guarantee.

It’s true that there are other ways of meeting these business needs other than through a classic database consolidation. You can undertake a major master data management initiative, and keep everything you need in its original database, which solves your data history problem but kills any attempt to reduce the complexity and cost of your IT environment. Similarly, you can build an enterprise SOA infrastructure, and hide the complexity of data reconciliation behind a wall of Web services interfaces. Once again, say farewell to simplification and budget savings.

Or, you can try to actually do a business-level consolidation, which up until recently would have involved a massive, brute-force effort to reconcile an enormous set of complexities that typically exist between different database instances. That brute force effort is so brutal, and requires so much force, that – guess what – virtually no one has ever tried it.

I say virtually because I leave open the possibility that it has been done on a small scale, or in some benighted corner of the IT universe. But I’ve been looking for an example of this kind of deep business-level consolidation, and every time I’ve scratched the surface of a database consolidation project what I’ve come up with is something far short of “far enough.”

That’s why I was intrigued to hear from Helene Abrams, a long-time Oracle database expert and serial entrepreneur, and her latest company, eprentise. Abrams’ solution for the database consolidation problem is simple – as long as you realize that simple means simple for the company trying to consolidate its databases, and not simple for the eprentise team that built this solution.

Eprentise has taken many of the core problems in true business-level consolidation – the ones that require so much brute force that no one wants to even bother – and automated them to such an extent that, Abrams claims, old-style database consolidation is now a thing of the past.

What this approach makes possible is a higher level of consolidation that can retain the historical data that was too often lost in traditional database consolidation, while offering a greater potential for savings and efficiency than has been offered by past consolidation efforts. Which means that Abrams and eprentise are promising a more effective consolidation process that has much greater business value, and therefore has an even larger potential for ROI than the database consolidation projects that dominate the market.

It almost sounds too good to be true, but it’s traditional database consolidation that was too good to be true. Database consolidation without business continuity has made the world a better place for IT managers and their budgets, but too often left the business side wanting, and needing, much more.

Being able to bring all that historical data into a new system, and doing so in a cost-effective and business-effective way, should open up a new perspective on the impact of business events like mergers, acquisitions, divestitures, and new business opportunities. Rather than compounding risk by consolidating only some of the data, enterprises can minimize risk and move forward with a clear view of the past and a clear understanding of where a company has to go from here.

Eprentise is new, and the concept Abrams is touting has only been tested by a handful of companies that have worked with Abrams over the years as she’s built up her automated business consolidation tools. But the need eprentise addresses is as old as commerce, and only growing in importance in today’s dynamic business climate.

One day the accepted wisdom on database consolidation will have shifted dramatically, and that shift will be toward the kinds of solution that eprentise is bringing to market. Until then, consolidator, beware: Your project may have made IT more efficient, but there’s a lot more you can do to help the business side succeed. A lot more.