The Universe and an Analytic Database

The Universe and an Analytic Database

If you’re modelling your data into business information in the universe then surely creating an analytic database as well is overkill?

It’s a distinct possibility. If your data is in reasonably good shape, then let the universe go at it with what it does best.

However, complex computations such as a validation rule calculating customer eligibility for a loyalty bonus may be pre-processed.

Taking this dreamed up criteria as an example:

  • has to have had a certain number of transactions for qualifying products (which need to be looked up from one source, decoded and compared to another source)
  • over a set value (which varies by customer country)
  • in a particular time period
  • had no gaps in their membership in that period
  • made no derogatory comments about the Chief Exec's gold handicap
  • opted in to receive worldly enlightments about future products
  • and not be related to any member past or present of the company's illustrious management structure.

Whilst the computation could be run at query time it would probably be better pre-processed, so at query time the only computation is true or false.

The universe doesn’t store data. You can sit it on top of a transactional system and let users see who’s bought what products in the last five seconds. But asking that same system which customers are eligible for a loyalty bonus, well that might make two people unhappy. Firstly the next customer waiting for the system to respond so they can buy one of your shiny products, but also the account humble manager wanting to know which of her customers she can delight with news of their eligibility. If the customer loyalty bonus object was selected with a few other objects of similar complexity, the resulting database query could take tens of seconds or over a minute to run. After waiting a minute for that information her mind may wander on to that spreadsheet she keeps of her own sales to her key customers and decide her time is better spent maintaining her own little island of data.

So by trimming the query run time from tens of second or a minute plus to milliseconds what will the impact be? Probably,

  • more people will use the system to make fact-based decisions
  • people will rely less on their own islands of data, meaning more consistency in decision making between people and departments
  • people will find uses for the system you or they didn't originally envisage
  • you may see a cultural shift in the way people use information.

After all, data is the new gold!

Posted By Angus Menter, BI Practice Manager on August 6th,2015