You are what you eat

Congratulations, blog fans! We’ve made it to the end (well almost, you have to read this one first).

Now, if you’ve ever worked with or for a bank you’ll know that over the years that banks data collection will be huge. There’s loads of it. An amount I believe is scientifically referred to as “oodles of data.” It’s all stored somewhere, whether in data stores locally or offshore, or master data management systems in a private cloud, or a combination of most of the above.

Where’s your bank’s data? Look! It’s over there! Or over there! And it’s in loads of different formats.

This is because making data consistent is hard, and matching data is hard; implementing new policies around the collection and storage of data harder still.

So, when the bank eventually sets up a major IT project to replace its thirty data management systems with a new one, in time what tends to happen instead is that the new system becomes number thirty-one.

But for any of our banks who really want to make New Year’s Resolutions they can achieve, it is time to stop thinking of data quality as something for IT to sort and realise that data quality is a business asset.

If the data quality is poor, questionable or unknown, it should be considered equally as damaging as, say, credit risk would be.

The theoretical jump to this mindset is reasonably easy; bringing it into reality is perhaps on the trickier side. This can be because IT departments are typically tasked with storing and securing the data, yet business units want to use, analyse and evolve it, opposing views which can cause tension.

It’s the same idea as committing to eat calorie-controlled lunches, but then getting home and eating the leftover cream-and-deliciousness dinner your flatmate or partner had leftover from the night before: unless the policy applies across the board, compromises will ensue and goals will be missed.

If the bank treats its data as an asset and makes perfecting data a responsibility of every business unit and individual, it means that everyone is focusing on addressing the core problem and making the data the best it can be. But in order to do this, the business units are going to need tools they can use themselves, without expecting developers or programmers to do it for them: after all, banks can hardly be expected to roll out a developer per team to code and script bespoke rule sets!

These tools have to be able to measure the underlying data in terms of absolute quality and also tailored to the teams’ individual requirements. In that respect, it’s no different to the importance of knowing precisely how bad one of those delicious doughnuts is going to be in terms of sugar, fat and carbohydrates: everything must be measurable if a beneficial and life-changing adjustment is going to be made.

In the EU there are regulations concerning the display on food packaging of key information concerning nutritional value to set quantities (100g, ml ~3.5oz, fl oz), to enable better-informed decisions to be made. Banks seeking an equivalent measure for data quality can use something like the Enterprise Data Management Council’s DCAM standard to give clear definitions of data quality so that a baseline measurement can be established into the underlying health of the data at hand.

This way, the bank can monitor what it’s eating and what it’s already eaten; it applies equally to measuring data already in the system and the new information the bank hoovers up each day.

Lastly, these tools need to connect equally as easy with the bank’s data systems, because “rip and replace” is an extremely costly activity to get right and an even costlier one to get wrong. Fast plug-in connectivity also means that when plugged into a remediation loop, it sets up a natural virtuous circle that shores up and improves the bank’s data assets.

For this and all our resolutions – whether exercising morelosing weight or eating more healthily – all that remains to achieve these in the near term is the classic final line from the bottom of any diet recommendation:

Willpower Required!

If you’ve read something here that’s piqued your interest, even if it’s just in doughnuts, biscuits or The Crown, ping me and we’ll have a chat.

Get ADQ 1.4 today!

With Snowflake connectivity, SQL rule wizard and the ability to bulk assign data quality breaks, ADQ 1.4 makes end-to-end data quality management even easier.