Why is it so difficult for Organizations to become Data-driven?

With all the marketing and hype around data and analytics (and rightly so), no one in this world wants to be called a laggard in effectively leveraging data. After all, it has the promise of making an organization more agile and efficient as well as providing that competitive edge that will help the company to stand out. If not for internal reasons, there is always the fear of the competition doing it better. For years now, IT and data leaders have been trying to make their companies more data-driven, but many face significant data-driven challenges. Despite the C Suite sponsorship as well as appropriate funding, only a handful of companies can claim to have significantly moved the needle in this space.  

The easiest part is to make the technology investment, however, without the required vision, culture, and commitment, mostly likely companies would end up with an expensive and fancy but underutilized piece of software that will only bloat the cost overheads. Treating data with a project mindset can be tempting as it may yield quick results but will lead to subsequent struggles with data quality and desired consistency, presenting data-driven challenges. 

Such strategic gaffe signals the fact that while the senior leadership understands the importance of data and analytics but fails to make the required strategic changes and investments in people and culture necessary for success. It is not that they do not realize this. Many companies are ensuring that Data and Analytics leaders have a seat at the C Suite, but that is not enough. In 2021, a study by NVP indicates problems with data leadership. The average tenure of a CDO (chief data officer) is between two and two-and-a-half years. The report mentioned below highlights data-driven challenges.

“The data leaders surveyed strongly believe in the value of data, analytics, and AI but lack confidence in how their role is structured.. And they are even less convinced that their company is on the right path toward data-driven cultures and organizations.”

Data Culture

It is evident that the C-Suite attention and funding are not enough. All too often, companies think of data as a technology problem, and it is just not. Rather companies that are committed to treating data as an asset and focus on changing the decision-making culture succeed.  

The three key disciplines around data culture are: 

a. Data Literacy: Ability to draw valid conclusions from data, including its interpretation within an organization’s context, uniform understanding of KPIs, and awareness of common biases.  

b. Data governance: An overarching process that ensures accountability and reliability of data including compliance with policies and regulations. This is often supported by proper data cataloging and enabling employees to instantly search and discover the right data for a specific purpose. Data governance is pivotal in overcoming data-driven challenges. 

c. Moving out of the HiPPO (highest paid person’s opinion) decision-making paradigm: This is one of the most complex aspects of this journey. Leaders need to show a hunger to consume data for decision-making and ensure that decisions are not based only on opinions but backed by required data points.  

Of course, building a vision and culture around data that gets your company to that point is the trick. The first step is to align the organization with a visionary core data strategy. It should clearly articulate the role the data is to play in achieving the company’s short-term and long-term objectives while addressing data-driven challenges.  

Data Strategy

A well-developed data strategy should clearly articulate the “why”. This is critical to bring alignment across all levels. While sponsorship for the top management is important, it is equally important for the grassroots level to feel connected and energized. Apart from that, it must include: 

a. High-impact areas: Identify use cases with their impact in terms of driving additional revenue, improving efficiency, reducing enterprise risks, or enabling newer possibilities. Subsequently, these should be qualified further with data availability (both internal and external), its quality and feasibility to ensure a high-quality supply of consistent data.  

b. Data management plan: This should articulate plans around data governance, accountabilities, policies, etc.  

c. Technology landscape: To enable execution of use cases and governance, a consistent architecture is needed to transform, integrate, process, monitor, and consume data. I have always found this to be the easiest of the problems in this equation, however, it often ends up becoming the center stage.  

d. Data literacy: For data democratization to effectively work, a plan to educate the larger organization to be able to consume data effectively is critical. Decisionmakers at strategic and tactical levels must do this at all levels.

e. Org Structure: Every organization has a different context but having a dedicated data team helps to bring in focus and the required skillset to make it work. Without a robust org structure, data-driven challenges may arise. 

Once aligned, leaders should drive this as a change management program. It is the role of the CIO and the data leaders to educate their peers at the C-Suite and make them understand the nuances and what it takes to be successful in this pursuit to become data-driven.