TDWI Survey Finds Lack of Trust in Analytical Outcomes Hampers Data-driven Enterprises’ Agility
Report uncovers prevalence of data access, quality and governance issues; recommends adoption of data intelligence strategy for increased collaboration and stewardship
Altair today announced the results of a new research report from TDWI that finds company executives do not trust their internal data and analytical processes for effective business operations.
According to the Altair-commissioned survey, “Reducing Inefficiency and Increasing the Value of Analytics and Business Intelligence,” only 11 percent of respondents said that they were very satisfied with their companies’ investments in data and analytics projects to meet strategic goals for enabling data-driven decision-making or actionable customer intelligence.
“Data is the lifeblood for critical business activities including risk evaluation, customer engagement, business performance management, regulatory requirements and more. When business users cannot access governed data, share it and collaborate on analytical outcomes, they are left feeling frustrated and ineffective,” said David Stodder, senior director of TDWI Research for business intelligence (BI). “Business users need to move beyond spreadsheets and inefficient data preparation practices to a team-based intelligent analytical approach that enables smarter data stewardship.”
The survey of 263 business and IT executives exposes the data management and governance shortcomings of many organizations and the reverberating business impact of poor data quality, lack of confidence and the scarcity of collaborative frameworks. Key findings from the survey include:
- Spreadsheets continue to be the preferred method for analytics. Eighty-nine percent of respondents state that they input data into spreadsheets for analysis, yet 81 percent are concerned about data quality and consistency when using these files.
- The majority of those surveyed (65 percent) say that users and analysts can create analytical dashboards with self-service applications; however, only 44 percent can find or access relevant data for the reports.
- One in five (20 percent) responded that individuals can find trusted data sources without IT support, and only 18 percent can track data lineage to a source, which leads to a decay in analytical confidence.
- Inefficiency related to data preparation tasks for analytics continues to be an issue with nearly half reporting (48 percent) that users are spending at least 61 percent of their time on finding and preparing data.
- Tribal knowledge about data use and sharing sources is conducted in less formal, governed formats, including email (48 percent), word-of-mouth suggestions (45 percent) and internal and external networks (25 and 5 percent respectively). Few organizations (5 percent) are using data marketplaces for collecting this knowledge and curating trusted data sources.
- Fifty percent of respondents stated that their organizations do not have a formal data governance strategy, which directly impacts how data usage is tracked for a complete data lineage. This lineage is key to increasing trust in data; yet nearly two in five (38 percent) are only somewhat confident about the lineage of the data used in reports and analytics, and 18 percent report no confidence.
- Data stewardship and sharing insights is essential to increasing trust in data, assisting in enforcing data governance policies and expanding collaboration across the enterprise, yet only 36 percent of respondents find that data stewards are helping with the selection of data sets. Additionally, a small amount (22 percent) indicate they share feedback or rate the analytical outcomes shared across the company.
While organizations can collect data easily, it is the application of this data to a defined business strategy that is harder to implement, according to the research. A complete data intelligence strategy enables business users to master data access and governance while improving team collaboration which is essential for achieving value from data and analytic projects and enabling trust in the analytical outcomes. With only 16 percent of respondents stating that business users and analysts rate/comment on analytical outputs, data intelligent frameworks with stewardship and collaboration will be the competitive differentiator that improves efficiency, integrity and time to insight.
Conducted in February 2018, TDWI requested that analytics, BI and data professionals through their website, publications and direct email invitation provide information related to data access strategies, master data management, governance and stewardship. The survey collected responses from 263 business and IT executives and managers from enterprises of all sizes and varied industries. For more information about the survey and detailed findings, visit: http://bit.ly/2pQ9v7J.