Challenges of Auditing Big Data (2024)

Big data is anticipated to make important contributions in the audit field by enhancing the quality of audit evidence and facilitating fraud detecting. A data set can be considered big if the current information system is cannot deal with it.

Table of Contents show

Challenges of Auditing Big Data:

Challenge 1: Equipping Auditors With The Right Skills

Today’s auditors are faced with complex business models which do not always operate in the same way as the more traditional ones.

Technological developments have created sophisticated systems which have greater capabilities and the auditor needs some insight into, and understanding of, how these systems work to be able to audit the organisation effectively.

This presents a challenge around how to appropriately train and educate our future auditors and has implications for the pre- and post-qualification training options that we provide.

Challenge 2: Variation In Data Quality

Big data has the potential to play a vital role in the audit process by providing insight into information which we have never had access to previously.

However, it is important to recognise that data quality is an issue with all data and not simply with big data. Inaccurate data or data which does not deliver the appropriate information poses a challenge for the auditor.

If this data is relied on in an audit it may result in incorrect conclusions being drawn.The challenge will be in determining what data is accurate.

Challenge 3: Data Protection And Privacy Laws

We need to ensure that we have a rigorous approach as to how we use and store data that is in the public domain or which has been provided to us by third parties.

Auditors carrying out forensic work will find data held on mobile phones, computers or household electrical items to be tremendously useful and they may use a range of different techniques to extract information from them.

However, as with all digital data we need to ensure that we handle it in the correct way and this will involve adherence to the principles of the Data Protection Act and associated legal guidance.

Challenge 4: Technology Integration

The challenge for the auditor is to understand how to integrate these big data sources into their existing data management infrastructure and how to use the data effectively.

The auditors of the future will need to be able to use data held in large data warehouses and in cloud-based information systems.

Challenge 5: Data Integrity

In some instances the auditor may have access to high quality data from off-the-shelf systems but there may be doubts as to the integrity of the data.

This may be due to the systems having been used for other purposes over a long period of time so there may be concerns about the reliability of the data.

The challenge facing the auditor is to be able to determine whether the data they use is of sufficient quality to be able to form the basis of an audit.

Challenge 6: Lack Of Access To ‘source’ Information

Access to good quality data is fundamental to the audit process.

As an audit progresses it will be necessary to retrieve additional data and if the data is not up to the required standard it may be necessary to carry out further work to be able to use the data.

Auditors will need to have access to the underlying data and if the auditor has doubts about the quality of the data it will be more challenging to determine whether the information is accurate.

Challenge 7: Big Data Analytics

An audit tool with the right analytics will strengthen the auditor’s ability to evaluate and understand information.

Data analytics involves those processes which are designed to transform data into information and which help the auditor to identify and assess risk. Audit analytics will allow the auditor to analyse the data they are now using and to scan their findings against what they already know about the entity.

Depending on the analytical tool being used, the results may be returned to the auditor in interactive digital dashboards providing results in a range of different formats. These will contain statistical summaries, visualisations of data and other analytical items which the auditor may use to identify material misstatements or to check for fraud.

Challenge 8: Data Integration And Data Integrity Across Multiple Sources

One of the challenges to be addressed in the future is how to integrate multiple sources of data using detection models – so that as new data sources are discovered they can be seamlessly integrated with the existing data.

Challenge 9 Effect Of Big Data On The Audit

The challenge is how to analyse big data to detect fraud.

For example, if a company applies for a loan from a bank, then you can use this data to predict if there is any hidden fraud or some other issues.

This post contains affiliate links. Affiliate disclosure: As an Amazon Associate, we may earn commissions from qualifying purchases from Amazon.com and other Amazon websites.

Challenges of Auditing Big Data (2024)

FAQs

What challenges do auditors face when using big data? ›

Inaccurate data or data which does not deliver the appropriate information poses a challenge for the auditor. If this data is relied on in an audit it may result in incorrect conclusions being drawn.

Which challenges affect big data analysis? ›

This data needs to be analyzed to enhance decision making. But, there are some challenges of Big Data encountered by companies. These include data quality, storage, lack of data science professionals, validating data, and accumulating data from different sources.

How does big data affect auditing? ›

The Benefits of Big Data In Auditing

Since artificial intelligence and automation are used in big data, large volumes of data are processed to provide auditors with great insights. For example, auditors can make decisions based on a review of previous cases regarding non-compliance and fraud.

What are four challenges you can face when auditing information systems? ›

The Top Challenges Facing IT Auditors
  • IT security and privacy/cybersecurity.
  • Data management and governance.
  • Emerging technology and infrastructure changes—transformation/innovation/disruption.
  • Staffing and skills challenges.
  • Third-party/vendor management.
Oct 30, 2019

What are the 3 factors affecting big data? ›

There are three defining properties that can help break down the term. Dubbed the three Vs; volume, velocity, and variety, these are key to understanding how we can measure big data and just how very different 'big data' is to old fashioned data.

What are the 3 Vs of big data challenges? ›

The 3 V's (volume, velocity and variety) are three defining properties or dimensions of big data. Volume refers to the amount of data, velocity refers to the speed of data processing, and variety refers to the number of types of data.

How data analytics affect auditing? ›

Overall, data analytics can help improve audit quality at each stage of the audit process, leading to improved audit quality as a whole. From audit planning to testing to reporting, internal auditors can use data analytics to better understand their work and collaborate with other stakeholders.

What are the advantages of big data analytics in auditing? ›

The use of audit analytics enables greater efficiencies and more accurate findings from the review process. As a result, businesses will be able to create strategies based on verifiable data, rather than a mix of small data and professional assumptions. The effects can revolutionize the auditing process as a whole.

Why auditing data is important? ›

Auditing your databases enables you to track and understand how your records are used and gives you visibility into any risks of misuse or breaches. When you conduct an audit, you can monitor each interaction with the data and log it to an audit trail.

What are the three main auditing risks? ›

There are three main types of audit risk: Inherent risk, detection risk, and control risk.

What is the biggest challenge you would face in internal auditing? ›

Lack of management support: The audit manager must make sure that the senior management understands the importance of auditing. One must communicate the cost of audit observations with the management and also the greater cost of not responding to them.

What are the top 3 big data privacy risks? ›

What Are the Biggest Privacy Issues Associated with Big Data?
  • #1- Obstruction of Privacy Through Breaches. ...
  • #2- It Becomes Near-Possible to Achieve Anonymity. ...
  • #3 – Data Masking Met With Failure in a Big Data-Driven Setting. ...
  • #4 – Big Data Analysis Isn't Completely Accurate. ...
  • #5 – Copyrights and Patents Are Rendered Irrelevant.

What is one of the major problems with big data __________? ›

Data Growth Issues

One of the foremost pressing challenges of massive Data is storing these huge sets of knowledge properly. The quantity of knowledge being stored in data centers and databases of companies is increasing rapidly. As these data sets grow exponentially with time, it gets challenging to handle.

What are the 5 V's of big data? ›

Big data is a collection of data from many different sources and is often describe by five characteristics: volume, value, variety, velocity, and veracity.

How can audit and accounting firms mitigate risks associated with big data? ›

By using data analytics procedures, accountants and auditors can produce high-quality, statistical forecasts that help them understand and identify risks relating to the frequency and value of accounting transactions.

What is the challenges of auditor in auditing of Computerised system? ›

Complexity of the computer systems. Non-existence of visible evidence. Possibility of systematic errors. Non retention of files and data.

What are the challenges of internal audit data analytics? ›

In making the most of data analytics, internal audit departments face issues, including: inaccurate or misleading results; misuse or misinterpretation of data; conflicts in independence; development of talent; and challenges around data privacy and security.

Top Articles
Latest Posts
Article information

Author: Clemencia Bogisich Ret

Last Updated:

Views: 6086

Rating: 5 / 5 (60 voted)

Reviews: 83% of readers found this page helpful

Author information

Name: Clemencia Bogisich Ret

Birthday: 2001-07-17

Address: Suite 794 53887 Geri Spring, West Cristentown, KY 54855

Phone: +5934435460663

Job: Central Hospitality Director

Hobby: Yoga, Electronics, Rafting, Lockpicking, Inline skating, Puzzles, scrapbook

Introduction: My name is Clemencia Bogisich Ret, I am a super, outstanding, graceful, friendly, vast, comfortable, agreeable person who loves writing and wants to share my knowledge and understanding with you.