[Analysis] Characteristics of Big Data – 5 V’s | Big Data vs Traditional Data | Banking

  • Blog|FEMA & Banking|
  • 10 Min Read

The 5 V’s and other characteristics of big data explained from IIBF’s Emerging Technologies courseware, with how big data differs from traditional data, its architecture and its uses in banking.

  • By Taxmann
  • |
  • Last Updated on 14 November, 2026

Characteristics of Big Data

The characteristics of big data are described by five V’s: volume, the huge amount of data; velocity, the speed at which it is processed; variety, the diversity of its sources and formats; veracity, the verification of its truth; and value, what it can bring to the user. Big data sets are so voluminous and diverse that traditional data processing software cannot manage or process them efficiently. The IIBF courseware on Emerging Technologies explains each V, how big data differs from traditional data and how banks put it to use.

Table of Contents

  1. What is big data?
  2. What are the characteristics of big data?
  3. How is big data different from traditional data?
  4. Why does big data need a different set of tools?
  5. What is big data architecture?
  6. How is big data used in banking?
  7. Quick answers

1. What is big data?

Big data is a collection of larger and more complex data sets, especially from new data sources. Traditional data processing software cannot manage or process data on this scale efficiently, yet these massive volumes of data can be used to solve complex business problems that were previously hard to address.

The volume keeps rising. Internet use is growing worldwide and more people are joining social media, so huge volumes of data are created every second. Citing Statista, the book puts the data created, captured, copied and consumed worldwide at about 64.2 zettabytes in 2020, with 181 zettabytes expected by 2025. A zettabyte is a trillion gigabytes.

No metric defines the minimum size of big data, but such data sets run to terabytes, petabytes or exabytes. The point at which an organisation enters big data territory depends on the capabilities of its users and their tools: for some it means hundreds of gigabytes, for others hundreds of terabytes. The meaning of the term also shifts as tools improve: more and more, it refers to the value that advanced analytics can extract from a data set rather than strictly to its size, though such data sets still tend to be quite large.

Big data arrives in structured, semi-structured and unstructured forms, and it has to be cleansed and transformed before it can be understood. Organisations use it to sharpen their marketing campaigns, raise customer engagement and conversion rates, improve customer service, personalise campaigns and increase profitability, and those that use it effectively gain a competitive advantage over their peers.

2. What are the characteristics of big data?

The characteristics of big data are the 5 V’s: volume, velocity, variety, veracity and value. They describe what makes big data different from other data processing.

Volume is the sheer amount of data. Big data sets are larger than traditional ones, so every stage of processing and storage takes more effort. A group of computers may have to pool, allocate and coordinate their resources to cope, which is why cluster management and algorithms that break tasks into smaller pieces have become increasingly important. Together they allow distributed processing, in which large data sets are handled across multiple systems.

Velocity is the speed at which data moves through the system. Data flows in from many sources and often has to be processed in real time, to gain insights and keep the current understanding of the system up to date. New information is constantly added, processed and analysed as it arrives, and high velocity lets an organisation respond quickly when its data changes fast.

Variety is the diversity of big data. Its sources range from internal systems such as application and server logs to social media feeds, external APIs, sensors on physical devices and other providers, and a big data system consolidates all of it in one place whatever its origin. Formats vary just as much: images, video, audio, text files and structured logs. Traditional systems may expect data to arrive labelled, formatted and organised, but big data systems usually accept and store it in its raw state, and any changes to the raw data should ideally happen in memory during processing.

Veracity is the truth of the data. Unconfirmed raw data collected from many sources, such as social media platforms and websites, can cause serious data quality problems that are difficult to identify. That makes veracity a critical feature for big data compliance, because accurate and trustworthy insights depend on high data quality.

Value is what an organisation gains from using big data, which depends on what it can do with the information it has gathered. The worth of a large data set rises with the insights that can be drawn from it. Organisations may use the same tools to gather and analyse data, but each derives value in its own way, and when systems and processes are complex, extracting real value can be difficult. Value is the end goal of big data, and big data’s value lies not in quantity but in its role in making decisions, developing insights and supporting automation.

Taxmann.com | Research | Subscribe Now!

3. How is big data different from traditional data?

Big data differs from traditional data in where it comes from, how much of it there is, how fast it arrives, the forms it takes and the systems needed to handle it. Any big data system aims to extract insights from large amounts of heterogeneous data that traditional data processing methods cannot process efficiently. The table sets the two side by side.

Point Traditional data Big data
Where it is generated At the enterprise level Both at the enterprise level and outside it
Volume Gigabytes to terabytes Petabytes to exabytes or zettabytes
Types of data Mainly structured Structured, semi-structured and unstructured
Speed of generation Per hour or per day; high-frequency data was often discarded or captured selectively Mainly per second; high-frequency data is captured, analysed in real time and often kept in full
Sources and management Centralised Distributed
Data integration Very easy Complex and challenging
Systems needed A normal system configuration High-performance, scalable systems
Tools and functions Traditional tools; normal functions can manipulate the data Specialised, evolving tools; advanced processing functions and algorithms
Data model Strict, schema-based and static Flexible (schema-on-read) and dynamic
Relationships in the data Stable, with well-known interrelationships Dynamic, with complex and often unknown relationships
Manageability Manageable volume, easy to manage and manipulate Massive volume, difficult to manage and process efficiently
Typical sources ERP transaction data, CRM data, financial data, organisational data, web transaction data Social media, sensor data, devices, images, audio and video

4. Why does big data need a different set of tools?

Big data needs different tools because traditional data processing applications cannot cope with the capture, storage, search, sharing, transfer, analysis and visualisation of data sets this large and complex. The basic requirements are the same as for a data set of any size. What changes is the massive scale, the speed of ingesting and processing, and the characteristics of the data at each stage, and these call for distributed computing, parallel processing and scalable storage. Big data sets are also diverse, complicated and large, so finding the value hidden in them takes new methods and technologies.

There are two common ways to scale. Scaling up, or vertical scaling, means a faster server with more powerful processors and memory. It uses less network hardware and power, but on many platforms it may be only a short-term fix if growth continues. Scaling out, or horizontal scaling, means adding servers for parallel computing. It is a long-term solution, since servers can be added when needed, although moving from one monolithic system to a cluster may be difficult, if extremely effective.

Clusters also bring the three benefits the chapter lists for big data. Resource pooling combines storage, CPU and memory, all of which large data sets need in quantity. High availability comes from the fault tolerance clusters provide, so that a hardware or software failure does not cut off access to data and processing. Simple scalability means machines can be added to the group, so the system can meet changing needs without expanding the resources of any one machine.

The common challenges of big data are unstructured data growth, performance, availability, security, manageability and cost. Common solutions are scale-out NAS, Hadoop, private clouds and public clouds, and Amazon Web Services, Google Cloud Platform, IBM Cloud and Microsoft Azure are public cloud providers with big data capabilities. Big data can be stored in the Hadoop Distributed File System (HDFS), in low-cost cloud object storage such as Amazon Simple Storage Service (S3), in NoSQL databases and in relational databases.

5. What is big data architecture?

Big data architecture is the design that handles the ingestion, processing and analysis of data too large or complex for traditional database systems. Implementations may follow different approaches, but big data processing involves four broad activities: ingesting data into the system, persisting it in non-volatile storage so that it survives after the process that created it has ended, computing and analysing it, and visualising the results.

The ingestion pipeline is built in layers, each with a specific function in keeping the flow of data secure:

  • The data ingestion layer is the first stop for data from various sources. Here data is prioritised and classified so that it flows smoothly into the later layers.
  • The data collection layer transports data from the ingestion layer to the rest of the pipeline and prepares it for the processing stages.
  • The data processing layer processes the information gathered in the previous layer, applying transformations, filtering and computations. It is the first point at which analysis can take place.
  • The data storage layer deals with where to store such large amounts of data efficiently, so that storage is scalable and reliable and data can be retrieved quickly.
  • The data query layer is where active analytic processing happens, as stored data is queried and analysed to extract meaningful insights.
  • The data visualisation layer, or presentation tier, is where users of the pipeline experience the value of the data, and effective visualisation communicates insights clearly to decision-makers.

Data can be ingested in real time, as soon as it arrives, or in batches, in chunks at periodic intervals. Processing follows the same two modes: in real-time mode data is processed as it is received, while in batch mode it is processed together at fixed times, such as hourly or once a day. Common ingestion tools include Apache Flume, Apache Sqoop, Apache Kafka and Apache Gobblin, a single framework that extracts, transforms and loads large volumes of data from many sources.

6. How is big data used in banking?

Banks use big data across their functions, from optimising cash management to understanding customer behaviour and improving the bottom line. They have been tapping its potential for the last few years, and with techniques such as clustering they can make data-driven, strategic business decisions. Big data also gives banks a fuller understanding of their customers, products and services, markets, industry regulations and competitors.

Customer insight and engagement is one of the significant areas of use. Digital financial products and services let customers deal with their bank easily, and big data technologies can analyse the data received from these digital channels to understand customers’ problems, preferences and needs. Those insights help banks offer personalised services, improve customer satisfaction and strengthen their competitive position.

Big data also improves employee engagement. Banks can track, monitor and evaluate employee performance to identify the best performers and the weak or unhappy ones, reward the top performers and work on the skills and motivation of non-performing employees, while workforce analytics supports human resource planning and talent management.

Financial services firms use big data systems for risk management and real-time market data analysis. Banks can also run in-database analytics, which builds the analytic logic into the database instead of moving large data sets to a separate application, for fraud detection, credit scoring, risk management, trend and pattern recognition and balanced scorecard analysis. Keeping the data inside the enterprise data warehouse (EDW) makes retrieval and analysis faster and the information much more secure.

Speed matters as well. Fast data is information that is available as it happens. To make the best investment decisions under a global-macro strategy, for example, a bank has to stay current on geopolitical and socio-economic developments.

Collecting big data starts with identifying the range of data-generating sources. Operational systems produce transactional data from sources that include financial transactions, IoT ecosystems, mobile apps, ATM, POS and cash deposit machines, second- and third-party sources such as marketing firms, customers’ social media posts and smartphone location data. Since no enterprise can collect and use everything it generates, business leaders need a big data collection programme that picks out the data required for existing and future business use cases.

7. Quick answers

What are the 5 V’s of big data?

The 5 V’s of big data are volume, velocity, variety, veracity and value: the huge amount of data, the speed of data processing, the diversity of the data, the verification of its truth and what big data can bring to the user.

What is big data?

Big data is a collection of large and complex data sets, especially from new data sources, so voluminous and diverse that traditional data processing software cannot manage or process them efficiently.

What is the difference between traditional data and big data?

Traditional data is generated at the enterprise level, ranges from gigabytes to terabytes, is mainly structured and is managed centrally. Big data also comes from outside the enterprise, ranges from petabytes to exabytes or zettabytes, mixes structured, semi-structured and unstructured data and is managed in a distributed environment.

What is veracity in big data?

Veracity is the truth of the data. Unconfirmed raw data from sources such as social media platforms and websites can cause serious data quality problems that are difficult to identify, and accurate, trustworthy insights depend on high data quality.

Why can’t traditional tools process big data?

Big data sets are too large and complex for traditional data processing applications. Their massive scale, the speed of ingesting and processing them and the characteristics of the data call for distributed computing, parallel processing and scalable storage.

What are the layers of big data architecture?

A big data ingestion pipeline has a data ingestion layer, a data collection layer, a data processing layer, a data storage layer, a data query layer and a data visualisation layer, each performing a specific function.

How big does data have to be to count as big data?

No metric defines the minimum size, but big data sets run to terabytes, petabytes or exabytes. Depending on the capabilities of the users and their tools, big data can mean hundreds of gigabytes for some organisations and hundreds of terabytes for others.

How do banks use big data?

Banks use big data analytics to optimise cash management, understand customer behaviour, personalise services and evaluate employee performance. They can also use in-database analytics for fraud detection, credit scoring, risk management, trend and pattern recognition and balanced scorecard analysis.


Chapter 2 of Emerging Technologies (2026 Edition), the Indian Institute of Banking & Finance’s courseware for its Certificate Course on Emerging Technologies, published by Taxmann, introduces big data, from the growth of data, the 5 V’s and the difference between big data and standard data to big data architecture, data ingestion, the importance and examples of big data and the methods of collecting and analysing large amounts of data, before turning to NoSQL, the Hadoop ecosystem and Hadoop’s success stories. The chapter closes with multiple choice questions and terminal questions.

For the rules that banks work under, Taxmann.com | Research, FEMA & Banking brings together the Acts, Rules, circulars and notifications, case laws and articles on FEMA, banking and insurance. Taxmann.com | Store also lists IIBF’s courseware for its other certificate courses, including Information System for Banks and IT Security.

Related reading: the role of big data analytics in chartered accountancy · an introduction to digital banking.

More in this series: emerging technologies in banking · the Hadoop ecosystem · structured and unstructured data · types of data analytics · AI in banking.

Based on the 2026 Edition of Emerging Technologies, IIBF’s courseware for the Certificate Course on Emerging Technologies.

Disclaimer: The content/information published on the website is only for general information of the user and shall not be construed as legal advice. While the Taxmann has exercised reasonable efforts to ensure the veracity of information/content published, Taxmann shall be under no liability in any manner whatsoever for incorrect information, if any.

Leave a Reply

Your email address will not be published. Required fields are marked *

Everything on Tax and Corporate Laws of India

To subscribe to our weekly newsletter please log in/register on Taxmann.com

Author: Taxmann

Taxmann Publications has a dedicated in-house Research & Editorial Team. This team consists of a team of Chartered Accountants, Company Secretaries, and Lawyers. This team works under the guidance and supervision of editor-in-chief Mr Rakesh Bhargava.

The Research and Editorial Team is responsible for developing reliable and accurate content for the readers. The team follows the six-sigma approach to achieve the benchmark of zero error in its publications and research platforms. The team ensures that the following publication guidelines are thoroughly followed while developing the content:

  • The statutory material is obtained only from the authorized and reliable sources
  • All the latest developments in the judicial and legislative fields are covered
  • Prepare the analytical write-ups on current, controversial, and important issues to help the readers to understand the concept and its implications
  • Every content published by Taxmann is complete, accurate and lucid
  • All evidence-based statements are supported with proper reference to Section, Circular No., Notification No. or citations
  • The golden rules of grammar, style and consistency are thoroughly followed
  • Font and size that's easy to read and remain consistent across all imprint and digital publications are applied