0 like 0 dislike
in Tutorial & Interview questions by (7k points)

1 Answer

0 like 0 dislike
by (7k points)
 
Best answer

What is Data?

Factual information (as measurements or statistics) used as a basis for reasoning,discussion, or calculation.

Information output by a sensing device or organ that includes both useful and irrelevant or redundant information must be processed to be meaningful.

Information in numerical form that can be digitally transmitted or processed.

Simply we can say, data is Factual Information or Data is raw facts before it has been processed. Data is our every day life, we deal with it every day basis.

What is Big Data?

Big data is high volume, high velocity and high-variety information assets that demand cost effective, innovative forms of information processing for enhanced insight and decision making-Gartner.

Big data refers to large data sets that are challenging to store, search, share, visualize  and analyze.

Big data is data that is going to give a certain contextual information for us to make a decision but it is not trivial in size.

Big data — Big data technology is a new generation of technology and architectures designed to extract value economically  from very large volume of a wide variety of data by enabling high velocity capture, discovery and analysis.

Big data is data that exceeds the processing capacity of conventional database systems.  The data is too big, moves too fast and does not fit the structures of existing data base architecture.

It is enormous amount of data .

When we going to deal with enourmous amount of data , these are the two problems that we need to sort first.

So we going to deal with problem by problem here.

Data Storage-needs to increase

Data Processing-needs to Have more information

So  big data is a problem domain. More data usually beats better algorithms

Good news is that Big Data is here

Bad news is that we are struggling to store and analyse it.

Data Sources of Big Data

There are majorly 4 sources of data for big data:

1) Social Media- social media is one of the key platform that is trying to pull information from us by providing such key environment for the user to put information.

We have popular social media websites, everybody knows-Facebook, Twitter, Instagrams, Pintrace etc. everything is there and we push information to it.

2) Cloud

3) Devices

4) IOT

The Model of Generating/Consuming Data has Changed

Old Model: Few companies are generating data, all others are consuming data

New Model: all of us are generating data, and all of us are consuming data

Attributes of Big Data

Volume(size)- Size, is one of the criteria to term data as big data but size itself is a subjective criteria which depends upon infrastructure that u choose to handle the data to process and compute.

Variety(Complexity)- the data type in other words or called formats , variety , variety of data is important.

Relational Data (Tables/Transaction/Legacy Data)

Text Data (Web)

Semi-structured Data (XML)

Graph Data

Social Network, Semantic Web (RDF), …

Streaming Data

You can only scan the data once

A single application can be generating/collecting many types of data 

Big Public Data (online, weather, finance, etc)  

Velocity(Speed)-

Data is begin generated fast and need to be processed fast

Online Data Analytics

Late decisions è missing opportunities

Examples

E-Promotions: Based on your current location, your purchase history, what you like è send promotions right now for store next to you

Healthcare monitoring: sensors monitoring your activities and body  è any abnormal measurements require immediate reaction

Veracity-

Trustworthiness of the data

Data in Doubt

Register fast for winter training program at Goeduhub Technologies. We are providing winter training in AI-ML, IoT, Python, Hadoop and PLC-SCADA.

[[ CALL - 07976731765 ]]

...