Big data what is it and how is it used What is big data Who

Big data – what is it and how is it used? What is big data? Who utilizes it and why would a company be interested in big data? What does big data provide for a company? What are security concerns regarding big data? What privacy concerns should individuals have regarding big data? Where is big data stored?

Solution

Big data – what is it and how is it used?

Big data is a set of large data sets or the large volume of data in structured, semi structured and unstructured way that is utilized in business on daily basis. Business analyse big data and get insights to take strategic level decisions and for business moves.

Big data is difficult to process or analyse by traditional database techniques or by database management system.

Big data can be described by 3V.

Volume

Velocity

Variety

Big data term is used with petabytes and exabytes of data, These data sets cannot be integrated easily.

It cannot be formulated or manipulated by traditional relational database as data takes time to load and costs for analysis, new techniques for storing and analysing data have been identified with artificial intelligence program which use complex algorithms to get insight and to aggregate data sets.

It is associated with cloud computing with Hadoop to store, process and get result from large data sets scattered in clusters at multiple sources.

Who utilizes it and why would a company be interested in big data?

What does big data provide for a company?

Database analysis is extremely important for organization to chase or evaluate performance. Big data revolve facts and figures of targets which are set by business to achieve organization’s business objectives. It does not matter how much data one has, but what you can do or how you analyse and interpret with it. Firm can get answers from big data to reduce cost, time and for new product development and launch, and for strategic decision making.

Business tasks are accomplished like:

Examples social giants like Facebook, twitter, Google, linked in, Amazon, etc are analysing user preferences on search terms to address target market for advertising personal pages

What are security concerns regarding big data? What privacy concerns should individuals have regarding big data?

There is big concern about data collection and privacy, one can sort data from large data set through techniques like data mining.

Many consumers should concern about the sharing personal information across web and the security issues involved by proving consent to use of their personal information online.

Social media are using your personal information to get insight like your family details, income details, location, occupation etc. sometime sharing these information cause serious consequences and have Privacy embarrassments.

Unethical way based on interpretations.

Big data analytics is used to interpret consumers’ buying behaviours. Big data analytics is used by organizations to take business decisions without account of considerations of ethical issues about human lives and rights. It is illegal to use personal information without prior permission that must be considered.

Work Discrimination.

Data analytics is used by HR to select job candidates, promotions, increment etc. but some time result of big data is not 100% accurate and cannot be rely on making such decisions which affect candidates’ career so such discrimination cause issues.

Intellectual property and copyrights issues

It may be difficult to get patents as due to large volume of scattered data because patent offices are not be able to verify that submitted patent is unique as much data validation is involved within repositories

Where is big data stored?

Terms associated with big data are input, output operations per second is called IOPS which is necessary to deliver data. high scale computing environments are required to set infrastructure to set big data environment like servers with direct-attached storage (DAS).

Such infrastructure can be run using technology like Hadoop, NoSQL and Cassandra as various analytics tools and have PCIe flash storage . There cannot be shared storage in this type of configuration.

Big data is stored as scale-out or clustered NAS which has complex computing environment and parallel systems different from ordinary file system processing.