Open Access Open Access  Restricted Access Subscription or Fee Access

Big Data – Concepts, Applications, Challenges and Future Scope

M. Nagaraj, G. Ruba

Abstract


The term, Big Data ‘has been coined to talk to the large bulk of information that can't be forbidden by ancient data-handling techniques. Massive information continues to be a unique thought, and within the following literature we have a tendency to will elaborate it in a very palpable fashion. It commences with the thought of the topic in itself together with its properties and therefore the 2 general approaches of addressing it. The excellent study more goes on to elucidate the applications of huge information altogether various aspects of economy and being. The employment of huge information Analytics once group action it with digital capabilities to secure business growth and its visualisation to form it graspable to the technically indentured business analyzers has been mentioned exhaustive. Aside this, the incorporation of huge information so as to boost population health, for the betterment of finance, medium trade, food trade and for fraud detection and sentiment analysis are represented. The challenges that square measure impeding the expansion of huge information Analytics square measure accounted for exhaustive within the paper. This subject has been white into 2 arenas- one being the sensible challenges faces while the opposite being the theoretical challenges. The hurdles of securing {the information|the info|the information} and democratizing it are detailed amongst many others like inability to find sound information professionals in needed amounts and software system that possess ability to method data at a high speed. Through the article, the authors will decipher the notions in associate degree intelligible manner embodying in text many use-cases and illustrations.


Keywords


Big Data, 3 V‘s, Sentiment Analysis, Data Visualization, Integration, Data Democratization, Encryption.

Full Text:

PDF

References


Apache Hive. Available at http://hive.apache.org

http://blogs.worldbank.org/voices/meet-winners-and-finalists-first-wbg-big-data-innovation-challenge

http://www.forbes.com/sites/gartnergroup/2013/03/27/gartners-big-data-definition-consists-of-three-parts-not-to-be-confused-with-three-vs/

http://www.exist.com/wp-content/uploads/2014/10/3Vsbigdata.png

http://www.internetlivestats.com/twitter-statistics/

http://www.internetlivestats.com/google-search-statistics/

Grand Challenge: Applying Regulatory Science and Big Data to Improve Medical Device Innovation, Arthur G. Erdman∗, Daniel F. Keefe, Senior Member, IEEE, and Randall Schiestl, IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, VOL. 60, NO. 3, MARCH 2013 http://lsst.org/lsst/google

http://en.wikipedia.org/wiki/Parkinson‘s_law

http://www.economist.com/node/15557443

http://www.youtube.com/t/press_statistics/?hl=en

http://www.forbes.com/sites/bernardmarr/2015/04/21/how-big-data-is-changing-healthcare/ [13] http://www.forbes.com/sites/bryanpearson/2015/04/10/exercise-in-service-fitbit-omni-channel-begs-for-omni-prescience/

http://www.engadget.com/2015/04/10/jawbone-up3-shipping-april-20th/

http://www.samsung.com/uk/consumer/mobile-devices/wearables/gear/SM-R3500ZKABTU

http://healthdataalliance.com/

http://www.ibm.com/software/data/bigdata/industry-healthcare.html

http://www.firstpost.com/business/big-data-booster-shot-healthcare-industry-needs-2160271.html

Chester Curme, Tobias Preis, Eugene Stanley, Helen Susannah Moat, ―Quantifying the semantics of search behavior before stock market moves‖; CrossMark, December 2013

http://www.wsj.com/articles/how-computers-trawl-a-sea-of-data-for-stock-picks-1427941801

Nitish Sinha, ―Using Big Data in Finance: Example of sentiment-extraction from news articles‖; FEDS notes, March 2014

Baker, Malcolm and Jeffrey Wurgler, 2007. "Investor Sentiment in the Stock Market", Journal of Economic Perspectives, vol. 21(2), pages 129-152.

Heston, Steven L. and Sinha, Nitish Ranjan, 2013. "News versus Sentiment: Comparing Textual Processing Approaches for Predicting Stock Returns", Robert H. Smith School Research Paper. Available at SSRN: http://ssrn.com/abstract=2311310 or http://dx.doi.org/10.2139/ssrn.2311310

http://www.ey.com/GL/en/Services/Assurance/Fraud-Investigation---Dispute-Services/EY-Global-Forensic-Data-Analytics-Survey-2014

http://www.ey.com/CA/en/Newsroom/News-releases/2014-Global-forensic-data-analytics-survey

http://www.ikanow.com/how-can-i-use-big-data-analytics-for-fraud-detection/

http://www.pactera.com/resources/blog/how-big-data-is-revolutionizing-fraud-detection-in-financial-services/

Ruchi Verma, Sathyan Ramakrishna Mani, ―Using Analyrtics for Insurance Fraud Detection‖; FINsights, Infosys, Issue 10

http://www-01.ibm.com/software/analytics/solutions/customer-analytics/social-media-analytics/

http://www.news-sap.com/sentiment-analysis-with-big-data/

https://datafloq.com/read/big-datas-impact-food-industry/96

http://venturebeat.com/2013/03/01/ibm-brings-big-data-tech-to-food-to-prevent-the-next-horse-meat-scandal/

http://www.forbes.com/sites/daniellegould/2012/09/24/food-industry-understand-trends-big-data-tools/

Puneet Singh Duggal, Sanchita Paul ,― Big Data Analysis: Challenges and Solutions‖, International Conference on Cloud, Big Data and Trust 2013, Nov 13-15, RGPV

MarcinJedyk, MAKING BIG DATA, SMALL, Using distributed systems for processing, analysing and managing large huge data sets, Software Professional‟s Network, Cheshire Data systems Ltd.

S. Ghemawat, H. Gobioff, and S. Leung, ―The Google File System.‖ in ACM Symposium on Operating Systems Principles, Lake George, NY, Oct 2003, pp. 29 – 43.

Jefry Dean and Sanjay Ghemwat, MapReduce:A Flexible Data Processing Tool, Communications of the ACM, Volume 53, Issuse.1,January 2010, pp 72-77. PIGTutorial,YahooInc.,http://developer.yahoo.com/hadoop/tutorial/pigtutorial.html

IBM-What.is.Jaql, www.ibm.com/software/data/infosphere/hadoop/jaql/

Dryad - Microsoft Research, http://research.microsoft.com/en-us/projects/dryad/

2013 Big Data Survey Research Brief‖, SAS, The power to know, 2013

David Loshin, ―Addressing Five Emerging Challenges Of Big Data‖; Progress Software, 2014

Eric Lundquist, ―Gartner: 2013 Tech Spending To Hit $3.7 Trillion‖ October 23, 2012

2014 Data Connectivity Outlook paper‖; Progress Software, January 2014.

http://www.forbes.com/sites/ciocentral/2012/04/16/the-big-cost-of-big-data/

SAS, The power to know, ―Five Big Data Challenges And how to overcome them with visual analytics

Arvind Narayanan, Vitaly Shmatikov, ―Robust De-anonymization of Large Sparse Datasets‖; The University of texas at Austin, 2007

Victor L. Voydock and Stephen T. Kent. Security mechanisms in high-level network protocols. ACM Comput. Surv 15(2):135–171, 1983.

Devaraj Das, Owen O‘Malley, Sanjay Radia and Kan Zhang, ―Adding security to Apache Hadoop, Hortonworks Technical Report 1

Disha H. Parekh, Dr. R. Sridaran ,‖An Analysis of Security Challenges in Cloud Computing‖ in International Journal of Advanced Computer Science and Applications, Vol. 4, No.1, 2013 [51] Rashmi N, Uma K M, Jayalakshmi K, Vinodkumar K P, ―Big Data Security Challenges: Dealing with too many issues‖; International Journal of Recent Development in Engineering and Technology, Volume 3, Issue 2, August 2014

http://www.forbes.com/sites/siliconangle/2012/02/29/big-data-is-creating-the-future-its-a-50-billion-market/

http://dataconomy.com/indian-government-using-big-data-to-revolutionise-democracy/

https://en.wikipedia.org/wiki/Google_Cloud_Platform

https://cloud.google.com/

http://www.idc.com/getdoc.jsp?containerId=prUS25329114

http://www.zdnet.com/article/30-big-data-project-takeaways/


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.