In this assignment you will use some of the tools and techniques learned in this course to analyze and report on a big data set of your choice. Initially you will need to identify a real-world problem that needs to be solved or real-world question that needs to be answered for which you can utilize big data. Then you will find an appropriate big dataset and analyze the data, develop insights into the data and finally provide a solution or answer based on your analysis.
Report
A 12 – 15 page paper that presents, in detail your analysis, results and explanation of and reason for your chosen methods. Include the following in your report:
Introduction
Introduce and discuss the real-world problem that can be solved with big data. Identify the specific dataset(s) you will use to examine the problem and explain its connection to the real-world problem. Discuss the methodology used to analyze the data.
Analysis
Outline the steps taken to analyze the data and the methodologies used. Describe the analysis process conducted and the results of the analysis. What tools and techniques were used and why? What did you learn about the data beyond your basic analysis? This should be connected to the three insights presented in the Basic Analysis work you submitted in Module 4. Be sure to explain how the results of the analysis reflects these insights from the basic analysis. Display proof of analysis via a tool utilized in class. This should include code and result with screen shots where appropriate(R, HDFS, SPARK, and/or Tableau)
Note: Analysis in only Excel in not acceptable
Results/Conclusions
Be sure to provide a detailed explanation of the results and, if necessary, recommendations. What do the results imply about the solution or answer to the question you posed in the beginning of the project?
0 comments