spark scala assignment

0 comments

Hi

This is the github link:

Project link

In this assignment you will be solving data analytic problems with Spark RDDs. You should have already pulled the project ‘spark-example’ from github. Run `git pull` in the repository root directory to pull down the assignment.

The explanation for the problems is in the test ‘src/test/scala/com/spark/assignment1/Assignment1Test.scala’

Each problem is a test. You will be graded on

1) The tests passing.

2) Descriptions of how the problem is being solved. This can be documented inline with the code. I’m not looking for many paragraphs. Concise documentation is good.

3) Cleanliness of code. Make it look nice, you’re attaching your name to it. Running `sbt scalafmt` will get you most of the way there.

The tests use a set of rental bike rider data. There are two datasets, one with information about individual trips, the other with information about bike stations.

The assignment is to fill out the empty function bodies in the file ‘src/main/scala/com/spark/assignment1/Assignment1.scala’.

About the Author

Follow me


{"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}