Joshua intro and advice, addition, Recap and Conclusion

  |   Source
Joshua intro and advice, addition, Recap and Conclusion

  • Joshua uses pig to reduce the data, also hive others used by company
  • it's important to use map reduce to agregate down your data to fit on a single machine
  • Pig is really help us to only thinks about the abstract way to do the computation for our data. Then it's up to pig to implement the efficient way to handle the map reduce
  • It's good to have good impact for all people in the world. Doing so we need big data and the outcome will produce the overall people


  • Now the final project would be including all the of we learn so far.
  • Building data analysis, making a good visualisation and then post a blog so family and friends can see about our findings.
  • Specifically, they will have knowledge about our findings, ridership on subway data
  • It's important to tell in the beginning, what object that we will discuss