4.11 Big Data

Video tutorials

4.11.1 Big Data

• Know that 'Big Data' is a catch-all term for data that won't fit the usual containers.

• Know that when data sizes are so big as not to fit on to a single server:

  • the processing must be distributed across more than one machine

  • functional programming is a solution, because it makes it easier to write correct and efficient distributed code.

• Know what features of functional programming make it easier to write:

  • correct code

  • code that can be distributed to run across more than one server.

• Be familiar with the:

  • fact-based model for representing data

  • graph schema for capturing the structure of the dataset

  • nodes, edges and properties in graph schema