Video 1 [18 mins]: Get started with BigQuery. Watch before Project 1
Embedded Files
Podcast [8 mins] -- Overview of SparkSQL, BigQuery, and the OG, MapReduce
Podcast (lightweight summary of use cases extracted from papers on MapReduce, SparkSQL, Spanner using NotebookLLM)
Optional: Related topics on data systems.
Optional: Related topics on data systems.
Goal: Below will not be tested in cs145. Videos will be mostly useful for systems-y students, and if you want to build more general awareness for interview questions such as
Goal: Below will not be tested in cs145. Videos will be mostly useful for systems-y students, and if you want to build more general awareness for interview questions such as
- How would you build a consumer app that stores 100 TBs of data and can handle 1000 queries per sec? [Ans: you could use Spanner and here's how]
- How would you run open source DBs in cloud? [Ans: Dataproc in GCP].
- Do you know how to run a Spark or Hadoop job [Ans: Watch Video 4 for GCP and Video5 for AWS]
- How would you decouple data systems using pub-sub? [Ans: Watch Video 6]
Video 2 [5 mins]: Quick start to Spanner
Video 3 [1 mins]: Running open source data systems like Hadoop/Spark/Presto in a cloud like GCP
Video 4 [17 mins]: Running Spark, Hadoop with Dataproc
Video 5 [15 mins]: Spark on AWS
Video 6 [8 mins]: Kafka to publish/subscribe messages between data systems
Video 7 [1 hr]: Playlist from Google Next conference on data pipelines. Ignore the marketing. Watch to learn about general trends from cloud providers.
Page updated
Google Sites
Report abuse