2021-09-10 SEP

Checks:

1. API

https://nih.app.box.com/file/818145170951

...

2. Consistency (pre-analytics wrangling)

...

3. Analytics

3.1 data wrangling

3.1. Flattening ? yes
Daniel and Lorena working on a background job that updates a secondary tabular data products. <-- ok
Question: what (who?) event should trigger it? Chron?
Question: How often is a job is executed and no one consumes its product? <-- daily

Lorena: put everything within a daily R ETL, manual won't do it <-- who owns it?
Daniel: try to put as much of it in scheduled BQ ... but otherwise all good

Stored procedures mixed with SQL: https://cloud.google.com/bigquery/docs/reference/standard-sql/user-defined-functions

Worth recalling BQ is an attempt to mix declarative constraint satisfaction with imperative procedure execution.

3.2 Analyses

...