Skip to content

Commit aa0e1de

Browse files
bassrockwhd
bassrock
and
whd
authored
feat(pocket): adding in pocket dbt datasets (#6574)
* feat(pocket): adding in pocket dbt datasets * fix(derived): adding _derived suffixes * Update sql/moz-fx-data-shared-prod/pocket_dbt_facts/dataset_metadata.yaml Co-authored-by: whd <[email protected]> --------- Co-authored-by: whd <[email protected]>
1 parent 29dc8cd commit aa0e1de

File tree

8 files changed

+115
-0
lines changed

8 files changed

+115
-0
lines changed

‎sql/moz-fx-data-shared-prod/pocket_dbt_facts/dataset_metadata.yaml‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
friendly_name: Pocket DBT Fact Models
2+
description: |-
3+
This dataset contains the DBT fact models for Pocket. These can be used for any Pocket reporting.
4+
https://github.com/Pocket/pocket-dbt
5+
6+
7+
dataset_base_acl: restricted
8+
user_facing: true
9+
labels: {}
10+
workgroup_access:
11+
- role: roles/bigquery.dataViewer
12+
members:
13+
- workgroup:pocket/apps
14+
- role: roles/bigquery.dataEditor
15+
members:
16+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_intermediate_derived/dataset_metadata.yaml‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
friendly_name: Pocket DBT Fact Models
2+
description: |-
3+
This dataset contains Pocket's intermediate models that have some light processing before being combined into Pocket's fact models.
4+
https://github.com/Pocket/pocket-dbt
5+
6+
7+
dataset_base_acl: restricted
8+
user_facing: false
9+
labels: {}
10+
workgroup_access:
11+
- role: roles/bigquery.dataViewer
12+
members:
13+
- workgroup:pocket/apps
14+
- role: roles/bigquery.dataEditor
15+
members:
16+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_scratch_derived/dataset_metadata.yaml‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
friendly_name: Pocket DBT Snowplow Scratch Models
2+
description: |-
3+
This dataset contains models used by Snowplow for each DBT run. They should not be used for direct reporting.
4+
https://github.com/Pocket/pocket-dbt
5+
6+
7+
dataset_base_acl: restricted
8+
user_facing: false
9+
labels: {}
10+
workgroup_access:
11+
- role: roles/bigquery.dataViewer
12+
members:
13+
- workgroup:pocket/apps
14+
- role: roles/bigquery.dataEditor
15+
members:
16+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_snowplow_derived/dataset_metadata.yaml‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
friendly_name: Pocket DBT Derived Snowplow Models
2+
description: |-
3+
This dataset contains models derived from Snowplow data for Pocket. These are used in downstream Pocket fact models for sessionization.
4+
They come from https://docs.snowplow.io/docs/modeling-your-data/modeling-your-data-with-dbt/dbt-models/dbt-unified-data-model/
5+
https://github.com/Pocket/pocket-dbt
6+
7+
8+
dataset_base_acl: restricted
9+
user_facing: false
10+
labels: {}
11+
workgroup_access:
12+
- role: roles/bigquery.dataViewer
13+
members:
14+
- workgroup:pocket/apps
15+
- role: roles/bigquery.dataEditor
16+
members:
17+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_snowplow_manifest_derived/dataset_metadata.yaml‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
friendly_name: Pocket DBT Snowplow Manifest Models
2+
description: |-
3+
This dataset contains models used by Snowplow to incrementally process new data in each run.
4+
https://github.com/Pocket/pocket-dbt
5+
6+
7+
dataset_base_acl: restricted
8+
user_facing: false
9+
labels: {}
10+
workgroup_access:
11+
- role: roles/bigquery.dataViewer
12+
members:
13+
- workgroup:pocket/apps
14+
- role: roles/bigquery.dataEditor
15+
members:
16+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_snowplow_seed_derived/dataset_metadata.yaml‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
friendly_name: Pocket DBT Snowplow Seed Models
2+
description: |-
3+
This dataset contains models that are used as seeds for the rest of the snowplow models.
4+
https://github.com/Pocket/pocket-dbt
5+
6+
7+
dataset_base_acl: restricted
8+
user_facing: false
9+
labels: {}
10+
workgroup_access:
11+
- role: roles/bigquery.dataViewer
12+
members:
13+
- workgroup:pocket/apps
14+
- role: roles/bigquery.dataEditor
15+
members:
16+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/pocket_dbt_staging_derived/dataset_metadata.yaml‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
friendly_name: Pocket DBT Staging Models
2+
description: |-
3+
This dataset contains models that are the first step in processing the derived snowplow data for Pocket reporting.
4+
These models are used to create the intermediate models that are then used to create the final fact models.
5+
https://github.com/Pocket/pocket-dbt
6+
7+
8+
dataset_base_acl: restricted
9+
user_facing: false
10+
labels: {}
11+
workgroup_access:
12+
- role: roles/bigquery.dataViewer
13+
members:
14+
- workgroup:pocket/apps
15+
- role: roles/bigquery.dataEditor
16+
members:
17+
- workgroup:dataops-managed/external-dbt-prod

‎sql/moz-fx-data-shared-prod/snowplow_external/dataset_metadata.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ workgroup_access:
99
- role: roles/bigquery.dataViewer
1010
members:
1111
- workgroup:pocket/apps
12+
- workgroup:dataops-managed/external-dbt-prod
1213
- role: roles/bigquery.dataEditor
1314
members:
1415
- workgroup:dataops-managed/external-snowplow

0 commit comments

Comments
 (0)