Skip to content

Commit 29dc8cd

Browse files
change data types from dates to strings, move to new airflow job (#6591)
* change data types from dates to strings, move to new airflow job * add addon_moderations dag to dags.yaml
1 parent bb6d9da commit 29dc8cd

File tree

3 files changed

+23
-3
lines changed

3 files changed

+23
-3
lines changed

dags.yaml

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1886,3 +1886,23 @@ bqetl_monitoring_weekly:
18861886
retry_delay: 30m
18871887
tags:
18881888
- impact/tier_3
1889+
1890+
bqetl_addons_moderations:
1891+
default_args:
1892+
depends_on_past: false
1893+
email:
1894+
1895+
1896+
email_on_failure: true
1897+
email_on_retry: true
1898+
end_date: null
1899+
1900+
retries: 2
1901+
retry_delay: 30m
1902+
start_date: '2024-12-02'
1903+
description: This DAG schedules queries for moderations of addons data ex. from
1904+
the external API Cinder.
1905+
repo: bigquery-etl
1906+
schedule_interval: 0 4 * * *
1907+
tags:
1908+
- impact/tier_3

sql/moz-fx-data-shared-prod/addon_moderations_derived/cinder_decisions_raw_v1/metadata.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ labels:
77
incremental: true
88
owner1: example
99
scheduling:
10-
dag_name: bqetl_addons
10+
dag_name: bqetl_addons_moderations
1111
arguments: ["--date", "{{ ds }}"]
1212
secrets:
1313
- deploy_target: CINDER_TOKEN

sql/moz-fx-data-shared-prod/addon_moderations_derived/cinder_decisions_raw_v1/schema.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ fields:
4747

4848
- mode: NULLABLE
4949
name: created_at
50-
type: DATE
50+
type: STRING
5151
description: Date decision made
5252

5353
- mode: NULLABLE
@@ -57,7 +57,7 @@ fields:
5757

5858
- mode: NULLABLE
5959
name: job_assigned_at
60-
type: DATE
60+
type: STRING
6161
description: Date addon report was assigned to a moderator
6262

6363
- mode: NULLABLE

0 commit comments

Comments
 (0)