You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When dbt recreates a model, it starts by dropping the Athena table/view for that model and the partitions that are associated with it in the Athena metadata. This means that by bringing our CTAS queries into the DAG (#111), we will be introducing an operation that destroys data, with potential for downtime during periods of data recreation.
As a first step to help address this data destruction, we should enable bucket versioning on the prod dbt data bucket so we can roll back to older data in case of a problem.
When dbt recreates a model, it starts by dropping the Athena table/view for that model and the partitions that are associated with it in the Athena metadata. This means that by bringing our CTAS queries into the DAG (#111), we will be introducing an operation that destroys data, with potential for downtime during periods of data recreation.
As a first step to help address this data destruction, we should enable bucket versioning on the prod dbt data bucket so we can roll back to older data in case of a problem.
Blocked by #111.
The text was updated successfully, but these errors were encountered: