Skip to content

use views for staging and refresh only in CI deployments#525

Draft
pnadolny13 wants to merge 1 commit intomainfrom
use_views_better
Draft

use views for staging and refresh only in CI deployments#525
pnadolny13 wants to merge 1 commit intomainfrom
use_views_better

Conversation

@pnadolny13
Copy link
Contributor

@pnadolny13 pnadolny13 commented Jan 18, 2023

  • consistently make all staging models views
  • when we deploy in CI we should refresh our views, similar to seed. Then following that we dont need to keep rebuilding the views.
  • add a test for slack notifications for consistency

TODO:

  • still need to figure out staging jobs, they dont need to run daily after EL if they are views. Maybe just run tests
  • consider going to opposite direction too and making all staging models tables to break pipeline if source tests fail before exposing to downstream models. Bad data wont make it to staging table then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant