Skip to content

[Hubs] Re-ingest costs when prices are ingested #1734

Description

@flanakin

📝 Scenario

As a FinOps hub admin, I need to re-ingest costs when prices are updated for the month in order to populate missing price data from Cost Management exports

💎 Solution

Update the ingestion_ExecuteETL pipeline to do the following:

  1. After the 'If Has Capacity' activity runs successfully, check if the current export is for the "Prices" dataset.
  2. If it is for "Prices", run a KQL extents query against the Ingestion database to see if there's an extent for the Costs dataset for the current month that is being ingested.
  3. If no Costs data has been ingested for the current month, do nothing.
  4. If Costs data for the current month has been ingested already, run the ingestion_ExecuteETL pipeline asynchronously for Costs and the current month.

🙋‍♀️ Ask for the community

We could use your help:

  1. Please vote this issue up (👍) to prioritize it.
  2. Leave comments to help us solidify the vision.

Metadata

Metadata

Assignees

No one assigned

    Fields

    No fields configured for Feature.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions