This solution accelerator provides the architecture and working solution for real-time intelligence for operations. We used simulated manufacturing facility asset data for the process flow. As real-time events are streamed in, anomalies are detected with notifications sent to a specified Outlook email account. The solution includes a customized Fabric Data Agent that provides a chat experience to answer users' questions with intelligence derived from the data.
Key use cases include:
- Real-time dashboard with up-to-date analysis and reporting.
- Anomaly detection and notification.
- Customized data agent answering users' questions with intelligence derived from the data.
This solution accelerator provides a working solution for manufacturing asset performance monitoring, real-time anomaly detection, and anomaly notification. The manufacturing facility telemetry data is synthetically generated with the Telemetry Data Simulator. This architecture can be extended to other industries as long as the appropriate data is generated or actual operations data is ingested into the Azure Event Hub, and related component configurations and Kusto Query Language (KQL) code are updated accordingly. For a brief description of the architecture, please refer to Solution Architecture Overview.
Below diagram illustrates the solution architecture.
 |
|---|
If you'd like to customize the solution accelerator, here are some common areas to start:
- Data generation and collection: You can customize the data simulator to generate data that is closely aligned with your own industry or your own company.
- Update the KQL queries for the tiles in Real-Time Intelligence dashboard.
- Update the Activator rules to meet your business needs.
- Update the instructions to the Fabric Data Agent to align with your own business goals and data insights.
What's New in Microsoft Fabric
What Is Real-Time Intelligence in Microsoft Fabric?
Click to learn more about the key features this solution enables
-
Fabric Data Ingestion Program and Real-Time Event Simulator
One-time batch historical data simulator and real-time telemetry data simulator are provided. For more details, please refer to Fabric Data Ingestion Guide and Event Simulator Guide. -
Real-Time Intelligence Operations Dashboard
Real-Time Intelligence Operations Dashboard provides an overview of how manufacturing assets are performing, and shows individual sensor data trends. For details, please refer to Real-Time Intelligence Dashboard Guide. -
Fabric EventHouse with Customized Fabric Data Agent
Manufacturing telemetry data is hosted in Fabric EventHouse. You can use conversational interface powered by Fabric Data Agent for live operational queries. For details, please refer to Fabric Data Agent Guide.
-
Anomaly Detection and Alerts through Fabric Activator
Microsoft Activator is configured with anomaly detection rules that trigger Outlook email notifications when an anomaly occurs. For more details, please refer to Activator Guide. -
Useful Data Analysis and Performance Metrics KQL Code
Reusable KQL code is provided to get you started quickly. For details, please refer to Data Analysis KQL Guide and Performance Metrics KQL Queryset Guide. -
Demonstrator's Guide
After successful deployment of the solution accelerator, you or your colleague who has required access can demonstrate this solution by following the steps outlined in the Demonstrator's Guide.
Follow these steps to deploy the solution to your own Azure subscription:
 |
 |
 |
 |
|---|
One-command deployment - Deploy everything with Azure Developer CLI and Azure CLI (check prerquisites):
# Clone and navigate to repository
git clone https://github.com/microsoft/real-time-intelligence-operations-solution-accelerator.git
cd real-time-intelligence-operations-solution-accelerator
# Authenticate (required)
azd auth login # Required to deploy with azd up
az login # Required to use the Azure CLI commands that connect Azure resources to Fabric workspace
# Recommended: set email to receive alerts
azd env set FABRIC_ACTIVATOR_ALERTS_EMAIL "myteam@company.com"
# Optional: Customize resource names
azd env set FABRIC_WORKSPACE_NAME "My RTI Workspace"
azd env set FABRIC_WORKSPACE_ADMINISTRATORS "user@company.com,12345678-1234-abcd-1234-123456789abc" # comma-separated
azd env set FABRIC_EVENTHOUSE_NAME "my_custom_eventhouse"
azd env set FABRIC_EVENTHOUSE_DATABASE_NAME "my_custom_kql_db"
azd env set FABRIC_EVENT_HUB_CONNECTION_NAME "my_eventhub_connection"
azd env set FABRIC_RTIDASHBOARD_NAME "My Custom Dashboard"
azd env set FABRIC_EVENTSTREAM_NAME "my_custom_eventstream"
azd env set FABRIC_ACTIVATOR_NAME "my_custom_activator"
# Deploy everything
azd upCheck more deployment aspects in our deployment guide:
| Topic | Description |
|---|---|
| Prerequisites | Required Azure permissions, API access, and software installations (Python, Azure CLI, azd) |
| Event Simulation | Once deployed, generate real-time telemetry data and test anomaly detection with the event simulator tool |
| Deployment validation | Once deployed, verify Azure infrastructure, Fabric workspace components, and real-time data flow |
| Deployment overview | Two-phase deployment process: Azure infrastructure provisioning and Fabric workspace setup |
| Advanced configuration | Customize workspace names, component names, email alerts, and capacity deployment options |
| Alternative deployment options | Deploy locally, Azure Cloud Shell, GitHub Codespaces, VS Code Dev Container or GitHub Actions |
| Limitations | See identified limitations of the solution |
| Cleanup | Remove all deployed resources and clean up your environment with azd down |
Microsoft Fabric Capacity is enabled for your organization. Please refer to Enable Microsoft Fabric for your organization for more information.
To deploy this solution accelerator, ensure you have access to an Azure subscription with the necessary permissions to create resource groups, resources, app registrations, and assign roles at the resource group level. This should include Contributor role at the subscription level and Role Based Access Control role on the subscription and/or resource group level. Follow the steps in Azure Account Set Up.
Licensing and cost for establishing Fabric can be found at Microsoft Fabric concepts and licenses and Microsoft Fabric Pricing.
Consumption model and pricing information for Azure Databricks can be found at Serverless DBU consumption by SKU - Azure Databricks.
Note: This is not meant to outline all costs as selected SKUs, scaled use, customizations, and integrations into your own tenant can affect the total consumption of this sample solution. The sample pricing sheet is meant to give you a starting point to customize the estimate for your specific needs.
| Product | Description | Cost |
|---|---|---|
| Microsoft Fabric | Core Medallion Architecture in Microsoft Fabric, and Unified Data Platform for integration with other platforms such as Azure Databricks and Snowflakes. | Pricing |
⚠️ Important: To avoid unnecessary costs, remember to take down your app if it's no longer in use, either by deleting the resource group in the Portal or runningazd down.
-
For manufacturing plants, the plant manager or other business stakeholders can use the Fabric Data Agent to get business and operations intelligence quickly without the need to create query code. For details, please refer to Fabric Data Agent Guide.
-
For manufacturing plants, the designated operations team receives email notification when an anomaly occurs. The solution can also be configured to send anomaly notifications to a Teams Channel. For rule configuration options (Email or Teams), please refer to Activator Guide.
-
Plant manager uses real-time dashboard to analyze manufacturing plant asset performance, key telemetry data over time.
The image below shows the first page of the real-time intelligence operations dashboard, which displays sensor status, quality metrics, and individual sensor data trends. The second page shows additional information such as daily anomaly rate by asset, asset maintenance status, and fault correlations. For more details, please refer to Real-Time Intelligence Operations Dashboard Guide.
 |
|---|
Click to learn more about what value this solution provides
-
The solution provides multiple business functions with a simple architecture
The deployed solution provides real-time telemetry data monitoring, analysis, summarization, graphical reports, anomaly detection and notifications with a quick to deploy, secure, and simple architecture. -
A Fabric Data Agent getting quick business intelligence without programming effort.
The Fabric Data Agent can be quickly configured with instructions delivered in this solution accelerator, providing quick and accurate insights from data effortlessly. No programming skills are necessary. -
Real-Time Intelligence for Operations Dashboard
The deployed solution accelerator provides a working architecture with best practices, security, components integration, and real-time intelligence for operations dashboard. -
Configurable Activator providing anomaly detection and notifications
The deployed and configurable Activator provides real-time anomaly detection and alert notifications out of the box. The rules are easily configurable. -
Reusable and updatable real-time event simulator and batch data update program
Real-time telemetry data simulator and batch data ingestion / update program are provided to help to bring the solution to simulate a real-time environment quickly.
This template uses Azure Key Vault to store all connections to communicate between resources.
This template also uses Managed Identity for local development and deployment.
To ensure continued best practices in your own repository, we recommend that anyone creating solutions based on our templates ensure that the GitHub secret scanning setting is enabled.
You may want to consider additional security measures, such as:
- Enabling Microsoft Defender for Cloud to secure your Azure resources.
- Protecting the Azure Container Apps instance with a firewall and/or Virtual Network.
Click here to learn more about common questions about this solution.
Check out similar solution accelerators
| Solution Accelerator | Description |
|---|---|
| Unified Data Foundation with Microsoft Fabric | Unified Data Foundation with Microsoft Fabric with Options to Integrate with Azure Databricks and Microsoft Purview. |
| Agentic applications for unified data foundation | Agentic AI application that provides natural language query of the data using unified data foundation. Description of solution accelerator. |
Have questions, find a bug, or want to request a feature? Submit a new issue on this repo and we'll connect.
Please refer to Transparency FAQ for responsible AI transparency details of this solution accelerator.
To the extent that the Software includes components or code used in or derived from Microsoft products or services, including without limitation Microsoft Azure Services (collectively, “Microsoft Products and Services”), you must also comply with the Product Terms applicable to such Microsoft Products and Services. You acknowledge and agree that the license governing the Software does not grant you a license or other right to use Microsoft Products and Services. Nothing in the license or this ReadMe file will serve to supersede, amend, terminate or modify any terms in the Product Terms for any Microsoft Products and Services.
You must also comply with all domestic and international export laws and regulations that apply to the Software, which include restrictions on destinations, end users, and end use. For further information on export restrictions, visit https://aka.ms/exporting.
You acknowledge that the Software and Microsoft Products and Services (1) are not designed, intended or made available as a medical device(s), and (2) are not designed or intended to be a substitute for professional medical advice, diagnosis, treatment, or judgment and should not be used to replace or as a substitute for professional medical advice, diagnosis, treatment, or judgment. Customer is solely responsible for displaying and/or obtaining appropriate consents, warnings, disclaimers, and acknowledgements to end users of Customer’s implementation of the Online Services.
You acknowledge the Software is not subject to SOC 1 and SOC 2 compliance audits. No Microsoft technology, nor any of its component technologies, including the Software, is intended or made available as a substitute for the professional advice, opinion, or judgement of a certified financial services professional. Do not use the Software to replace, substitute, or provide professional financial advice or judgment.
BY ACCESSING OR USING THE SOFTWARE, YOU ACKNOWLEDGE THAT THE SOFTWARE IS NOT DESIGNED OR INTENDED TO SUPPORT ANY USE IN WHICH A SERVICE INTERRUPTION, DEFECT, ERROR, OR OTHER FAILURE OF THE SOFTWARE COULD RESULT IN THE DEATH OR SERIOUS BODILY INJURY OF ANY PERSON OR IN PHYSICAL OR ENVIRONMENTAL DAMAGE (COLLECTIVELY, “HIGH-RISK USE”), AND THAT YOU WILL ENSURE THAT, IN THE EVENT OF ANY INTERRUPTION, DEFECT, ERROR, OR OTHER FAILURE OF THE SOFTWARE, THE SAFETY OF PEOPLE, PROPERTY, AND THE ENVIRONMENT ARE NOT REDUCED BELOW A LEVEL THAT IS REASONABLY, APPROPRIATE, AND LEGAL, WHETHER IN GENERAL OR IN A SPECIFIC INDUSTRY. BY ACCESSING THE SOFTWARE, YOU FURTHER ACKNOWLEDGE THAT YOUR HIGH-RISK USE OF THE SOFTWARE IS AT YOUR OWN RISK.
