๐ Overview
A comprehensive data analytics and reporting solution designed to monitor operational transactions within a cloud-based data ecosystem. This project demonstrates end-to-end expertise โ from data modeling and warehouse design to building dynamic, parameter-driven reports that track submission schedules and missing transaction identifiers. The system leverages Azure Synapse Analytics, Power BI, SQL, and DAX, emphasizing automation, exception tracking, and business-driven reporting for enhanced operational transparency.
Reports support:
- Interactive parameter-based filtering
- Conditional formatting for quick exception identification
- Multi-format export options (Excel, PDF)
โ๏ธ System Architecture
-
Data Source Layer Type: NoSQL (Azure Cosmos DB) Purpose: Stores contract- and transaction-level data used for downstream analytics and monitoring in CosmosDB containers.
-
Data Warehouse Layer Platform: Cloud Data Warehouse (Azure Synapse Analytics) Core Views: vw_submission_schedule โ Tracks expected vs. actual submission timelines vw_transaction_monitor โ Monitors data processing status and updates for OSND These curated views act as the foundation for analytical transformations and reporting.
-
Semantic Model Built using Power BI Desktop, the semantic model aggregates, cleans, and structures data from the warehouse for report consumption. Key Features:
- Dynamic database parameter to switch between environments (DEV/UAT/PROD).
- DAX-based calculated columns for performance and timeliness tracking.
- Calculated Field Description
- DaysDifference: Calculates the number of days between expected and actual receipt dates.
- PendingDays: Shows remaining or overdue days for unreceived submissions.
- DerivedStatus: Classifies records as Pending, Overdue, or Received.
- StatusColor: Applies conditional color formatting based on timeliness and category.
-
Deployment
Environments:
- DEV โ Development and unit testing
- UAT โ User Acceptance Testing
- PROD โ Live production data
๐ Reports Developed
-
BDX Submission Monitor Report: Tracks the status and timeliness of scheduled BDX submissions for each contract or project. Key Functionalities: Displays expected vs. actual receipt timelines with the following flags and colour-codes:
- ๐ข On Schedule โ More than 7 days away from expected date.
- ๐ Due Soon โ Within the next 7 days.
- ๐ด Overdue โ Expected date passed, not received.
- ๐ข Received On Time โ Received before or on expected date.
- ๐ด Received Late โ Received after expected date.
Displayed Fields: record_id, status, document_type, submission_date, reporting_period, expected_date, received_by, received_on, business_unit, contract_name, DerivedStatus
Available Filters: Document Type, Reporting Period, Status, Business Unit, Contract ID
This report provides a consolidated view of submission timeliness, improving accountability and reducing manual monitoring efforts.
-
OSND Tracking Report: Monitors and identifies missing or delayed unique identifiers for processed transactions. About the Identifier: Each transaction record carries a unique identifier (OSND - Original Signing Number and Date, a combination of reference number and date) generated upon successful processing. Missing identifiers may indicate unprocessed or unsubmitted transactions โ crucial for ensuring data completeness.
Key Functionalities:
- Detects missing identifiers across active records.
- Enables targeted filtering for root-cause analysis.
- Ensures reconciliation between processed and unprocessed transactions.
Displayed Fields: record_id, contract_id, entity_name, is_active, effective_start, effective_end, reporting_year, commission_rate, brokerage_rate, contract_category, product_segment, business_class, unique_identifier, currency, risk_type, partner, market_region, contract_name, business_unit
Available Filters: Carrier, Reporting Year, Unique Identifier, Contract ID
This report allows teams to detect missing reference IDs early(are flagged using a red colour-code) , improving data reliability and process traceability.
๐งฎ Tech Stack
| Component | Technology |
|---|---|
| Data Source | NoSQL (Azure Cosmos DB ) |
| Data Warehouse | Azure Synapse Analytics |
| Transformation Layer | SQL Views, DAX Expressions |
| Reporting | Power BI Desktop (Semantic Model), Power BI Report Builder (Paginated Reports) |
๐ CI/CD Deployment: A CI/CD deployment in Microsoft fabric was implemented for seamless deployment across environments:
-
Development: Feature design, data validation, and local report testing.
-
UAT: User acceptance and functionality verification.
-
Production: Live environment deployment after automated validation.
Pipeline Features:
-
Version-controlled Power BI and SQL artifacts.
-
Environment variables for dynamic database and connection string mapping.
This ensured consistent releases, faster testing cycles, and minimal downtime during updates.
๐ Outcomes & Impact
- โ Automated submission and identifier tracking
- ๐ Reduced manual tracking time via centralized reports
- ๐ฏ Quick anomaly detection through visual indicators
- โ๏ธ Multi-environment dynamic configuration
- ๐ก Improved auditability, compliance, and operational oversight