Skip to content

Latest commit

ย 

History

14 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Enterprise-Bordereau-Management

๐Ÿ“˜ Overview

A comprehensive data analytics and reporting solution designed to monitor operational transactions within a cloud-based data ecosystem. This project demonstrates end-to-end expertise โ€” from data modeling and warehouse design to building dynamic, parameter-driven reports that track submission schedules and missing transaction identifiers. The system leverages Azure Synapse Analytics, Power BI, SQL, and DAX, emphasizing automation, exception tracking, and business-driven reporting for enhanced operational transparency.

Reports support:

  • Interactive parameter-based filtering
  • Conditional formatting for quick exception identification
  • Multi-format export options (Excel, PDF)

โš™๏ธ System Architecture

  1. Data Source Layer Type: NoSQL (Azure Cosmos DB) Purpose: Stores contract- and transaction-level data used for downstream analytics and monitoring in CosmosDB containers.

  2. Data Warehouse Layer Platform: Cloud Data Warehouse (Azure Synapse Analytics) Core Views: vw_submission_schedule โ€“ Tracks expected vs. actual submission timelines vw_transaction_monitor โ€“ Monitors data processing status and updates for OSND These curated views act as the foundation for analytical transformations and reporting.

  3. Semantic Model Built using Power BI Desktop, the semantic model aggregates, cleans, and structures data from the warehouse for report consumption. Key Features:

    • Dynamic database parameter to switch between environments (DEV/UAT/PROD).
    • DAX-based calculated columns for performance and timeliness tracking.
    • Calculated Field Description
      • DaysDifference: Calculates the number of days between expected and actual receipt dates.
      • PendingDays: Shows remaining or overdue days for unreceived submissions.
      • DerivedStatus: Classifies records as Pending, Overdue, or Received.
      • StatusColor: Applies conditional color formatting based on timeliness and category.
  4. Deployment

    Environments:

    • DEV โ€“ Development and unit testing
    • UAT โ€“ User Acceptance Testing
    • PROD โ€“ Live production data

๐Ÿ“ˆ Reports Developed

  1. BDX Submission Monitor Report: Tracks the status and timeliness of scheduled BDX submissions for each contract or project. Key Functionalities: Displays expected vs. actual receipt timelines with the following flags and colour-codes:

    • ๐ŸŸข On Schedule โ€” More than 7 days away from expected date.
    • ๐ŸŸ  Due Soon โ€” Within the next 7 days.
    • ๐Ÿ”ด Overdue โ€” Expected date passed, not received.
    • ๐ŸŸข Received On Time โ€” Received before or on expected date.
    • ๐Ÿ”ด Received Late โ€” Received after expected date.

    Displayed Fields: record_id, status, document_type, submission_date, reporting_period, expected_date, received_by, received_on, business_unit, contract_name, DerivedStatus

    Available Filters: Document Type, Reporting Period, Status, Business Unit, Contract ID

    This report provides a consolidated view of submission timeliness, improving accountability and reducing manual monitoring efforts.

  2. OSND Tracking Report: Monitors and identifies missing or delayed unique identifiers for processed transactions. About the Identifier: Each transaction record carries a unique identifier (OSND - Original Signing Number and Date, a combination of reference number and date) generated upon successful processing. Missing identifiers may indicate unprocessed or unsubmitted transactions โ€” crucial for ensuring data completeness.

    Key Functionalities:

    • Detects missing identifiers across active records.
    • Enables targeted filtering for root-cause analysis.
    • Ensures reconciliation between processed and unprocessed transactions.

    Displayed Fields: record_id, contract_id, entity_name, is_active, effective_start, effective_end, reporting_year, commission_rate, brokerage_rate, contract_category, product_segment, business_class, unique_identifier, currency, risk_type, partner, market_region, contract_name, business_unit

    Available Filters: Carrier, Reporting Year, Unique Identifier, Contract ID

    This report allows teams to detect missing reference IDs early(are flagged using a red colour-code) , improving data reliability and process traceability.

๐Ÿงฎ Tech Stack

Component Technology
Data Source NoSQL (Azure Cosmos DB )
Data Warehouse Azure Synapse Analytics
Transformation Layer SQL Views, DAX Expressions
Reporting Power BI Desktop (Semantic Model), Power BI Report Builder (Paginated Reports)

๐Ÿ”„ CI/CD Deployment: A CI/CD deployment in Microsoft fabric was implemented for seamless deployment across environments:

  • Development: Feature design, data validation, and local report testing.

  • UAT: User acceptance and functionality verification.

  • Production: Live environment deployment after automated validation.

    Pipeline Features:

  • Version-controlled Power BI and SQL artifacts.

  • Environment variables for dynamic database and connection string mapping.

This ensured consistent releases, faster testing cycles, and minimal downtime during updates.

๐Ÿš€ Outcomes & Impact

  • โœ… Automated submission and identifier tracking
  • ๐Ÿ•’ Reduced manual tracking time via centralized reports
  • ๐ŸŽฏ Quick anomaly detection through visual indicators
  • โš™๏ธ Multi-environment dynamic configuration
  • ๐Ÿ’ก Improved auditability, compliance, and operational oversight

About

End-to-end bordereaux management solution with Power BI tracking reports and Microsoft Fabric analytics platform for compliance monitoring and business insights.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors