Data Analytics dashboard

Analytics Reliability & Release Control

Synthetic analytics quality, reconciliation and release-governance dashboard.

fixture

Decision: should the next analytics release ship, be held, or ship with an explicitly accepted caveat?

Deterministic synthetic portfolio data · snapshot 30 Jun 2026 · raw anomalies are disclosed in the scenario manifest.

Release decision

SHIP WITH CAVEATSource: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Hard gate derived from failures, signoff, rollback and accepted exceptions.

Hard gate derived from failures, signoff, rollback and accepted exceptions.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Critical pass rate

98.9%Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Passed critical controls divided by executed critical controls in June.

Passed critical controls divided by executed critical controls in June.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Freshness SLA

99.2%Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Scheduled June runs completed successfully within four hours.

Scheduled June runs completed successfully within four hours.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Latest max variance

0.2%Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Highest raw-to-dashboard variance on the snapshot date.

Highest raw-to-dashboard variance on the snapshot date.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Open high/critical

1Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Unresolved incidents whose severity is High or Critical.

Unresolved incidents whose severity is High or Critical.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Avg change lead days

4.33Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Ready-to-release days for completed changes.

Ready-to-release days for completed changes.Source: Release decisionTables: fact_release, fact_quality_result, fact_pipeline_run, fact_incident, fact_change_request

Deterministic query executed by scripts/build_analytics_projects.py.

Quality test pass rate by week
Quality test pass rate by week data
WeekPass Rate
2026-W08100%
2026-W09100%
2026-W10100%
2026-W11100%
2026-W12100%
2026-W13100%
2026-W14100%
2026-W1597.6%
2026-W16100%
2026-W17100%
2026-W1896.4%
2026-W19100%
2026-W20100%
2026-W21100%
2026-W2298.2%
2026-W23100%
2026-W2497.6%
2026-W2599.4%
2026-W2695.8%
Quality pass rate by asset
Quality pass rate by asset data
Asset IdPass Rate
CAMPAIGN_SPEND98.8%
COMMERCE_ORDERS99.5%
WEB_EVENTS99.5%
CRM_LEADS99.6%
Latest reconciliation variance by asset
Latest reconciliation variance by asset data
Asset IdReconciliation Variance Bps
CRM_LEADS21.5
COMMERCE_ORDERS10.72
CAMPAIGN_SPEND8.45
WEB_EVENTS8.31

Incidents by root-cause category

Source: Incident root causesTable: fact_incident

Deterministic query executed by scripts/build_analytics_projects.py.

Incidents by root-cause category
Root causeIncidentsCritical
Channel definition governance1Source: Incident root causesTable: fact_incident0Source: Incident root causesTable: fact_incident
Duplicate tracking1Source: Incident root causesTable: fact_incident1Source: Incident root causesTable: fact_incident
Partial partition1Source: Incident root causesTable: fact_incident1Source: Incident root causesTable: fact_incident
Schema drift1Source: Incident root causesTable: fact_incident0Source: Incident root causesTable: fact_incident
Taxonomy drift1Source: Incident root causesTable: fact_incident0Source: Incident root causesTable: fact_incident

Release gate history

Source: Release gatesTable: fact_release

Deterministic query executed by scripts/build_analytics_projects.py.

Release gate history
ReleaseScheduledEvidence dateCritical failuresHigh warningsException ownerException expiryDecision
REL-0072026-07-012026-06-300Source: Release gatesTable: fact_release1Source: Release gatesTable: fact_releaseMarketing Operations2026-07-15SHIP WITH CAVEAT
REL-0062026-06-192026-06-190Source: Release gatesTable: fact_release0Source: Release gatesTable: fact_releaseSHIP
REL-0052026-06-052026-06-050Source: Release gatesTable: fact_release0Source: Release gatesTable: fact_releaseSHIP
REL-0042026-05-122026-05-120Source: Release gatesTable: fact_release0Source: Release gatesTable: fact_releaseSHIP
REL-0032026-05-082026-05-081Source: Release gatesTable: fact_release1Source: Release gatesTable: fact_releaseHOLD
REL-0022026-04-172026-04-170Source: Release gatesTable: fact_release0Source: Release gatesTable: fact_releaseSHIP
REL-0012026-04-142026-04-142Source: Release gatesTable: fact_release0Source: Release gatesTable: fact_releaseHOLD

Failure and warning evidence

Source: Failure evidenceTable: fact_quality_result

Deterministic query executed by scripts/build_analytics_projects.py.

Failure and warning evidence
DateAssetRuleSeverityStatusAffectedOwner
2026-06-30CAMPAIGN_SPENDUnknown taxonomy rateHighWARN2Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-06-29CAMPAIGN_SPENDUnknown taxonomy rateHighWARN2Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-06-28CAMPAIGN_SPENDUnknown taxonomy rateHighWARN2Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-06-18COMMERCE_ORDERSRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultAnalytics Engineering
2026-06-18COMMERCE_ORDERSRequired type validityHighWARN4Source: Failure evidenceTable: fact_quality_resultAnalytics Engineering
2026-06-17COMMERCE_ORDERSRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultAnalytics Engineering
2026-06-17COMMERCE_ORDERSRequired type validityHighWARN4Source: Failure evidenceTable: fact_quality_resultAnalytics Engineering
2026-06-03CRM_LEADSPartition row coverageCriticalFAIL42Source: Failure evidenceTable: fact_quality_resultRevenue Analytics
2026-06-03CRM_LEADSRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultRevenue Analytics
2026-06-03CRM_LEADSFreshness lagHighWARN1Source: Failure evidenceTable: fact_quality_resultRevenue Analytics
2026-05-10CAMPAIGN_SPENDRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-05-10CAMPAIGN_SPENDUnknown taxonomy rateHighWARN13Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-05-09CAMPAIGN_SPENDRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-05-09CAMPAIGN_SPENDUnknown taxonomy rateHighWARN13Source: Failure evidenceTable: fact_quality_resultMarketing Operations
2026-05-08CAMPAIGN_SPENDRaw-to-dashboard varianceCriticalFAIL1Source: Failure evidenceTable: fact_quality_resultMarketing Operations

20 results · Showing first 15

Gate, evidence and limitations

The dashboard deliberately avoids an opaque trust score. A critical failure blocks release. A high warning can ship only with an accepted, owned, expiring caveat. All issues and resolutions are fictional and exist only to demonstrate quality and release-governance methods.

Sources

  1. Release decisionsql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    WITH latest_release AS (
      SELECT *, CASE
        WHEN critical_failures > 0 OR signoff_complete = 0 OR rollback_ready = 0 THEN 'HOLD'
        WHEN high_warnings BETWEEN 1 AND 2
             AND exceptions_accepted = 1
             AND exception_owner <> ''
             AND exception_expiry > scheduled_date THEN 'SHIP WITH CAVEAT'
        WHEN high_warnings = 0 THEN 'SHIP'
        ELSE 'HOLD' END AS release_decision
      FROM fact_release ORDER BY scheduled_date DESC LIMIT 1
    ), recent_quality AS (
      SELECT * FROM fact_quality_result WHERE run_date >= '2026-06-01'
    ), critical AS (
      SELECT SUM(CASE WHEN status = 'PASS' THEN 1 ELSE 0 END) * 1.0 / COUNT(*) AS critical_pass_rate
      FROM recent_quality WHERE severity = 'Critical'
    ), freshness AS (
      SELECT SUM(CASE WHEN freshness_minutes <= 240 AND pipeline_status = 'SUCCEEDED' THEN 1 ELSE 0 END) * 1.0 / COUNT(*) AS freshness_sla_rate
      FROM fact_pipeline_run WHERE run_date >= '2026-06-01'
    ), latest_recon AS (
      SELECT MAX(ABS(dashboard_value - governed_value) / ABS(governed_value))
             AS latest_reconciliation_variance
      FROM fact_pipeline_run WHERE run_date = '2026-06-30'
    ), open_incidents AS (
      SELECT COUNT(*) AS open_high_critical_incidents FROM fact_incident
      WHERE resolved_at = '' AND severity IN ('High', 'Critical')
    ), lead_time AS (
      SELECT AVG(julianday(release_date) - julianday(ready_date)) AS average_change_lead_days
      FROM fact_change_request WHERE release_date <= '2026-06-30'
    )
    SELECT release_decision, ROUND(critical_pass_rate, 6) AS critical_pass_rate,
           ROUND(freshness_sla_rate, 6) AS freshness_sla_rate,
           ROUND(latest_reconciliation_variance, 6) AS latest_reconciliation_variance,
           open_high_critical_incidents, ROUND(average_change_lead_days, 2) AS average_change_lead_days
    FROM latest_release CROSS JOIN critical CROSS JOIN freshness CROSS JOIN latest_recon
    CROSS JOIN open_incidents CROSS JOIN lead_time;
  2. Weekly quality trendsql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT strftime('%Y-W%W', run_date) AS week,
           ROUND(SUM(CASE WHEN status = 'PASS' THEN 1 ELSE 0 END) * 1.0 / COUNT(*), 6) AS pass_rate,
           SUM(CASE WHEN status = 'FAIL' THEN 1 ELSE 0 END) AS failures,
           SUM(CASE WHEN status = 'WARN' THEN 1 ELSE 0 END) AS warnings
    FROM fact_quality_result GROUP BY week ORDER BY week;
  3. Asset qualitysql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT asset_id,
           ROUND(SUM(CASE WHEN status = 'PASS' THEN 1 ELSE 0 END) * 1.0 / COUNT(*), 6) AS pass_rate,
           SUM(CASE WHEN status = 'FAIL' THEN 1 ELSE 0 END) AS failures,
           SUM(CASE WHEN status = 'WARN' THEN 1 ELSE 0 END) AS warnings
    FROM fact_quality_result GROUP BY asset_id ORDER BY pass_rate ASC;
  4. Latest reconciliationsql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT asset_id,
           ROUND(ABS(dashboard_value - governed_value) / ABS(governed_value), 6)
           AS reconciliation_variance,
           ROUND(ABS(dashboard_value - governed_value) / ABS(governed_value) * 10000, 2)
           AS reconciliation_variance_bps
    FROM fact_pipeline_run WHERE run_date = '2026-06-30'
    ORDER BY reconciliation_variance DESC;
  5. Failure evidencesql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT run_date, asset_id, rule_name, severity, status, observed_value, threshold, affected_rows, owner
    FROM fact_quality_result WHERE status <> 'PASS'
    ORDER BY run_date DESC, CASE severity WHEN 'Critical' THEN 1 ELSE 2 END LIMIT 30;
  6. Release gatessql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT release_id, scheduled_date, evidence_date, critical_failures, high_warnings,
           exception_owner, exception_expiry,
           CASE
             WHEN critical_failures > 0 OR signoff_complete = 0 OR rollback_ready = 0 THEN 'HOLD'
             WHEN high_warnings BETWEEN 1 AND 2
                  AND exceptions_accepted = 1
                  AND exception_owner <> ''
                  AND exception_expiry > scheduled_date THEN 'SHIP WITH CAVEAT'
             WHEN high_warnings = 0 THEN 'SHIP'
             ELSE 'HOLD' END AS decision
    FROM fact_release ORDER BY scheduled_date DESC;
  7. Incident root causessql/analytics.sql · SQLite 3 · 2026-06-30T18:00:00Z

    Deterministic query executed by scripts/build_analytics_projects.py.

    SQL query
    SELECT root_cause, COUNT(*) AS incidents,
           SUM(CASE WHEN severity = 'Critical' THEN 1 ELSE 0 END) AS critical_incidents
    FROM fact_incident GROUP BY root_cause ORDER BY incidents DESC, root_cause;