Overview
This is a remote position.
Job Title: BI QA Engineer
Location: Remote
Experience: 5–8 Years
Notice Period: Immediate Joiners Only
Job Summary
We are seeking a detail-oriented BI QA Engineer to validate the accuracy, reliability, and governance compliance of Power BI dashboards and semantic models within the organization’s enterprise BI platform.
In this role, you will ensure the quality and integrity of business intelligence assets operating within a Snowflake + dbt + Power BI ecosystem. You will work closely with BI Engineers, Analytics Engineers, and platform leadership to verify data accuracy, KPI consistency, performance, security, and documentation before dashboards are released to production.
This position is highly technical and quality-focused, playing a critical role in reducing reporting risk, preventing KPI inconsistencies, and maintaining BI platform stability at scale.
Key Responsibilities
Dashboard & Data Validation
- Perform structured validation of Power BI dashboards prior to production release.
- Validate KPIs and calculations against Snowflake source data.
- Reconcile aggregates, filters, and dimensional logic to ensure data accuracy.
- Test drill-through functionality, slicer interactions, and filter propagation.
- Identify discrepancies between report logic and documented business requirements.
- Document validation outcomes and clearly report defects.
Semantic Model & DAX Quality Assurance
- Review semantic models for adherence to star schema and snowflake schema standards.
- Validate DAX calculations, ensuring correctness, context handling, and edge-case coverage.
- Test time intelligence measures for correct date filtering behavior.
- Identify duplicated measures or inconsistent KPI definitions.
- Review relationship configurations, cardinality, and cross-filter directions.
- Validate Row-Level Security (RLS) implementation and testing.
Regression Testing & Release Management
- Conduct regression testing for dashboard enhancements and model updates.
- Validate dataset refresh behavior across Development, QA, and Production environments.
- Confirm dataset refresh schedules and failure handling mechanisms.
- Support structured release sign-off processes.
- Maintain QA checklists, validation templates, and test documentation.
Performance & Reliability Testing
- Identify performance bottlenecks at the report and semantic model level.
- Validate dataset optimization including unused field cleanup.
- Test dashboard responsiveness under typical filter and drill scenarios.
- Escalate performance or refresh reliability concerns.
- Support monitoring and validation of production incidents and root causes.
Governance & Standards Enforcement
- Ensure adherence to naming conventions and dataset certification standards.
- Validate documentation completeness before production release.
- Prevent duplicate datasets and fragmented reporting logic.
- Confirm dashboards utilize certified datasets when required.
- Enforce publishing protocols and workspace governance standards.
Collaboration & Communication
- Collaborate with BI Engineers and Analytics Engineers during development.
- Provide clear and structured defect reports with reproducible test cases.
- Participate in sprint reviews and release planning sessions.
- Coordinate across time zones for efficient development and QA handoffs.
- Escalate systemic risks or recurring data quality issues.
Required Skills & Qualifications
- 5+ years of experience working with Power BI (development or QA).
- Strong understanding of data modeling concepts, especially star schema design.
- Advanced knowledge of DAX, including context transition and time intelligence.
- Strong SQL skills for source-to-report data validation and reconciliation.
- Experience validating dashboards connected to Snowflake or other cloud data warehouses.
- Experience testing Row-Level Security (RLS) and Power BI App Audience configurations.
- Familiarity with Dev/Test/Prod deployment workflows.
- Experience working within structured QA or testing processes.
Preferred Qualifications
- Prior experience in BI Quality Assurance or Data QA roles.
- Exposure to dbt-based data transformation environments.
- Familiarity with CI/CD pipelines and automated release workflows.
- Experience in Power BI dataset performance testing and optimization.
- Experience creating and maintaining test cases, QA documentation, and validation artifacts.