Job Description
Senior Data Engineer
Location: Frisco, TX
Experience: 8+ Years
Domain: Finance / Revenue / Billing / Data & Intelligence
Job Summary
We are seeking a highly experienced Senior Data Engineer to join the Data & Intelligence team supporting T-Mobile Finance / RDMP . The ideal candidate will have strong expertise in designing and developing enterprise-scale data platforms and pipelines across Snowflake, Databricks, PySpark, Python, Advanced SQL, and Azure .
The candidate will provide technical leadership across data engineering, real-time processing, data quality, DevOps, security, governance, and finance/revenue data integration. Strong experience with billing, revenue, GL, Opex, reconciliation, and financial reporting data is highly preferred.
Key Responsibilities
Data Pipeline Development
- Architect, design, and oversee development of enterprise-scale ELT/ETL pipelines for finance and revenue data, including billing, revenue, GL, and Opex.
- Define standards for batch, incremental, CDC, watermarking, and event-driven ingestion patterns.
- Design idempotent, fault-tolerant, highly scalable, and production-ready pipelines.
- Establish frameworks for error handling, retry strategies, dead-letter queues, and operational resiliency.
- Provide technical leadership for high-volume, multi-source data integration.
Platform & Tooling
- Lead architecture and adoption of Snowflake and Databricks for large-scale data processing and analytics.
- Establish best practices for:
- Snowflake: Snowpipe, Streams, Tasks, query optimization, and cost efficiency.
- Databricks: PySpark, Delta Live Tables, Unity Catalog, and job optimization.
- dbt: Modular design, testing frameworks, CI/CD integration, and reusable components.
- Establish and govern orchestration frameworks using Airflow and/or Azure Data Factory .
- Define DAG standards, dependencies, monitoring, and operational best practices.
- Evaluate and drive platform and tooling standardization across engineering teams.
Cloud Infrastructure
- Architect and optimize cloud-native data platforms on Azure , including:
- ADLS Gen2
- Event Hub
- Azure Data Factory
- Key Vault
- Define standards for Infrastructure as Code using Terraform and/or Bicep .
- Drive cloud cost optimization through compute sizing, storage design, partitioning, and workload isolation.
- Ensure data platforms are scalable, secure, resilient, and production-ready.
Languages & Data Processing
- Provide technical leadership in Advanced SQL, Python, and PySpark .
- Develop and optimize complex transformations and distributed data processing workloads.
- Guide engineering teams on reusable frameworks, coding standards, and performance optimization.
- Provide oversight for Spark, Scala where applicable, and automation scripting.
Streaming & Real-Time Data
- Architect real-time and near-real-time data processing solutions using Kafka, Azure Event Hub, and Spark Structured Streaming .
- Define standards for stateful processing, watermarking, checkpointing, and fault tolerance.
- Lead real-time finance and revenue use cases such as:
- Reconciliation
- Anomaly detection
- Operational reporting
- Data monitoring
Data Quality & Testing
- Establish enterprise frameworks for data quality, validation, testing, and observability.
- Define standards for automated unit, integration, and regression testing.
- Implement data validation for completeness, accuracy, consistency, and freshness.
- Utilize dbt tests, Great Expectations, and custom data quality frameworks .
- Establish SLA monitoring, alerting, and data freshness tracking across pipelines.
- Drive proactive data quality and governance practices.
Data Modeling
- Interpret and implement architect-defined enterprise data models, including Star Schema, Snowflake Schema, and Data Vault .
- Provide guidance on:
- SCD Type 1 and Type 2
- Partitioning
- Clustering
- Performance optimization
- Collaborate with data architects to evolve scalable and reusable data models.
- Support semantic layer enablement for analytics and reporting.
DevOps & Engineering Practices
- Define and enforce CI/CD standards for data engineering using GitHub Actions and/or Azure DevOps .
- Establish code quality, versioning, branching, pull request, and deployment standards.
- Standardize environment promotion across Dev QA Production .
- Establish reusable frameworks, templates, and engineering best practices.
- Drive continuous improvement and engineering excellence across teams.
Security & Governance
- Lead implementation of enterprise-grade security and governance controls.
- Implement and govern:
- RBAC
- Row-level and column-level security
- PII and CPNI compliance
- TISS-310 controls
- Define standards for secrets management and secure pipeline development.
- Ensure data lineage, auditability, security, and compliance readiness.
Finance Domain Expertise
- Apply strong understanding of finance and revenue data domains, including:
- Billing and revenue systems
- General Ledger (GL)
- Financial reporting
- Revenue recognition
- Revenue reconciliation
- Period-end close processes
- Guide engineering teams in accurately implementing finance-related business logic.
- Ensure high data integrity and reliability for regulated financial data.
Required Skills
- 8+ years of experience in Data Engineering .
- Strong hands-on experience with Snowflake and Databricks .
- Expert-level PySpark, Python, and Advanced SQL skills.
- Strong experience designing enterprise-scale ETL/ELT pipelines .
- Experience with Azure data services , particularly ADLS Gen2, ADF, Event Hub, and Key Vault.
- Experience with Kafka and/or Event Hub and Spark Structured Streaming.
- Strong experience with dbt and/or Airflow .
- Experience with Terraform and/or Bicep .
- Strong understanding of CI/CD and DevOps practices .
- Experience with data quality, observability, testing, and governance.
- Strong understanding of enterprise data modeling and SCD methodologies.
- Excellent troubleshooting, performance tuning, and production support experience.
Preferred Qualifications
- Experience working with telecom, finance, revenue, billing, or GL data .
- Experience with large-scale financial data platforms.
- Experience with revenue reconciliation and revenue recognition processes.
- Experience with CPNI/PII compliance and TISS-310 .
- Experience establishing enterprise data engineering standards and reusable frameworks.
- Strong technical leadership and architecture experience.
Soft Skills
- Strong technical leadership and decision-making abilities.
- Ability to act as a technical escalation point across engineering teams.
- Excellent collaboration skills with architects, product managers, analysts, and business stakeholders.
- Ability to communicate complex technical concepts clearly to technical and non-technical audiences.
- Strong problem-solving and incident management skills.
- Experience leading incident reviews and driving continuous improvement.
Job Tags