Data Engineer

Company Overview

Channel Factory provides intelligent marketing solutions for the next generation of contextual safety, suitability, and performance for brands and agencies. Our platform helps marketers implement, automate, and scale their marketing programs across the world’s largest video library, YouTube, and emerging growth channels. We sit at the intersection of marketing and suitability and have a mission of enabling the world’s top brands to consciously connect with the right audience in the right context, maximizing suitability and contextual performance. Channel Factory embodies a strong culture that values diversity, collaboration, and results. Our bias towards execution balances critical thinking, analysis, and pragmatic problem solving. We expect a lot from one another and value our thoughtful and intellectually curious company culture. Our company is a global leader in brand suitability and contextual targeting for digital video advertising. Utilizing a proprietary platform, we enable brands and agencies to maximize advertising effectiveness through safe and appropriate ad placements. As a trusted partner in the industry, we provide data-driven insights and advanced measurement solutions to help advertisers optimize their media investments.

Channel Factory is in search of an innovative and dedicated Data Engineer to design, build, and maintain scalable data infrastructure that powers our analytics and business intelligence initiatives. This is a high-impact role where you will play a pivotal part in evolving our core data infrastructure.

Responsibilities

• Modernize Core ETL processes by refactoring our existing Python / OpenSearch / SQL (PostgreSQL) based ETL systems to land data in our Data Lakehouse (Apache Iceberg)
• Update and maintain existing ETL pipelines with robust QA, monitoring, and alerting
• Collaborate with product managers, software developers, and business stakeholders to understand complex business requirements and translate business needs into well-designed and maintainable solutions
• Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting
• Develop data models and schemas optimized for analytical workloads
• Create and maintain documentation related to managing data infrastructure and ETL pipelines
• Collaborate effectively with distributed team members across multiple time zones, including remote development teams
• Build relationships and foster team cohesion across geographical and cultural boundaries
• Why You’ll Love It
• Competitive Salary
• Annual Paid Leaves
• Private Health Insurance
• Opportunity to learn and work with the most advanced advertising technology platforms
  
  

Work in a professional, active, international, and dynamic environment

Qualifications

Requirements

• 4+ years of experience in data engineering or related experience, with a proven track record of building and maintaining scalable data pipelines in production
• Experience designing and developing large-scale, efficient batch and streaming data processing pipelines
• Strong SQL proficiency, with experience in both transactional RDBMS systems and distributed systems
• Expert-level proficiency in Python
• In-depth experience with distributed data technologies
• RabbitMQ
• Celery
• PySpark
• In-depth experience with AWS data services (ECS, EC2, Glue, OpenSearch, RDS)
• Experience with modern Data Lakehouse technologies a plus:
• Apache Iceberg
• S3 Tables
• StarRocks
• Knowledge of digital social media advertising is a plus
  
  

Must have skills

• starrocks
• PySpark
• RabbitMQ
• Data pipelines
• Python
• AWS data
• Data Lakehouse