[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. MediaRadar, Inc. is seeking a highly technical, hands-on Senior Data Engineer to drive the evolution of their data delivery platform while leading a team of data engineers. This role involves architecting the next-generation data stack, building proofs-of-concept, and managing a distributed team to ensure high-quality data delivery.

Responsibilities

• Lead, manage, and grow a distributed team of data engineers (across North America and India) who report directly to you
• Champion the use of AI coding assistants (e.g., GitHub Copilot, Cursor, Claude) and prompt-based development to accelerate prototyping, code generation, refactoring, testing, and documentation. Establish best practices, guardrails, and review standards so the team uses these tools effectively and safely
• Personally build proofs-of-concept to validate new tools and patterns (e.g., ClickHouse, dbt, open-source orchestration and pipeline frameworks) before broader rollout, and translate the results into clear recommendations
• Help shape the technical vision for our ETL and data platform. Evaluate, prototype, and recommend the technologies that will carry us forward, balancing flexibility, cost, performance, and avoiding vendor lock-in
• Drive the hands-on migration away from Azure Databricks toward a more open, flexible stack, minimizing disruption to our high-volume daily data delivery
• Design, build, and optimize robust ETL pipelines that move and transform millions of daily data points reliably and efficiently
• Master all systems upstream and downstream of your area, from ingestion through to client-facing platforms, to ensure seamless, high-quality, end-to-end data delivery
• Establish testing frameworks, QA plans, observability, and CI/CD practices that guarantee data integrity at scale
• Set technical standards and raise the bar across a distributed team (North America and India) through design guidance, code reviews, and mentorship — leading by expertise rather than direct people management
• Rapidly learn the nuances of the Advertising and Market Research domain to translate business needs into robust technical requirements

Skills

• 8+ years in data engineering / ETL, with a strong track record as a hands-on engineer who has architected and built data platforms (Principal-level candidates will bring deeper architectural and cross-team impact)
• Hands-on experience using AI coding tools (e.g., GitHub Copilot, Cursor, Claude, or similar) and strong prompt-based development skills, with good judgment about where these tools help and where human review is essential
• Expert-level SQL and RDBMS skills with deep, hands-on experience in SQL Server and Postgres (schema design, performance tuning, complex query optimization, root-cause analysis)
• Hands-on experience with technologies such as ClickHouse, dbt, and open-source data pipeline / orchestration tools (e.g., Airflow, Dagster, or similar), with the judgment to choose the right tool for the job
• Strong, hands-on AWS experience is required, as we are standardizing on AWS as we move off Azure Databricks
• Demonstrated ability to independently prototype, benchmark, and evaluate new technologies and make pragmatic adoption decisions
• Strong proficiency in Python (or similar) for building and automating data pipelines
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Previous experience in Advertising, Media, or Market Research
• Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code
• Experience with streaming/real-time data technologies (e.g., Kafka)

Benefits

• Medical, Dental & Vision Insurance
• 401k with Company Match
• Flexible PTO
• Commuter Benefits
• Gym Discounts
• Summer Fridays

Company Overview

Company H1B Sponsorship