[Remote] Senior Staff Data Engineer
Note: The job is a remote job and is open to candidates in USA. Pandora, part of SiriusXM, is at the forefront of audio entertainment, providing innovative audio experiences. As a Senior Staff Data Engineer, you will lead the design and development of scalable data products and reporting systems, collaborating with various teams to enhance data onboarding and insights.
Responsibilities
- Design and build high-performance, reliable, and scalable reporting APIs and data pipelines
- Lead high-level architecture discussions and planning sessions work with ad measurement, revenue and addressability data
- Work with various teams of engineers building software in a collaborative development process
- Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent
- Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively
- Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team
- Responsible for mentoring and guiding junior engineers
Skills
- 12+ years of software engineering experience in Python or Java programming language (preferably JDK17 or higher)
- 7+ years designing, building, and managing data pipelines using Spark, BigQuery, AWS EMR, and GCP Cloud Analytics
- 7+ years of experience crafting REST API based-microservices and scalable products, utilizing diverse cloud platforms (ideally AWS)
- Cloud data warehouse & analytics platforms (Snowflake, BigQuery)
- Observability tools like Prometheus, Grafana, ELK stack
- Data pipeline expectations framework experience (like Monte Carlo data, Great Expectations, Soda)
- Working with containers (Docker, Kubernetes)
- Messaging platforms and stream data processing (like Kafka, Flink, Pub/Sub)
- Collaboration tools like Miro (or Lucidchart), Jira and Confluence
- Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing
- Ability to work independently and oversee entire projects or significant parts, focusing on research and completing the tasks on time
- Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement
- Bachelor's Degree in Computer Science/Mathematics or a similar field
- Must have legal right to work in the U.S
- Nice to have expertise in Caching implementations (like Redis, Memcached, etc.)
- Nice to have expertise in Designing and maintaining Public APIs and data contracts
- Nice to have Security basics (e.g., OAuth2 standard)
- Nice to have Foundational Amazon Cloud Services, like S3, CloudTrail, SQS, SNS, Lambda, API Gateway, ElasticCache, Athena, Kinesis, EKS, Cognito, and others
- Nice to have NoSQL databases knowledge (Druid, DynamoDB, SingleStore, or others)
- Nice to have hands on experience with AI coding assistants and tools to help with coding and data analytics
Company Overview