[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. Together AI is a research-driven artificial intelligence company. They are seeking a Senior Data Engineer to help define, build, and operate the data infrastructure for their mission-critical systems, focusing on scaling data processing components and real-time analytics products.
Responsibilities
- Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
- Analyze and improve the robustness and scalability of existing data processing infrastructure
- Partner with product teams to understand functional requirements and deliver solutions that meet business needs
- Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
- Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
- Participate in an on-call rotation to address critical incidents when necessary
Skills
- 5+ years of demonstrated experience in building large scale, fault tolerant, distributed data platforms, stream processing pipelines, ETLs, etc
- Expert-level skills in designing, building, and operating stream processing pipelines with services like AWS Kinesis, Apache Kafka, or Redpanda
- Expert-level knowledge of building real-time customer facing analytics systems using services like AWS TimeStream or Clickhouse
- Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform, AWS CDK, or Pulumi
- Proficiency in version control practices and integrating IaC with CI/CD pipelines
- Proficiency in implementing and managing GitOps workflows with tools such as ArgoCD, Github Actions, TeamCity, or similar
- Proficiency in one or more of Golang, Rust, Python, Java, or TypeScript
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
- Experience with Kubernetes, or containers a plus
Benefits
- Startup equity
- Health insurance
- Other competitive benefits
Company Overview
Company H1B Sponsorship