AWS Data Broker (Software Engineer)
AWS Data Broker (Software Engineer) Requirements:
- 5+ years of work experience as a software engineer, with a strong focus on backend and middleware solutions, including API, compute, application-level networking, and security
- 2+ years of experience creating ETL data pipelines, data infrastructure, or data systems.
- 2+ years of work experience with AWS, specifically creating data pipelines in production using any or all of the following AWS services: AWS Glue, Step Functions, Athena, RDS, API Gateway, Lambda, SFTP, Eventbridge, SNS, SQS, SES, IAM.
- Expertise in Python, Typescript, and Object-Oriented Programming (OOP) with a strong understanding of design principles such as SOLID, YAGNI, DRY, etc.
- Expertise in SQL.
- Experience with data analysis, data modeling, and data warehousing.
- Experience working with REST APIs and understanding of OAuth flows (Postman a plus) with a strong emphasis on integrating and interacting with third-party APIs
- Experience with VS Code preferred (adaptability and willingness to use VS Code required)
Job Description
Responsibilities:
- Implement a highly scalable, and resilient data integration system using AWS CDK (Cloud Development Kit) with TypeScript and Python.
- Implement Infrastructure as Code and automated release management, ensuring the platform's scalability, and maintainability
- Collaborate closely with cross-functional teams to ensure the data broker adheres to the highest security and compliance standards, safeguarding sensitive data and maintaining regulatory compliance across all processes.
- Engage as part of an Agile scrum software development team contributing to scrum ceremonies and collaborating with product owners and other engineers