[Remote] Snowflake & Talend - Data Movement Engineer - New Haven CT (Remote)
Note: The job is a remote job and is open to candidates in USA. Harvey Nash is seeking a Data Movement Engineer who can provide production support to existing and future ETL environments. The role involves managing Snowflake data operations, optimizing data pipelines, and leading design and support framework of Snowflake-based data solutions.
Responsibilities
- Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines
- Proactively identify and resolve issues related to data integrity, latency, and pipeline failures to maintain smooth operations
- Translate stakeholder requirements into Snowflake-specific solutions for data movement
- Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability
- Design, develop, and optimize Snowflake data pipelines and models
- Design, develop, and maintain robust ETL workflows using Talend, Informatica (IICS, PowerCenter), and BODI
- Recommend and implement best practices for data ingestion, transformation, storage, security and data modeling
- Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2)
- Support frameworks like Data Vault and dimensional modeling in Snowflake
- Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments
- Thoroughly test all production solutions prior to implementation
- Perform root cause analysis of data discrepancies, latency, and integrity issues
- Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP)
- Collaborate with other teams to implement fixes and preventive measures
- Perform data quality analysis, report issues, and propose solutions
- Ensure data accuracy, completeness, and consistency across systems
- Implement validation and reconciliation checks within pipelines
- Support data governance initiatives including metadata management and lineage tracking
- Lead the design, development, and maintenance of Snowflake processes
- Provide technical leadership, code reviews, and mentorship to junior developers
- Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions
- Communicate issue status, impact, and resolution timelines effectively
- Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards
- Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling
- Prepare effort estimations and contribute to architectural decisions
- Provide regular updates and reports on issue trends and improvement initiatives
- On-call and/or after-hours work required
Skills
- Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis
- Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2)
- Strong expertise in Snowflake (development, data modeling, security)
- Strong proficiency in SQL and scripting languages (e.g., Python, Shell)
- Expert-level proficiency in Talend Management Console and Talend Open Studio
- Expertise in CDC and SCD Type 2 implementations using SQL
- Solid understanding of data architecture, dimensional modeling, and frameworks like Data Vault
- Ability to solve problems using analytical thinking skills
- Must work well independently and be inquisitive
- Strong organizational and time management skills
- Bachelors degree in computer science, Information Systems, or related field
- 5+ years of experience in Snowflake development and data warehousing
- Snowflake certification
- Experience with cloud database technologies
- Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git)
- Experience with incident management tools (e.g., ServiceNow, Jira) and CI/CD practices
Benefits
- W2 option
Company Overview