Key Job Details
Country/Region: United States
State: New York
City: New York
Employment Type: Contract
Work Type: Onsite
Duration: 12 Months
Company: Techwaukee Solutions LLC
Senior Data Engineer
Summary: We are looking to hire Sr.
Data Engineer with a financial background.
Who will play a crucial role in leveraging Snowflake, a cloud-based data warehousing platform, to manage and analyze financial data.
Primary Responsibilities:
Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse Provide production support for Data Warehouse issues such data load problems, transformation translation problems.
Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
Able to work on data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations
Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and SnowSQL.
Able to provide data ingestion and processing pipelines using Python, Databricks, SnowSql
Able to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality)
Basic Qualifications:
Overall 10+ years of experience is required.
Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data Warehouse
Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.
Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
Good knowledge of MS Azure configuration items with respect to Snowflake
Experience in writing scripts (UNIX, Python)
Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies
Good to Have:
Experience in Finance / Banking industry – some understanding of Securities and Banking products