Data Warehouse Engineer (Cloud / Azure) at ProctorU in Basom, NY
The role:
The Data Warehouse Engineer will be a key part of the Business Intelligence team with the goal of assisting the Data Warehouse Architect in creating and maintaining a Data Warehouse that will be the foundation of all products that the Business Intelligence department will deliver. Such deliverables will answer key business questions in assisting our leaders and clients with data to support organizational effectiveness. The things you'll do:
Collaborate and work with the data warehouse team to design processing framework for data warehouse in Azure Synapse Create innovative solutions leveraging cloud platform services to solve client business challenges Coordinate with Data Engineer to design, build, monitor, and manage data pipelines and other solutions Use big data processing techniques to load Azure Synapse data warehouse and Data Lake Work with data warehouse team to support all aspects of the DW/BI implementation Evaluate different Azure product offerings for best fit to the requirements; requires ability to create proof of concepts (POC) to demonstrate features and functionality across a range of Azure offerings Source existing data sets from multiple data sources to new data warehouse format in Azure Synapse Ability to discover, profile and model data sets for various data sources for inclusion into data warehouse Work with Data Engineer to implement auditing and monitoring framework and ensure appropriate documentation of implemented solutions Research and discover new methods to acquire data and create new applications for existing data Responsible for handling data pipeline code in repository (Git, Azure DevOps) General data troubleshooting and analysis Other relevant projects as assigned The experience & abilities you'll need:
Strong experience in Azure architecture and usage of Azure services. Hands on with Azure serverless design creating on demand scalable and highly available applications Experience in data modeling and architecture, analysis and design Understand business goals and drivers and translate those into an appropriate technical cloud solutions Azure
Experience:
Azure functions, Azure PaaS and IaaS solutions, Azure security, Azure App services, encryption and key management principles, and secure cloud design patterns Implementation experience with Azure Synapse, Data Factory v2, Azure Databricks, SQLDB/Hyperscale, Data Lake Store v2, blob storage and other Azure services Experience with SSIS package development for both Azure and local SQL Server environments Experience managing Azure Data Lakes and Data Lake Analytics and an understanding of how to integrate with other Azure Services Knowledge of USQL and how it can be used for data transformation as part of a cloud platform data integration strategy Knowledge of Open Source Software (Apache Hive, Spark, Impala, Hadoop, etc.) 2
years' hands-on experience implementing and supporting a range of Azure Data Warehouse solutions, such as Azure Data Factory pipelines, Azure Synapse Services, Azure Data Lake Store, Blob Storage, etc Knowledge in the design and implementation of streaming solutions using Kafka or Azure Stream Analytics preferred Bachelor's degree or above in Business, Computer Science, Mathematics, Engineering, Information Technology or related field Experience in ETL/ELT design patterns for authoring data pipelines 5
years of data-oriented solution design and development experience Experience working with various database solutions across platforms (e.g. PostgreSQL, SQL Server) An understanding of cloud ecosystem and cloud emergent technologies Experience configuring and tuning cloud hosted solutions and services Experience supporting production applications and workloads in a cloud-based environment Experience with performance analysis, troubleshooting and remediation techniques Strong written, verbal and presentation communication skills Independent worker/self-starter; but also team oriented
Salary Range:
$80K -- $100K
Minimum Qualification
Business Intelligence & AnalyticsEstimated Salary: $20 to $28 per hour based on qualifications.
The Data Warehouse Engineer will be a key part of the Business Intelligence team with the goal of assisting the Data Warehouse Architect in creating and maintaining a Data Warehouse that will be the foundation of all products that the Business Intelligence department will deliver. Such deliverables will answer key business questions in assisting our leaders and clients with data to support organizational effectiveness. The things you'll do:
Collaborate and work with the data warehouse team to design processing framework for data warehouse in Azure Synapse Create innovative solutions leveraging cloud platform services to solve client business challenges Coordinate with Data Engineer to design, build, monitor, and manage data pipelines and other solutions Use big data processing techniques to load Azure Synapse data warehouse and Data Lake Work with data warehouse team to support all aspects of the DW/BI implementation Evaluate different Azure product offerings for best fit to the requirements; requires ability to create proof of concepts (POC) to demonstrate features and functionality across a range of Azure offerings Source existing data sets from multiple data sources to new data warehouse format in Azure Synapse Ability to discover, profile and model data sets for various data sources for inclusion into data warehouse Work with Data Engineer to implement auditing and monitoring framework and ensure appropriate documentation of implemented solutions Research and discover new methods to acquire data and create new applications for existing data Responsible for handling data pipeline code in repository (Git, Azure DevOps) General data troubleshooting and analysis Other relevant projects as assigned The experience & abilities you'll need:
Strong experience in Azure architecture and usage of Azure services. Hands on with Azure serverless design creating on demand scalable and highly available applications Experience in data modeling and architecture, analysis and design Understand business goals and drivers and translate those into an appropriate technical cloud solutions Azure
Experience:
Azure functions, Azure PaaS and IaaS solutions, Azure security, Azure App services, encryption and key management principles, and secure cloud design patterns Implementation experience with Azure Synapse, Data Factory v2, Azure Databricks, SQLDB/Hyperscale, Data Lake Store v2, blob storage and other Azure services Experience with SSIS package development for both Azure and local SQL Server environments Experience managing Azure Data Lakes and Data Lake Analytics and an understanding of how to integrate with other Azure Services Knowledge of USQL and how it can be used for data transformation as part of a cloud platform data integration strategy Knowledge of Open Source Software (Apache Hive, Spark, Impala, Hadoop, etc.) 2
years' hands-on experience implementing and supporting a range of Azure Data Warehouse solutions, such as Azure Data Factory pipelines, Azure Synapse Services, Azure Data Lake Store, Blob Storage, etc Knowledge in the design and implementation of streaming solutions using Kafka or Azure Stream Analytics preferred Bachelor's degree or above in Business, Computer Science, Mathematics, Engineering, Information Technology or related field Experience in ETL/ELT design patterns for authoring data pipelines 5
years of data-oriented solution design and development experience Experience working with various database solutions across platforms (e.g. PostgreSQL, SQL Server) An understanding of cloud ecosystem and cloud emergent technologies Experience configuring and tuning cloud hosted solutions and services Experience supporting production applications and workloads in a cloud-based environment Experience with performance analysis, troubleshooting and remediation techniques Strong written, verbal and presentation communication skills Independent worker/self-starter; but also team oriented
Salary Range:
$80K -- $100K
Minimum Qualification
Business Intelligence & AnalyticsEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
