Senior Data Engineer
📋 Role Overview & Responsibilities
SENIOR DATA ENGINEER - MICROSOFT BIG DATA STACK
100% REMOTE - CANDIDATES MUST LIVE IN ONE OF THE FOLLOWING STATES:
PennsylvaniaArizonaWashingtonIllinoisMassachusettsFloridaGeorgiaNorth CarolinaColoradoTennesseeTexasVirginia
Summary of Duties & Responsibilities
The AI & Analytics product team delivers data driven business analytic solutions leveraging artificial intelligence (AI), Big Data architecture and machine learning expertise to deliver business intelligence (BI) and analytics insight for the professional consulting market.The Senior Data Engineer is a key member of the AI & Analytics team, providing domain expertise and leadership to deliver data-related products, features, and functionality that serves business and technical leaders.The Senior Data Engineer must have a thorough knowledge of the Microsoft Big Data solutions. This individual will be responsible for defining high volume data processing pipelines in a multi-tenant environment, verifying data integrity and curating data for consumption by data warehouse, third-party data analytics tools and machine learning models.The ideal candidate is an exceptional critical thinker with strong business acumen that is adept at solving complex problems and creating elegant business solutions. You will be involved in the design and development efforts for our big data solutions including data lake, Business Intelligence Solutions, Machine Learning, Data Pipeline and cloud-based data warehouse products.
Essential Functions
Strong analytical skills, able to translate complex business requirements into sound data management and data governance solutionsWork with clients to understand data analytics requirements. Analyze data to ensure it meets specific data management, data governance, and data quality assurance requirements before processing the data within the Data Lake and data warehouseWork with the Product Managers, Database Architect or BI Architect to understand data pipeline and data life cycle processing requirements and patternsInstall and configure data sources for use by the data pipelinesWork with the Database Architect to define data management, data governance, and data quality assurance requirements to manage the entire data processing life cycleActs as a key contributor to all phases of the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platformsCurates data for analyses, business reviews, and operational data analysis demandsUse an agile approach to define requirements, design and develop data pipeline solutions to enable near real-time change data capture (CDC) and data consumptionProficient in applying data management, data governance, and data quality processes and tools to correlate disparate sources
Skills & Competencies
Strong business acumen and proven experience in solving complex problems and creating elegant business solutionsAdept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of actionAdvanced SQL development skills, broad exposure to all language constructsExperience with Microsoft On-premise SQL Server (2017 or higher) and Azure SQL Server technologies including broad experience with SQL Server capabilities and tools (e.g., CDC, Columnstore Index, In-memory Table, SSAS Tabular, DAX, T-SQL, SSIS)Experience in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI DataflowExperience with Azure products and services including Azure Data Lake Gen2, Azure Databricks, Azure Databricks Unity Catalog, Databricks API, Databricks Row-level security, Databricks error logging, Azure SQL Server, and Azure Analysis Services.Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and ConfluenceExperience with data integration through APIs, Web Services, SOAP, and/or REST servicesExperience with Lakehouse architecture and design for multi-tenant, OLTP data modeling, dimensional data modeling, composite modeling, data transformation, row-level security, and designing the most optimal analytical data structures for near real-time data analyticsAdditional programming experience is a plus (preferably.NET) or other languages such as Python, Scala, R.
Education or Prior Work Experience
Bachelor's degree in CS10+ years of experience with designing and developing complex data analytics solutions5+ years of experience with Microsoft Big Data solutions
Frequently Asked Questions
How do I apply for the Senior Data Engineer position at TSR Consulting Services, Inc.? ▼
Click the “Apply for this Position” button on this page to submit your application directly to TSR Consulting Services, Inc. without recruitment intermediary fees.
Is this position eligible for remote work or visa sponsorship? ▼
This position is located in United States with potential relocation and sponsorship assistance depending on candidate qualifications.
Are there any candidate fees on Hirely? ▼
No. Hirely is completely free for candidates. We never charge registration fees or placement fees.
Legitimate employers will never ask you to transfer funds, purchase equipment from unauthorized vendors, or pay application/visa fees. Hirely rigorously monitors listings, but always verify communication is from official corporate email domains.
Learn how to protect yourself against employment fraud →