Not Authorized
You are currently not authorized to access this section.
Please contact your Administrator to change your authorization settings.
Please contact your Administrator to change your authorization settings.
Data Engineer II
Redmond, WA
Job Description
OverviewThe Azure Core Organization is responsible for creating the foundation of Microsoft's Cloud Platform for utility computing. This platform is one of the lowest levels of the services software/hardware stack and includes an efficient, virtualized computational substrate, a fully automated service management system, and a comprehensive set of highly scalable storage services.The Azure Compute Capacity and Efficiency (AC2E) team is the team in Azure Core tasked with managing all aspects of Compute capacity and efficiency management across the fleet. Capacity Management needs to ensure that on the one hand, there is sufficient capacity across all regions, allocation domains, and hardware infrastructure to meet all customer demand, while on the other hand ensuring that capacity is provisioned efficiently thereby avoiding overspending and COGS/CAPEX impact. At the scale of Azure's business, managing this trade-off across the entire Azure Compute fleet is an enormously complex and challenging task, where improvements can make the difference between customer allocation failures on the one hand, and gargantuan savings on the other.As a Data Engineer II in the team, you will work closely with our software engineers, program managers, and data scientists across different teams within Azure Core. You will also collaborate with a variety of internal partner teams across Azure and Microsoft. You will build reliable, secured, highly scalable, performant data pipelines to enhance the Azure Compute allocation, deliver capacity management and efficiency improvements. The value of your work will be reflected in improvements to the Azure platform, Azure service capacity fulfillment rate, customer satisfaction, and various efficiency metrics, including COGS reduction. You will have opportunities for mentorship, accelerate your career growth, and work on truly high-business impact areas.Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
ResponsibilitiesWith guidance, you'll implement basic code to extra raw data, validate its quality, and ensure the correct data is ingested across multiple areas of work. You'll also apply standard modification techniques to transform raw data into forms compatible with downstream data sources.You will design and maintain assigned data tools that are used to transform, manage, and access data. You'll also write code to validate the storage and availability of data platforms so that they're more resilient.You will follow existing documentation to implement performance monitoring protocols across a data pipeline, building basic visualizations and aggregations to monitor pipeline health. You'll also implement solutions and improvements that minimize points of failure across a product feature.You will follow data modeling and handling procedures to maintain compliance with all applicable laws and policies across your assigned workstreams. You'll also govern data accessibility within your assigned pipelines and models.Embody our Culture & Values
ResponsibilitiesWith guidance, you'll implement basic code to extra raw data, validate its quality, and ensure the correct data is ingested across multiple areas of work. You'll also apply standard modification techniques to transform raw data into forms compatible with downstream data sources.You will design and maintain assigned data tools that are used to transform, manage, and access data. You'll also write code to validate the storage and availability of data platforms so that they're more resilient.You will follow existing documentation to implement performance monitoring protocols across a data pipeline, building basic visualizations and aggregations to monitor pipeline health. You'll also implement solutions and improvements that minimize points of failure across a product feature.You will follow data modeling and handling procedures to maintain compliance with all applicable laws and policies across your assigned workstreams. You'll also govern data accessibility within your assigned pipelines and models.Embody our Culture & Values
Job Summary
Company
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Experience
Open
Email this Job to Yourself or a Friend