Senior Data Engineer (Walgreens Health)
- Military veterans preferred
Chicago Illinois United States
The Sr. Data Engineer (WH) builds and maintains big data pipelines to support advanced analytics and data science solutions. The role also identifies valuable internal and external data, and collaborates closely with data scientists to define data for the design, development, and deployment of new solutions that support strategic business priorities.
Develops software that processes, stores and serves data for use by others.
Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs.
Writes ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processing.
Develops and maintains optimal data pipelines into the advanced analytics platform, including design of data flows, procedures, and schedules. Ensures that optimal data pipelines are scalable, repeatable and secure.
Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
Anticipates and prevents problems and roadblocks before they occur.
Interacts with internal and external peers and managers to exchange complex information related to areas of specialization.
Collaborates with data scientists to prepare data for model development.
Bachelor’s Degree and at least 4 years of experience in data engineering OR High School/GED and at least 7 years of experience in data engineering
Advanced level skill in Wide-Column Databases (Cassandra, MariaDB, etc) and Graph Databases (Neo4J, Cosmos Gremlin, etc)
Deep knowledge of Advanced level skill in Data Warehousing and Data Lakes
Advanced level skill in Data Migration and Transformation
At least 2 years of experience with REST API development
Experience establishing and maintaining key relationships with internal (peers, business partners and leadership) and external (business community, clients and vendors) within a matrix organization to ensure quality standards for service.
Experience diagnosing, isolating, and resolving complex business issues and recommending and implementing strategies to resolve problems.
Experience presenting to all levels of an organization
At least 2 years of experience contributing to financial decisions in the workplace.
At least 2 years of direct leadership, indirect leadership and/or cross-functional team leadership.
Willing to travel up to 10% of the time for business purposes (within state and out of state).
Experience deploying Python applications
Experience with Azure application deployment
Experience with messaging systems such as Kafka or Azure Event Hubs