Principal Data Engineer

Company: Apex Systems
Location: Pittsburgh
Posted on: November 20, 2020

Job Description:

Please contact for more information on this Principal Data Engineer role supporting our client in Pittsburgh, PA. General Job Function The Principal Data Engineer is responsible for leading a team to maintain, improve, clean, transform, and move data related to Clienthouse's digital solutions. Daily interactions with data scientists and stakeholders are expected in order to understand and aid in the implementation of database requirements and ensure database and data pipeline health. The Principal Data Engineer will also work with the Lead Data Engineer to create and maintain standards, train and mentor team members, and collaborate with IT for database administration. Duties and Responsibilities (in the order of priority) Responsibilities Lead a team of data engineers to implement defined data schemas, stored procedures, data pipelines, and data visualization artifacts Lead a team of data engineers to build and maintain services for optimal ingestion, transformation, and loading of data from a wide variety of data sources and small to large data sets Lead the implementation of scalable data pipelines and API integrations to support increases in data volume and complexity. Owns and implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. Collaborate with the development team members during design and development to refine the data architecture and transform datasets to achieve the desired end state Create and maintain standards and guidelines based on industry best practices for ETL solutions, data storage, data ingestion, and data pipelines Evaluate emerging technology to integrate into the digital roadmap to strengthen the digital ecosystem Collaborate with IT for database administration Train and mentor data engineers. Desired Background Experience with creating and maintaining technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources and small to large data sets Experience with various data storage and management services such as relational databases, non-relational database, Data Lake 2.0, Azure Data Factory, Blob storage, and Hadoop Understanding of software development lifecycles Experience interacting with cross-functional groups to support consensus outcomedecision Knowledge of best practices and IT operations for database administration Experience with Agile Software Development methodologies Excellent problem solving and troubleshooting skills Process oriented with great documentation skills Excellent oral and written communication skills with a keen sense of customer service Desired characteristics Strategic you always ask "why" and "how" and "is this best for the customer and Clienthouse?" Relationship oriented you enjoy building long term relationships with coworkers, customers, partners Driven you want to win and have a "get stuff done" attitude in everything you do Fun sense of humor is a requirement Flexibility you are comfortable working in a heavily matrixed, changing environment Highly collaborative strong communication skills - you succeed or fail as a team Education and Qualifications Skills and Competencies Education Level (Degree, Area of Study) - Minimum Requirement B.S. (M.S. preferred) in Computer Science, Information Systems, or equivalent Years of Experience (if applicable) 7 years of experience of developing data schemas, stored procedures, data pipelines, and data visualization for medium to complex solutions Professional Certifications Microsoft Certified Azure Data Engineer Associate (Preferred) Microsoft Certified Azure Database Administrator Associate (Preferred) Skills and Competencies Core Technical Skillset Experience with Relational Database Management System technologies and architecture, proficiency with PLSQL andor T-SQL, Relational and NoSQL database, XML, JSON, and tabular data sources, strong understanding of ETL principles, time series data, Python, Azure Data Factory, Spark, Hadoop, and Data Lake 2.0 Ability to develop, implement and deliver enterprise-grade systems, products and services. Excellent verbal and written communication skills Strong project management and organizational skills Demonstrated ability to build consensus among many stakeholders Comfortable with ambiguity and willing to take principled bets to reach a desired end state EEO Employer Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or

Keywords: Apex Systems, Pittsburgh , Principal Data Engineer, Other , Pittsburgh, Pennsylvania