AllentownRecruiter Since 2001
the smart solution for Allentown jobs

Data Engineering Lead

Company: Mitchell Martin Inc
Location: Allentown
Posted on: May 5, 2021

Job Description:

Our client, a nonprofit organization, is seeking a Data Engineering LeadLocation: Allentown, PAPosition Type: Full TimeJob Summary:The Data Engineering Lead is responsible for the development and end-to-end technical hands-on management of the Data Engineering process within the Enterprise Data Platform and Analytics function. This is a hands-on data engineering lead role which will primarily support our large-scale data repository. The scope of this role includes a wide range of highly transactional data sources and healthcare data sources with diverse collection points and complicated collection methods. Ensuring data reliability, efficiency, and quality is core to this role.The candidate will be self-learning, motivated and team-oriented individual. Willingness to learn new technologies quickly. Pairs up with Informatics team to develop cutting edge Analytic applications leveraging Big Data and Streaming modern cloud technologies.Job Duties And Responsibilities:-Architects, Designs, manages, and troubleshoots complex large-scale data engineering problems within a hybrid on premise and cloud hosted environment.-Interfaces with other team members internal or external to understand and finalize complex data requirements, improve data engineering processes, design, architecture and deliver robust data platform that drives automated and or self-service Data Onboarding, Data Engineering, Data Warehousing, and BI solutions.-Proactively assess and identify opportunities to better maintain and reduce ingestion volume, as a continuous process.-Supports the Data Management Lifecycle engineering processes from inception and design through deployment, operation, and optimization.-Manages day to day activities of the Data Engineering/Reporting team via Agile/Scrum methodologies. Is able to run Scrum/Kanban meets.-Passionate about staying on top of tech trends especially in cloud, experimenting with and learning new technologies, participating in internal & external technology communities.-Ensures solutions have proper documentation and regularly updated.-Troubleshoots and debugs code developed by themselves as well as other developers.-Train and mentor entry-level and or less-senior data/report engineers/analysts ensuring they are knowledgeable in critical aspects of their roles, SDLC methodologies best practices and optimization techniques.-Helps implement proper data protection and storage, secure and performant solutions that adhere to defined standards ensuring high data reliability, efficiency, quality.-Keeps abreast of new technology developments. Continuously grow knowledge of Cloud Data technologies and Analytics tools.-Is readily available and easily able to handle high pressure situation. Convert chaos into opportunity.-All other duties as assigned.Education: -BA/BS degree in an analytical area such as Computer Science, Physics, Mathematics, Statistics, Engineering, or similar field required.Training And Experience:-Minimum 10 yrs. of Programming experience on various stack, primarily focused on data engineering.-Recent 5+ years of experience in hands-on Data engineering, BI role with extensive cloud-based data processing application design and development.-Experience in developing and delivering Big Data related services on AWS or Azure cloud.-Extensive experience using Python, Java, Unix/Linux scripting, SQL, ETL/ELT, Data Warehousing solutions and database modeling in a business environment-Strong understanding of Data Ingestion pipelines, Data Lakes and Data cataloging techniques.-Experience in designing, developing, and implementing advanced data collection methods, sizing for data storage, index strategies and processes, transforming/normalizing data to common standards, data enrichment and/or anonymization of data upon ingest.-Experience transforming large datasets into consumable assets for self-service analytics and reporting.-Experience building self-service reporting solutions using business intelligence or data visualization software (e.g. Tableau, PowerBI, AWS Quicksight).-Experience with high volume data streaming methods and platforms such as Kafka/Kinesis and Spark.-Experience using enterprise data orchestration tool (Airflow, etc.)-Strong data analysis skills, problem-solving abilities with an analytic and qualitative eye for reasoning under pressure.-Flexible to changing priorities and comfortable in a fast-passed dynamic environment.-Self-starter with the ability to independently prioritize and complete multiple tasks with little to no supervision.-Experience with the Software Development Life Cycle (SDLC) and Agile/Scrum methods.-Experience with APM tools like JIRA/Confluence and Source control tools like Github.-Experience leading small data engineering team from technical perspective.-Strong communication skills.Preferred:-Master's degree in analytical area.-Experience in Healthcare vertical.-Cloud certification is preferable: AWS/Azure Developer/Architect/Big Data.-Experience with MS Office suite.

Keywords: Mitchell Martin Inc, Allentown , Data Engineering Lead, Engineering , Allentown, Pennsylvania

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest Pennsylvania jobs by following @recnetPA on Twitter!

Allentown RSS job feeds