Azure Data Engineer

Company: Certitude Business solutions llc
Location: Allentown
Posted on: February 22, 2021

Job Description:

Position: Azure Data EngineerLocation: Allentown, PA (Remote till covid)Duration:6+ months As per client:Need more here. Had a candidate go off the market right before interview!Candidates must have experience with Azure Data Factory, Databricks, Data Lake, PPL etc. As a Data Engineer, you will work closely with a multidisciplinary Agile team to build high quality data pipelines driving analytic solutions. These solutions will generate insights from our connected data, enabling PPL to advance the data-driven decision-making capabilities of our enterprise. This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic understanding of data science techniques and workflows. The ideal candidate is a skilled data / software engineer with experience creating data products supporting analytic solutions. The ideal candidate is a skilled data / software engineer with experience creating data products supporting analytic solutions. They are an Agile learner, possess strong problem-solving skills, work as part of a technical, cross functional analytics team, and want to Solve complex data problems and deliver the insights to enable analytics strategy.Responsibilities

• Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals
• Solve complex data problems to deliver insights that helps our business to achieve their goals
• Create data products for analytics and data scientist team members to improve their productivity
• Advise, consult, mentor and coach other data and analytic professionals on data standards and practices
• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions
• Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering in order to improve our productivity as a team
• Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes
• Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
• Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematicsSkills
  • Bachelor's degree required; Computer Science, MIS, or Engineering preferred
  • 5 years of experience working in data engineering or architecture role, 7+ preferred
  • Expertise in SQL and data analysis and experience with at least one programming language (Python/PySparkor Scala preferred)
  • Experience developing and maintaining data warehouses in big data solutions
  • Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space (preferred)
  • Database development experience using Hadoop or BigQuery and experience with a variety of relational, NoSQL, and cloud data lake technologies
  • Worked with BI tools such as Tableau, Power BI, Looker, Shiny
  • Conceptual knowledge of data and analytics, such as dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data.
  • Big Data Development experience using Hive, Impala, Sparkand familiarity with Kafka (Preferred)
  • Familiarity with the Linux operating system (Preferred)
  • Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
  • Passionate about Agile software processes, data-driven development, reliability, and experimentation
  • Experience working on a collaborative Agile product team
  • Self-motivated with strong problem-solving and learning skills
  • Flexibility to changes in work direction as the project develops
  • Excellent communication, listening, and influencing skills
  • Demonstrated strong number sense, intellectually curious and willing to adjust position based on additional information
  • Strong work ethic; ability to work at an abstract level and gain consensus - provided by Dice

Keywords: Certitude Business solutions llc, Allentown , Azure Data Engineer, Engineering , Allentown, Pennsylvania