Data Engineer

Job Overview:

Responsible for the on-time completion of projects or components of large, complex projects for clients in the life sciences field. Identifies and elevates potential new business opportunities and assists in the sales process.

Skills required:

• Experience in developing Azure components like Azure data factory, Azure data Bircks, Logic Apps, Functions
• Develop efficient & smart data pipelines in migrating various sources on to Azure datalake
• Proficient in working with Delta Lake, Parquet file formats
• Designs, implements, and maintain the CI/CD pipelines, deploy, merge codes
• Expert in programming in SQL, Pyspark, Python
• Creation of databases on Azure data lake with best data warehousing practises
• Build smart metadata databases and solutions, parameterization, configurations
• Develop Azure frameworks, develops automated systems for deployment & monitoring
• Hands-on experience in continuous delivery and continuous integration of CI/CD pipelines, CI/CD infrastructure and process troubleshooting.
• Extensive experience with version control systems like Git and their use in release management, branching, merging, and integration strategies

Essential Functions:

• Participates or leads teams in the design, development and delivery of consulting projects or components of larger, complex projects.
• Reviews and analyzes client requirements or problems and assists in the development of proposals of cost effective solutions that ensure profitability and high client satisfaction.
• Provides direction and guidance to Analysts, Consultants, and where relevant, to Statistical Services assigned to engagement.
• Develops detailed documentation and specifications.
• Performs qualitative and/or quantitative analyses to assist in the identification of client issues and the development of client specific solutions.
• Designs, structures and delivers client reports and presentations that are appropriate to the characteristics or needs of the audience.
• May deliver some findings to clients.