وظيفة Senior Data Engineer

About the Role

• We address Data at Eden tech as a top priority for driving success into various functions adapting our heterogenous datasets to formulate data into information, information into insight and insight into business decisions. Data analyst responsibilities include conducting full data infrastructure developing, maintaining, and testing for data generation. Data Engineer has a deep expertise in building large-scale data processing systems by using the latest database and data processing technologies.
• We are looking for a savvy Data Engineer to join our growing team of analytics experts. Excited to be responsible for building and expanding our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. 
• The ideal candidate enjoys optimizing data systems and building them from the ground up. 
• The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. striving for operational excellence along with igniting innovative ideas hidden in large data sets and working with stakeholders to improve business outcomes.

Responsibilities

• Create and maintain, with the team, an optimal data pipeline architecture. Build, deploy, and maintain distributed data analytics systems using Hadoop/Spark, Python, Java , Go , Scala, and C/C++
• Assemble large, complex data sets that meet functional / non-functional requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal loading of data from a wide variety of data sources using SQL and big data technologies.
• Work with stakeholders including the Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Identify gaps and improve the platform’s quality, robustness, and speed
• Meet customer requirements in terms of availability, reliability, functionality, and performance