Data engineer - united arab emirates, united arab emirates

As the data engineer you will be responsible for playing a crucial role in working with a variety of data technologies, systems, and tools and are expected to drive the design and delivery of complex, high-performance data architecture for the organization.client detailsa new start-up venture within adtech with a strong track record of success and already quite significant client base, looking to build and develop new adverts and campaigns for existing clients. they have strong funding and appetite to create an exciting new player in the e-commerce market.descriptionleverage your expertise in clickhouse to design, develop, and optimize a data warehouse that caters to the team of data scientists and analysts.utilize cutting-edge data structures to ensure sub-second response timesimplement sophisticated etl procedures for cleaning, normalizing, and aggregating datademonstrate agility by working across cloud and on-premise environments, employing tools such as snowflake, clickhouse, and moredevelop, deploy, and monitor procedures running on apache airflowefficiently manage the export and import of terabytes of data to and from s3define requirements and maintain an on-premise clickhouse cluster housing petabytes of dataimplement performance optimization solutions for clickhouse, including the use of various engines and other toolsoptimization and improvement of analytical queries for clickhouseprofilesignificant experience in data warehouse design and data miningdeep understanding of database structure principlesproficiency in python, sql, apache airflow, clickhouse, snowflake, and other relevant technologiesexcellent knowledge of data backup, recovery, security, integrity, and sqlfamiliarity with big data tools and the data ecosystemstrong problem-solving skills with an emphasis on product developmentcomprehensive understanding of data quality management principles and best practicesability to work both independently and as part of a team on various projectsjob offeropportunity to play a critical role in the establishment, growth and success of an exciting new businesslong-term role with exciting immediate objectives, followed by fantastic growth prospects skillsclickhouse

More jobs