ETL Developer

Transguard group is currently hiring an ETL Developer for one of the esteemed clients in Dubai. The candidate has the flexibility to work Onsite or Offsite.

The role requires below responsibilities-

• Data Ingestion Engineer - Responsible for developing ETL ingestion pipelines and data streams from structured and non-structured (IoT) data sources
• Data Warehouse Architect - Ability to design Dimensional Data Warehouse model in star and snowflake schema
• Responsible for data transformation from operational 3NF store to analytical data sets, including data validation, query optimization ensuring data consistency and system performance
• Design and develop streaming data ingestion pipelines using Change Data Capture for data replication in real-time
• Design and develop ETL pipelines for handling large amount of data from various data sources
• Worked on the data integration and data migration projects
• Automate, optimize and fine tune ingestion pipelines to gain optimal performance
• Develop and design APIs
• Skilled Big Data Engineer- experienced in big data platform
• Ensure data quality, data integrity and data availability
• Accountable for managing delivery of assigned project(s), including scope, schedule and quality management, and status reporting.  Manages requirements gathering, communication and risk assessment. Complies with DA Project Management & Project governance practices.

• Design, build and deploy effective data ingestion pipelines/streams in Streeamsets Data Collector & Kafka
• Implement stored procedures and effectively query a different database
• Manage distributed database systems like Teradata, Oracle Exadata , PostgreSQL + Citus
• Excellent knowledge in Dimensional Data Modelling, Star and Snowflake schema
• Develop and organize data transformations in DBT and Apache Airflow
• Translate requirements from the business and translate into technical code
• Identify and test for bugs and bottlenecks in the ETL solution
• Ensure the best possible performance and quality in the packages
• Provide support and fix issues in the packages
• Excellent written and verbal communication in English
• Experience forming and maintaining relationships with Senior Leaders and external stakeholders
• Knowledge of the aviation industry and aviation solutions is preferable