Job details | ||
---|---|---|
Data Engineering Team | ||
Job Title: | Professional Data Engineer | |
Grade: | P1 | |
Supervisor: | Director for Data Science Unit | |
Location: | HQ | |
Working Mode: | Hybrid | |
Purpose | ||
A Professional Data Engineer is a technical expert who, under the supervision of Director for Data Science Unit, architects, builds, and maintains an organization’s data infrastructure and ecosystem by designing robust data pipelines, implementing automated ETL workflows, ensuring data quality and consistency across systems, supporting cross-divisional data needs with particular focus on Risk Management and Data Analytics, while developing and maintaining data warehouse solutions that align with enterprise risk management frameworks. |
||
Key duties and responsibilities | ||
|
||
Required Academic Qualification | ||
Preferred Qualifications | ||
|
||
Relevant Qualifications | ||
Skill Type | Required Skill | Required Proficiency level |
Data Management | Experience building and optimizing ‘big data’ data pipelines, architectures and data sets | advanced |
Data Management | Build processes supporting data transformation, data structures, metadata, dependency and workload management | advanced |
Data Management | SQL and NoSQL databases, including Postgres | advanced |
Data Management | Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases | advanced |
Data Management | Strong analytic skills related to working with unstructured datasets | advanced |
Data Management | Experience with big data tools: Hadoop, Spark, Kafka, etc | advanced |
Data Management | Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc | advanced |
Programming | Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc | advanced |
Project Management | Project Management | advanced |
Risk management | Risk management | advanced |
Software Development | Knowledge of best practices and IT operations in an always-up, always-available service | advanced |
Software Development | CI/CD pipelines | advanced |
Software Development | Excellent problem solving and troubleshooting skills | advanced |
Software Development | DevOps | advanced |
Software Development | Advanced Data warehouse and Business Intelligence (Oracle product) | advanced |
Required Competencies |
||
|
||
Required Experiences | ||
|
Click here to visit the website source