Purpose | ||
---|---|---|
A Professional in charge of data collection and management is the principal technical expert in Data Engineering Section. Under the supervision of Supervisor in charge of Data Engineering Section, the professional in charge of data collection and management extracts data from systems and submits the data to other teams in Risk Management and Data Analytics Division for analysis, develops and reviews risk rules in Data warehouse. |
||
Key duties and responsibilities | ||
|
||
Required Academic Qualification | ||
Preferred Qualifications | ||
|
||
Relevant Qualifications | ||
Skill Type | Required Skill | Required Proficiency level |
Data Management | Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases | advanced |
Data Management | Strong analytic skills related to working with unstructured datasets | advanced |
Data Management | Experience with big data tools: Hadoop, Spark, Kafka, etc | advanced |
Data Management | Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc | advanced |
Data Management | Experience building and optimizing ‘big data’ data pipelines, architectures and data sets | advanced |
Data Management | Build processes supporting data transformation, data structures, metadata, dependency and workload management | advanced |
Data Management | SQL and NoSQL databases, including Postgres | advanced |
Programming | Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc | advanced |
Project Management | Project Management | advanced |
Risk management | Risk management | advanced |
Software Development | Excellent problem solving and troubleshooting skills | advanced |
Software Development | DevOps | advanced |
Software Development | Advanced Data warehouse and Business Intelligence (Oracle product) | advanced |
Software Development | Knowledge of best practices and IT operations in an always-up, always-available service | advanced |
Software Development | CI/CD pipelines | advanced |
Required Competencies | ||
|
||
Required Experiences | ||
|
Click here for details & Apply