Data Engineer
Your Mission
This position is responsible for ETL and database SQL performance tuning , Data optimization, and Data Modelling for HMGICS applications. He/She should be passionate about learning and building the latest technologies of distributed big data platform.
What To Expect
- Translate business requirements into technical specifications, including data streams, integrations, transformations, databases, data warehouses, and big data
- Define the data architecture framework, standards, and principles, including modelling, metadata, and security
- Collaborate and coordinate with multiple departments, stakeholders, partners, and external vendors
- Examine and identify data structural necessities by evaluating applications and programming
- Assess data implementation procedures to ensure their compliance with internal and external regulations
- Prepare accurate database design and architecture reports for management and executive teams
- Assist in Data Governance activities
What You'll Bring
- Bachelor's Degree in Computer Science, Information Technology or relevant disciplines
- At least 2 years of relevant experience in data engineering
- Proficient in design, develop and maintaining scalable and reliable end-to-end ETL data pipelines
- Experience with any database SQL-based technologies (e.g. PostgreSQL/ MySQL/ Oracle/ Tibero)
- Knowledge in both SQL & NoSQL databases, including performance tuning and troubleshooting
- Experience with database architectures, database design, Application SQL tuning and optimization
- Good knowledge with distributed data platforms such as Hadoop, HDFS, Hive, Spark, PySpark is an added advantage
- Proficiency in Scripting languages( Python, Shell Script) for automation and monitoring