Total 3 job vacancies by Digiworld Technologies Pte. Ltd.

Job Objective:
Develop and deliver scalable ETL/ELT solutions across Teradata and Hadoop platforms by building robust data pipelines, ingestion frameworks, and automation capabilities. Ensure efficient data processing, performance optimization, and reliable integration of enterprise data sources, while supporting data warehouse, CDC, and MDM initiatives.

Responsibilities

• Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid, Trino to perform various transformations and load into Teradata based data warehouse or datamarts
• Performance tuning of highly complex applications to reduce resource usage
• Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 
• Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable
• Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval workflow.

Requirements:

• Strong handson experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.
• Create EDW ETL/ELT codes using Teradata SQL, Informatica, apache Spark, QueryGrid, Trino to perform various transformation and load into Teradata based data warehouse or datamarts
• Performance tuning of highly complex applications to reduce resource usage
• Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 
• Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable

Job Objective:
Design and deliver scalable real-time data and machine learning solutions by building robust ingestion and transformation frameworks across Hadoop ecosystems. Enable end-to-end ML model operationalization and performance optimization, while supporting multi-modal data processing and development of engineering tools and applications.

Responsibilities:

•  Design and develop highly scalable, Real time systems using Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive, Ranger, Kafka, Flink and Nifi)
• Build robust data ingestion and transformation frameworks using Java, Spark, Python, and shell scripting for ingesting multi model data(image, audio, video, unstructured documents) with both batch and real-time.
• Develop fullstack applications and internal engineering tools using Python, shell scripting, and modern web frameworks (e.g., Flask, React).
• Collaborate closely with data scientists to operationalize machine learning models using Cloudera Machine Learning (CML).
• Perform performance tuning and optimization of data applications on Hadoop to ensure optimal resource utilization.

Requirements:

• Experience working with ML platforms such as CML, Spark MLlib, and Python ML libraries (scikitlearn, XGBoost), including model deployment.
• Design and develop highly scalable, Real time systems using Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive, Ranger, Kafka, Flink and Nifi)
• Build robust data ingestion and transformation frameworks using Java, Spark, Python, and shell scripting for ingesting multi model data(image, audio, video, unstructured documents) with both batch and real-time.
• Develop fullstack applications and internal engineering tools using Python, shell scripting, and modern web frameworks (e.g., Flask, React).
• Collaborate closely with data scientists to operationalize machine learning models using Cloudera Machine Learning (CML).
• Perform performance tuning and optimization of data applications on Hadoop to ensure optimal resource utilization.

Responsibilities

The IT Enablement Engineer plays a hands-on technical role that requires close collaboration with multiple KRI data owners. 

The role involves understanding each source system, how KRIs are collected and calculated, and identifying approaches to automate the extraction of KRI metrics through system integration and data engineering techniques.

The engineer is responsible for designing and building end-to-end ETL data pipelines and enhancing the existing Power BI dashboard to present consolidated KRI metrics effectively.

The primary responsibility of this role is to support the Enterprise Management Information Platform project. 

The individual will also take on additional tasks including automation initiatives in IT Operations, DevSecOps, observability, and related domains.

Key Requirements

· At least 7 years of hands-on experience

· 3-5 years of data analysis experience

· Strong SQL skills

· Data quality tools/frameworks

· Statistical analysis

· Visualization tools: Tableau, Power BI

Technical Skills:

· Automation, system integration, and data engineering (data analysis, modelling, ETL, validation)

· Experience building ETL pipelines in AWS

· Power BI dashboard development with strong UX principles

· REST API development and integration

· AWS services: Lambda, EC2, S3, Glue

· Experience with ServiceNow, Tenable, SharePoint APIs

· Programming: Python, Unix Shell, PowerShell

· DevSecOps pipeline experience

· Application support, troubleshooting, optimization

· ITIL best practices and governance compliance

Functional Skills:

· Experience with SDLC methodologies

· Requirement gathering and validation with stakeholders

· Test coordination and validation

· Prepare functional and technical specifications

· Work with Infra, App, Security, Ops, PMO teams

· Understanding of ITIL and IT Operations (ITSM, ITAM, CMDB, etc.)

Certifications (Preferred)

· Microsoft Power BI Data Analyst

· AWS Certified Data Engineer

· Red Hat Ansible Certification