Total 3 job vacancies by K2 Partnering Solutions Pte. Ltd.

As a Data Engineer on this project, you will architect and develop infrastructure to support modern data science and machine learning applications. You will also partner actively with policy and business divisions to support digital transformation efforts through the use of Data and AI methods. You will be expected to:

• Take full ownership of end-to-end data systems and architecture development, integrating databases, backend services, DevOps and cloud infrastructure as required to achieve organisational objectives
• Develop data systems and supporting infrastructure, including database administration, ETL pipelining, and analytics tools for use cases across the education ecosystem
• Develop infrastructure and applications in accordance with modern cloud technology, ensuring reusability, scalability and security
• Work cross-functionally with Product Managers, Data Scientists and Users with a strong sense of ownership to ensure that products developed meet user needs

Requirements:

• Bachelor's Degree in Computer Science, Information Technology, Engineering, or a related discipline or equivalent experience.
• Experience with data systems and architecture development, encompassing database systems, backend, DevOps and infrastructure development with care for reusability, scalability and security considerations
• Experience with developing and administering production-grade databases and data pipelines
• Experience with frontend development is a plus
• Experience with data science and machine learning applications is a plus
• Strong communication and collaboration skills
• Passion towards working for public good with interest in the education domain in particular

Tech Stack:

• Government on Commercial Cloud (GCC 2.0)
• Primary Cloud: AWS, though Azure or GCP are possibilities.
• Containerisation: Docker and Kubernetes
• IaC (Infrastructure as Code): Terraform is the standard for provisioning these cloud resources.
• Languages: Python (non-negotiable for ETL/ML) and SQL. Kotlin or Go are common for backend services.
• Orchestration: Apache Airflow for managing complex data workflows.
• Data Warehousing: Likely Snowflake, Databricks, or AWS Redshift.
• Processing: PySpark or Pandas for large-scale data manipulation.
• Backend & API Development
• Frameworks: FastAPI, Flask (Python), or Node.js/TypeScript.
• API Standards: Strong knowledge of RESTful APIs and APEX
• Databases: PostgreSQL (Relational) and potentially MongoDB or Elasticsearch (Non-relational/Search).
• DevOps & Security SHIP-HATS, their CI/CD toolchain. CI/CD: GitLab CI, GitHub Actions, or Jenkins.
• Security: Awareness of Vault for secret management and automated security scanning tools (SonarQube, Checkmarx).
• Frontend: If you have the "plus" skill, it’s likely React.js or Vue.js.
• MLOps: Tools like MLflow or Kubeflow for deploying the Data Science models

To support the development and maintenance of enterprise data products within our organisation's data platform, we are looking for experienced data engineers to join our team who will be responsible for:

Data Engineering and Platform Integration

• Design, develop, and maintain data pipelines and ETL processes using AWS services (Glue, Athena, S3, RDS)
• Work with data virtualisation tools like Denodo and develop VQL queries
• Ingest and process data from various internal and external data sources
• Perform data extraction, cleaning, transformation, and loading operations
• Implement automated data collection processes including API integrations when necessary

Data Architecture

• Design and implement data models (conceptual, logical, and physical using tools like ER Studio
• Develop and maintain data warehouses, data lakes, and operational data stores
• Develop and maintain data blueprints
• Create data marts and analytical views to support business intelligence needs using Denodo, RDS
• Implement master data management practices and data governance standards

Technical Architecture and Integration

• Ensure seamless integration between various data systems and applications
• Implement data security and compliance requirements
• Design scalable solutions for data integration and consolidation

Qualifications and Experience:

• At least 3 years of experience in data engineering or similar role
• Strong proficiency in Python, VQL, SQL
• Experience with AWS services (Glue, Athena, S3, RDS, Sagemaker)
• Knowledge of data virtualisation concepts and tools (preferably Denodo)
• Experience with BI tools (preferably Tableau, Power BI)
• Understanding of data modelling and database design principles
• Familiarity with data governance and master data management concepts
• Experience with version control systems (Gitlab) and CI/CD pipelines
• Experience working in Agile environments with iterative development practices
• Strong problem-solving skills and attention to detail
• Excellent communication skills and ability to work in a team environment
• Knowledge of AI technologies (AWS Bedrock, Azure AI, LLMs) would be advantageous
• Due to sensitivity of system, only Singaporean or Singaporean PR should apply.

Key Responsibilities

• Cluster Lifecycle Engineering: Design and automate the full lifecycle of Red Hat OpenShift clusters across multi-cloud environments (AWS, Azure, GCP), ensuring they are treated as immutable infrastructure.

• Automation Development: Build robust, reusable automation for cluster provisioning, version upgrades, and auto-scaling using Ansible, Terraform, and Python.

• Advanced Component Management: Implement and fine-tune critical OpenShift components, specifically OVN-Kubernetes for networking and OpenShift Data Foundation (ODF)/Ceph for software-defined storage.

• GitOps & Orchestration: Establish and maintain GitOps workflows (e.g., using ArgoCD or Flux) to ensure the "Source of Truth" for all cluster configurations remains in Git.

• Reliability & Performance: Conduct deep-dive performance tuning and engineer high-availability (HA) solutions to ensure the container platform meets strict government Service Level Agreements (SLAs).

• Security & Compliance: Implement "Policy as Code" to ensure all clusters automatically adhere to IM8 security standards and CIS benchmarks.

Requirements

• Education: Bachelor’s Degree in Computer Science, Computer Engineering, or a related technical field.

• Experience: Minimum 3+ years of hands-on experience in Platform Engineering, DevOps, or Site Reliability Engineering (SRE).

• Technical Expertise:

  • Strong mastery of Red Hat OpenShift (OCP 4.x) and Kubernetes internals (API, etcd, Scheduler).

  • Proficiency in Infrastructure as Code (IaC) tools, specifically Terraform and Ansible.

  • Strong scripting skills in Python or Bash for building custom automation tools.

  • Knowledge of container networking (SDN, OVN) and storage orchestration (CSI, Ceph/ODF).

Preferred Qualifications (Bonus)

• Red Hat Certified Specialist in OpenShift Administration/Automation.

• Experience with Cloud Native monitoring stacks (Prometheus, Grafana, ELK).

• Prior experience working within the GCC 2.0 ecosystem or GovTech stacks.