Total 69 process development engineer job vacancies in Australia

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Spark (PySpark) and related technologies
• Build and manage data architectures, including data lakes, warehouses, and operational data stores (ODS)
• Develop and maintain Data APIs to support data access and integration across systems
• Work with large-scale distributed systems using the Hadoop ecosystem (Hadoop, Hive, HDFS)
• Implement and optimize data models, ensuring efficient storage and retrieval
• Collaborate with cross-functional teams (data scientists, analysts, and business stakeholders) to understand data requirements
• Ensure data quality, integrity, and governance across all data platforms
• Contribute to the design and implementation of Master Data Management (MDM) solutions
• Monitor and optimize performance of data processing jobs and workflows
• Document data processes, architectures, and technical solutions

Requirements

• 2–6 years of experience in software engineering or data engineering
• Strong programming skills in Scala/Java and Python
• Hands-on experience with ETL processes and Apache Spark (PySpark)
• Solid experience working with the Hadoop ecosystem (Hadoop, Hive, HDFS)
• Experience designing and developing Data APIs
• Strong understanding of data modelling, ODS, and MDM concepts
• Proven experience building data frameworks and architectures

Nice-to-Have

• Experience with data warehousing, data lakes, and data optimization techniques
• Basic understanding of Artificial Intelligence (AI) and Data Science concepts
• Experience with BI tools such as Tableau (dashboarding and reporting)

• Handling of tickets for boardroom Manage Engine Plus ITSM system.
• Create and maintain systems documentation. Maintain IT hardware inventory.
• Provide IT technical support on desktop/laptops(software and hardware, be it remotely or physical.
• Basic support on users mobiles with corporate approved Boardroom's applications Interacting/explaining well with end user, with clear communication. Basic administration of Active Directory users.
• Basic administration of Microsoft Office 365 users. Basic knowledge of basic network issue troubleshooting.
• Provide basic technical troubleshooting support to AV systems in meeting rooms.
• Providing onboard/offboard requests.
• Basic knowledge and troubleshooting of external software applications(crowdstrike, intune, bitlocker, one drive)
• Procurement of laptops on DELL portal. Positive mindset and good learning attitude. Other ad-hoc duties as assigned or required

The System Engineer is responsible for managing and supporting enterprise-level infrastructure across Windows and Red Hat Linux environments on both physical and virtual platforms. The role ensures system reliability, availability, security, and compliance with customer requirements, IM8 security policies, and system access controls through proactive monitoring, maintenance, optimisation, and troubleshooting of enterprise infrastructure services.

The System Engineer supports compute, storage, virtualisation, identity services, endpoint management, and infrastructure security platforms while ensuring adherence to operational governance, incident management processes, and service level requirements.

Key Responsibilities

- Manage and maintain enterprise server infrastructure across Windows Server and Red Hat Enterprise Linux (RHEL) environments running on both physical and VMware vSphere virtualised platforms.

- Perform system administration activities including configuration, provisioning, hardening, patching, monitoring, performance tuning, incident resolution, and documentation in accordance with customer operational and security policies.

- Manage enterprise storage and backup platforms, including infrastructure integrated with Pure Storage and Commvault backup solutions, ensuring data protection, recovery readiness, and disaster recovery compliance.

- Administer identity and authentication services including Microsoft Active Directory, Group Policy, LDAP and Kerberos, ensuring secure access control and identity lifecycle management.

- Manage endpoint configuration and patch management using enterprise tools such as Microsoft Endpoint Configuration Manager (MECM), WSUS, and golden image deployment frameworks.

- Implement and maintain infrastructure security controls including BitLocker encryption, privileged access management (CyberArk), endpoint security platforms (Trellix), and vulnerability remediation aligned with Tenable scanning results.

- Support system monitoring and operational visibility through enterprise monitoring and logging platforms such as Splunk, ensuring proactive incident detection and capacity planning.

- Plan, test, and implement operating system updates, software deployments, and infrastructure changes in accordance with approved change management procedures and governance controls.

- Monitor infrastructure performance and capacity using enterprise monitoring tools, analyse trends, and recommend improvements to enhance system performance, availability, and reliability.

- Develop automation scripts and operational tools using scripting technologies (e.g., PowerShell, Bash or Python) to streamline infrastructure management and operational tasks.

- Support infrastructure common services including privileged access systems, endpoint protection platforms, MFA services, DDI infrastructure and certificate management services.

- Participate in incident management, problem management, and service improvement initiatives to ensure infrastructure stability and service continuity.

Competency Requirements

- Minimum 3 years of experience managing enterprise server environments across Windows Server and Red Hat Enterprise Linux platforms.

- Demonstrated experience in at least five infrastructure domains, including:

- Server and virtualisation platforms (VMware vSphere)

- Directory and identity services (Active Directory)

- Patch and endpoint management (MECM, WSUS)

- Storage and backup platforms (Pure Storage, Commvault)

- Infrastructure monitoring and logging (Splunk)

- Automation and scripting

- Endpoint and backend infrastructure support

- Professional certifications such as Microsoft Certified Solutions Associate (MCSA), Red Hat Certified System Administrator (RHCSA) or equivalent are preferred.

- Strong technical troubleshooting, analytical, and problem-solving capabilities across enterprise infrastructure environments.

- Knowledge of enterprise security practices including IM8 compliance, vulnerability remediation, privileged access management, encryption technologies, and endpoint protection frameworks.

- Ability to operate effectively within structured IT service management processes including incident, change, and problem management aligned with ITIL practices.

• Diagnose and resolve client platform issues to restore functionality and minimize downtime
• Support Windows OS, office software, and desktop hardware by applying technical expertise to maintain optimal user experience
• Respond promptly to IT incidents by investigating root causes and delivering temporary or permanent solutions to meet service level agreements
• Coordinate with external support vendors to manage maintenance, support, and issue resolution effectively
• Monitor system performance and document configurations to ensure accurate records and compliance with operational standards
• Participate in client platform implementation and upgrade projects by providing technical support and ensuring smooth transitions
• Execute assigned ad-hoc IT duties to support business operations and technology needs

• Diagnose and resolve client platform issues to restore functionality and minimize downtime
• Support Windows OS, office software, and desktop hardware by applying technical expertise to maintain optimal user experience
• Respond promptly to IT incidents by investigating root causes and delivering temporary or permanent solutions to meet service level agreements
• Coordinate with external support vendors to manage maintenance, support, and issue resolution effectively
• Monitor system performance and document configurations to ensure accurate records and compliance with operational standards
• Participate in client platform implementation and upgrade projects by providing technical support and ensuring smooth transitions
• Execute assigned ad-hoc IT duties to support business operations and technology needs

- Implement and manage Windows-based infrastructure and associated technologies.

- Monitor and maintain the health, performance, and security of Windows servers and systems.

- Administer Active Directory, Group Policy, DNS, DHCP, and related services.

- Administer Microsoft 365 or Office 365 and its related services

- Configure and troubleshoot Azure Cloud services and the workload running

- Configure and troubleshoot Hypervisor Virtualization platforms (e.g., VMware).

- Install, configure, and manage Windows servers and services, including IIS, SQL Server and Exchange Server

- Collaborate with cross-functional teams to implement and support enterprise-wide solutions.

- Perform routine system and application updates, patches, and upgrades.

- Develop and maintain documentation related to system configurations, processes, and procedures.

- Provide level 1 and level 2 support for Windows-related issues.

- Participate in on-call rotation for after-hours support as needed.

Qualifications

Qualifications:

- Experience in administering Windows-based systems and infrastructure.

- Experience in administering Microsoft Endpoint Configuration Manager (MECM)

- Proficiency in Windows Server operating systems (2019 and above).

- Strong understanding of Active Directory, Group Policy, DNS, and DHCP.

- Experience with virtualization platforms such as VMware

- Knowledge of scripting languages (e.g., PowerShell, Python) for automation and scripting tasks.

- Familiarity with monitoring tools and systems management solutions.

- Excellent problem-solving and troubleshooting skills.

- Strong communication and interpersonal abilities.

- Certifications such as MCSA, AZ-104, AZ-900 or equivalent are a plus.

- Implement and manage Windows-based infrastructure and associated technologies.

- Monitor and maintain the health, performance, and security of Windows servers and systems.

- Administer Active Directory, Group Policy, DNS, DHCP, and related services.

- Administer Microsoft 365 or Office 365 and its related services

- Configure and troubleshoot Azure Cloud services and the workload running

- Configure and troubleshoot Hypervisor Virtualization platforms (e.g., VMware).

- Install, configure, and manage Windows servers and services, including IIS, SQL Server and Exchange Server

- Collaborate with cross-functional teams to implement and support enterprise-wide solutions.

- Perform routine system and application updates, patches, and upgrades.

- Develop and maintain documentation related to system configurations, processes, and procedures.

- Provide level 1 support for Windows-related issues.

- Participate in on-call rotation for after-hours support as needed.

Qualifications

- Experience in administering Windows-based systems and infrastructure.

- Experience in administering basic Microsoft 365 or Office 365

- Basic understanding of Active Directory, Group Policy, DNS, and DHCP.

- Basic understanding of virtualization platforms such as VMware

- Knowledge of scripting languages (e.g., PowerShell, Python) for automation and scripting tasks is a plus

- Familiarity with monitoring tools and systems management solutions.

- Basic problem-solving and troubleshooting skills.

- Strong communication and interpersonal abilities.

- Certifications such as AZ-104, AZ-900 or equivalent are a plus.

For asuccessful POC, the candidate should ideally be a Mid-to-Senior level DataEngineer (3–5+ years) with the following "must-haves":

TechnicalCore

• Databricks Mastery: Expert-level knowledge of Delta Lake and the Medallion Architecture (Bronze/Silver/Gold layers).
• Apache Spark (PySpark/SQL): Ability to write optimized Spark code. For coming POC, Python is usually preferred over Scala/R for its flexibility and ecosystem.
• AWS Infrastructure: Deep understanding of S3 (Bucket policies/storage), IAM (Roles/Policies) for secure Databricks access, and VPC/Networking (Good to have)
• Data Ingestion: Experience with Databricks Autoloader or Unity Catalog for managed data governance.

"POC-Specific"Skills

• Prototyping Speed: The ability to set up a working end-to-end pipeline (Source → S3 → Databricks → OOTB BI Tool) in weeks, not months.
• Cost Management: Knowledge of how to configure Databricks Clusters (Autoscaling, Spot Instances) to prevent the POC from blowing your AWS budget.

JobDescriptions

Focus: Hands-on ETL/ELT and connectingvarious data sources and setup the platform with technical leadership.

• Role Summary:
• We are seeking a hands-on Data Engineer to spearhead our Databricks POC on AWS. You will be responsible for the initial environment setup, security configuration, and designing the framework for our future data platform.
• You will connect diverse AWS and external data sources into a unified Databricks environment.
• Key Responsibilities:
• Configure Databricks workspace integration with AWS (S3, IAM, VPC).
• Cleanse and transform raw data from S3, RDS, and APIs into Delta tables.
• Design and implement a scalable Medallion Architecture using Delta Lake.
• Build automated ingestion pipelines using Databricks Autoloader.
• Optimize Spark jobs for performance and reliability.
• Establish data governance standards using Unity Catalog. (Good to have)
• Evaluate POC success metrics (performance, cost, ease of use).

• Requirements: 3-5+ years in Data Engineering with PySpark/SQL; strong experience with AWS Glue or EMR is a plus.; Databricks Certified Data Engineer Professional preferred.

Role description

·      You are operating GlobalData Platform components (VM Servers, Kubernetes, Kafka) and applications(Apache stack, Collibra, Dataiku and similar)

·      Implement automation ofinfrastructure, security components, and Continuous Integration &Continuous Delivery for optimal execution of data pipelines (ELT/ETL).

·      Develop solutions tobuild resiliency in data pipelines with platform health checks, monitoring, andalerting mechanisms, quality, timeliness, recency, and accuracy of datadelivery are improved

·      Apply DevSecOps &Agile approaches to deliver the holistic and integrated solution in iterativeincrements.

·      Liaison and collaboratewith enterprise security, digital engineering, and cloud operations to gainconsensus on architecture solution frameworks.

·      Review system issues,incidents, and alerts to identify root causes and continuously implementfeatures to improve platform performance.

·      Be current on the latestindustry developments and technology trends to effectively lead and design newfeatures/capabilities.

Experience

·      You have 5+ years ofexperience in building or designing large-scale, fault-tolerant, distributedsystems

·      Migration experience ofstorage technologies (e.g. HDFS to S3 Object Storage)

·      Integration of streamingand file-based data ingestion /consumption (Kafka, Control M, AWA)

·      Experience in DevOps,data pipeline development, and automation using Jenkins and Octopus (optional:Ansible, Chef, XL Release, and XL Deploy)

·      Experience predominatelywith on-prem Big Data architecture, cloud migration experience might come handy

·      Hands-on experience inintegrating Data Science Workbench platforms (e.g. Dataiku)

·      Experience of agileproject management and methods (e.g., Scrum, SAFe)

·      Supporting allanalytical value streams from enterprise reporting (e.g. Tableau) to datascience (incl. ML Ops)

Skills

·      Hands-on workingknowledge of large data solutions (for example: data lakes, delta lakes, datameshes, data lakehouses, data platforms, data streaming solutions...)

·      In-depth knowledge andexperience in one or more large scale distributed technologies including butnot limited to: Hadoop ecosystem, Kafka, Kubernetes, Spark

·      Expert in Python andJava or another static language like Scala/R, Linux/Unix scripting, Jinjatemplates, puppet scripts, firewall config rules setup

·      VM setup and scaling(pods), K8S scaling, managing Docker with Harbor, pushing Images through CI/CD

·      Experience using dataformats such as Apache Parquet, ORC or Avro Experience in machine learningalgorithms is a plus.

·      Good knowledge of Germanis beneficial, excellent command of English is essential

·      Knowledge of financialsector and its products

·      Higher education (e.g."Fachhochschule", "Wirtschaftsinformatik")