Site Reliability Engineer - Data Engineering
At a glance
Mid-level Site Reliability role at IMC. Sydney.
Pay not stated Site Reliability Engineer salary
devopsroles summary, based on the employer's posting.
What you'll do
- Run and monitor distributed storage, processing systems and data pipelines, keeping the platform safe and dependable
- Automate system operations and CI/CD so hardware and software changes can be deployed quickly
- Work with traders, developers, and systems and network engineers to investigate questions and resolve platform issues
- Assess new technologies and recommend solutions, then put suitable options into use
What you bring
- At least two years managing multi-petabyte data infrastructure in a similar role
- You can administer Linux systems and diagnose issues in Linux environments
- You have experience with Kafka, HDFS or Kubernetes, plus working knowledge of Docker and Helm
- You have experience with Dremio or Presto, workflow tools such as Airflow, or another listed area
Who this fits
This mid-level role suits someone focused on dependable data infrastructure and its continued development. You’ll join a four-person team in Sydney and collaborate with counterparts in Chicago, Mumbai and Amsterdam.
From the employer
Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.
You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.
Your Core Responsibilities:
- Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
- Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
- Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
- Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.
Your Skills and Experience:
- 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.
- Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
- Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
- Working knowledge of Docker, Kubernetes, and Helm.
- Experience with data access technologies such as Dremio and Presto.
- Familiarity with workflow orchestration tools like Airflow and Prefect.
- Exposure to cloud platforms such as AWS, GCP, or Azure.
About Us
IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real-time feedback to turn insight into execution and execution into advantage.