27 Data Engineer jobs in Australia

**Make an impact with NTT DATA**
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.
**Your day at NTT DATA**
The Data Engineer (Consultant) is a seasoned subject matter expert, responsible for the transformation of data into a structured format that can be easily analyzed in a query or report.
This role is responsible for developing structured data sets that can be reused or complimented by other data sets and reports.
This role analyzes the data sources and data structure and designs and develops data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.
**Key responsibilities:**
+ Creates data models in a structured data format to enable analysis thereof.
+ Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources,
+ Participates in the transformation of object and data models into appropriate database schemas within design constraints.
+ Interprets installation standards to meet project needs and produce database components as required.
+ Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations.
+ Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems.
+ Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
+ Accountable for analysis, and development of ETL and migration documentation.
+ Collaborates with various stakeholders to evaluate potential data requirements.
+ Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives.
+ Collaborates with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.
**To thrive in this role, you need to have:**
+ The skills we require are:- ETL Design and Development (Azure / Fabric Data Factory, Databricks, Snowflake)- Cloud and On-Prem Data Engineering / Warehousing (Azure SQL, Snowflake, Databrick, SSMS/SSIS)- Programming languages (SQL, Python)- Version Control (Azure Dev Ops, GIT)- Data Visualisation (Power BI)- Data Analysis and Mapping
+ Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities.
+ Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
+ Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server.
+ Seasoned understanding of data architecture landscape between physical and logical data models
+ Analytical mindset with excellent business acumen skills.
+ Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
+ Ability to build effective relationships at all levels within the organization.
+ Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.).
**Academic qualifications and certifications:**
+ Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
+ Relevant certifications preferred.
+ Certified Data Engineer, Certified Professional certification preferred.
**Required experience:**
+ Minimum 5 years of experience as Data Engineer (Consultant).
+ Seasoned experience as a data engineering, data mining within a fast-paced environment.
+ Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
+ Seasoned experience with architecture and design of secure, highly available and scalable systems.
+ Seasoned proficiency in automation, scripting and proven examples of successful implementation.
+ Seasoned proficiency using scripting language (Perl, bash, Shell Scripting, Python, etc.).
+ Seasoned proficiency in working with SQL, MySQL databases and Microsoft SQL.
**Workplace type** **:**
Hybrid Working
**About NTT DATA**
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.
**Equal Opportunity Employer**
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Senior Data Engineer - Domain - Sydney
Job Description
**Company** **Overview:**
CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.
We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We've continually refined, transformed, and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.
**About** **Domain** **:**
Domain is a leading property marketplace reaching 7 million Australians each month, making it one of the country's most recognised and trusted property platforms. Domain operates the Allhomes and CRE 'commercial real estate' platforms and provides product and solutions to consumers, agents, government and enterprise to digitise every step of the property journey. Learn more about Domain: .
**About the Role:**
Are you passionate about designing and implementing robust, scalable data solutions in a dynamic environment with evolving products and opportunities? We're seeking an innovative Senior Data Engineer to join our data department.
Our team is dedicated to driving value across the Domain Group by creating reusable data assets. These assets empower every department to rapidly extract insights and deliver results.
In this role, you'll develop scalable data ingestion pipelines for property data assets, establishing them as the authoritative source for all property-related decisions and lifecycle journeys across various products and business units within the Domain Group ecosystem.
We continuously challenge the status quo, building reliable and insightful data solutions that fuel product innovation and drive business growth. This includes developing automated workflows with agentic AI solutions.
If you're excited about transforming raw data into valuable insights and creating data infrastructure that powers decision-making across an entire organization, we want to hear from you!
**Why Join Us:**
We're the right size business for you to make a real impact, with a workplace culture where you can be you. Perks of the role include:
+ Our much-loved approach to flexible hybrid working;
+ Mentoring and leadership programs, with access to Learning & Development tools;
+ First rate parental leave and support for working parents;
+ Regular social events including our famous Innovation Days.
**In a typical day you can expect to:**
As a key member of the Domain Group, you'll collaborate across all areas of our organization to lead the design and architecture of innovative data solutions that enhance every aspect of our property ecosystem.
What we're looking for:
+ Demonstrated experience in leading the design, architecture, and end-to-end implementation of complex, high-performance, and scalable data pipelines and data infrastructure solutions.
+ A strong background in designing and implementing effective data models and architecting components of data warehousing and data lake/lakehouse solutions to meet evolving business needs.
+ Proven ability in establishing and implementing comprehensive data quality frameworks and contributing to data governance practices from an engineering perspective.
+ A track record of optimizing the performance, reliability, and cost-effectiveness of data storage, retrieval, and processing systems at scale.
+ A commitment to providing technical leadership, mentorship, and guidance to junior and mid-level Data Engineers on advanced techniques, design patterns, and problem-solving.
+ The ability to identify opportunities and implement solutions to automate data engineering processes and improve tooling for increased efficiency and reliability.
+ Experience collaborating effectively with data architects, platform engineers, and data consumers to define technical requirements and integrate robust data solutions.
**Our Ideal Person:**
ESSENTIALS **:**
+ 4+ years of proven experience as a Senior Data Engineer in commercial/business environments
+ Expert-level proficiency in SQL, with a deep understanding of advanced data modeling, query optimization, and data warehousing concepts.
+ Hands-on experience architecting, building, and optimizing advanced data solutions on a modern cloud data platform (Snowflake or BigQuery is a must).
+ Demonstrated mastery in designing and implementing complex data orchestration frameworks and transformation pipelines using tools like Apache Airflow and DBT.
+ Extensive programming experience in Python for building robust, scalable data applications and automation.
+ Proven experience designing and managing data solutions on a major cloud platform (AWS preferred; GCP/Azure valued).
+ Proficiency with version control systems (Git) and CI/CD practices for data engineering.
+ Excellent communication and technical leadership skills, with a proven ability to mentor other engineers and collaborate with cross-functional teams
NICE TO HAVES **:**
+ Knowledge of the real estate industry and its data challenges
+ Experience with streaming data frameworks and real-time data processing
+ Understanding of Infrastructure as Code (IaC) principles and experience with tools like CDK, CloudFormation, or Terraform is highly desirable
+ Familiarity with various ETL tools and services (e.g., SSIS, Fivetran, Stitch, Talend, Airbyte, Matillion)
+ Hands-on experience with major cloud platforms (AWS preferable or GCP, Azure)
+ Strong problem-solving skills and ability to optimize data infrastructure for performance and scalability
+ Excellent communication skills and ability to collaborate with cross-functional teams
+ AI hand on experience for automation workflow
**What's Next?**
We'll give your application the thoughtful attention it deserves and get back to you as soon as possible. If there's a match, one of our recruitment consultants will reach out-so keep your phone handy! We're genuinely excited about the chance to work together and make a meaningful impact.
Apply now to help us drive progress in diversity, equity, and inclusion. We are devoted to fostering a diverse and supportive work environment and warmly welcome applications from Aboriginal and Torres Strait Islander peoples. If you have any accessibility needs or require accommodations during the application process, please let us know, and we will ensure you receive the support you need.
**Equity, Diversity & Inclusion**
Domain Group is enthusiastically and unapologetically committed to fostering an equitable, inclusive work culture which reflects our customers and communities. We are proactively looking for candidates from all lived experiences, including people with disability, and people of all ages, ethnicities, cultures (including Aboriginal and Torres Strait Islander Peoples), faiths, sexual orientations, and gender identities (including trans and non-binary people).
We are committed to providing an equitable recruitment process for people with disability. If you require adjustments during the process we're here to support. If you wish to receive this job advertisement in an accessible format, or have a confidential chat about workplace adjustments, please contact our Equity, Diversity and Inclusion team at or leave a message on and we will get back to you.
CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing
CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.
We have been living and breathing the world of real estate information and online marketplaces for over 37 years, giving us the perspective to create truly unique and valuable products and services. We've continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry and for our customers. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.
CoStar is committed to creating a diverse environment and is proud to be an equal opportunity workplace and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. CoStar is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access as a result of your disability. You can request reasonable accommodations by calling or by sending an email to .

What's in it for you?

• Permanent role with long-term career growth
• Location: Double Bay | Hybrid working
• Opportunity to design secure, high-performance platforms for a global security firm protecting UHNW individuals, billionaires, and celebrities
• Work on cutting-edge data fabric/mesh architectures, Azure cloud engineering, and AI/LLM integrations

Role



We are seeking a skilled Data Professional with strong communication and technical expertise to design and deliver intelligent data systems.

You'll help build advanced data functionality-including facial recognition, Power Platform, and data mesh architectures-to create secure platforms that monitor, process, and deliver mission-critical information.



Key Responsibilities

• Design & code AI agents as .NET microservices (REST, MCP, WebSockets, gRPC, SignalR)
• Apply Domain-Driven Design within Dataverse to model domains & manage event/message flows
• Integrate LLM capabilities (OpenAI/Azure OpenAI) incl. vector storage & RAG
• Deploy via Docker/Kubernetes, automate with GitHub Actions/Azure DevOps
• Collaborate with data science, product & SRE teams; mentor engineers; uphold engineering excellence

What You'll Need

Essential:

• Power Platform / Power Apps development
• Domain-Driven Design (Dataverse)
• Strong API & integration development
• Data fabric / data mesh architecture expertise
• Azure infrastructure architecture & deployment
• Containers (Docker, K8s/Service Fabric), CI/CD & IaC (Terraform/Bicep/CloudFormation)

Highly Preferred:

• Agentic-communication frameworks (e.g. MCP)
• Observability & performance optimisation
• Security & compliance expertise (OWASP, OAuth2/OIDC, GDPR, SOC2, HIPAA)
• Leadership in design reviews, coaching, and stakeholder communication

Talented, committed, can-do individuals have always been the cornerstone of this dynamic organisation. If you have what it takes to thrive in this role and want to know more, please reach out to Isha Khanna at



Privacy

Due to new privacy laws regarding the collection and handling of personal information, all applications must be submitted online. Once you click on the "apply for this job" button below you will be directed to our Online Centre where you will have the opportunity to read and agree to our Privacy and Consent statements and it will allow your details to be formally lodged and processed correctly.

"Akkodis is an Equal Opportunity employer, committed to all forms of workforce inclusion. We actively invite and encourage applications by candidates from diverse backgrounds"

Akkodis is an Equal Opportunity employer, committed to all forms of workforce inclusion. We actively invite and encourage applications by candidates from diverse backgrounds

**Description**
+ **Life Days** are the Leidos way of recognising that we all need extra time to take care of life. By working slightly more than the minimum weekly hours (2 hours per week for full-timers), you can accrue up to **12 days of leave** per year.
+ **Leidos Life Hub** provides access to discount offers or cashback rewards with over 400 Australian and International retailers.
+ Due to the nature of the role, **you must be an Australian Citizen and hold an active NV-2** AGSVA security clearance.
Our team feel Leidos is a great place to work. Learn more about our culture and benefits by visiting us here Work That Matters**
Leidos Australia delivers IT and airborne solutions that protect and advance the Australian way of life. Our 2000 local experts, backed by our global experience and network of partners, are working to solve the world's toughest challenges in government, intelligence, defence, aviation, border protection and health markets.
**Expression of Interest**
We anticipate an increase in work to support upcoming projects and are proactively building a pipeline of talented professionals to meet this demand.
We are expecting a range of project terms and will review applicants who wish to join us through a contracting employment arrangement.
**Your New Role and** **Responsibilities**
Our Data Centre Engineers work as part of our enterprise data centre team to audit and maintain our existing data centre footprints.
Under the direction of a designated Team leader, perform the following functions as individual assignments or as part of a team:
+ **Cabling & Connectivity:** Install, terminate, test, and label CAT6, fibre, and MDF phone lines within the IBX environment.
+ **Hardware Setup:** Install ICT hardware, including shelves, rails, power strips, and cable management systems.
+ **Infrastructure Maintenance:** Support ongoing infrastructure projects, including installation, updates, rationalisation, and decommissioning.
+ **System & Environment Audits:** Conduct physical audits, update CMDB systems, and perform power and cooling assessments.
+ **Reporting & Quality Standards:** Maintain cleanliness, ensure high-quality work, and report progress via the ticketing system.
**What You'll Bring to Make an Impact**
+ **Data Centre Experience:** Proven background in maintaining data centres, especially for critical ICT services, with familiarity in Defence environments and protocols.
+ **Technical Tools Knowledge:** Working knowledge of PowerIQ and DC Track systems.
+ **Physical Requirements:** Capable of manual handling, climbing ladders, and lifting to 25kg.
+ **Flexible Work Hours:** Willingness to work nights and weekends during transition periods.
+ **Qualifications:** IT or Telecommunications degree or diploma preferred.
Don't worry if you don't tick all the boxes - if you meet most of them, we encourage you to submit your application. We're most interested in your strengths, what you want to learn and how far you want to go.
**Diverse Team Members, Shared Values and a Common Purpose**
_Providing our customers with smarter solutions takes an incredible team with diversity of thought, experience and perspectives driving innovation. Inclusion is at the heart of our culture and is one of our core values. It's about creating a workplace where everyone can do important work, feels welcome, valued, and respected, and has equal access to opportunities to thrive. Paul Chase - Chief Executive, Leidos Australia._
Leidos Australia is an equal opportunities organisation and is committed to creating a truly inclusive workplace. We welcome and encourage applications from Aboriginal and Torres Strait Islanders, culturally and linguistically diverse people, people with disabilities, veterans, neurodiverse people, and people of all genders, sexualities, and age groups.
Our five Advocacy Groups (Women and Allies Network, Young Professionals, Defence & Emergency Services, Action for Accessibility and Abilities and Pride+) provide an opportunity for team members to connect and collaborate on shared interests, and work to support and celebrate our diverse community.
**Next Steps**
+ To apply for this role, follow the links or apply via our Careers page.
+ Recruitment process - 1 virtual interview and/or 1 face-to-face & background checks.
+ Applicants may also need to meet International Traffic in Arms Regulations (ITAR) requirements. In certain circumstances this can place limitations on persons who hold dual nationality, permanent residency or are former nationals of certain countries as per ITAR 126.1.
+ We are committed to making our recruitment process accessible to all candidates. Please contact our Careers team if you'd like to discuss any additional support during your application or throughout the recruitment process.
At Leidos, we don't want someone who "fits the mold"-we want someone who melts it down and builds something better. This is a role for the restless, the over-caffeinated, the ones who ask, "what's next?" before the dust settles on "what's now."
If you're already scheming step 20 while everyone else is still debating step 2. good. You'll fit right in.
**Original Posting:**
For U.S. Positions: While subject to change based on business needs, Leidos reasonably anticipates that this job requisition will remain open for at least 3 days with an anticipated close date of no earlier than 3 days after the original posting date as listed above.
**Pay Range:**
The Leidos pay range for this job level is a general guideline onlyand not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
REQNUMBER: R-
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. Leidos will consider qualified applicants with criminal histories for employment in accordance with relevant Laws. Leidos is an equal opportunity employer/disability/vet.

HUB24 leads the wealth industry as the best provider of integrated platform, technology and data solutions. At HUB24, we know the smartest investments start with our people. We are innovative and ambitious, and we move fast.

At HUB24, we empower our employees to bring their ideas and creativity to work. Rather than getting bogged down in bureaucracy and red tape, we build a culture that supports our team members to have a real impact on our business and the success of our customers.

HUB24 Limited is a company listed on the Australian Securities Exchange (ASX: HUB)

THE HUB24 STORY

We think creatively and we’re not constrained by traditional thinking or barriers to success. We’re led by experts, realists with ideas, grounded in commercial reality who are bold enough to visualise the future a little differently and to advocate for what matters to our clients. We are here to lead change and are committed to empowering better financial futures for more Australians.

Benefits And Life At HUB24

Learn more about our employee benefits HERE.

Job Summary

At HUB24, we’re shaping the future of financial services by building innovative platforms that help financial advisers deliver more accessible, affordable advice to Australians.

We’re looking for a Software Engineer Data who’s passionate about creating reliable, scalable solutions. In this role, you’ll use your skills in SQL, data transformation, and software engineering to support and enhance our HUBconnect Licensee product.

You'll work closely with our Product, Delivery, and Engineering teams to bring new clients on board, understand their data needs, and design seamless data solutions. You'll also have the opportunity to upskill in modern data tools like Databricks, DBT, and explore full stack development.

Responsibilities

• Collaborate with product, delivery, and client teams to onboard customers and understand their data needs.
• Design and maintain ETL processes and data transformations using SQL and C#.
• Support existing data and software applications, including after-hours support on a rotating roster.
• Ensure system integrity, security, and compliance with financial industry standards.
• Contribute to system documentation and knowledge sharing across the team.
• Work within an Agile team to deliver enhancements and solve technical challenges.
• Communicate effectively with both technical and non-technical stakeholders.
  
  

Requirements

• Degree in Computer Science, Software Engineering or equivalent.
• 3+ years’ experience as a Software/Data Engineer.
• Advanced SQL skills and experience with Microsoft SQL Server.
• Solid experience building stored procedures, views, triggers, and ETL functions.
• Exposure to modern data platforms such as Databricks.
• Proficiency in C# and Visual Studio for building services and integrations.
• Familiarity with tools like Git, Azure DevOps, Postman, and Agile methodologies.
• Experience with Google Cloud Platform or Apigee is a plus.
• Clear communicator with a collaborative mindset.
• Curious, self-motivated, and eager to learn new technologies.
• Able to manage time and tasks independently.
• Strong attention to detail with a focus on quality and client outcomes.
• Values teamwork, integrity, and continuous improvement.
  
  

The Recruitment Process

• Acknowledgement email once your application has been submitted.
• Our Talent team will start reviewing your application. If unsuccessful, you will be notified.
• If your application progresses to the next stage, our Talent team will be in touch to discuss your alignment with the role.
• If you’re a person with an impairment or disability, this is an opportunity to share with us any accessibility requirements that you may have for the role.
• Should you require any accommodations to the recruitment process, please email , and one of our team will contact you.
• Interviews can happen virtually or face-to-face with the hiring manager or other members of the broader team. Depending on the role, there may be more than two interviews.
• Communication of outcomes to successful and unsuccessful candidates and feedback provided.
• As part of our process, a police check will be conducted on all successful candidates*. Further details on our HUB24 Group Recruitment Privacy Collection notice can be found here.
  
  

2024 Circle  Back  Initiative Employer – we commit to respond to every applicant.

Endorsed by WORK180, we are proud to be recognised as an employer of choice for women.

We have been nominated and placed on the BOSS Best Places to work list.

Seek Star Awards 2024 - Nominated as a finalist for the Best Employer Brand Initiative

HUB24 is an equal opportunity employer. We are committed to creating an inclusive environment where diverse perspectives are valued and every individual is treated with respect. We welcome applications from people of all backgrounds, including Aboriginal and Torres Strait Islander peoples, people with disabilities, people from culturally and linguistically diverse communities, and people of all gender identities and sexual orientations. If you require adjustments to the recruitment process or have accessibility requirements, please let us know – we’re here to support you

Who We Are

Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.

Optiver’s Sydney office is one of the primary players within Asian markets, trading a range of products. Established in 1996, we're an active participant on the Hong Kong, Korea, Singapore, Taiwan and Japan exchanges, and act as Optiver’s APAC head office.

What You'll Do

Optiver Sydney is seeking an experienced Software Engineer to support and advance the data needs of our local research team. You’ll work closely with researchers in Sydney and our Global Research and Data Platform teams to productionise workflows, optimise large-scale data processing, and manage infrastructure costs efficiently.

This role requires deep expertise in Software Engineering concepts and technologies - particularly in Data Engineering - along with a strong ability to work independently and deliver impactful results in a fast-paced environment. You will play a pivotal role in designing and implementing data solutions that enable efficient access to high-quality data, ensuring smooth operations of our data pipelines. Your work will directly support our research teams in deriving real-time insights and making data-driven decisions.

As a key hire into the data engineering team in our Sydney office, you will partner with cross-functional teams across regions to enhance and align our data strategy, helping drive Optiver’s data and analytics capabilities forward. Dependent on experience and seniority, your responsibilities will include:

• Data Pipeline Design & Development: Architect, build, and manage scalable data pipelines using Spark, Databricks, and proprietary HPC tooling, ensuring high availability, scalability, and performance.
• Platform and Tooling Development: Advance the state of the art of Optiver’s Research and Data platforms and tools.
• Cost Optimisation: Monitor and optimise resource usage in partnership with the Data Platform team, balancing performance and cost-effectiveness.
• Monitoring & Tuning: Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability.
• Cross-Functional Collaboration: Work closely with global Data Platform teams to maintain alignment on data strategy, tools, and best practices.
• Documentation & Standards: Develop and maintain clear documentation of data pipeline architectures, processes, and best practices.
• Mentorship & Guidance: Provide technical mentorship to junior engineers and support the growth of the data engineering function in Sydney.
  
  
  

Who You Are

We are looking for a highly skilled Software Engineer with:

• 3+ years of experience in software engineering, with a data focus.
• Demonstrable proficiency in Python
• Familiarity with distributed data processing and building robust data pipelines.
• Familiarity with the use of or concepts underpinning various Data Engineering technologies and approaches.
• Ability to lead projects autonomously, prioritise tasks, and deliver high-quality results.
• Proven success working with research and platform engineering teams to support data-driven projects.
• Strong problem-solving skills, focusing on efficiency, scalability, and cost-effectiveness.
• Excellent written and verbal communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.
• A Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
• Other preferred qualifications include:
  • Hands-on experience with Spark or Databricks.
  • Experience developing bespoke software components for data pipelines.
  • Familiarity with system languages (e.g. C++, Rust).
  • Familiarity with cloud-based architectures (e.g. AWS).
  • Experience with large-scale relational databases (e.g. PostgreSQL).
  • Knowledge of real-time data streaming technologies (e.g. Kafka).
  • Experience collaborating with researchers to transform experimental workflows into production-ready pipelines.
    
    
    

What You'll Get

You’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Driven by a passion for continuous improvement, you’ll thrive in a supportive, high-performing environment alongside talented colleagues, working collectively to tackle some of the most complex problems in the financial markets.

In return for your expertise, you will be offered a competitive salary package as well as access to a range of Optiver perks, including:

• The chance to work alongside best-in-class professionals
• Competitive remuneration, including an attractive bonus structure and additional leave entitlements
• Training, mentorship and personal development opportunities
• Gym membership plus weekly in-house chair massages
• Daily breakfast, lunch and an in-house barista
• Regular social events including a biennnial company trip
• Guided relocation, a competitive relocation package and visa sponsorship where necessary.
  
  
  

Optiver is committed to diversity and inclusion, and it is hardwired through every stage of our hiring process. We encourage applications from candidates from any and all backgrounds, and we welcome requests for reasonable adjustments during the process to ensure that you can best demonstrate your abilities.

Questions? Get in touch with the recruitment team at

Description
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centres and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion
Amazon Web Services (AWS) is looking for a highly motivated Chief Engineer to join our Data Centre Engineering Operations (DCEO) Team. This committed group works to maintain the critical physical infrastructure that supports AWS. Specifically, this team works to ensure that the data centre's Mechanical/Electrical/Plumbing (MEP) operates at 100% availability, while maintaining first-class customer service to the teams and groups within the data centres. The Data Centre Chief Engineer (CE) is responsible for ensuring that all electrical, mechanical, and fire/life safety equipment within the data centre is operating at peak efficiency. This involves planned preventative maintenance of equipment, daily corrective work, and emergency response. The CE serves as an expert technical resource interacting with onsite Engineering Operations Technicians (EOT) and any third party vendors. They are expected to be a singular focal point for all facility operations within a given data centre and to support AWS.
The CE manages small-to-medium projects from conception to completion. As well as own cluster-wide technical programs that monitor and maintain the effectiveness of DCEO equipment and staff. These projects and programs involve large amounts of independent work as well as collaboration with external support groups including engineering, automation, processing, and finance in both local and global settings. The CE will be tasked with creating and delivering on key milestones, obtaining and tracking quotes for all necessary costs, and documenting project results for future implementation at other facilities. The goals of such projects are for the CE to drive innovation and resiliency while reducing operational costs in the facilities.
The CE directs, trains and supports EOT's in their role of providing hands-on electrical and mechanical equipment troubleshooting and operations. Implementation and execution of site/equipment-specific training exercises is also expected. This equipment includes, but is not limited to, stand-by diesel generators, switchgear, UPS's, PDU's, DAHU's, chillers, chemical treatment systems, pumps, motors, VFD's, and building automation systems.
Key job responsibilities
* Cover gaps in a 24 x 7 rotating shift roster.
* Responsible for the on-site management of contractors, sub-contractors and vendors, ensuring that all work performed, is in accordance with established practices, procedures & local legislation.
* Establish performance benchmarks, conduct analyses & prepare reports on all aspects of the critical facility infrastructure operations & maintenance.
* Generate Change Management requests & Incident Management tickets for events that DCEO are responsible to manage.
* Work with DC managers (IT) and other business leaders to coordinate projects, manage capacity, and optimize plant safety, performance, reliability, sustainability and efficiency.
* Establish documentation relevant to business & facility operations.
* Responsible for the installation of the racks and the provision of power/cooling within it's constraints.
* Review the management of both routine maintenance and emergency services on a variety of critical systems such as: switchgear, generators, UPS systems, power distribution equipment, chillers, cooling towers, computer room air handlers, building monitoring systems, etc.
* Assist in the design, implementation, commissioning and build out of new facilities.
* Drive & implement projects to increase current facility capacity, efficiency, sustainability & reliability.
* Management of the Facility assets and the provision of infrastructure & inventory asset management.
* Attend and participate in regular Construction & Operational Meetings as required.
* Familiar with Work Order compliance to ensure all contractual SLA's are achieved.
* Interface with Infra Ops management for day to day operational requirements.
* Assist in recruiting efforts.
* Assist in the the resolution of any infrastructure engineering or services issue.
* Delivery of exceptional customer service and satisfaction.
* Day to day supervision of a team of Engineering Operation technicians.
Hold or be able to attain an Australian Government Security Vetting Agency clearance (see the team
We are experiencing rapid growth, therefore your onboarding will be dynamic in nature, where you will gain diverse experience working in new and established AWS data centre's. These future Amazonians will rotate through various AWS locations to complete training as part of their onboarding to prepare for deployment in a data centre region. This training will be completed over a duration of 6-12 months. Once training is completed, individuals will be relocated to the permanent location.
About AWS
Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.
Why AWS?
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do.
Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.
Basic Qualifications
* Ability to participate and manage a 24 x 7 rotating shift roster with team leadership experience.
* 4+ years of relevant work experience in maintaining a DC or Critical Space facility, or other critical environment with Technical (Military/Trade School) training
* Strong verbal and written communication skills.
Preferred Qualifications
* Further education in Electrical Engineering, Mechanical Engineering or relevant discipline.
Acknowledgement of country:
In the spirit of reconciliation Amazon acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.
IDE statement:
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Description
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centres and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion
Amazon Web Services (AWS) is looking for a highly motivated Chief Engineer to join our Data Centre Engineering Operations (DCEO) Team. This committed group works to maintain the critical physical infrastructure that supports AWS. Specifically, this team works to ensure that the data centre's Mechanical/Electrical/Plumbing (MEP) operates at 100% availability, while maintaining first-class customer service to the teams and groups within the data centres. The Data Centre Chief Engineer (CE) is responsible for ensuring that all electrical, mechanical, and fire/life safety equipment within the data centre is operating at peak efficiency. This involves planned preventative maintenance of equipment, daily corrective work, and emergency response. The CE serves as an expert technical resource interacting with onsite Engineering Operations Technicians (EOT) and any third party vendors. They are expected to be a singular focal point for all facility operations within a given data centre and to support AWS.
The CE manages small-to-medium projects from conception to completion. As well as own cluster-wide technical programs that monitor and maintain the effectiveness of DCEO equipment and staff. These projects and programs involve large amounts of independent work as well as collaboration with external support groups including engineering, automation, processing, and finance in both local and global settings. The CE will be tasked with creating and delivering on key milestones, obtaining and tracking quotes for all necessary costs, and documenting project results for future implementation at other facilities. The goals of such projects are for the CE to drive innovation and resiliency while reducing operational costs in the facilities.
The CE directs, trains and supports EOT's in their role of providing hands-on electrical and mechanical equipment troubleshooting and operations. Implementation and execution of site/equipment-specific training exercises is also expected. This equipment includes, but is not limited to, stand-by diesel generators, switchgear, UPS's, PDU's, DAHU's, chillers, chemical treatment systems, pumps, motors, VFD's, and building automation systems.
Key job responsibilities
* Cover gaps in a 24 x 7 rotating shift roster.
* Responsible for the on-site management of contractors, sub-contractors and vendors, ensuring that all work performed, is in accordance with established practices, procedures & local legislation.
* Establish performance benchmarks, conduct analyses & prepare reports on all aspects of the critical facility infrastructure operations & maintenance.
* Generate Change Management requests & Incident Management tickets for events that DCEO are responsible to manage.
* Work with DC managers (IT) and other business leaders to coordinate projects, manage capacity, and optimize plant safety, performance, reliability, sustainability and efficiency.
* Establish documentation relevant to business & facility operations.
* Responsible for the installation of the racks and the provision of power/cooling within it's constraints.
* Review the management of both routine maintenance and emergency services on a variety of critical systems such as: switchgear, generators, UPS systems, power distribution equipment, chillers, cooling towers, computer room air handlers, building monitoring systems, etc.
* Assist in the design, implementation, commissioning and build out of new facilities.
* Drive & implement projects to increase current facility capacity, efficiency, sustainability & reliability.
* Management of the Facility assets and the provision of infrastructure & inventory asset management.
* Attend and participate in regular Construction & Operational Meetings as required.
* Familiar with Work Order compliance to ensure all contractual SLA's are achieved.
* Interface with Infra Ops management for day to day operational requirements.
* Assist in recruiting efforts.
* Assist in the the resolution of any infrastructure engineering or services issue.
* Delivery of exceptional customer service and satisfaction.
* Day to day supervision of a team of Engineering Operation technicians.
Hold or be able to attain an Australian Government Security Vetting Agency clearance (see the team
We are experiencing rapid growth, therefore your onboarding will be dynamic in nature, where you will gain diverse experience working in new and established AWS data centre's. These future Amazonians will rotate through various AWS locations to complete training as part of their onboarding to prepare for deployment in a data centre region. This training will be completed over a duration of 6-12 months. Once training is completed, individuals will be relocated to the permanent location.
About AWS
Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.
Why AWS?
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Inclusive Team Culture
AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do.
Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.
Basic Qualifications
* Ability to participate and manage a 24 x 7 rotating shift roster with team leadership experience.
* 4+ years of relevant work experience in maintaining a DC or Critical Space facility, or other critical environment with Technical (Military/Trade School) training
* Strong verbal and written communication skills.
Preferred Qualifications
* Further education in Electrical Engineering, Mechanical Engineering or relevant discipline.
Acknowledgement of country:
In the spirit of reconciliation Amazon acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.
IDE statement:
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Description
Are you excited about Server and Networking Technology and want to work in the Largest Data Centers in the World? We are looking for skilled Data Center Technicians with a passion for technology to help us expand our data centers to the next level. At Amazon, career progression is part of our environment. We want you to progress, so come and work for the world's most Customer-centric Company.
You will work on installing and troubleshooting the infrastructure that supports the AWS cloud. You will also be responsible to work with logistics and other teams to maintain daily operations. There is never a dull moment as each day presents itself with different challenges.
Data Center Operations designs, installs & maintains the world's largest Computing Infrastructure. This role is a unique opportunity to work in some of the most advanced data centers in the world. Amazon data centers are large-scale high-density centers where you will be working on changing the face of cloud technology in the region.
Key job responsibilities
- Escalation point and technical troubleshooter for all Systems and problems.
- Deep diving into Linux server issues.
- Remediation of physical layer outages, both Systems & Network.
- Remediation or recovery of physical power issues on racks and participate in Data Center power & cooling events.
- Shift work (4 days on and 4 days off including night shifts on a rotational basis).
- Install & configure racks of hosts in line with internal SLAs.
- Triage & resolve trouble tickets for all devices in your region.
- Physical replacement of server and network device parts.
- Ensure correct rotation of parts & spares.
- Enforcing Amazons Security Best Practices.
- Interact with third party vendors & contractors.
- Engage with Remote Hands & Eyes in EU Regional Cloudfront POPs.
- This position also has a physical component requiring the ability to lift & rack equipment using our lifting equipment.
- It may require working in cramped spaces or in elevated locations while adhering to health & safety guidelines.
- Candidates must possess a valid driver's license and their own vehicle to travel between sites.
Basic Qualifications
- 1+ years of computer hardware troubleshooting and repair experience
- 1+ years of computer networking experience
- High school or equivalent diploma
Preferred Qualifications
- Experience dealing effectively with customers during problem resolution and operating efficiently under pressure
Acknowledgement of country:
In the spirit of reconciliation Amazon acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.
IDE statement:
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.