Senior Big Data Engineer

Sydney, New South Wales, Australia Full-time

Quantium Big Data Engineer

Since 2002, our data teams have wrung every bit of information they can from our clients’ data in order to give them the insight they need to make a real difference to their business.

Times and technology have changed, but this remains our goal. Instead of wrangling single, SQL-based databases, runs across 200 nodes with multiple clusters using the latest big data technology.

Our industry-leading partners’ real-world data sets are growing along with their complexity so we need to bring more developers and engineers into our team. We’re hoping that’s you.

Working with Scala, Spark and the rest of the Hadoop ecosystem, you’ll be building applications to work with unique data sets (some of the largest and most complex in Australia) to make a real difference to our clients.

Role summary

As a Senior Engineer you will be responsible for developing readable, maintainable and efficient code to realise user stories that deliver the product road-map. You will be accountable for coordinating Engineers and other stakeholders in breaking down large epics into collections of smaller stories / tasks and in implementing the overall functionality.

Through active participation in Scrum ceremonies, you will contribute to the product road-map and collaborate with other Engineers and Analysts to assist in defining the technical direction for the product. You will also work with support teams to ensure the product's smooth operation.

Experience and education required

  • 5+ years' experience developing at scale applications using Scala
  • Proven experience manipulating large data-sets using Spark
  • Solid foundation in functional programming and data structures
  • Values delivering high-quality, peer-reviewed, well-tested code
  • Awareness of DevOps functions and appetite to contribute to CI / CD pipelines
  • Experience working with source control tools (GIT preferred) with good understanding of branching / merging strategies
  • Bachelor’s degree in Computer Science, Information Technology or a related discipline
  • Comfortable working in a fast moving, agile development environment
  • Excellent problem solving / analytical skills
  • Good written / verbal communication skills
  • Commercially aware, with the ability to work with a diverse range of stakeholders
  • Enthusiasm for coaching and mentoring more junior engineers

Please note, this role is not suitable for Graduates. If you are a graduate and you’d like information about our Graduate Academy please visit https://au.gradconnection.com/employers/quantium/about-us/