Senior Data Engineer

Job Posted - 25/11/2024
‍
Location: Melbourne-based, Remote and Full-time

VC-backed SaaS business in scale-up

‍About Operata

Operata is building the world’s first CX Observability platform for Cloud Contact Centers. Our platform is designed to measure, optimize and maintain voice performance to deliver the best customer and agent experience for cloud contact centers. 

Operata is an AWS Select Technology Partner, our customers include leading insurers, telcos, banks and managed service providers. We are a remote-first company, headquartered in Melbourne, Australia. 

‍

About the role

We are seeking a highly skilled and motivated Data Engineer to join our team to develop and drive our Data Engineering practice.  You will play a pivotal role in designing, developing, optimizing and maintaining our data processing pipelines and integrated BI tool based on Superset. 

You will work closely with our product team, software engineers and business stakeholders to ensure our data systems are robust, scalable, and deliver the insights aligned to our customer personas and their jobs to be done.

How you will make an impact

• Design, develop, and optimize ELT/ETL processes suitable for an Observability platform, to ensure the efficient and accurate flow of data with scalability.
• Develop and manage data pipelines using technologies such as AWS, OpenTelemetry and Apache Flink for real-time data processing.
• Integrate and manage data storage solutions using AWS S3, RDS, and EKS.
• Collaborate with software engineers to integrate data collection systems and build data models.
• Implement and manage data warehousing solutions to support BI and analytics needs.
• Develop and maintain data governance policies to ensure data quality, cost management, security, and compliance.
• Monitor and troubleshoot data systems to ensure performance is fit-for-purpose.
• Stay current with industry trends and best practices in data engineering and apply them to enhance our data infrastructure.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Expertise in ETL/ELT processes, data lakehouse platforms, data modeling and data pipeline development.
• Proficiency with real-time data processing platforms such as Apache Flink, Spark, Airflow, or DataBricks.
• Extensive experience in SQL and experience with database management systems such as PostgreSQL, OpenSearch, Redshift, Clickhouse or similar.
• Strong programming skills in Python, Java, Scala or similar languages. Golang is a plus.
• Proficient in CICD workflow tools (i.e. GitHub Actions, Buildkite Pipelines or AWS Workflows).
• Hands-on experience with AWS services, including S3, RDS, EKS, and associated data services.
• Experience with Infrastructure as Code and Cloud technologies (ie; K8s, Terraform).
• Experience with building data schemas for consumption of data visualization tools such as Superset, Tableau.

What you’ll bring to the role

• You promote openness, diversity of opinions and inclusive discussions at all times to evaluate a wide variety of ideas and perspectives in solving challenging problems
• You demonstrate clear decision making and good trade-offs in complex situations comprising multiple opinions, needs, teams, technologies, cloud providers, and architectural settings
• You communicate effectively with stakeholders ranging from founders and executives to junior engineers across the breadth and depth of the business. 
• You exemplify high accountability, integrity, and resilience to maintain focus on both big-picture goals and milestones to get there
• You enable the engineering organization to innovate and deliver with greater speed and safety.

Additional Information

At Operata, we embrace inclusion and embrace diversity.  We believe in work / life balance and bringing our true selves to work.  To that end, we offer best-in-class flexibility that support our Operatas along their career journey with us. For us, better connection is something we live - with our people, customers, partners and our team. Read more about our culture and values  at operata.com/story

Operata is an equal opportunity employer and makes employment decisions on the basis of merit.  Operata prohibits discrimination based on race, color, religion, sex, sexual identity, gender identity, marital status, veteran status, nationality, citizenship, age, disability, medical condition, pregnancy, or any other unlawful consideration. 

‍