Be aware of scams on social media involving phony job postings. Learn more


Data Engineer

Location: Canberra ACT, Australia

Notice

This position is no longer open.

Requisition Number: 216835

External Description:

Role Description

Data Engineers work with Data Scientists as part of an agile process to solve complex data projects using innovative solutions. The role involves configuring and integrating cutting edge data warehouse and big data technologies, developing new data schemas, and figuring out innovative ways of storing and representing data, including highly structured to multi-structured data types.

While supporting projects with the data provisioning and acquisition process, Data Engineers have a focus on collecting, parsing, quality assessing, and managing data, including sensor data, clickstream data, emails, documents etc. Data Engineers support the analytics process, helping to design, construct and build analytical datasets. Working closely with Data Scientists, Data Engineers are responsible for expanding data processing capabilities; establishing efficient ways of implementing advanced analytics; and ensuring that reusable data assets are built for our clients.

Data Engineers embrace the challenge of dealing with petabytes of structured and unstructured data and associated metadata daily. Data Engineers are involved in the design of big data solutions, leveraging the experience they have with Teradata and Hadoop based technologies such as Hive and Cassandra. Strong communication skills are required to work in a team environment and with business sponsors of programs.

Principal Data Engineers may function as Tech Leads.

Key Areas of Responsibility

  • Configuring and integrating new cutting-edge data warehouse and big data technologies
  • Developing new data schemas and figuring out innovative ways of storing and representing data, including highly structured to multi-structured data types
  • Supporting our clients with the data provisioning and acquisition process.
  • Focus on collecting, parsing, quality assessing, and managing data, including sensor data, clickstream data, emails, documents, etc.
  • Supporting the analytics process, helping to design, construct and build analytical datasets, which includes exploring and visualizing large sets of data
  • Working closely with Data Scientists, Data Engineers are responsible for expanding data processing capabilities; establishing efficient ways of implementing advanced analytics; and ensuring that reusable data assets are built for our clients
  • Clarify the client’s business problem for data analysis
  • Participate in requirements and design workshops with our clients
  • Translate the business requirements into technical requirements
  • Design and develop code, scripts, and data pipelines that leverage structured and unstructured data.
  • Sizing and estimating new projects, as well as supporting new business development
  • Develop project deliverable documentation
  • Help establish thought leadership in the big data space by contributing to white-papers, technical commentary, and representing Teradata at industry conferences

All consultants are expected to build value in their practice through the contribution and reuse of consulting assets. After each assigned project, a consultant is expected to evaluate the project deliverables and to contribute those items that may be useful to other consultants that may be assigned similar projects. When a new project is assigned, the consultant will search the asset repository for assets that may improve or accelerate the project delivery.

Technical Skills

  • Strong expertise building relational databases and writing SQL for Teradata, Oracle, or PostgreSQL
  • Hands-on exposure of parallelized data processing systems such as Hadoop, Spark, NoSQL
  • Experience with large data sets consisting of structured and unstructured data and associated metadata
  • Extensive knowledge & understanding of how algorithms work and experience building high-performance algorithms
  • Proven expertise in production software development
  • Experience designing and tuning high-performance systems
  • Knowledge of and experience with different programming or scripting languages like Java, C++, PHP, Ruby, Scala, Clojure, and/or Python
  • Understand basic modeling techniques and tool sets. Implement simple Python or R analytic routines
  • Strong understanding of Unix systems, especially Linux
  • Work with the appropriate project management methodology (e.g., Agile or Waterfall) based upon customer and project requirements
  • Knowledge of Architecture Principles, Advocated Positions, Design Patterns, and Implementation Alternatives
  • Knowledge, interest, and passion for big data analytics

CountryEEOText_Description: Why We Think You’ll Love Teradata We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.

City: Canberra

State: Australian Capital Territory

Community / Marketing Title: Data Engineer

Job Category: Consulting

Company Profile:

Our Company

At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise.

LinkedIn Remote:

Location_formattedLocationLong: Canberra, Australian Capital Territory AU

.