Data Developers development, implement, and test data ingestion and/or ETL/ELT processes to meet functional and non-functional requirements and objectives. Data Developers focus on moving vast amounts of data from source to target systems and building data pipelines. A Data Developer works with the delivery team, Data Engineers, and Data Scientists as part of an agile process solving complex data projects using innovative solutions. Data Developers have a deep knowledge of Teradata and the data warehousing arena, and open source analytical and data technologies. Data Developers are broadly aligned with the Data Acquisition & Integration sub-practice.

Data Developers are encouraged to develop into “T-shaped” professionals, who may specialize in one or two disciplines (e.g.: streaming ingest or ELT processing) and technologies (e.g.: Informatica, GCFR, Kafka), but also have a working knowledge of a wider range of data processing patterns and technologies. Data Developers develop an adaptable skillset to enable them to perform technical consultancy and post sales project delivery.

Key Areas of Responsibility

• Supporting our clients with data provisioning and acquisition processes.
• Focus on collecting, parsing, quality assessing, and managing data, including sensor, clickstream, emails, documents etc.
• Capture ETL requirements – note this includes all data integration techniques such as ELT, etc.
• Develop, implement, and test processes for extracting data from legacy systems, production databases, Teradata, Hadoop, and Open Source platforms.
• Develop, implement, and test processes for validating and conditioning data prior to loading it into a Teradata Warehouse, Hadoop, or other platforms.
• Develop, implement, and test processes for loading initial and cyclical data into a Teradata Warehouse, Hadoop, or other platforms.
• Develop, implement, and test the processes to meet service level agreements for data timeliness and frequency.
• Determine which data elements are historic and the retention period for historic data.
• Determine data growth trends and peak business periods.
• Contribute to the development of new techniques, models, processes or plans within area of expertise.
• Ensure technical solutions are shared and collated in our asset library.
• Deliver high-quality services to our clients.
• Build relationships with clients.

Technical Skills

• In depth knowledge of the Teradata Database and / or Hadoop platforms.
• In depth knowledge of ETL tools and writing programs with the SQL language.
• Ability to understand and properly use data integration techniques such as ETL and ELT.
• Profiling, validating, conditioning, transforming, and cleansing of data.
• Knowledge in one or more programming or scripting languages like Java, C++, PHP, Ruby, Python and/or R
• Background in Unix systems, especially Linux.
• Knowledge of business intelligence tools, such as Tableau, Qlik, Spotfire, MicroStrategy.
• Implement projects on premises, in the cloud, and hybrid environments.
• Knowledge of Architecture Principles, Advocated Positions, Design Patterns, and Implementation Alternatives.
• Understanding of the Teradata Reference Information Architecture
• Work with the appropriate project management methodology (Agile or Waterfall) based upon customer and project requirements
• Knowledge of the software delivery life cycle (SDLC).
• Ability to work alone or in a team, equally effectively.

Consulting Skills

• Enthusiasm, passion and interest in data analytics.
• Support the analytics process, helping to design, construct and build analytical datasets, which includes exploring and visualizing large sets of data.
• Good communicator
• Excellent time management skills.
• Good analytical skills, attention to detail, and problem-solving skills.
• Ability to take initiative and self-motivate.
• Quickly adapt in a fast pace environment.