Data Engineer

Requisition Number: 202478

External Description:

Data Engineers define the architecture and design of data ingestion and ETL / ELT processing to meet functional and non-functional requirements and objectives. Data Engineers will generally be expected to be “T-shaped” professionals who have a broad understanding of the data acquisition and integration space and to be able to weigh the pros and cons of different architectures and approaches.

A Data Engineer works on implementing complex big data projects with a focus on ingesting, parsing, integrating, and managing large sets of structured and unstructured data. Data Engineers embrace the challenge of dealing with petabytes of structured and unstructured data and associated metadata daily. Data Engineers are involved in the design of big data solutions, leveraging the experience they have with Teradata and Hadoop based technologies such as Hive, Cassandra, and MapReduce. Strong communication skills are required to work in a team environment and with business sponsors of programs.

Key Areas of Responsibility:

• Clarify the client’s business problem for data analysis
• Translate the business requirements into technical requirements
• Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
• Data modelling, database design and the design of non-relational data structures
• Data ingestion pipelines and ETL processing, including low-latency data acquisition and stream processing
• Oversee the design, evaluation, and selection of major databases and metadata structures
• Develop project deliverable documentation
• Must be adept at sizing and estimating new projects, as well as supporting new business development

Job Qualifications:

• Proven expertise in production software development
• Experience with large data sets consisting of structured and unstructured data and associated metadata and distributed computing with Teradata, Hadoop, Hive, HBase, Pig, etc.
• Proficiency in SQL, NoSQL, relational database design and methods
• Hadoop ecosystem technologies (e.g.: HIVE);
• Message bus and broker technologies, real-time data pipeline and streaming technologies (e.g.: Kafka, Kylo, Listener)
• High-performance data processing platforms (e.g.: SPARK)
• Scripting languages and related libraries (e.g.: Python/Pandas)
• Linux / Unix experience
• Experience with Avro, Thrift
• JMS: ActiveMQ, RabbitMQ, JBoss, etc.
• Experience with structured and unstructured data, and metadata
• Work with the appropriate project management methodology (Agile or Waterfall) based upon customer and project requirements
• Excellent verbal and written communication skills
• Knowledge of Architecture Principles

We offer:

• 25 days of holiday a year
• Private medical care
• Meal vouchers in amount of 110 CZK/ day (Teradata contributes 83 CZK/day)
• Company’s contribution for the Pension fund (up to 3% of monthly gross salary)
• Life insurance
• Company’s assistance in case of sickness (25% of your gross base salary) in addition to local regulations
• Employee referral program (4,000$ USD)
• Sports and activities membership program
• Employee stock purchase program
• Contribution of 300$ USD for a mobile phone of your choice (every 2 years)

 

CountryEEOText_Description: Why We Think You’ll Love Teradata We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.

City: Prague

State: Praha

Community / Marketing Title: Data Engineer

Job Category: Consulting

Company Profile:

Our Company

At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise.

LinkedIn Remote:

Location_formattedLocationLong: Prague, Praha CZ