Big Data Software Engineer
Location: Madrid, Madrid ES
Requisition Number: 201740
As a Big Data Software Engineer you will participate in projects that shape the strategy and architecture of our clients. You will provide technical knowledge and creative problem-solving capabilities to your team, working in developing path-breaking large-scale Big Data and Analytics solutions. You have some experience and understand the Big Data ecosystem (at least Hadoop, HDFS, Hive, Yarn, Kafka, Flume, Spark, and No-SQL databases). You also have sound knowledge on the needs of Analytics Solutions, and Data Pipelines and Data Governance concerns.
You will be requested to design and develop code, scripts, and data pipelines that leverage structured and unstructured data integration from multiple sources, using Shell scripts, Java, Scala, Python, SQL and related languages. You will participate in architechting and installing complex software environments. You participate in customer workshops, supporting your team on how to address our customer’s concerns.
As a Teradata Think Big Analytics team member, we will appreciate your help in establishing Teradata thought leadership in the big data space by contributing white papers, technical commentary, and participating at industry conferences.
This position offers the opportunity to be at the forefront of the growing Big Data and Analytics market. The successful individual possesses knowledge of past and modern data architecture patterns, a strong sense of the art of the possible and, at the same time, can balance it with the requirements of large organizations to build reliable data environments. The right candidate is excited about working hands-on to some of the biggest and most well-known organizations.
Your main responsibilities are to deliver on our commitments and to advise organizations on how to make Big Data and Analytic technologies work for them. You will be designing and developing large scale data processing solutions for Fortune 500 clients. Be a member of a team that develops and implements advanced algorithms and data pipelines that extract, classify, merge, and deliver new insights and business value out of heterogeneous structured and unstructured data sets. You will have a chance to learn and work with multiple technologies and Thought Leaders in the Big Data space.
Support Sales Activities - You may be requested to support the sales team in demonstrating our clients the benefits of modern data architectures, and to position Teradata Think Big Analytics as the trusted advisor of choice.
Develop customer relationship - As a Think Big Analytics ambassador in our clients you will develop deep relationships with stakeholders at your level in their organizations. You proactively advise on needs and issues and deriving actionable solutions.
Knowledge, Skills and Abilities
Excellent interpersonal skills. Strong verbal and written communication, with good exposure to working in a cross-cultural environment. You may be requested to communicate and present some topics to small audiences. Experienced in writing documents that communicate complex technical topics in an accessible manner.
Experience with data architectures. Knowledge and experience of Big Data and/or Analytics technologies and tools, as the Hadoop ecosystem, Apache Hive, and Spark, among others. Sound knowledge of data governance and security, and data-related methodologies.
At least some experience in other data platforms, such as relational database systems, data warehouses or other OLAP systems, and in delivering enterprise-level ETL pipelines, data workflows, migrations and lifecycles, is also requested.
- Hand-on experience with the Hadoop stack and related Big Data technologies: Hive, Spark, Flink, Kafka, Flume, HBase. Knowledge and experience of structured, semi-structured and unstructured data.
- A strong background on software development, continuous integration, tooling and software architectures and software development patterns is needed, either in in enterprise environments, system integration, or science-related ones. Experience programming in Java, Scala, Python and/or SQL.
- Experience with Unix/Linux (Bash scripting, ssh tunneling, networking (netstat, lsof, ifconfig) and Unix piping.
- Professional or academic background that includes mathematics and statistics.
- Experience with SQL and relational database design and methods for efficiently retrieving data.
- Experience with NoSQL databases (HBase, Cassandra, MongoDB).
- Strong analytical skills and creative problem solver.
- Excellent verbal and written communications skills.
- Strong team player capable of working in a demanding environment.
- Experience with Docker containers and orchestration platforms such as ECS, Kubernetes, Mesos and/or Docker Swarm.
- Experience with cloud services from AWS, GCP and/or Azure (e.g. EMR, S3, AWS Lambda, Google Cloud DataProc, HDInsight).
Education and Experience:
- Two years or more experience in relevant roles.
- Computer Science, Mathematics, Physics, Engineering, or other relevant degree.
- Consulting experience is considered a plus.
We offer you a not average place to work: we are inspiring and passionate people. We may work hard at times, but always in a dynamic, relaxed and collaborative culture. We offer you the chance of joining a rapidly expanding organization with ambitious growth targets, where you can really make the difference and shape the future.
Position is based in Madrid. However, we are often required to spend time on-site with our customers, mainly local but also international ones. You will be required to participate in travel-based work as a Teradata Think Big Analytics team member. English business-level is mandatory.
Community / Marketing Title: Big Data Software Engineer
Job Category: Consulting
Teradata (NYSE: TDC) is the leading multi-cloud data platform company for enterprise analytics, transforming how businesses work and people live through the power of data.
At Teradata, we are leading the data era. As enterprises address today’s digital economy, they are faced with new competition and consumer expectations and are turning to data to power their future. Teradata has worked with the largest companies in the world for 40+ years, bringing our experience and expertise to support global enterprises with their most demanding, mission-critical, complex, and large-scale data needs. Teradata is recognized as a leader in the cloud, data, and analytics spaces by top analyst firms, Gartner and Forrester, and Fortune Magazine as well.
Our connected multi-cloud data platform for enterprise analytics, Teradata Vantage™, is an extremely scalable, secure, and resilient offering that simplifies ecosystems by connecting data and making it easier to uncover insights from across the organization…regardless of where that data resides. With Vantage, we enable companies to modernize their data management, from start to scale. Every day, millions of users benefit from our open data platform. Empowering customers and partners to develop and build how they like, we enable hundreds of business outcomes and solutions, including improving customer experience and profitability, driving operational efficiency, realizing financial transformation, or achieving operational efficiency.
As the world of data grows, we are the leader in enabling the future of connected businesses, powered by data intelligence. We are committed to delivering on this vision by following sustainable business practices and with a strong focus on diversity, equity, and inclusion. We believe that only by embracing diversity of identity, thought, background, expression, and perspective can we solve today’s challenges and reimagine tomorrow’s world.
Location_formattedLocationLong: Madrid, Madrid ES