Principal data engineer/Architect

Requisition Number: 173966

External Description:

Primary Responsibilities:

As a Principal Data Engineer II, you will provide technical and managerial leadership to a world class engineering team that designs and develops path-breaking large scale cluster data processing systems. You will collaborate with Sales and Services Directors to develop new business and manage existing client relationships. You will mentor sophisticated organizations on large scale data and analytics and work with client teams to deliver results. As a senior member of the consulting team, you will help Think Big establish thought leadership in the big data space by contributing white papers, technical commentary and representing our company at industry conferences.

Secondary Responsibilities:

You will mentor junior members on the team in application architecture, design and development best practices. Support and manage internal asset development projects. Complete other duties as assigned.

Job Qualifications:

• Prior consulting experience required
• Prior experience managing client relationships
• 5 years of experience managing software teams
• 7 years of experience programing in Java or C/C
• Proficient in SQL, NoSQL, relational database design and methods for efficiently retrieving data
• Prior experience with Hadoop, HBase, Hive, Pig and Map/Reduce
• Experience building complex and non-interactive systems (batch, distributed, etc.)
• Must be adept at sizing and estimating new projects, as well as have experience supporting new business development
• Must have strong analytical skills and be a creative problem-solver
• Excellent verbal and written communications skills
• Adept at learning and applying new technologies
• Strong team player capable of working in a demanding start-up environment

Preferred Knowledge, Skills and Abilities:

• Experience with JMS: ActiveMQ, RabbitMQ, JBoss, etc.
• Dynamic and/or functional languages (e.g., Python, Ruby, Scala, Clojure)
• Experience designing and tuning high performance systems
• Prior experience with data warehousing and business intelligence systems
• Linux expertise
• Prior work and/or research experience with unstructured data and data modeling
• Familiarity with different development methodologies (e.g., agile, waterfall, XP, scrum, etc.)
• Able to create, write to and read from a Kafka topic. Understanding of key partitioning (just how it works), able to maintain an offset in the topic for consistent reading
• Able to create and deploy a Samza job via YARN or Mesos, read from a streaming source (like Kafka) and produce some filtered or enhanced output
• Able to create storm topology to filter or transform a stream of data. Ability to track state and isolation in Trident or similar
• Able to connect DStream to Kafka or Flume (or similar) queue, filter or transform data and write back to DStream on a different topic/queue
• Implementation of D3, Tableau or R graphing technologies that produce an intuitive view of the underlying data
• Implement a graph (line or pie etc.) baked by a live (changing) data set, something like “request per minute” or similar
• Understand basic modeling techniques and tool sets. Implement simple Python or R analytic routines.

Job Abilities:

Must be able to sit for long periods of time working on computers. Must be able to travel to client sites at least 50% of the time. Must be able to interact and communicate with the client in meetings. Must be able to write programming code in applicable languages. Must be able to write project documentation in English.

Education:

Bachelor's Degree or foreign equivalent in Computer Science or related technical field followed by nine (9) years of progressively responsible professional experience programming in Java, Python or C/C . Experience with production software development life-cycle. Experience with Linux, SQL, relational database design and methods for efficiently retrieving data. Experience building complex and non-interactive systems (batch, distributed, etc.).

OR

Master's Degree or foreign equivalent in Computer Science or related technical field. Seven (7) years of experience programming in Java, Python or C/C . Experience with production software development life-cycle. Experience with Linux, SQL, relational database design and methods for efficiently retrieving data. Experience building complex and non-interactive systems (batch, distributed, etc.).

Employer will accept any suitable combination of education, training, or experience.

CountryEEOText_Description: Why We Think You’ll Love Teradata We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.

City: Tokyo

State: Tokyo

Community / Marketing Title: Principal data engineer/Architect

Job Category: Consulting

Company Profile:

Our Company

At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise.

LinkedIn Remote:

Location_formattedLocationLong: Tokyo, Tokyo JP