Be aware of scams on social media involving phony job postings. Learn more


Senior Data Engineer

Location: Islamabad, Islamabad Capital Territory, Pakistan

Notice

This position is no longer open.

Requisition Number: 215982

External Description:

Position

 

Senior Data Engineer – DataStage Consultant

 

Experience

 

5+ Years

 

Job Description

 

This role is responsible for the development and implementation of data warehouse solutions for company-wide application and managing large sets of structured and unstructured data. The candidate will be expected to analyze complex customer requirements and work with data warehouse architect to gather, define and document data transformation rules and its implementation. Data Engineers will be expected to have a broad understanding of the data acquisition and integration space and be able to weigh the pros and cons of different architectures and approaches.

 

You will have a chance to learn and work with multiple technologies and Thought Leaders in the domain.

 

Responsibility

 

  • Translate the business requirements into technical requirements
  • ETL development using native and 3rd party tools and utilities
  • Write and optimize complex SQL and shell scripts
  • Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
  • Data ingestion pipelines and ETL processing, including low-latency data acquisition and stream processing IBM DataStage.
  • Design and develop processes/procedures for integration of data warehouse solutions in an operative IT environment.
  • Monitoring performance and advising any necessary configurations & infrastructure changes.
  • Create and maintain technical documentation that is required in supporting solutions.
  • Coordinate with customers to understand their requirements
  • Provide direct support to the project lead and the solution delivery team.
  • Readiness to travel to customer sites for short, medium or long-term engagements.

 

Skills and Qualifications

 

  • S. / M.S. in Computer Sciences or related field.
  • Hands-on experience with IBM DataStage and DB2.
  • Good experience in developing DataStage Parallel & Server jobs and the ability to migrate DataStage code between different environments for data integrity.
  • Expertise in developing DataStage job sequencers for complex business requirements.
  • Ability to design and develop effective data integration and data extraction solutions using IBM DataStage.
  • Analyze DataStage logs, perform root cause analysis and identify performance issues to reduce the runtime of long running jobs.
  • Have designed and worked on multi-instance jobs in IBM DataStage.
  • Experience with converting DataStage jobs into ANSII SQL.
  • Good programming experience with Python and PySpark. Working knowledge of Data Frames.
  • Experience with Tivoli, Unix and Azure DevOps is highly desirable.
  • Strong RDBMS concepts, SQL development skills and Teradata Technology.
  • Knowledge of data modeling and data mapping
  • Experience with Data Integration from multiple data sources
  • Good Data warehouse & ETL concepts
  • Understanding of one or more business areas and industries: Telecom, Retail, Financial etc.
  • Good knowledge of Big Data technologies such as Pig, Hive, Spark, Kafka, Nifi
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Experience with any of the Hadoop distributions such as Cloudera/Hortonworks
  • Experience on any of one development or scripting languages e.g. Java or Groovy
  • Good understanding and basic working experience with at least one cloud service provider: AWS, Azure or Google Cloud and with their native tools.
  • Good understanding of Agile delivery methodologies.
  • Solid understanding of DevOps technology stack and standard tools/practices like Linux, Dockers, Jenkins & Git etc.
  • Training/Certification on any Hadoop distribution will be a plus.
  • Good communication and analytical skills
  • Ability to work in a dynamic and collaborative team environment, demonstrating excellent interpersonal skills.

 

 

CountryEEOText_Description: Why We Think You’ll Love Teradata We prioritize a people-first culture because we know our people are at the very heart of our success. We embrace a flexible work model because we trust our people to make decisions about how, when, and where they work. We focus on well-being because we care about our people and their ability to thrive both personally and professionally. We are an anti-racist company because our dedication to Diversity, Equity, and Inclusion is more than a statement. It is a deep commitment to doing the work to foster an equitable environment that celebrates people for all of who they are.

City: Islamabad

State: Islamabad

Community / Marketing Title: Senior Data Engineer

Job Category: Consulting

Company Profile:

Our Company

At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise.

LinkedIn Remote:

Location_formattedLocationLong: Islamabad, Islamabad PK

.