Graduate Engineer Trainee
Noida, UP, IN, 201305
Job Title: Data Engineer
Organization Name: NEC Corporation of India Ltd.
Reporting Relationship:
Required Skills
- Data Architecture
- Data Modelling and Design
- Data Storage and Operation
- SQL query development/building
- ETL using native SQL query
KEY RESPONSIBILITIES:
- Responsible for the Architecting systems architecture, design, and development of a large, scaled-out, real-time, high performing Data Lake / Data Warehouse systems (including Big data and Cloud)
- Requirements analyses and finalize in discussion with the customer
- Design, modelling based on the customer ecosystem based on the set the guidelines
- Convert the work package into modules and work closely to deliver the task
- Manage the team for the technical deliveries
- Creation of complex Queries to retrieving data from database using joins, Sub Queries, Correlated Sub-queries, and Hierarchical queries for data retrieval operations and converting into Views and materialized views based on business requirement.
- Creation of database objects like tables, indexes, views, Sequences, Synonyms, and constraints.
- Experience with application programs such as stored Procedures, Functions, Packages, cursors, collections, and triggers and materialized views using SQL and PL/SQL with exception handling.
- Develop Packages (SQL loader, Data pump, and Import/Export utilities) each to import data to Oracle base tables from external files like CSV, Excel, JSON and XML.
- Develop Shell Scripts for invoking SQL scripts and scheduled in using jobs.
- Performing Unit Testing and Performance Tuning for each program developed.
- Preparing below mentioned documents for each project;
- Prepare Requirement specification document
- Prepare Technical Design Document
- Coding and scripts documentations
- Supporting team for integration with apache Spark and other open source framework for data processing
- Well versed in the Data domains (Data Warehousing, Data Governance, MDM, Data Quality, Data Catalogue, Analytics, BI, Operational Data Store, Metadata, Unstructured Data, ETL, ESB)
- Responsible for installation and configuration of Databases, back up, restoring databases, setting up High Availability, Disaster recovery, performance tuning etc.
- Perform Relational Database Modeling and Database Design on different operating systems
- Responsible for PostgreSQL/MS SQL Database administration.
- Design and deploy high availability load balancing and DR in On-Premise as well in Cloud environment
- Design backup policy/template and configure overall database backup and recovery
- Database Performance tuning and optimization which includes Operating System-level parameters also.
- Responsible for Database migration from one platform to another
- Responsible for providing CDC solutions
- Responsible for Database middleware related work and coordinating with application and development team
- Responsible to deploy and manage No-SQL databases like Hadoop HDFS, Hive etc.
- Responsible for working on cloud infrastructures such as Azure and AWS
- Responsible for developing SQL administration or data ingestion script using shell/PowerShell, PL SQL T-SQL, and PL/SQL
- Design and Development of database migration strategy
Prerequisites
Bachelor’s degree in computer science or a related field experience.
- Data Storage and Operation
- SQL query development/building
- ETL using native SQL query
Base Location: Noida
Specialization Description
Software Development Engineering (High Tech) focus on developing multiple types/categories of software including end-user applications and operating systems/utility software, that provides a platform for running end user applications for sale to external customers. The work includes:
- Conducting requirements gathering and analysis to understand the domain of the software problem and/or functionality, the interfaces between hardware and software, and the overall software characteristics
- Using programming, scripting, and/or database languages to write the software code
- Supporting software testing, deployment, maintenance, and evolution activities by correcting programming errors, responding to scope changes, and coding software enhancements
- Applying knowledge of software development best practices, including coding standards, code reviews, source control management, build processes, testing, and operations
Level Description
An experienced support level position that requires a basic knowledge of a given job area and tools, typically seen through work experience as well as vocational or technical training. Works under moderate supervision. Problems are typically of a routine nature, but may at times require interpretation or deviation from standard procedures. Communicates information that requires some explanation or interpretation to achieve business results for a given area of a department or function.