! Oops. This position is closed.

Data Engineer

  • Gurugram, Haryana, India
  • Permanent
  • Software Engineering & Technology
  • 2 - 5 years
Job Title:

Data Engineer

Job Description:

Objective:
Helping large data consumption easy across organization through Data Engineering
Key results:
1. Help build cost effective cloud architectures for the seamless functioning of the data science projects.
2. Gauge the impactful possibilities of the futuristic data requirements of the data science team.

7.Roles & Responsibilities
As a Data Engineer, you shall be responsible for designing, building and integrating data from various sources into data lake and build large scale data processing pipelines in the context of data analytics projects.
• Leveraging your deep knowledge to provide technical leadership to take projects from zero to completion.
• Architect, build and maintain scalable data pipelines and access patterns related to permissions and security.
• Research, evaluate and utilize new technologies/tools/frameworks centred around high-volume data processing
• Involve in building and deploying large scale data processing pipelines in a production environment.
• Work with data scientists and other engineers to develop data pipelines for model development and productization.
• Identify gaps and implement solutions for data security, quality and automation of processes.
• Provide inputs on right tool options and model designs for use cases
• Identify gaps and implement solutions for data security, quality and automation of processes.
• Designing scalable implementations of the models developed by our Data Scientists.
• Contribute to a culture of collaborative reviews of designs, code and test plans.

8.Education qualifications, skills & experience Education qualifications
• B.Tech/ M.Tech/MCA in Computer Science

Skills
• Python, SQL, Spark (Pyspark)
• S3, Athena
• AWS/Azure
• Analytical and problem-solving skills
Tools
• Apache Nifi
• Apache Airflow
• Power BI,
• Git
• Jira

Experience:
• A data engineer with 3+ years strong programming experience in Python.
• Extensive experience related to processing frameworks such as Spark, Spark Streaming, Airflow, Hive, Sqoop, Kafka etc.
• Experience with big data processing within cloud environments such AWS S3, Athena.
• Deep understanding of measuring and ensuring data quality at scale and the required tooling to monitor and optimize the performance of
our data pipelines. Experience building data pipelines and data-centric applications using distributed storage platforms and shipping data production pipelines sourcing data from a diverse array of sources.
• Proven track record in extracting value and features from large scale data, an understanding of data usage and dependencies.

Experience Range:

2 - 5 years

Educational Qualifications:

B.Tech/B.E, and M.Tech

Skills Required:

Data Engineering, Data Modeling, MySQL, Python, Kafka, Hadoop, Spark, ETL, Data Warehouse,

Job Code: KL-QYRNLZQR
About Us
Neemtree is a specialised talent solutions firm with focus on tech hiring, for companies looking to hire high quality tech talent.

We enable startups & enterprises build tech teams.
Why Us?
- Our Clients are Top 100 IT product companies
- Our Clients and their Employees are top 10% of talent in India
- Our Clients look for top tech talent
- Our Recruiters are specialised in Tech Hiring
- We strive to deliver superior experiences to Candidates
- We strive to ensure that follow ups don't slip through the cracks