. Job Designation / Role: Bigdata Developer / Data Engineer
Location: Ahmedabad, Hyderabad.
Objective :
The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products
Responsibilities :
- Analyze user requirements and design appropriate big data solutions that best fit those requirements
- Work in a cross functional Agile Scrum team to design, develop, test and maintain solutions
- Ensure that solutions are in line with department and domain architecture strategies and contribute to defining and improving those strategies
- Help build, maintain and continually implement tests for an automated testing framework that drives integration tests front to back across components
- Work collaboratively - sharing knowledge and helping teammates in your areas of expertise
- Building and optimizing Apache Spark
- Decompose high level business needs into functional needs by understanding problem and determining data needs
- Experience handling complex, high volume, multi-dimensional data and architecting data products in streaming, serverless and microservices based Architecture and platform.
- Design and create processes for contextualizing, cleaning, aggregating, and transforming data, making it better and more useful to the business
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
-Performance tuning in Spark Yarn cluster and Hadoop resources
Skills :
- SQL- 8/10 : needs to be strong on this
- Spark, Scala - 8/10 : needs to be strong on this
- In-depth knowledge of Apache Spark and different Spark Frameworks/Cloud Services (e.g., Databricks, EMR, Azure HDI)
- Strong in stakeholder management & communication
- Strong Learning attitude
- Cloud desirable
Education: BE/B.Tech, MCA, MSC, M.Tech
Experience 5 Year+
Max Budget - 18-24 Lacs
Education: BE/B.Tech, MCA, MSC, M.Tech
Regards
Aarti B
SI Placements International.
Recruiting For : SI Placements International
Please do not pay any money to anyone who promises to offer you a guaranteed job.This could be in the form of a registration fee or document processing fee or any other pretext.
The money could be asked upfront or it could be asked after trust has been built or after some correspondence has been exchanged.
If you get a job offer or a letter of intent without having been through an interview process it is probably a scam and you should contact @ support@beatsjobs.com.
Beats Jobs does not promise a job or an interview in exchange for money. We value your trust and are committed to making your job search a safe and fraud free experience on beatsjobs.com