• +1 (844) 824-6686


Spark Devop’s Engineer

150 150 parkaradmin

Educational Qualification: B.S. or higher in Computer Science, Engineering

Experience: Minimum 5 years

Location: Bangalore

Job Description:

Automating and improving infrastructure, using Open Source tools (Chef/Puppet/Ansible) for configuration management and orchestration.

Design and implementation of application build, release, deployment, and configuration activities. (Application Lifecycle Management)

Design and implementation of monitoring & notification systems for the various services

Continuously review and enhance processes and operating procedures needed to maintain the most cost effective enterprise-grade cloud infrastructure.

Identify and promote best practices and patterns for the setup, configuration and management including databases, servers, and network and storage systems.

Maintain a team-oriented working environment that promotes a high level of personal commitment and accountability and a continued focus on quality and efficiency

Strong experience in running Spark and Java-Hadoop based jobs

Minimum 5 years’ experience designing, building, testing, and maintaining software applications.

Deep understanding of BigData products and Hadoop eco-system components(HDFS,Hive,PIG,SQOOP,Oozie)

Knowledge of Spark and its components (Core,SQL,Streaming,MLib,R) and it’s internals.

Proficiency with Scala, Python, Java and SQL with L2/L3 support for Spark.

Strong Linux/Unix administration skills.

Deliver proactive suggestions for improving performance and efficiency for Spark Applications

Application level root-cause analysis, suggesting code optimizations and assist with integrations.

Excellent communication skills.

Ability to work in a fast paced startup environment.

Demonstrated analytical and problem solving skills, particularly those that apply to a “Big Data” environment.

Ability to write scripts to pull specific data from Hadoop/Spark environments based on customer requests

Expertise in at least one scripting language (Python/Perl), experience with continuous integration using Jenkins, experience of working in a Scrum team, and experience of using GIT for version control.

Develop tools and procedures in support of the team.

Knowledge of Java and AWS infrastructure will be an added advantage.

Passion about delivering premiere 24×7 enterprise-grade cloud and hosted services.

Able to resolve crisis situations and guide the team to quick resolution.

Responsible for performing end-to-end incident management. Responsible for time-critical User Service/ Infrastructure restoration, technical troubleshooting in system.

Escalating and communicating in a timely fashion the status of major incidents and problems with IT and business stakeholders including executive management.

Continuously raise the bar on what defines customer service delivery.

Create and maintain complete and accurate documentation for the purpose of operational audits including security and compliance.

A good team player, high level of personal commitment & ‘can do’ attitude

Should be ready to work in rotational shifts and respond to work requirements at various times of the day/night including On-call duties and/or weekend activities.

Mandatory Skills:

Minimum of 5 years’ experience in DevOps role in a product hosted in a cloud infrastructure.

5+ years of experience in Deployment, testing and supporting Client /Server and Web Applications


© 2018 Parkar Consulting Group LLC.