Staff Devops Engineer

Description:

At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you.

With more than 7,400+ customers, we serve approximately 80% of the Fortune 500, and we're proud to be one of FORTUNE's 100 Best Companies to Work For® and World's Most Admired Companies® 2022.

The Big Data team plays a critical and strategic role in ensuring that ServiceNow can exceed the availability and performance SLAs of the ServiceNow Platform powered Customer instances deployed across the ServiceNow cloud and Azure cloud. Our mission is to:

Deliver state of the art Monitoring, Analytics and Business Insights by employing new tools, Big Data systems, AI and Machine Learning methodologies that improve efficiencies across a variety of functions in the company: Cloud Operations, Customer Support, Product Usage Analytics, Product Upsell Opportunities enabling to have an significant impact both on the topline and bottomline growth The Big Data team is responsible for:

• Collecting, storing and providing real-time access to large amount of data
• Provide real-time analytics tools and reporting capabilities for various functions including:
  • Machine Learning and Anomaly detection
  • Monitoring, alerting and troubleshooting
  • Capacity planning
  • Data analytics and deriving Business Insights

Role Responsibilities

• Responsible for Building, Maintaining and Supporting BigData infrastructure on ServiceNow Private Cloud and Azure.
• Automate deployment, maintenance, and monitoring of BigData components.
• Implement security for our Hadoop clusters.
• Capacity planning for BigData clusters.
• Performance tuning for various Hadoop components.
• Responsible for enforcing data governance policies.
• Help with various Big Data and cloud automation projects.
• Application code deployment, maintenance and troubleshooting Spark, Hbase, Kudu applications, API’s, Python, and shell scripts.
• Perform On-Call production monitoring and support for Big Data infrastructure and Big Data applications in ServiceNow private cloud and Azure cloud.

Technical Skills

• Expert level experience in a Hadoop administration (preferably Cloudera CDP) role.
• Expert level experience working on Azure or AWS.
• Experience with performing Hadoop and Azure/AWS performance tuning.
• Experience with Ansible, Terraform, Puppet and similar technologies.
• CI/CD automation leveraging Docker/Kubernetes orchestration.
• In-depth knowledge of Hadoop components such as Spark Streaming, HDFS, HBase, YARN, Hive, Impala, Atlas, and Kudu.
• Experience securing Hadoop stack with Sentry, Ranger, LDAP, Kerberos KDC.
• In-depth knowledge of Centos 7.x and shell scripts.
• Working knowledge of Java, Python, Shell.
• Ability to learn quickly in a fast-paced, dynamic team environment.
• Highly effective communication and collaboration skill.
• Required Bachelors or master’s degree in computer science or equivalent.