We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000+ people across 54 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version of themselves that they can be. We are on the lookout for a highly talented and self-motivated Devops Data Hadoop to join us on our journey in advancing the technological world through innovation and creativity.Key Responsibilities:Dev Ops and CI/CD: Design, implement, and manage CI/CD pipelines using tools like Jenkins and Git Ops to automate and streamline the software development lifecycle. Containerization and Orchestration: Deploy and manage containerized applications using Kubernetes and Open Shift, ensuring high availability and scalability. Infrastructure Management: Develop and maintain infrastructure as code (IaC) using tools like Terraform or Ansible. Big Data Solutions: Architect and implement big data solutions using technologies such as Hadoop, Spark, and Kafka. Distributed Systems: Design and manage distributed data architectures to ensure efficient data processing and storage. Collaboration: Work closely with development, operations, and data teams to understand requirements and deliver robust solutions. Monitoring and Optimization: Implement monitoring solutions and optimize system performance, reliability, and scalability. Security and Compliance: Ensure infrastructure and data solutions adhere to security best practices and regulatory requirements. Qualifications:Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. Experience: Minimum of 5 years of experience in big data engineering or a related role. Technical Skills:Proficiency in CI/CD tools such as Jenkins and Git Ops. Strong experience with containerization and orchestration tools like Kubernetes and Open Shift. Knowledge of big data technologies such as Hadoop, Spark, ETLs. Proficiency in scripting languages such as Python, Bash, or Groovy. Familiarity with infrastructure as code (IaC) tools like Terraform or Ansible.Soft Skills:Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Ability to work in a fast-paced, dynamic environment. Preferred Qualifications:Certifications in Dev Ops, cloud platforms, or big data technologies. Experience with monitoring and logging tools such as Prometheus, Grafana, or ELK Stack. Knowledge of security best practices in Dev Ops and data engineering. Familiarity with agile methodologies and continuous integration/continuous deployment (CI/CD) practices.Knowledge & Skills: -Up-to-date knowledge of CDP versions, including latest releases through 7.1.7 through 7.1.9In-depth knowledge of Cloudera manager for deploying, configuring and monitoring CDP services Strong understanding of security mechanisms like Kerberos, LDAP/AD integration, and Transport Layer Security (TLS) Collaborate with supporting teams (database, network, security, system teams) and conduct root cause analysis of production issues and provide corrective actions Strong command over Linux CLI, as it’s the foundation for managing CDP environments Skills in automating repetitive tasks using scripting languages like Bash or Python Ability to set up and manage monitoring solutions for CDP clusters to increase observability Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification. Experiences in cloud native principals, designs and deployments. Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments Expertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival Define workload migration strategies using appropriate tools Drive delivery in a matrixed environment working with various internal IT partners Demonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously Must be able to work independently and have skills in planning, strategy, estimation, scheduling,Strong problem solving, influencing, communication, and presentation skills, self-starter Experience with data processing frameworks and platforms (Informatica, Hadoop, Presto, Tez, Hive, Spark etc.) Hands-on experience with related/complementary open source software platforms and languages (e.g. Java, Linux, Python, GIT, Jenkins). Exposure to BI tools and reporting software (e.g. MS Power BI and Tableau).Why Us: -We are one of the fastest-growing large tech companies in the world, with offices in 50+ countries across the globe and 219,000 employees,Our company is extremely diverse with 165 nationalities represented. We offer the opportunity to work with colleagues across the globe. We offer a virtual-first work environment, promoting a good work-life integration and real flexibility. We offer comprehensive benefits for all employees. We are a certified great place to work and a top employer in 17 countries, offering a positive work environment that values employee recognition and respect.Equality & Opportunity for All: -Representing 165 nationalities across the globe, we pride ourselves on being an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law.