Sr. DevOps Engineer - BigData platforms and cloud infrastructure (Remote) Job at Stage 4 Solutions Inc, Remote

QW5tRlg4UEdURXYwajU4Z1hFQWhZMkIrRmc9PQ==
  • Stage 4 Solutions Inc
  • Remote

Job Description

Sr. DevOps Engineer BigData platforms and cloud infrastructure (Remote)

We are seeking a Sr. DevOps Engineer for a large, global B2B high-tech company. In this role, you will be responsible for maintaining and supporting a dedicated data environment within BigData infrastructure. You will be doing capacity planning and data pruning, database administration and performance tuning for various tables and queries.

This is a 5-month contract (Extension and conversion possible). 40-hour-per-week remote role in the US.

This is a W2 employee of Stage 4 Solutions. Health benefits and 401K are offered.

Responsibilities:

Performance tuning for various tables and queries.

Responsible for access control, secrets management, and enforcing compliance with data governance policies.

Support various CFI data management and data ingestion projects.

Continuously monitor and optimize system performance and reliability.

Diagnose and resolve issues in multi-source data ingestion pipelines, ETL processes, and data storage solutions.

Develop CI/CD pipelines to automate code testing, integration, and deployment processes to ensure rapid delivery of new features.

Collaborate with data engineering and development teams to integrate changes seamlessly into the deployment pipeline.

Requirements:

Over 7+ Years of experience in DevOps/SRE function, with at least 3 years emphasizing bigdata platforms, data engineering, and cloud infrastructure services.

Experienced with designing, building, and maintaining scalable and robust cloud infrastructure using Kubernetes and Docker for containerization and orchestration.

Knowledge of MLOps platforms and practices

Hands-on experience with data processing tools like Apache Spark, dbt, Kafka, and Airflow.

Strong knowledge of Hadoop components, including Spark Streaming, HDFS, HBase, YARN, Hive, Impala, Atlas, and Kudu.

Familiarity with Snowflake and Clickhouse. Trino, starburst, and data lakehouse technologies

Experience in securing the Hadoop stack using Sentry, Ranger, LDAP, and Kerberos KDC.

Skilled in leveraging Software Configuration Management (SCM) and build tools like Git, GitLab, Nexus, Maven, Grunt, Jenkins, Docker, and Ansible for ongoing CI/CD operations.

Good knowledge of CentOS 7.x and Linux system administration

Strong experience with scripting languages for automation, such as Python, Bash, Go, Groovy, and YAML, for Big Data cluster deployment and monitoring automation.

Ability to learn quickly in a fast-paced, dynamic team environment.

Strong communication skills and the ability to work collaboratively

Software development background with/ experience in OOP languages such as Java, JavaScript, Node.js, a plus.

B.S. or Master's Degree in Computer Science, related field, or commensurate work experience.

Please submit your resume to our network at (apply to the Sr. DevOps Engineer BigData platforms and cloud infrastructure (Remote) role).

Please feel free to forward this job post to others you think may be interested.

Stage 4 Solutions is an equal-opportunity employer. We celebrate diversity and are committed to providing employees with an inclusive environment that is free of discrimination and harassment. All employment decisions are based on the job requirements and candidates' qualifications, without regard to

race, color, religion/belief, national origin, gender identity, age, disability, marital status, genetic information, or other applicable legally protected characteristics.

Compensation: $60/hr. - $69.28/hr.

#LI-SW1

Job Tags

Contract work, Work experience placement, Remote job,

Similar Jobs

New York State Unified Court System

Clinical Social Worker - Lackawanna City Job at New York State Unified Court System

 ...necessary to ensure service to court clientele; assist in various projects; and represent the...  ...dependency assessment, together with a working knowledge of the treatment community, a...  ...of satisfactory full-time experience in social casework with a recognized public or private... 

avatr(A)

3D Artist - unreal Job at avatr(A)

 ...effectively communicate design concepts, aesthetics, and functionalitiesOptimize models, materials, lighting, and textures for real-time rendering while maintaining high visual fidelityCollaborate with designers, CMF, modelers, and other artists to integrate visual elements... 

Hickory Trail Hospital

PRN- Outpatient Therapist Job at Hickory Trail Hospital

 ...dedicated therapists who take pride in their work and focus on assisting clients in successfully reaching their goals. We...  ...medication needs for mental health concerns, but we also offer animal-assisted therapy, music and art therapy, movement therapy, and other... 

Majestic Care

Regional Nurse Consultant , RN Job at Majestic Care

 ...Regional Nurse Consultant, RN Majestic Care is looking for a Regional Nurse Consultant to join our teams mission and believe in our core values! This position will provide clinical support to Majestic Care facilities in Kentucky and Southern Indiana. Our mission... 

Belcan

Custodian Job at Belcan

Benefits: On the job training, with cross training for other skilled positions and opportunities for advancement. The aerospace business is growing and we are continually training and promoting up from within. *Medical, Dental, Vision, Retirement savings options, tuition...