4 data engineer jobs found

Data Engineer with Oil & Gas Domain Houston /Spring,TX (Onsite) Experience : 12+ Years Duration : Contract Role Passport No & LinkedIn is Mandatory Mandatory Skills: Oil & Gas refinery, Python, Databricks (SQL/Data Engineering), Apache Spark Description: Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark. Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions. Implement and optimize ETL processes to ensure data quality and integrity. Develop and maintain SQL queries and scripts for data extraction, transformation, and loading. Monitor and troubleshoot data workflows to ensure high availability and performance. Work with large datasets to perform data cleaning, transformation, and analysis. Stay up-to-date with the latest industry trends and technologies to continuously improve our data infrastructure. Requirements: Bachelor's degree in Computer Science,...

Data Engineer (4168-1) Columbus, OH Databricks, ETL pipelines, Docker for containerization, utilizing REST API in Python, Python    Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Summary Strong experience in Databricks Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks. Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware houses Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition,...

Data Engineer (4168-1) Columbus, OH  hold Databricks, ETL pipelines, Docker for containerization, utilizing REST API in Python, Python    Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Summary Strong experience in Databricks Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks. Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware houses Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition,...

Azure Databricks DevOps Administrator New York City, New York  >  > Description:  >  > Job Location: New York City, New York - Hybrid (3 days onsite)  >  > Job Title: Azure Databricks DevOps Administrator  >  > Duration: Long term Contract / CTH  >  > Target Start Date: ASAP  >  > Experience  >  > As an Azure Databricks DevOps Administrator, you will be responsible > for managing and maintaining the Databricks platform, ensuring optimal > performance and security across workspaces, clusters, and jobs. This > role is crucial in overseeing user administration, managing Azure > storage solutions, and implementing CI/CD pipelines using Azure > DevOps. By leveraging a deep understanding of Databricks architecture > and proficiency in scripting languages, the Azure DevOps administrator > will automate tasks and enhance the efficiency of data operations....