216 data engineer jobs found

Microsoft Fabric Data Engineer (14362-1) Newark, NJ     Experience level:  Mid-senior   Experience required:  7 Years   Education level:  Bachelor’s degree   Job function:  Information Technology   Industry:  Information Technology and Services   Pay rate :   $64 per hour    Total position:  1   Relocation assistance:  No   Visa sponsorship eligibility:  No   Only local candidates can apply.  Please DO NOT share any profiles without Fabric experience or DP-600 Fabric Certification or DP-203 Azure Data Engineer Certification. Only NJ based profiles. Key words to search in resume: Microsoft Fabric, Azure Data Factory, Azure Data Engineer 8+ Years of Experience: Data Management and Storage: Design and implement data storage systems using Azure services like Azure SQL...

AWS Data Engineer (10737-1) San Francisco, CA  AWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI/CD  If you post this job on a job board, please do not use company name or salary.  Experience level: Mid-senior Experience required: 7 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Description: 7+ years of experience in Amazon Web Services (AWS) Cloud Computing Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services Key Skills & Expertise ETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data Data Storage Solutions: Design and maintain storage solutions using...

Data Engineer (13494-1) Princeton, NJ Microsoft BI/Azure BI solutions like Azure Data Factory, Azure Databricks, Azure Analysis Services, SQL Server Integration Services, SQL Server Reporting Services,   If you post this job on a job board, please do not use company name or salary.  Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Insurance Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Role : Data Engineer Location: Princeton 3 days a week Technical Skills: Business Intelligence:Azure Data Factory (ADF), Azure Databricks, Azure Analysis Services (SSAS), Azure Data Lake Analytics, Azure Data Lake Store (ADLS), Azure Integration Runtime, Azure Event Hubs, Azure Stream Analytics, DBT Database Technologies:Azure SQL, MongoDB, PySpark Experience Required: Data Engineering  Experience...

Sr   Data Engineer :  Kansas City, Missouri_ Remote_ in person interview Duration: Long Term      Experience level :  12+ Years   Job Description:     Reason for Request:  (Migration from Oracle to an Enterprise data platform (Snowflake) This position involves designing, developing, and maintaining scalable data pipelines, databases, and systems to ensure the efficient collection, storage, and accessibility of data. Data Engineers collaborate closely with data scientists, analysts, software engineers, and business stakeholders to ensure data is accurate, reliable, and optimized for analysis.   High Level Technical Skills/Experience Required: ·        Educational Background: bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a related field....

Data Engineer with Oil & Gas Domain Houston /Spring,TX (Onsite) Experience : 12+ Years Duration : Contract Role Passport No & LinkedIn is Mandatory Mandatory Skills: Oil & Gas refinery, Python, Databricks (SQL/Data Engineering), Apache Spark Description: Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark. Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions. Implement and optimize ETL processes to ensure data quality and integrity. Develop and maintain SQL queries and scripts for data extraction, transformation, and loading. Monitor and troubleshoot data workflows to ensure high availability and performance. Work with large datasets to perform data cleaning, transformation, and analysis. Stay up-to-date with the latest industry trends and technologies to continuously improve our data infrastructure. Requirements: Bachelor's degree in Computer Science,...

 Python Data Engineer  Python Data Engineer     Computer Software India In-office Full-time $13K - $57K per annum Share Job Apply Description About the Role: We are seeking a skilled Data Engineer to build and maintain our data infrastructure, enabling business intelligence, reporting, and analytics. You will be responsible for developing scalable data pipelines, integrating data from diverse sources, and ensuring data quality and accessibility. Expertise in Amazon Redshift, Python, Apache Airflow, dbt, API integration, and AWS is essential. You will collaborate with cross-functional teams to optimize our data architecture and deliver clean, high-quality data to the business. Key Responsibilities: Data Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines using Python, Apache Airflow, and dbt to ingest, transform, and load data into Amazon Redshift. Amazon Redshift Management: Design, optimize, and maintain Amazon...

Data Engineer (4168-1) Columbus, OH Databricks, ETL pipelines, Docker for containerization, utilizing REST API in Python, Python    Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Summary Strong experience in Databricks Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks. Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware houses Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition,...

Middle Support Data Engineer Kyiv, Ukraine Description Our company is seeking a highly motivated Middle/Senior Data Support Engineer to join the Technical Support Team our client is seeking a highly motivated Middle Data Support Engineer to join the Technical Support Team. As an Engineer, you will work closely with our experienced Data Engineering team members to provide technical support and assistance to our stakeholders in utilizing our data-driven solutions. You will play a crucial role in ensuring the smooth operation and successful implementation of our data products while gaining valuable hands-on experience in the field of data engineering. Responsibilities: Ensure that all data is getting refreshed automatically daily as per SLA and data quality is being permanently monitored Troubleshoot and resolve complex issues of Foundry users within SLAs Solve small change requests and bug fixes self-sufficiently Provide a standard and ad-hoc reports about pipeline...

 Data Engineer (4122-1) Milford or Milwaukee, WI hold    Data Warehousing applications, ETL, IBM, AWS Infrastructure tools (EBS, S3, EC2, Elastic IP, Route 53, VPC) and with cloud infrastructure Management and automation technologies.   Experience level:  Mid-senior   Experience required:  8 Years   Education level:  Bachelor’s degree   Job function:  Information Technology   Industry:  Information Technology and Services     Total position:  1   Relocation assistance:  No   Visa sponsorship eligibility:  No   Job Summary IT experience in Design, Development, and implementation of large scale and medium scale. Data Warehousing applications using ETL tool IBM Infosphere Information server DataStage, SQL and Unix. 5-7 years with a broad portfolio of AWS Infrastructure tools (EBS, S3, EC2,...

Data Engineer (4168-1) Columbus, OH  hold Databricks, ETL pipelines, Docker for containerization, utilizing REST API in Python, Python    Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Summary Strong experience in Databricks Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks. Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware houses Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition,...

GCP Data Engineer austin, tx algeb GCP Data Engineer with 3+ years of experience for our Austin, Texas office. Candidates need a Bachelor’s degree in Computer Science or related field. You’ll design robust data systems using Google Cloud technologies such as BigQuery, Dataflow, and Pub/Sub. Key Responsibilities: Build and maintain scalable data pipelines using GCP tools. Ensure data security and governance. Monitor, troubleshoot, and optimize data workflows. Collaborate with stakeholders to gather requirements and deliver data solutions. Implement data quality checks and best practices. Develop and maintain ETL processes. Create detailed documentation of data processes. Work closely with data analysts and business teams for data alignment. Ensure high availability and reliability of data services. Stay current with GCP data technology advancements. Qualifications: 3+ years of experience in data engineering with GCP. Proficiency in Python, SQL, and GCP services....

AWS Data Engineer in Austin, Texas  Glue, Redshift, and S3 If you have at least 3 years of experience and a Bachelor’s in Computer Science or similar, we invite you to apply. This position requires expertise in building data workflows and leveraging AWS tools such as Glue, Redshift, and S3. Key Responsibilities: Develop and maintain data pipelines using AWS services. Automate data ingestion and processing workflows. Collaborate with cross-functional teams to ensure robust data solutions. Monitor and optimize data pipeline performance. Ensure data quality and implement security best practices. Integrate data from multiple sources for analytics. Implement data validation and error-handling processes. Write and maintain technical documentation for data workflows. Manage and configure cloud infrastructure related to data pipelines. Provide technical support and troubleshooting for data-related issues. Qualifications: 3+ years of experience in data engineering with AWS....

senior data engineer san jose, ca ref  Data Engineering, BI, Financial Services, DBT, Data Modeling, SQL, Redshit, Snowflake, Trino, BI Tools, Tableau   Experience level:  Mid-senior   Experience required:  3 Years   Education level:  Bachelor’s degree   Job function:  Information Technology   senior data engineer san jose, ca ref   Industry:  Financial Services   Pay rate :    Total position:  1   Relocation assistance:  No   Visa sponsorship eligibility:  No   Job Description:   Make your impact within a rapidly growing Fintech Company  The Data Operations team builds capabilities and owns practices that enable seamless data usage across the company. The team collaborates with stakeholders to understand requirements, develop scalable solutions, solicit feedback,...

Data Engineer Malvern, PA eff All On-site Contract Share on Job Description Responsibilities Data Engineers will be data mining, writing code, and creating tables/environments in S3 Qualifications Engineer required - SQL, Python, Pyspark, S3, AWS, environment creation Preferable for both - retail business knowledge, technical documentation

Data Engineer Malvern, PA eff All On-site Contract Share on Job Description Responsibilities Data Engineers will be data mining, writing code, and creating tables/environments in S3 Qualifications Engineer required - SQL, Python, Pyspark, S3, AWS, environment creation Preferable for both - retail business knowledge, technical documentation

Data Engineer San Jose, CA Data Engineering, BI, Financial Services, DBT, Data Modeling, SQL, Redshit, Snowflake, Trino, BI Tools, Tableau, Version Controlling via GIT Experience level: Mid-senior Experience required: 3 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Financial Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Job Description: Make your impact within a rapidly growing Fintech Company The Data Operations team builds capabilities and owns practices that enable seamless data usage across the company. The team collaborates with stakeholders to understand requirements, develop scalable solutions, solicit feedback, deploy models, and ensure high-quality data products. Engineers on the Data Operations team bring a pragmatic approach to building robust, efficient, and well-documented data models. They balance speed with accuracy, ensuring that our...

Experience level: 10+ years   Ø  Mandatory skills: ADF, Azure Data Bricks, PySpark, Spark SQL, PL/SQL, Python   Job Description:       Core Skills required – ADF, Azure Data Bricks, PySpark, Spark SQL, PL/SQL, Python ·        At least 5 years of consulting or client service delivery experience on Azure ·        At least 10 years of experience in Azure, Big data, database and data warehouse architecture and delivery ·        Minimum of 5 years of professional experience in 2 of the following areas: o   Solution/technical architecture in the Azure cloud o   Big Data/analytics/information analysis/database management in the cloud o   IoT/event-driven/microservices in the cloud ·        Experience with private and public cloud architectures, pros/cons, and migration considerations...

Data Engineers with Snowflake experience (3959-1) Waltham, MA  Azure VM Deployment, Monitoring Set up, Azure Alert management, Terraform (good experience in scripting), CICD pipeline, Application monitoring    Experience level: Mid-senior Experience required: 9 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Information Technology and Services Pay rate : View hourly payrate Total position: 1 Relocation assistance: No Visa sponsorship eligibility: No Need candidates from Life Sciences/Pharma industry Qualifications Please focus on Data Engineers with Snowflake experience Resource should have good hands-on experience in the above-mentioned Tools / Technology - Azure VM Deployment, Monitoring Set up, Azure Alert management. Deployment using Terraform (good experience in scripting). Deployments and configuration management using CICD pipeline. Application support hosted on Azure VM. Incident management related...

Senior Data Analyst and Engineer Senior Data Analyst and Engineer to join our dynamic team. In this role, you will play a key role in analyzing large datasets, building data pipelines, and developing innovative solutions to extract actionable insights. The ideal candidate is highly skilled in both data analysis and engineering, with a passion for turning data into valuable business intelligence. Responsibilities: Analyze complex datasets to identify trends, patterns, and opportunities for optimizationDesign and develop robust data pipelines to extract, transform, and load (ETL) data from various sourcesCollaborate with cross-functional teams to understand business requirements and translate them into technical solutionsBuild predictive models and algorithms to support data-driven decision-makingPerform exploratory data analysis to uncover insights and inform strategic initiativesOptimize and maintain existing data infrastructure to ensure scalability, reliability, and...

Staff Data Warehouse Engineer San Jose, California, United States   Make your impact within a rapidly growing Fintech Company The Data Operations team builds capabilities and practices that support the usage of data across BILL. The team supports stakeholders across the company to understand their needs, collect applicable requirements, develop solutions, solicit feedback, deploy to the data ecosystem, and showcase the result. Engineers on the Data Operations team bring a sense of pragmatic perfectionism, doing their best work every day and delivering quality data products to those whom they support. Architect and maintain a scalable CDP aligned with GTM and sales objectives Design and implement robust ETL/ELT pipelines for efficient data processing, as necessary Integrate the CDP with CRM and marketing automation tools Ensure data quality, security, and governance across the platform Collaborate cross-functionally to translate business requirements into technical...