senior azure data engineer remote

Experience level: 10+ years

Ø  Mandatory skills: ADF, Azure Data Bricks, PySpark, Spark SQL, PL/SQL, Python

Job Description:     

 Core Skills required – ADF, Azure Data Bricks, PySpark, Spark SQL, PL/SQL, Python

·        At least 5 years of consulting or client service delivery experience on Azure

·        At least 10 years of experience in Azure, Big data, database and data warehouse architecture and delivery

·        Minimum of 5 years of professional experience in 2 of the following areas:

o   Solution/technical architecture in the Azure cloud

o   Big Data/analytics/information analysis/database management in the cloud

o   IoT/event-driven/microservices in the cloud

·        Experience with private and public cloud architectures, pros/cons, and migration considerations

·        Design and architect an Azure Data Factory, Azure Databricks, Azure Data Lake

·        Lead the Data Governance Program

·        Extensive hands-on experience implementing data migration and data processing using Azure services:, Serverless Architecture, Azure Storage, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, ML Studio, AI/ML, Azure Functions, ARM Templates, Azure DevOps, CI/CD etc.

·        Cloud migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc.

·        Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation:  Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.

·        Familiarity with Networking, Windows/Linux virtual machines, Container, Storage, ELB, AutoScaling is a plus

·        Experience developing and deploying ETL solutions on Azure

·        Strong in Power BI, Java, C##, Spark, PySpark, Unix shell/Perl scripting

·        Familiarity with the technology stack available in the industry for metadata management:  Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.

·        Multi-cloud experience a plus - Azure, AWS, Google

·        Proven ability to build, manage and foster a team-oriented environment

·        Proven ability to work creatively and analytically in a problem-solving environment

·        Excellent communication (written and oral) and interpersonal skills

·        Excellent leadership and management skills

·        Excellent organizational, multi-tasking, and time-management skills

·        Proven ability to work independently and lead the onsite offshore team towards the project plan

syd