Sr. Lead Hadoop Developer Boston, MA Contract: 12+ Months
Job Description
Must Skills:
Hadoop
Spark scheduler
Python programming and scripting
AWS
Skills:
Delivered the full lifecycle of a solution using Hadoop, AWS S3, AWS EMR
Understand Data and Data Quality from many sources, help design the data with producers and consumers
Expert knowledge of Python
Ingested data using Big Data ETL tools (Apache Spark)
JSON data structures
Implemented data security and privacy in a cloud environment
Delivered solutions using Agile methodology
Extended Skills :
Cloudera tool set
Apache Airflow
Support Data Science and ML tools like AWS Sagemaker, Cloudera CDSW
