Hadoop Admin on w2 contract
DeegitInc3
Posted: December 9, 2015
Interested in this position?
Create a free account to apply with AI-powered matching
Quick Summary
Hadoop Admin is responsible for managing and maintaining Hadoop infrastructure, including monitoring and troubleshooting, ensuring high availability and scalability, and implementing new features and upgrades.
Required Skills
Job Description
Client : Leading global IT services firm
Hi,
Please let me know if you are comfortable for the below position
Hadoop Admin
Long term
Chicago, IL
Mandatory Skills:
1. Knowledgeable in SQL server DB
2. Aggressive self-starter, can operate without Infrastructure support
3. IOT experience
Desired Skills:
1. a. Config DB backup and recovery processes b. File system (Blob & HDFS) management and monitoring c. Manage and review Hadoop log files; house keeping d. Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation and Config of Hadoop projects such as Hive, Pig, HBase, Spark, etc. f. Performance optimization (MR job and other) g. Setup performance monitoring & tuning
2. Cloud a. Solid experience managing & administering cloud platform - Azure, AWS, BigTable, etc. b. deploying Big Data solutions in Cloud c. Cluster install & config d. Capacity estimation and configure for elasticity e. Script automation for allocation, deallocation, etc.
3. Establish Big Data Security a. Data at Rest & Transit b. Access from backend and front-end applications c. Row level security & Role based security d. integration - LDAP, AD, Okta
4. Ingestion a. Sqoop, Kakfa, Storm – highly desirable b. ADF, Informatica Cloud, etc. are definite plus c. Setup processes for historical and incremental data ingestion
5. Front-end access – Configure connectivity and interfaces enabling Cognos, Tableau, PowerBI, R, and SAS applications to access Hadoop Big data.
6. Scheduler & Runtime environment – Configure YARN and Oozie for optimal resource utilization and end-to-end workflow process.
7. Deploy and configure Neo4J (Graph DB), Document DB and emerging big data repositories 8. Big data modeling
Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation and Configration of Hadoop projects