Senior Core Data Engineer
SATechnologiesInc4
Posted: September 23, 2015
Interested in this position?
Create a free account to apply with AI-powered matching
Quick Summary
A Senior Core Data Engineer is responsible for designing, implementing, and maintaining large-scale data processing systems using Hadoop MapReduce and HBase/Cassandra, with a focus on scalability, performance, and reliability.
Required Skills
Job Description
SA Technologies Inc. (www.satincorp.com) is a market leader and one of the fastest growing IT consulting firms with operations in US, Canada, Mexico & India. SAT is an Oracle Gold Partner, SAP Services Partner & IBM Certified enterprise.
All SA Technologies requirements are Direct Client Requirements from IT Hiring Managers. We guarantee you the best rate for your skills and performance.
Position: Senior Core Data Engineer
Location: SFO, CA
Duration: 12 Months
Ideal candidate:
Solid Java programmer who has production-level hands-on experience on Hadoop MapReduce and HBase or Cassandra database.
Examples of previous project experience we are looking for
* ingested large amount of raw data (web logs, web pages, data feeds, ... )
* run Hadoop map reduce jobs to parse them and process them. (simple reporting, machine learning, ...)
* loaded the outcome to NoSQL database (HBase / Cassandra) and served them to other applications (live website traffic, other internal tools, ... )
Technologies that are a must
* Programming language -- Java
* Batch processing -- Hadoop MapReduce
* Stream processing -- Apache Storm
* NoSQL -- HBase, Cassandra
* Restful web services -- Spring boot, Jackson
* Code/Build/Deployment -- git, maven, jenkins
Technologies that would get our attention….
*Programming lang: Python, Scala, Shell scripting
*Batch Processing: Cascading/Scalding, Apache Spark
* Stream processing -- AKKA, Samza, Spark streaming
* NoSQL -- MongoDB, Riak, ...
* Restful web services -- DropWizard, Jersey, , GSON
* Code/Build/Deployment -- hg, svn, sbt, bamboo, ...
All your information will be kept confidential according to EEO guidelines.