§ Translate complex functional and technical requirements into detailed design.
§ Design for now and future success
§ Hadoop technical development and implementation.
§ Loading from disparate data sets. by leveraging various big data technology e.g. Kafka
§ Pre-processing using Hive, Impala, Spark, and Pig
§ Design and implement data modeling
§ Maintain security and data privacy in an environment secured using Kerberos and LDAP
§ High-speed querying using in-memory technologies such as Spark.
§ Following and contributing best engineering practice for source control, release management, deployment etc
§ Production support, job scheduling/monitoring, ETL data quality, data freshness reporting
Job Type: Contract
Salary: $75.00 to $85.00 /hour
- Big Data: 4 years (Preferred)